Understanding Sources of Variation to Improve the Reproducibility of Radiomics

Prediction of early recurrence of adult-type diffuse gliomas following radiotherapy using multi-modal magnetic resonance images

BACKGROUND

Adult-type diffuse gliomas are among the central nervous system's most aggressive malignant primary neoplasms. Despite advancements in systemic therapies and technological improvements in radiation oncology treatment delivery, the survival outcome for these patients remains poor. Fast and accurate assessment of tumor response to oncologic treatments is crucial, as it can enable the early detection of recurrent or refractory gliomas, thereby allowing timely intervention with life-prolonging salvage therapies.

PURPOSE

Radiomics is a developing field with great potential to improve medical image interpretation. This study aims to apply a radiomics-based predictive model for classifying response to radiotherapy within the first 3 months post-treatment.

METHODS

Ninety-five patients were selected from the Burdenko Glioblastoma Progression Dataset. Tumor regions were delineated in the axial plane on contrast-enhanced T1(CE T1W) and T2 fluid-attenuated inversion recovery (T2_FLAIR) magnetic resonance imaging (MRI). Hand-crafted radiomic (HCR) features, including first- and second-order features, were extracted using PyRadiomics (3.7.6) in Python (3.10). Then, recursive feature elimination with a random forest (RF) classifier was applied for feature dimensionality reduction. RF and support vector machine (SVM) classifiers were built to predict treatment outcomes using the selected features. Leave-one-out cross-validation was employed to tune hyperparameters and evaluate the models.

RESULTS

For each segmented target, 186 HCR features were extracted from the MRI sequence. Using the top-ranked radiomic features from a combination of CE T1W and T2_FLAIR, an optimized classifier achieved the highest averaged area under the curve (AUC) of 0.829 ± 0.075 using the RF classifier. The HCR features of CE T1W produced the worst outcomes among all models (0.603 ± 0.024 and 0.615 ± 0.075 for RF and SVM classifiers, respectively).

CONCLUSIONS

We developed and evaluated a radiomics-based predictive model for early tumor response to radiotherapy, demonstrating excellent performance supported by high AUC values. This model, harnessing radiomic features from multi-modal MRI, showed superior predictive performance compared to single-modal MRI approaches. These results underscore the potential of radiomics in clinical decision support for this disease process.

Non-invasive CT radiomic biomarkers predict microsatellite stability status in colorectal cancer: a multicenter validation study

BACKGROUND

Microsatellite instability (MSI) status is a strong predictor of response to immunotherapy of colorectal cancer. Radiogenomic approaches promise the ability to gain insight into the underlying tumor biology using non-invasive routine clinical images. This study investigates the association between tumor morphology and the status of MSI versus microsatellite stability (MSS), validating a novel radiomic signature on an external multicenter cohort.

METHODS

Preoperative computed tomography scans with matched MSI status were retrospectively collected for 243 colorectal cancer patients from three hospitals: Seoul National University Hospital (SNUH); Netherlands Cancer Institute (NKI); and Fondazione IRCCS Istituto Nazionale dei Tumori, Milan Italy (INT). Radiologists delineated primary tumors in each scan, from which radiomic features were extracted. Machine learning models trained on SNUH data to identify MSI tumors underwent external validation using NKI and INT images. Performances were compared in terms of area under the receiving operating curve (AUROC).

RESULTS

We identified a radiomic signature comprising seven radiomic features that were predictive of tumors with MSS or MSI (AUROC 0.69, 95% confidence interval [CI] 0.54-0.84, p = 0.018). Integrating radiomic and clinical data into an algorithm improved predictive performance to an AUROC of 0.78 (95% CI 0.60-0.91, p = 0.002) and enhanced the reliability of the predictions.

CONCLUSION

Differences in the radiomic morphological phenotype between tumors MSS or MSI could be detected using radiogenomic approaches. Future research involving large-scale multicenter prospective studies that combine various diagnostic data is necessary to refine and validate more robust, potentially tumor-agnostic MSI radiogenomic models.

RELEVANCE STATEMENT

Noninvasive radiomic signatures derived from computed tomography scans can predict MSI in colorectal cancer, potentially augmenting traditional biopsy-based methods and enhancing personalized treatment strategies.

KEY POINTS

Noninvasive CT-based radiomics predicted MSI in colorectal cancer, enhancing stratification. A seven-feature radiomic signature differentiated tumors with MSI from those with MSS in multicenter cohorts. Integrating radiomic and clinical data improved the algorithm's predictive performance.

Enhancing the Clinical Utility of Radiomics: Addressing the Challenges of Repeatability and Reproducibility in CT and MRI

Radiomics, which integrates the comprehensive characterization of imaging phenotypes with machine learning algorithms, is increasingly recognized for its potential in the diagnosis and prognosis of oncological conditions. However, the repeatability and reproducibility of radiomic features are critical challenges that hinder their widespread clinical adoption. This review aims to address the paucity of discussion regarding the factors that influence the reproducibility and repeatability of radiomic features and their subsequent impact on the application of radiomic models. We provide a synthesis of the literature on the repeatability and reproducibility of CT/MR-based radiomic features, examining sources of variation, the number of reproducible features, and the availability of individual feature repeatability indices. We differentiate sources of variation into random effects, which are challenging to control but can be quantified through simulation methods such as perturbation, and biases, which arise from scanner variability and inter-reader differences and can significantly affect the generalizability of radiomic model performance in diverse settings. Four suggestions for repeatability and reproducibility studies are suggested: (1) detailed reporting of variation sources, (2) transparent disclosure of calculation parameters, (3) careful selection of suitable reliability indices, and (4) comprehensive reporting of reliability metrics. This review underscores the importance of random effects in feature selection and harmonizing biases between development and clinical application settings to facilitate the successful translation of radiomic models from research to clinical practice.

Impact of Preprocessing Parameters in Medical Imaging-Based Radiomic Studies: A Systematic Review

BACKGROUND

Lately, radiomic studies featuring the development of a signature to use in prediction models in diagnosis or prognosis outcomes have been increasingly published. While the results are shown to be promising, these studies still have many pitfalls and limitations. One of the main issues of these studies is that radiomic features depend on how the images are preprocessed before their computation. Since, in widely known and used software for radiomic features calculation, it is possible to set these preprocessing parameters before the calculation of the radiomic feature, there are ongoing studies assessing the stability and repeatability of radiomic features to find the most suitable preprocessing parameters for every used imaging modality.

MATERIALS AND METHODS

We performed a comprehensive literature search using four electronic databases: PubMed, Cochrane Library, Embase, and Scopus. Mesh terms and free text were modeled in search strategies for databases. The inclusion criteria were studies where preprocessing parameters' influence on feature values and model predictions was addressed. Records lacking information on image acquisition parameters were excluded, and any eligible studies with full-text versions were included in the review process, while conference proceedings and monographs were disregarded. We used the QUADAS-2 (Quality Assessment of Diagnostic Accuracy Studies 2) tool to investigate the risk of bias. We synthesized our data in a table divided by the imaging modalities subgroups.

RESULTS

After applying the inclusion and exclusion criteria, we selected 43 works. This review examines the impact of preprocessing parameters on the reproducibility and reliability of radiomic features extracted from multimodality imaging (CT, MRI, CBCT, and PET/CT). Standardized preprocessing is crucial for consistent radiomic feature extraction. Key preprocessing steps include voxel resampling, normalization, and discretization, which influence feature robustness and reproducibility. In total, 44% of the included works studied the effects of an isotropic voxel resampling, and most studies opted to employ a discretization strategy. From 2021, several studies started selecting the best set of preprocessing parameters based on models' best performance. As for comparison metrics, ICC was the most used in MRI studies in 58% of the screened works.

CONCLUSIONS

From our work, we highlighted the need to harmonize the use of preprocessing parameters and their values, especially in light of future studies of prospective studies, which are still lacking in the current literature.

Mitigating the impact of image processing variations on tumour [18F]-FDG-PET radiomic feature robustness

Radiomics analysis of [18F]-fluorodeoxyglucose ([18F]-FDG) PET images could be leveraged for personalised cancer medicine. However, the inherent sensitivity of radiomic features to intensity discretisation and voxel interpolation complicates its clinical translation. In this work, we evaluated the robustness of tumour [18F]-FDG-PET radiomic features to 174 different variations in intensity resolution or voxel size, and determined whether implementing parameter range conditions or dependency corrections could improve their robustness. Using 485 patient images spanning three cancer types: non-small cell lung cancer (NSCLC), melanoma, and lymphoma, we observed features were more sensitive to intensity discretisation than voxel interpolation, especially texture features. In most of our investigations, the majority of non-robust features could be made robust by applying parameter range conditions. Correctable features, which were generally fewer than conditionally robust, showed systematic dependence on bin configuration or voxel size that could be minimised by applying corrections based on simple mathematical equations. Melanoma images exhibited limited robustness and correctability relative to NSCLC and lymphoma. Our study provides an in-depth characterisation of the sensitivity of [18F]-FDG-PET features to image processing variations and reinforces the need for careful selection of imaging biomarkers prior to any clinical application.

Radiomics and artificial intelligence applications in pediatric brain tumors

BACKGROUND

The study of central nervous system (CNS) tumors is particularly relevant in the pediatric population because of their relatively high frequency in this demographic and the significant impact on disease- and treatment-related morbidity and mortality. While both morphological and non-morphological magnetic resonance imaging techniques can give important information concerning tumor characterization, grading, and patient prognosis, increasing evidence in recent years has highlighted the need for personalized treatment and the development of quantitative imaging parameters that can predict the nature of the lesion and its possible evolution. For this purpose, radiomics and the use of artificial intelligence software, aimed at obtaining valuable data from images beyond mere visual observation, are gaining increasing importance. This brief review illustrates the current state of the art of this new imaging approach and its contributions to understanding CNS tumors in children.

DATA SOURCES

We searched the PubMed, Scopus, and Web of Science databases using the following key search terms: ("radiomics" AND/OR "artificial intelligence") AND ("pediatric AND brain tumors"). Basic and clinical research literature related to the above key research terms, i.e., studies assessing the key factors, challenges, or problems of using radiomics and artificial intelligence in pediatric brain tumors management, was collected.

RESULTS

A total of 63 articles were included. The included ones were published between 2008 and 2024. Central nervous tumors are crucial in pediatrics due to their high frequency and impact on disease and treatment. MRI serves as the cornerstone of neuroimaging, providing cellular, vascular, and functional information in addition to morphological features for brain malignancies. Radiomics can provide a quantitative approach to medical imaging analysis, aimed at increasing the information obtainable from the pixels/voxel grey-level values and their interrelationships. The "radiomic workflow" involves a series of iterative steps for reproducible and consistent extraction of imaging data. These steps include image acquisition for tumor segmentation, feature extraction, and feature selection. Finally, the selected features, via training predictive model (CNN), are used to test the final model.

CONCLUSIONS

In the field of personalized medicine, the application of radiomics and artificial intelligence (AI) algorithms brings up new and significant possibilities. Neuroimaging yields enormous amounts of data that are significantly more than what can be gained from visual studies that radiologists can undertake on their own. Thus, new partnerships with other specialized experts, such as big data analysts and AI specialists, are desperately needed. We believe that radiomics and AI algorithms have the potential to move beyond their restricted use in research to clinical applications in the diagnosis, treatment, and follow-up of pediatric patients with brain tumors, despite the limitations set out.

Radiomics and Deep Features: Robust Classification of Brain Hemorrhages and Reproducibility Analysis Using a 3D Autoencoder Neural Network

This study evaluates the reproducibility of machine learning models that integrate radiomics and deep features (features extracted from a 3D autoencoder neural network) to classify various brain hemorrhages effectively. Using a dataset of 720 patients, we extracted 215 radiomics features (RFs) and 15,680 deep features (DFs) from CT brain images. With rigorous screening based on Intraclass Correlation Coefficient thresholds (>0.75), we identified 135 RFs and 1054 DFs for analysis. Feature selection techniques such as Boruta, Recursive Feature Elimination (RFE), XGBoost, and ExtraTreesClassifier were utilized alongside 11 classifiers, including AdaBoost, CatBoost, Decision Trees, LightGBM, Logistic Regression, Naive Bayes, Neural Networks, Random Forest, Support Vector Machines (SVM), and k-Nearest Neighbors (k-NN). Evaluation metrics included Area Under the Curve (AUC), Accuracy (ACC), Sensitivity (SEN), and F1-score. The model evaluation involved hyperparameter optimization, a 70:30 train-test split, and bootstrapping, further validated with the Wilcoxon signed-rank test and q-values. Notably, DFs showed higher accuracy. In the case of RFs, the Boruta + SVM combination emerged as the optimal model for AUC, ACC, and SEN, while XGBoost + Random Forest excelled in F1-score. Specifically, RFs achieved AUC, ACC, SEN, and F1-scores of 0.89, 0.85, 0.82, and 0.80, respectively. Among DFs, the ExtraTreesClassifier + Naive Bayes combination demonstrated remarkable performance, attaining an AUC of 0.96, ACC of 0.93, SEN of 0.92, and an F1-score of 0.92. Distinguished models in the RF category included SVM with Boruta, Logistic Regression with XGBoost, SVM with ExtraTreesClassifier, CatBoost with XGBoost, and Random Forest with XGBoost, each yielding significant q-values of 42. In the DFs realm, ExtraTreesClassifier + Naive Bayes, ExtraTreesClassifier + Random Forest, and Boruta + k-NN exhibited robustness, with 43, 43, and 41 significant q-values, respectively. This investigation underscores the potential of synergizing DFs with machine learning models to serve as valuable screening tools, thereby enhancing the interpretation of head CT scans for patients with brain hemorrhages.

The impact of the combat method on radiomics feature compensation and analysis of scanners from different manufacturers

BACKGROUND

This study investigated whether the Combat compensation method can remove the variability of radiomic features extracted from different scanners, while also examining its impact on the subsequent predictive performance of machine learning models.

MATERIALS AND METHODS

135 CT images of Credence Cartridge Radiomic phantoms were collected and screened from three scanners manufactured by Siemens, Philips, and GE. 100 radiomic features were extracted and 20 radiomic features were screened according to the Lasso regression method. The radiomic features extracted from the rubber and resin-filled regions in the cartridges were labeled into different categories for evaluating the performance of the machine learning model. Radiomics features were divided into three groups based on the different scanner manufacturers. The radiomic features were randomly divided into training and test sets with a ratio of 8:2. Five machine learning models (lasso, logistic regression, random forest, support vector machine, neural network) were employed to evaluate the impact of Combat on radiomic features. The variability among radiomic features were assessed using analysis of variance (ANOVA) and principal component analysis (PCA). Accuracy, precision, recall, and area under the receiver curve (AUC) were used as evaluation metrics for model classification.

RESULTS

The principal component and ANOVA analysis results show that the variability of different scanner manufacturers in radiomic features was removed (P˃0.05). After harmonization with the Combat algorithm, the distributions of radiomic features were aligned in terms of location and scale. The performance of machine learning models for classification improved, with the Random Forest model showing the most significant enhancement. The AUC value increased from 0.88 to 0.92.

CONCLUSIONS

The Combat algorithm has reduced variability in radiomic features from different scanners. In the phantom CT dataset, it appears that the machine learning model's classification performance may have improved after Combat harmonization. However, further investigation and validation are required to fully comprehend Combat's impact on radiomic features in medical imaging.

Influence of image preprocessing on the segmentation-based reproducibility of radiomic features: in vivo experiments on discretization and resampling parameters

PURPOSE

To systematically investigate the impact of image preprocessing parameters on the segmentation-based reproducibility of magnetic resonance imaging (MRI) radiomic features.

METHODS

The MRI scans of 50 patients were included from the multi-institutional Brain Tumor Segmentation 2021 public glioma dataset. Whole tumor volumes were manually segmented by two independent readers, with the participation of eight readers. Radiomic features were extracted from two sequences: T2-weighted (T2) and contrast-enhanced T1-weighted (T1ce). Two methods were considered for discretization: bin count (i.e., relative discretization) and bin width (i.e., absolute discretization). Ten discretization (five for each method) and five resampling parameters were varied while other parameters were fixed. The intraclass correlation coefficient (ICC) was used for reliability analysis based on two commonly used cut-off values (0.75 and 0.90).

RESULTS

Image preprocessing parameters had a significant impact on the segmentation-based reproducibility of radiomic features. The bin width method yielded more reproducible features than the bin count method. In discretization experiments using the bin width on both sequences, according to the ICC cut-off values of 0.75 and 0.90, the rate of reproducible features ranged from 70% to 84% and from 35% to 57%, respectively, with an increasing percentage trend as parameter values decreased (from 84 to 5 for T2; 100 to 6 for T1ce). In the resampling experiments, these ranged from 53% to 74% and from 10% to 20%, respectively, with an increasing percentage trend from lower to higher parameter values (physical voxel size; from 1 x 1 x 1 to 2 x 2 x 2 mm3).

CONCLUSION

The segmentation-based reproducibility of radiomic features appears to be substantially influenced by discretization and resampling parameters. Our findings indicate that the bin width method should be used for discretization and lower bin width and higher resampling values should be used to allow more reproducible features.

Clinical prediction of microvascular invasion in hepatocellular carcinoma using an MRI-based graph convolutional network model integrated with nomogram

OBJECTIVES

Based on enhanced MRI, a prediction model of microvascular invasion (MVI) for hepatocellular carcinoma (HCC) was developed using graph convolutional network (GCN) combined nomogram.

METHODS

We retrospectively collected 182 HCC patients confirmed histopathologically, all of them performed enhanced MRI before surgery. The patients were randomly divided into training and validation groups. Radiomics features were extracted from the arterial phase (AP), portal venous phase (PVP), and delayed phase (DP), respectively. After removing redundant features, the graph structure by constructing the distance matrix with the feature matrix was built. Screening the superior phases and acquired GCN Score (GS). Finally, combining clinical, radiological and GS established the predicting nomogram.

RESULTS

27.5% (50/182) patients were with MVI positive. In radiological analysis, intratumoural artery (P = 0.007) was an independent predictor of MVI. GCN model with grey-level cooccurrence matrix-grey-level run length matrix features exhibited area under the curves of the training group was 0.532, 0.690, and 0.885 and the validation group was 0.583, 0.580, and 0.854 for AP, PVP, and DP, respectively. DP was selected to develop final model and got GS. Combining GS with diameter, corona enhancement, mosaic architecture, and intratumoural artery constructed a nomogram which showed a C-index of 0.884 (95% CI: 0.829-0.927).

CONCLUSIONS

The GCN model based on DP has a high predictive ability. A nomogram combining GS, clinical and radiological characteristics can be a simple and effective guiding tool for selecting HCC treatment options.

ADVANCES IN KNOWLEDGE

GCN based on MRI could predict MVI on HCC.

Investigation of a potential upstream harmonization based on image appearance matching to improve radiomics features robustness: a phantom study

Objective. Radiomics is a promising valuable analysis tool consisting in extracting quantitative information from medical images. However, the extracted radiomics features are too sensitive to variations in used image acquisition and reconstruction parameters. This limited robustness hinders the generalizable validity of radiomics-assisted models. Our aim is to investigate a possible harmonization strategy based on matching image quality to improve feature robustness.Approach.We acquired CT scans of a phantom with two scanners across different dose levels and percentages of Iterative Reconstruction algorithms. The detectability index was used as a comprehensive task-based image quality metric. A statistical analysis based on the Intraclass Correlation Coefficient was performed to determine if matching image quality/appearance could enhance the robustness of radiomics features extracted from the phantom images. Additionally, an Artificial Neural Network was trained on these features to automatically classify the scanner used for image acquisition.Main results.We found that the ICC of the features across protocols providing a similar detectability index improves with respect to the ICC of the features across protocols providing a different detectability index. This improvement was particularly noticeable in features relevant for distinguishing between scanners.Significance.This preliminary study demonstrates that a harmonization based on image quality/appearance matching could improve radiomics features robustness and heterogeneous protocols can be used to obtain a similar image appearance in terms of the detectability index. Thus protocols with a lower dose level could be selected to reduce the amount of radiation dose delivered to the patient and simultaneously obtain a more robust quantitative analysis.

Contrast Agent Dynamics Determine Radiomics Profiles in Oncologic Imaging

BACKGROUND

The reproducibility of radiomics features extracted from CT and MRI examinations depends on several physiological and technical factors. The aim was to evaluate the impact of contrast agent timing on the stability of radiomics features using dynamic contrast-enhanced perfusion CT (dceCT) or MRI (dceMRI) in prostate and lung cancers.

METHODS

Radiomics features were extracted from dceCT or dceMRI images in patients with biopsy-proven peripheral prostate cancer (pzPC) or biopsy-proven non-small cell lung cancer (NSCLC), respectively. Features that showed significant differences between contrast phases were identified using linear mixed models. An L2-penalized logistic regression classifier was used to predict class labels for pzPC and unaffected prostate regions-of-interest (ROIs).

RESULTS

Nine pzPC and 28 NSCLC patients, who were imaged with dceCT and/or dceMRI, were included in this study. After normalizing for individual enhancement patterns by defining seven individual phases based on a reference vessel, 19, 467 and 128 out of 1204 CT features showed significant temporal dynamics in healthy prostate parenchyma, prostate tumors and lung tumors, respectively. CT radiomics-based classification accuracy of healthy and tumor ROIs was highly dependent on contrast agent phase. For dceMRI, 899 and 1027 out of 1118 features were significantly dependent on time after contrast agent injection for prostate and lung tumors.

CONCLUSIONS

CT and MRI radiomics features in both prostate and lung tumors are significantly affected by interindividual differences in contrast agent dynamics.

Advancements in Pancreatic Cancer Detection: Integrating Biomarkers, Imaging Technologies, and Machine Learning for Early Diagnosis

Artificial intelligence (AI) has come to play a pivotal role in revolutionizing medical practices, particularly in the field of pancreatic cancer detection and management. As a leading cause of cancer-related deaths, pancreatic cancer warrants innovative approaches due to its typically advanced stage at diagnosis and dismal survival rates. Present detection methods, constrained by limitations in accuracy and efficiency, underscore the necessity for novel solutions. AI-driven methodologies present promising avenues for enhancing early detection and prognosis forecasting. Through the analysis of imaging data, biomarker profiles, and clinical information, AI algorithms excel in discerning subtle abnormalities indicative of pancreatic cancer with remarkable precision. Moreover, machine learning (ML) algorithms facilitate the amalgamation of diverse data sources to optimize patient care. However, despite its huge potential, the implementation of AI in pancreatic cancer detection faces various challenges. Issues such as the scarcity of comprehensive datasets, biases in algorithm development, and concerns regarding data privacy and security necessitate thorough scrutiny. While AI offers immense promise in transforming pancreatic cancer detection and management, ongoing research and collaborative efforts are indispensable in overcoming technical hurdles and ethical dilemmas. This review delves into the evolution of AI, its application in pancreatic cancer detection, and the challenges and ethical considerations inherent in its integration.

Assessing the robustness of a machine-learning model for early detection of pancreatic adenocarcinoma (PDA): evaluating resilience to variations in image acquisition and radiomics workflow using image perturbation methods

PURPOSE

To evaluate robustness of a radiomics-based support vector machine (SVM) model for detection of visually occult PDA on pre-diagnostic CTs by simulating common variations in image acquisition and radiomics workflow using image perturbation methods.

METHODS

Eighteen algorithmically generated-perturbations, which simulated variations in image noise levels (σ, 2σ, 3σ, 5σ), image rotation [both CT image and the corresponding pancreas segmentation mask by 45° and 90° in axial plane], voxel resampling (isotropic and anisotropic), gray-level discretization [bin width (BW) 32 and 64)], and pancreas segmentation (sequential erosions by 3, 4, 6, and 8 pixels and dilations by 3, 4, and 6 pixels from the boundary), were introduced to the original (unperturbed) test subset (n = 128; 45 pre-diagnostic CTs, 83 control CTs with normal pancreas). Radiomic features were extracted from pancreas masks of these additional test subsets, and the model's performance was compared vis-a-vis the unperturbed test subset.

RESULTS

The model correctly classified 43 out of 45 pre-diagnostic CTs and 75 out of 83 control CTs in the unperturbed test subset, achieving 92.2% accuracy and 0.98 AUC. Model's performance was unaffected by a three-fold increase in noise level except for sensitivity declining to 80% at 3σ (p = 0.02). Performance remained comparable vis-a-vis the unperturbed test subset despite variations in image rotation (p = 0.99), voxel resampling (p = 0.25-0.31), change in gray-level BW to 32 (p = 0.31-0.99), and erosions/dilations up to 4 pixels from the pancreas boundary (p = 0.12-0.34).

CONCLUSION

The model's high performance for detection of visually occult PDA was robust within a broad range of clinically relevant variations in image acquisition and radiomics workflow.

Reproducibility in Radiomics: A Comparison of Feature Extraction Methods and Two Independent Datasets

Radiomics involves the extraction of information from medical images that are not visible to the human eye. There is evidence that these features can be used for treatment stratification and outcome prediction. However, there is much discussion about the reproducibility of results between different studies. This paper studies the reproducibility of CT texture features used in radiomics, comparing two feature extraction implementations, namely the MATLAB toolkit and Pyradiomics, when applied to independent datasets of CT scans of patients: (i) the open access RIDER dataset containing a set of repeat CT scans taken 15 min apart for 31 patients (RIDER Scan 1 and Scan 2, respectively) treated for lung cancer; and (ii) the open access HN1 dataset containing 137 patients treated for head and neck cancer. Gross tumor volume (GTV), manually outlined by an experienced observer available on both datasets, was used. The 43 common radiomics features available in MATLAB and Pyradiomics were calculated using two intensity-level quantization methods with and without an intensity threshold. Cases were ranked for each feature for all combinations of quantization parameters, and the Spearman's rank coefficient, rs, calculated. Reproducibility was defined when a highly correlated feature in the RIDER dataset also correlated highly in the HN1 dataset, and vice versa. A total of 29 out of the 43 reported stable features were found to be highly reproducible between MATLAB and Pyradiomics implementations, having a consistently high correlation in rank ordering for RIDER Scan 1 and RIDER Scan 2 (rs > 0.8). 18/43 reported features were common in the RIDER and HN1 datasets, suggesting they may be agnostic to disease site. Useful radiomics features should be selected based on reproducibility. This study identified a set of features that meet this requirement and validated the methodology for evaluating reproducibility between datasets.

Analysis of Hybrid Feature Optimization Techniques Based on the Classification Accuracy of Brain Tumor Regions Using Machine Learning and Further Evaluation Based on the Institute Test Data

Aim

The goal of this study was to get optimal brain tumor features from magnetic resonance imaging (MRI) images and classify them based on the three groups of the tumor region: Peritumoral edema, enhancing-core, and necrotic tumor core, using machine learning classification models.

Materials and Methods

This study's dataset was obtained from the multimodal brain tumor segmentation challenge. A total of 599 brain MRI studies were employed, all in neuroimaging informatics technology initiative format. The dataset was divided into training, validation, and testing subsets online test dataset (OTD). The dataset includes four types of MRI series, which were combined together and processed for intensity normalization using contrast limited adaptive histogram equalization methodology. To extract radiomics features, a python-based library called pyRadiomics was employed. Particle-swarm optimization (PSO) with varying inertia weights was used for feature optimization. Inertia weight with a linearly decreasing strategy (W1), inertia weight with a nonlinear coefficient decreasing strategy (W2), and inertia weight with a logarithmic strategy (W3) were different strategies used to vary the inertia weight for feature optimization in PSO. These selected features were further optimized using the principal component analysis (PCA) method to further reducing the dimensionality and removing the noise and improve the performance and efficiency of subsequent algorithms. Support vector machine (SVM), light gradient boosting (LGB), and extreme gradient boosting (XGB) machine learning classification algorithms were utilized for the classification of images into different tumor regions using optimized features. The proposed method was also tested on institute test data (ITD) for a total of 30 patient images.

Results

For OTD test dataset, the classification accuracy of SVM was 0.989, for the LGB model (LGBM) was 0.992, and for the XGB model (XGBM) was 0.994, using the varying inertia weight-PSO optimization method and the classification accuracy of SVM was 0.996 for the LGBM was 0.998, and for the XGBM was 0.994, using PSO and PCA-a hybrid optimization technique. For ITD test dataset, the classification accuracy of SVM was 0.994 for the LGBM was 0.993, and for the XGBM was 0.997, using the hybrid optimization technique.

Conclusion

The results suggest that the proposed method can be used to classify a brain tumor as used in this study to classify the tumor region into three groups: Peritumoral edema, enhancing-core, and necrotic tumor core. This was done by extracting the different features of the tumor, such as its shape, grey level, gray-level co-occurrence matrix, etc., and then choosing the best features using hybrid optimal feature selection techniques. This was done without much human expertise and in much less time than it would take a person.

A combination of radiomic features, clinic characteristics, and serum tumor biomarkers to predict the possibility of the micropapillary/solid component of lung adenocarcinoma

BACKGROUND

Invasive lung adenocarcinoma with MPP/SOL components has a poor prognosis and often shows a tendency to recurrence and metastasis. This poor prognosis may require adjustment of treatment strategies. Preoperative identification is essential for decision-making for subsequent treatment.

OBJECTIVE

This study aimed to preoperatively predict the probability of MPP/SOL components in lung adenocarcinomas by a comprehensive model that includes radiomics features, clinical characteristics, and serum tumor biomarkers.

DESIGN

A retrospective case control, diagnostic accuracy study.

METHODS

This study retrospectively recruited 273 patients (males: females, 130: 143; mean age ± standard deviation, 63.29 ± 10.03 years; range 21-83 years) who underwent resection of invasive lung adenocarcinoma. Sixty-one patients (22.3%) were diagnosed with lung adenocarcinoma with MPP/SOL components. Radiomic features were extracted from CT before surgery. Clinical, radiomic, and combined models were developed using the logistic regression algorithm. The clinical and radiomic signatures were integrated into a nomogram. The diagnostic performance of the models was evaluated using the area under the curve (AUC). Studies were scored according to the Radiomics Quality Score and Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis guidelines.

RESULTS

The radiomics model achieved the best AUC values of 0.858 and 0.822 in the training and test cohort, respectively. Tumor size (T_size), solid tumor size (ST_size), consolidation-to-tumor ratio (CTR), years of smoking, CYFRA 21-1, and squamous cell carcinoma antigen were used to construct the clinical model. The clinical model achieved AUC values of 0.741 and 0.705 in the training and test cohort, respectively. The nomogram showed higher AUCs of 0.894 and 0.843 in the training and test cohort, respectively.

CONCLUSION

This study has developed and validated a combined nomogram, a visual tool that integrates CT radiomics features with clinical indicators and serum tumor biomarkers. This innovative model facilitates the differentiation of micropapillary or solid components within lung adenocarcinoma and achieves a higher AUC, indicating superior predictive accuracy.

Computed Tomography-derived intratumoral and peritumoral radiomics in predicting EGFR mutation in lung adenocarcinoma

OBJECTIVE

To investigate the value of Computed Tomography (CT) radiomics derived from different peritumoral volumes of interest (VOIs) in predicting epidermal growth factor receptor (EGFR) mutation status in lung adenocarcinoma patients.

MATERIALS AND METHODS

A retrospective cohort of 779 patients who had pathologically confirmed lung adenocarcinoma were enrolled. 640 patients were randomly divided into a training set, a validation set, and an internal testing set (3:1:1), and the remaining 139 patients were defined as an external testing set. The intratumoral VOI (VOI_I) was manually delineated on the thin-slice CT images, and seven peritumoral VOIs (VOI_P) were automatically generated with 1, 2, 3, 4, 5, 10, and 15 mm expansion along the VOI_I. 1454 radiomic features were extracted from each VOI. The t-test, the least absolute shrinkage and selection operator (LASSO), and the minimum redundancy maximum relevance (mRMR) algorithm were used for feature selection, followed by the construction of radiomics models (VOI_I model, VOI_P model and combined model). The performance of the models were evaluated by the area under the curve (AUC).

RESULTS

399 patients were classified as EGFR mutant (EGFR+), while 380 were wild-type (EGFR-). In the training and validation sets, internal and external testing sets, VOI4 (intratumoral and peritumoral 4 mm) model achieved the best predictive performance, with AUCs of 0.877, 0.727, and 0.701, respectively, outperforming the VOI_I model (AUCs of 0.728, 0.698, and 0.653, respectively).

CONCLUSIONS

Radiomics extracted from peritumoral region can add extra value in predicting EGFR mutation status of lung adenocarcinoma patients, with the optimal peritumoral range of 4 mm.

Improving radiology workflow using ChatGPT and artificial intelligence

Artificial Intelligence is a branch of computer science that aims to create intelligent machines capable of performing tasks that typically require human intelligence. One of the branches of artificial intelligence is natural language processing, which is dedicated to studying the interaction between computers and human language. ChatGPT is a sophisticated natural language processing tool that can understand and respond to complex questions and commands in natural language. Radiology is a vital aspect of modern medicine that involves the use of imaging technologies to diagnose and treat medical conditions artificial intelligence, including ChatGPT, can be integrated into radiology workflows to improve efficiency, accuracy, and patient care. ChatGPT can streamline various radiology workflow steps, including patient registration, scheduling, patient check-in, image acquisition, interpretation, and reporting. While ChatGPT has the potential to transform radiology workflows, there are limitations to the technology that must be addressed, such as the potential for bias in artificial intelligence algorithms and ethical concerns. As technology continues to advance, ChatGPT is likely to become an increasingly important tool in the field of radiology, and in healthcare more broadly.

Machine learning for differentiation of lipid-poor adrenal adenoma and subclinical pheochromocytoma based on multiphase CT imaging radiomics

BACKGROUND

There is a paucity of research investigating the application of machine learning techniques for distinguishing between lipid-poor adrenal adenoma (LPA) and subclinical pheochromocytoma (sPHEO) based on radiomic features extracted from non-contrast and dynamic contrast-enhanced computed tomography (CT) scans of the abdomen.

METHODS

We conducted a retrospective analysis of multiphase spiral CT scans, including non-contrast, arterial, venous, and delayed phases, as well as thin- and thick-thickness images from 134 patients with surgically and pathologically confirmed. A total of 52 patients with LPA and 44 patients with sPHEO were randomly assigned to training/testing sets in a 7:3 ratio. Additionally, a validation set was comprised of 22 LPA cases and 16 sPHEO cases from two other hospitals. We used 3D Slicer and PyRadiomics to segment tumors and extract radiomic features, respectively. We then applied T-test and least absolute shrinkage and selection operator (LASSO) to select features. Six binary classifiers, including K-nearest neighbor (KNN), logistic regression (LR), decision tree (DT), random forest (RF), support vector machine (SVM), and multi-layer perceptron (MLP), were employed to differentiate LPA from sPHEO. Receiver operating characteristic (ROC) curves and area under the curve (AUC) values were compared using DeLong's method.

RESULTS

All six classifiers showed good diagnostic performance for each phase and slice thickness, as well as for the entire CT data, with AUC values ranging from 0.706 to 1. Non-contrast CT densities of LPA were significantly lower than those of sPHEO (P < 0.001). However, using the optimal threshold for non-contrast CT density, sensitivity was only 0.743, specificity 0.744, and AUC 0.828. Delayed phase CT density yielded a sensitivity of 0.971, specificity of 0.641, and AUC of 0.814. In radiomics, AUC values for the testing set using non-contrast CT images were: KNN 0.919, LR 0.979, DT 0.835, RF 0.967, SVM 0.979, and MLP 0.981. In the validation set, AUC values were: KNN 0.891, LR 0.974, DT 0.891, RF 0.964, SVM 0.949, and MLP 0.979.

CONCLUSIONS

The machine learning model based on CT radiomics can accurately differentiate LPA from sPHEO, even using non-contrast CT data alone, making contrast-enhanced CT unnecessary for diagnosing LPA and sPHEO.

Review of the use of radiomics to assess the risk of recurrence in early-stage non-small cell lung cancer

Background and Objective

Radiomics is an emerging field of advanced image analysis that has shown promise as a non-invasive, companion diagnostic in predicting clinical outcomes and response assessments in solid tumors. Radiomics aims to extract high-content information from medical images not visible to the naked eye, especially in early-stage non-small cell lung cancer (NSCLC) patients. Although these patients are being identified by early detection programs, it remains unclear which patients would benefit from adjuvant treatment versus active surveillance. Having a radiomic signature(s) that could predict early recurrence would be beneficial. In this review, an overview of the basic radiomic approaches used to evaluate solid tumors on radiologic scans, including NSCLC is provided followed by a review of relevant literature that supports the use of radiomics to help predict tumor recurrence in early-stage NSCLC patients.

Methods

A review of the radiomic literature from 1985 to present focusing on the prediction of disease recurrence in early-stage NSCLC was conducted. PubMed database was searched using key terms for radiomics and NSCLC. A total of 41 articles were identified and 13 studies were considered suitable for inclusion based upon study population, patient number (n>50), use of well described radiomic methodologies, suitable model building features, and well-defined testing/training and validation where feasible.

Key Content and Findings

Examples of using radiomics in early-stage NSCLC patients will be presented, where disease free survival is a primary consideration. A summary of the findings demonstrates the importance of both the intratumor and peritumoral radiomic signals as a marker of outcomes.

Conclusions

The value of radiomic information for predicting disease recurrence in early-stage NSCLC patients is accumulating. However, overcoming several challenges along with the lack of prospective trials, has inhibited it use as a clinical decision-making support tool in early-stage NSCLC.

Associations between Vertebral Localized Contrast Changes and Adjacent Annular Fissures in Patients with Low Back Pain: A Radiomics Approach

Low back pain (LBP) is multifactorial and associated with various spinal tissue changes, including intervertebral disc fissures, vertebral pathology, and damaged endplates. However, current radiological markers lack specificity and individualized diagnostic capability, and the interactions between the various markers are not fully clear. Radiomics, a data-driven analysis of radiological images, offers a promising approach to improve evaluation and deepen the understanding of spinal changes related to LBP. This study investigated possible associations between vertebral changes and annular fissures using radiomics. A dataset of 61 LBP patients who underwent conventional magnetic resonance imaging followed by discography was analyzed. Radiomics features were extracted from segmented vertebrae and carefully reduced to identify the most relevant features associated with annular fissures. The results revealed three important texture features that display concentrated high-intensity gray levels, extensive regions with elevated gray levels, and localized areas with reduced gray levels within the vertebrae. These features highlight patterns within vertebrae that conventional classification systems cannot reflect on distinguishing between vertebrae adjacent to an intervertebral disc with or without an annular fissure. As such, the present study reveals associations that contribute to the understanding of pathophysiology and may provide improved diagnostics of LBP.

Limited impact of discretization/interpolation parameters on the predictive power of CT radiomic features in a surgical cohort of pancreatic cancer patients

PURPOSE

To explore the variation of the discriminative power of CT (Computed Tomography) radiomic features (RF) against image discretization/interpolation in predicting early distant relapses (EDR) after upfront surgery.

MATERIALS AND METHODS

Data of 144 patients with pre-surgical high contrast CT were processed consistently with IBSI (Image Biomarker Standardization Initiative) guidelines. Image interpolation/discretization parameters were intentionally changed, including cubic voxel size (0.21-27 mm³) and binning (32-128 grey levels) in a 15 parameter's sets. After excluding RF with poor inter-observer delineation agreement (ICC < 0.80) and not negligible inter-scanner variability, the variation of 80 RF against discretization/interpolation was first quantified. Then, their ability in classifying patients with early distant relapses (EDR, < 10 months, previously assessed at the first quartile value of time-to-relapse) was investigated in terms of AUC (Area Under Curve) variation for those RF significantly associated to EDR.

RESULTS

Despite RF variability against discretization/interpolation parameters was large and only 30/80 RF showed %COV < 20 (%COV = 100*STDEV/MEAN), AUC changes were relatively limited: for 30 RF significantly associated with EDR (AUC values around 0.60-0.70), the mean values of SD of AUC variability and AUC range were 0.02 and 0.05 respectively. AUC ranges were between 0.00 and 0.11, with values ≤ 0.05 in 16/30 RF. These variations were further reduced when excluding the extreme values of 32 and 128 for grey levels (Average AUC range 0.04, with values between 0.00 and 0.08).

CONCLUSIONS

The discriminative power of CT RF in the prediction of EDR after upfront surgery for pancreatic cancer is relatively invariant against image interpolation/discretization within a large range of voxel sizes and binning.

Radiomics and Radiogenomics in Pelvic Oncology: Current Applications and Future Directions

Radiomics refers to the conversion of medical imaging into high-throughput, quantifiable data in order to analyse disease patterns, guide prognosis and aid decision making. Radiogenomics is an extension of radiomics that combines conventional radiomics techniques with molecular analysis in the form of genomic and transcriptomic data, serving as an alternative to costly, labour-intensive genetic testing. Data on radiomics and radiogenomics in the field of pelvic oncology remain novel concepts in the literature. We aim to perform an up-to-date analysis of current applications of radiomics and radiogenomics in the field of pelvic oncology, particularly focusing on the prediction of survival, recurrence and treatment response. Several studies have applied these concepts to colorectal, urological, gynaecological and sarcomatous diseases, with individual efficacy yet poor reproducibility. This article highlights the current applications of radiomics and radiogenomics in pelvic oncology, as well as the current limitations and future directions. Despite a rapid increase in publications investigating the use of radiomics and radiogenomics in pelvic oncology, the current evidence is limited by poor reproducibility and small datasets. In the era of personalised medicine, this novel field of research has significant potential, particularly for predicting prognosis and guiding therapeutic decisions. Future research may provide fundamental data on how we treat this cohort of patients, with the aim of reducing the exposure of high-risk patients to highly morbid procedures.

A pilot study of MRI radiomics for high-risk prostate cancer stratification in 1.5 T MR-guided radiotherapy

PURPOSE

To investigate the potential value of MRI radiomics obtained from a 1.5 T MRI-guided linear accelerator (MR-LINAC) for D'Amico high-risk prostate cancer (PC) classification in MR-guided radiotherapy (MRgRT).

METHODS

One hundred seventy-six consecutive PC patients underwent 1.5 T MRgRT treatment were retrospectively enrolled. Each patient received one or two pretreatment T₂ -weighted MRI scans on a 1.5 T MR-LINAC. The endpoint was to differentiate high-risk from low/intermediate-risk PC based on D'Amico criteria using MRI-radiomics. Totally 1023 features were extracted from clinical target volume (CTV) and planning target volume (PTV). Intraclass correlation coefficient of scan-rescan repeatability, feature correlation, and recursive feature elimination were used for feature dimension reduction. Least absolute shrinkage and selection operator regression was employed for model construction. Receiver operating characteristic area under the curve (AUC) analysis was used for model performance assessment in both training and testing data.

RESULTS

One hundred and eleven patients fulfilled all criteria were finally included: 76 for training and 35 for testing. The constructed MRI-radiomics models extracted from CTV and PTV achieved the AUC of 0.812 and 0.867 in the training data, without significant difference (P = 0.083). The model performances remained in the testing. The sensitivity, specificity, and accuracy were 85.71%, 64.29%, and 77.14% for the PTV-based model; and 71.43%, 71.43%, and 71.43% for the CTV-based model. The corresponding AUCs were 0.718 and 0.750 (P = 0.091) for CTV- and PTV-based models.

CONCLUSION

MRI-radiomics obtained from a 1.5 T MR-LINAC showed promising results in D'Amico high-risk PC stratification, potentially helpful for the future PC MRgRT. Prospective studies with larger sample sizes and external validation are warranted for further verification.

Inconsistent Partitioning and Unproductive Feature Associations Yield Idealized Radiomic Models

Background Radiomics is the extraction of predefined mathematic features from medical images for the prediction of variables of clinical interest. While some studies report superlative accuracy of radiomic machine learning (ML) models, the published methodology is often incomplete, and the results are rarely validated in external testing data sets. Purpose To characterize the type, prevalence, and statistical impact of methodologic errors present in radiomic ML studies. Materials and Methods Radiomic ML publications were reviewed for the presence of performance-inflating methodologic flaws. Common flaws were subsequently reproduced with randomly generated features interpolated from publicly available radiomic data sets to demonstrate the precarious nature of reported findings. Results In an assessment of radiomic ML publications, the authors uncovered two general categories of data analysis errors: inconsistent partitioning and unproductive feature associations. In simulations, the authors demonstrated that inconsistent partitioning augments radiomic ML accuracy by 1.4 times from unbiased performance and that correcting for flawed methodologic results in areas under the receiver operating characteristic curve approaching a value of 0.5 (random chance). With use of randomly generated features, the authors illustrated that unproductive associations between radiomic features and gene sets can imply false causality for biologic phenomenon. Conclusion Radiomic machine learning studies may contain methodologic flaws that undermine their validity. This study provides a review template to avoid such flaws. © RSNA, 2022 Supplemental material is available for this article. See also the editorial by Jacobs in this issue.

Multi-centre radiomics for prediction of recurrence following radical radiotherapy for head and neck cancers: Consequences of feature selection, machine learning classifiers and batch-effect harmonization

Background and purpose

Radiomics models trained with limited single institution data are often not reproducible and generalisable. We developed radiomics models that predict loco-regional recurrence within two years of radiotherapy with private and public datasets and their combinations, to simulate small and multi-institutional studies and study the responsiveness of the models to feature selection, machine learning algorithms, centre-effect harmonization and increased dataset sizes.

Materials and methods

562 patients histologically confirmed and treated for locally advanced head-and-neck cancer (LA-HNC) from two public and two private datasets; one private dataset exclusively reserved for validation. Clinical contours of primary tumours were not recontoured and were used for Pyradiomics based feature extraction. ComBat harmonization was applied, and LASSO-Logistic Regression (LR) and Support Vector Machine (SVM) models were built. 95% confidence interval (CI) of 1000 bootstrapped area-under-the-Receiver-operating-curves (AUC) provided predictive performance. Responsiveness of the models' performance to the choice of feature selection methods, ComBat harmonization, machine learning classifier, single and pooled data was evaluated.

Results

LASSO and SelectKBest selected 14 and 16 features, respectively; three were overlapping. Without ComBat, the LR and SVM models for three institutional data showed AUCs (CI) of 0.513 (0.481-0.559) and 0.632 (0.586-0.665), respectively. Performances following ComBat revealed AUCs of 0.559 (0.536-0.590) and 0.662 (0.606-0.690), respectively. Compared to single cohort AUCs (0.562-0.629), SVM models from pooled data performed significantly better at AUC = 0.680.

Conclusions

Multi-institutional retrospective data accentuates the existing variabilities that affect radiomics. Carefully designed prospective, multi-institutional studies and data sharing are necessary for clinically relevant head-and-neck cancer prognostication models.

Radiomics Applications in Head and Neck Tumor Imaging: A Narrative Review

Recent advances in machine learning and artificial intelligence technology have ensured automated evaluation of medical images. As a result, quantifiable diagnostic and prognostic biomarkers have been created. We discuss radiomics applications for the head and neck region in this paper. Molecular characterization, categorization, prognosis and therapy recommendation are given special consideration. In a narrative manner, we outline the fundamental technological principles, the overall idea and usual workflow of radiomic analysis and what seem to be the present and potential challenges in normal clinical practice. Clinical oncology intends for all of this to ensure informed decision support for personalized and useful cancer treatment. Head and neck cancers present a unique set of diagnostic and therapeutic challenges. These challenges are brought on by the complicated anatomy and heterogeneity of the area under investigation. Radiomics has the potential to address these barriers. Future research must be interdisciplinary and focus on the study of certain oncologic functions and outcomes, with external validation and multi-institutional cooperation in order to achieve this.

Determining the reliable feature change in longitudinal radiomics studies: A methodological approach using the reliable change index

PURPOSE

Determination of reliable change of radiomics feature over time is essential and vital in delta-radiomics, but has not yet been rigorously examined. This study attempts to propose a methodological approach using reliable change index (RCI), a statistical metric to determine the reliability of quantitative biomarker changes by accounting for the baseline measurement standard error, in delta-radiomics. The use of RCI was demonstrated with the MRI data acquired from a group of prostate cancer (PCa) patients treated by 1.5 T MRI-guided radiotherapy (MRgRT).

METHODS

Fifty consecutive PCa patients who underwent five-fractionated MRgRT were retrospectively included, and 1023 radiomics features were extracted from the clinical target volume (CTV) and planning target volume (PTV). The two MRI datasets acquired at the first fraction (MRI11 and MRI21) were used to calculate the baseline feature reliability against image acquisition using intraclass correlation coefficient (ICC). The RCI was constructed based on the baseline feature measurement standard deviation, ICC, and feature value differences at two time points between the fifth (MRI51) and the first fraction MRI (MRI11). The reliable change of features was determined in each patient only if the calculated RCI was over 1.96 or smaller than -1.96. The feature changes between MRI51 and MRI11 were correlated to two patient-reported quality-of-life clinical endpoints of urinary domain summary score (UDSS) and bowel domain summary score (BDSS) in 35 patients using the Spearman correlation test. Only the significant correlations between a feature that was reliably changed in ≥7 patients (20%) by RCI and an endpoint were considered as true significant correlations.

RESULTS

The 352 (34.4%) and 386 (37.7%) features among all 1023 features were determined by RCI to be reliably changed in more than five (10%) patients in the CTV and PTV, respectively. Nineteen features were found reliably changed in the CTV and 31 features in the PTV, respectively, in 10 (20%) or more patients. These features were not necessarily associated with significantly different longitudinal feature values (group p-value < 0.05). Most reliably changed features in more than 10 patients had excellent or good baseline test-retest reliability ICC, while none showed poor reliability. The RCI method ruled out the features to be reliably changed when substantial feature measurement bias was presented. After applying the RCI criterion, only four and five true significant correlations were confirmed with UDSS and BDSS in the CTV, respectively, with low true significance correlation rates of 10.8% (4/37) and 17.9% (5/28). No true significant correlations were found in the PTV.

CONCLUSIONS

The RCI method was proposed for delta-radiomics and demonstrated using PCa MRgRT data. The RCI has advantages over some other statistical metrics commonly used in the previous delta-radiomics studies, and is useful to reliably identify the longitudinal radiomics feature change on an individual basis. This proposed RCI method should be helpful for the development of essential feature selection methodology in delta-radiomics.

Clinical Impact and Generalizability of a Computer-Assisted Diagnostic Tool to Risk-Stratify Lung Nodules With CT

OBJECTIVE

To evaluate whether an imaging classifier for radiology practice can improve lung nodule classification and follow-up.

METHODS

A machine learning classifier was developed and trained using imaging data from the National Lung Screening Trial (NSLT) to produce a malignancy risk score (malignancy Similarity Index [mSI]) for individual lung nodules. In addition to NLST cohorts, external cohorts were developed from a tertiary referral lung cancer screening program data set and an external nonscreening data set of all nodules detected on CT. Performance of the mSI combined with Lung-RADS was compared with Lung-RADS alone and the Mayo and Brock risk calculators.

RESULTS

We analyzed 963 subjects and 1,331 nodules across these cohorts. The mSI was comparable in accuracy (area under the curve = 0.89) to existing clinical risk models (area under the curve = 0.86-0.88) and independently predictive in the NLST cohort of 704 nodules. When compared with Lung-RADS, the mSI significantly increased sensitivity across all cohorts (25%-117%), with significant increases in specificity in the screening cohorts (17%-33%). When used in conjunction with Lung-RADS, use of mSI would result in earlier diagnoses and reduced follow-up across cohorts, including the potential for early diagnosis in 42% of malignant NLST nodules from prior-year CT scans.

CONCLUSION

A computer-assisted diagnosis software improved risk classification from chest CTs of screening and incidentally detected lung nodules compared with Lung-RADS. mSI added predictive value independent of existing radiological and clinical variables. These results suggest the generalizability and potential clinical impact of a tool that is straightforward to implement in practice.

Translating Data Science Results into Precision Oncology Decisions: A Mini Review

While reviewing and discussing the potential of data science in oncology, we emphasize medical imaging and radiomics as the leading contextual frameworks to measure the impacts of Artificial Intelligence (AI) and Machine Learning (ML) developments. We envision some domains and research directions in which radiomics should become more significant in view of current barriers and limitations.

Feature selection methods and predictive models in CT lung cancer radiomics

Radiomics is a technique that extracts quantitative features from medical images using data-characterization algorithms. Radiomic features can be used to identify tissue characteristics and radiologic phenotyping that is not observable by clinicians. A typical workflow for a radiomics study includes cohort selection, radiomic feature extraction, feature and predictive model selection, and model training and validation. While there has been increasing attention given to radiomic feature extraction, standardization, and reproducibility, currently, there is a lack of rigorous evaluation of feature selection methods and predictive models. Herein, we review the published radiomics investigations in CT lung cancer and provide an overview of the commonly used radiomic feature selection methods and predictive models. We also compare limitations of various methods in clinical applications and present sources of uncertainty associated with those methods. This review is expected to help raise awareness of the impact of radiomic feature and model selection methods on the integrity of radiomics studies.

Advances in CT features and radiomics of checkpoint inhibitor-related pneumonitis: A short review

Checkpoint inhibitor-related pneumonitis (CIP) is a complication of immunotherapy for malignant tumors that severely limits the treatment cycles as well as endangers patients' health. The chest CT imaging features or typing of CIP and the application of radiomics will contribute to the precise prevention, early diagnosis and instant treatment of CIP. This article reviews the advances in the CT features and the application of radiomics in CIP.

A review of radiomics and genomics applications in cancers: the way towards precision medicine

The application of radiogenomics in oncology has great prospects in precision medicine. Radiogenomics combines large volumes of radiomic features from medical digital images, genetic data from high-throughput sequencing, and clinical-epidemiological data into mathematical modelling. The amalgamation of radiomics and genomics provides an approach to better study the molecular mechanism of tumour pathogenesis, as well as new evidence-supporting strategies to identify the characteristics of cancer patients, make clinical decisions by predicting prognosis, and improve the development of individualized treatment guidance. In this review, we summarized recent research on radiogenomics applications in solid cancers and presented the challenges impeding the adoption of radiomics in clinical practice. More standard guidelines are required to normalize radiomics into reproducible and convincible analyses and develop it as a mature field.

Resampling and harmonization for mitigation of heterogeneity in image parameters of baseline scans

Our study investigates the effects of heterogeneity in image parameters on the reproducibility of prognostic performance of models built using radiomic biomarkers. We compare the prognostic performance of models derived from the heterogeneity-mitigated features with that of models obtained from raw features, to assess whether reproducibility of prognostic scores improves upon application of our methods. We used two datasets: The Breast I-SPY1 dataset-Baseline DCE-MRI scans of 156 women with locally advanced breast cancer, treated with neoadjuvant chemotherapy, publicly available via The Cancer Imaging Archive (TCIA); The NSCLC IO dataset-Baseline CT scans of 107 patients with stage 4 non-small cell lung cancer (NSCLC), treated with pembrolizumab immunotherapy at our institution. Radiomic features (n = 102) are extracted from the tumor ROIs. We use a variety of resampling and harmonization scenarios to mitigate the heterogeneity in image parameters. The patients were divided into groups based on batch variables. For each group, the radiomic phenotypes are combined with the clinical covariates into a prognostic model. The performance of the groups is assessed using the c-statistic, derived from a Cox proportional hazards model fitted on all patients within a group. The heterogeneity-mitigation scenario (radiomic features, derived from images that have been resampled to minimum voxel spacing, are harmonized using the image acquisition parameters as batch variables) gave models with highest prognostic scores (for e.g., IO dataset; batch variable: high kernel resolution-c-score: 0.66). The prognostic performance of patient groups is not comparable in case of models built using non-heterogeneity mitigated features (for e.g., I-SPY1 dataset; batch variable: small pixel spacing-c-score: 0.54, large pixel spacing-c-score: 0.65). The prognostic performance of patient groups is closer in case of heterogeneity-mitigated scenarios (for e.g., scenario-harmonize by voxel spacing parameters: IO dataset; thin slice-c-score: 0.62, thick slice-c-score: 0.60). Our results indicate that accounting for heterogeneity in image parameters is important to obtain more reproducible prognostic scores, irrespective of image site or modality. For non-heterogeneity mitigated models, the prognostic scores are not comparable across patient groups divided based on batch variables. This study can be a step in the direction of constructing reproducible radiomic biomarkers, thus increasing their application in clinical decision making.

Evaluation of radiomics feature stability in abdominal monoenergetic photon counting CT reconstructions

Feature stability and standardization remain challenges that impede the clinical implementation of radiomics. This study investigates the potential of spectral reconstructions from photon-counting computed tomography (PCCT) regarding organ-specific radiomics feature stability. Abdominal portal-venous phase PCCT scans of 10 patients in virtual monoenergetic (VM) (keV 40-120 in steps of 10), polyenergetic, virtual non-contrast (VNC), and iodine maps were acquired. Two 2D and 3D segmentations measuring 1 and 2 cm in diameter of the liver, lung, spleen, psoas muscle, subcutaneous fat, and air were obtained for spectral reconstructions. Radiomics features were extracted with pyradiomics. The calculation of feature-specific intraclass correlation coefficients (ICC) was performed by comparing all segmentation approaches and organs. Feature-wise and organ-wise correlations were evaluated. Segmentation-resegmentation stability was evaluated by concordance correlation coefficient (CCC). Compared to non-VM, VM-reconstruction features tended to be more stable. For VM reconstructions, 3D 2 cm segmentation showed the highest average ICC with 0.63. Based on a criterion of ≥ 3 stable organs and an ICC of ≥ 0.75, 12-mainly non-first-order features-are shown to be stable between the VM reconstructions. In a segmentation-resegmentation analysis in 3D 2 cm, three features were identified as stable based on a CCC of > 0.6 in ≥ 3 organs in ≥ 6 VM reconstructions. Certain radiomics features vary between monoenergetic reconstructions and depend on the ROI size. Feature stability was also shown to differ between different organs. Yet, glcm_JointEntropy, gldm_GrayLevelNonUniformity, and firstorder_Entropy could be identified as features that could be interpreted as energy-independent and segmentation-resegmentation stable in this PCCT collective. PCCT may support radiomics feature standardization and comparability between sites.

Radiomics-based machine learning (ML) classifier for detection of type 2 diabetes on standard-of-care abdomen CTs: a proof-of-concept study

PURPOSE

To determine if pancreas radiomics-based AI model can detect the CT imaging signature of type 2 diabetes (T2D).

METHODS

Total 107 radiomic features were extracted from volumetrically segmented normal pancreas in 422 T2D patients and 456 age-matched controls. Dataset was randomly split into training (300 T2D, 300 control CTs) and test subsets (122 T2D, 156 control CTs). An XGBoost model trained on 10 features selected through top-K-based selection method and optimized through threefold cross-validation on training subset was evaluated on test subset.

RESULTS

Model correctly classified 73 (60%) T2D patients and 96 (62%) controls yielding F1-score, sensitivity, specificity, precision, and AUC of 0.57, 0.62, 0.61, 0.55, and 0.65, respectively. Model's performance was equivalent across gender, CT slice thicknesses, and CT vendors (p values > 0.05). There was no difference between correctly classified versus misclassified patients in the mean (range) T2D duration [4.5 (0-15.4) versus 4.8 (0-15.7) years, p = 0.8], antidiabetic treatment [insulin (22% versus 18%), oral antidiabetics (10% versus 18%), both (41% versus 39%) (p > 0.05)], and treatment duration [5.4 (0-15) versus 5 (0-13) years, p = 0.4].

CONCLUSION

Pancreas radiomics-based AI model can detect the imaging signature of T2D. Further refinement and validation are needed to evaluate its potential for opportunistic T2D detection on millions of CTs that are performed annually.

Artificial intelligence in pancreatic cancer

Pancreatic cancer is the deadliest disease, with a five-year overall survival rate of just 11%. The pancreatic cancer patients diagnosed with early screening have a median overall survival of nearly ten years, compared with 1.5 years for those not diagnosed with early screening. Therefore, early diagnosis and early treatment of pancreatic cancer are particularly critical. However, as a rare disease, the general screening cost of pancreatic cancer is high, the accuracy of existing tumor markers is not enough, and the efficacy of treatment methods is not exact. In terms of early diagnosis, artificial intelligence technology can quickly locate high-risk groups through medical images, pathological examination, biomarkers, and other aspects, then screening pancreatic cancer lesions early. At the same time, the artificial intelligence algorithm can also be used to predict the survival time, recurrence risk, metastasis, and therapy response which could affect the prognosis. In addition, artificial intelligence is widely used in pancreatic cancer health records, estimating medical imaging parameters, developing computer-aided diagnosis systems, etc. Advances in AI applications for pancreatic cancer will require a concerted effort among clinicians, basic scientists, statisticians, and engineers. Although it has some limitations, it will play an essential role in overcoming pancreatic cancer in the foreseeable future due to its mighty computing power.

The Impact of Image Acquisition Parameters and ComBat Harmonization on the Predictive Performance of Radiomics: A Renal Cell Carcinoma Model

Radiomics, one of the potential methods for developing clinical biomarker, is one of the exponentially growing research fields. In addition to its potential, several limitations have been identified in this field, and most importantly the effects of variations in imaging parameters on radiomic features (RFs). In this study, we investigate the potential of RFs to predict overall survival in patients with clear cell renal cell carcinoma, as well as the impact of ComBat harmonization on the performance of RF models. We assessed the robustness of the results by performing the analyses a thousand times. Publicly available CT scans of 179 patients were retrospectively collected and analyzed. The scans were acquired using different imaging vendors and parameters in different medical centers. The performance was calculated by averaging the metrics over all runs. On average, the clinical model significantly outperformed the radiomic models. The use of ComBat harmonization, on average, did not significantly improve the performance of radiomic models. Hence, the variability in image acquisition and reconstruction parameters significantly affect the performance of radiomic models. The development of radiomic specific harmonization techniques remain a necessity for the advancement of the field.

Radiomic Analysis: Study Design, Statistical Analysis, and Other Bias Mitigation Strategies

Rapid advances in automated methods for extracting large numbers of quantitative features from medical images have led to tremendous growth of publications reporting on radiomic analyses. Translation of these research studies into clinical practice can be hindered by biases introduced during the design, analysis, or reporting of the studies. Herein, the authors review biases, sources of variability, and pitfalls that frequently arise in radiomic research, with an emphasis on study design and statistical analysis considerations. Drawing on existing work in the statistical, radiologic, and machine learning literature, approaches for avoiding these pitfalls are described.

Radiomic Signatures Associated with CD8+ Tumour-Infiltrating Lymphocytes: A Systematic Review and Quality Assessment Study

The tumour immune microenvironment influences the efficacy of immune checkpoint inhibitors. Within this microenvironment are CD8-expressing tumour-infiltrating lymphocytes (CD8+ TILs), which are an important mediator and marker of anti-tumour response. In practice, the assessment of CD8+ TILs via tissue sampling involves logistical challenges. Radiomics, the high-throughput extraction of features from medical images, may offer a novel and non-invasive alternative. We performed a systematic review of the available literature reporting radiomic signatures associated with CD8+ TILs. We also aimed to evaluate the methodological quality of the identified studies using the Radiomics Quality Score (RQS) tool, and the risk of bias and applicability with the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool. Articles were searched from inception until 31 December 2021, in three electronic databases, and screened against eligibility criteria. Twenty-seven articles were included. A wide variety of cancers have been studied. The reported radiomic signatures were heterogeneous, with very limited reproducibility between studies of the same cancer group. The overall quality of studies was found to be less than desirable (mean RQS = 33.3%), indicating a need for technical maturation. Some potential avenues for further investigation are also discussed.

The impact of inter-observer variation in delineation on robustness of radiomics features in non-small cell lung cancer

Artificial intelligence and radiomics have the potential to revolutionise cancer prognostication and personalised treatment. Manual outlining of the tumour volume for extraction of radiomics features (RF) is a subjective process. This study investigates robustness of RF to inter-observer variation (IOV) in contouring in lung cancer. We utilised two public imaging datasets: ‘NSCLC-Radiomics’ and ‘NSCLC-Radiomics-Interobserver1’ (‘Interobserver’). For ‘NSCLC-Radiomics’, we created an additional set of manual contours for 92 patients, and for ‘Interobserver’, there were five manual and five semi-automated contours available for 20 patients. Dice coefficients (DC) were calculated for contours. 1113 RF were extracted including shape, first order and texture features. Intraclass correlation coefficient (ICC) was computed to assess robustness of RF to IOV. Cox regression analysis for overall survival (OS) was performed with a previously published radiomics signature. The median DC ranged from 0.81 (‘NSCLC-Radiomics’) to 0.85 (‘Interobserver’—semi-automated). The median ICC for the ‘NSCLC-Radiomics’, ‘Interobserver’ (manual) and ‘Interobserver’ (semi-automated) were 0.90, 0.88 and 0.93 respectively. The ICC varied by feature type and was lower for first order and gray level co-occurrence matrix (GLCM) features. Shape features had a lower median ICC in the ‘NSCLC-Radiomics’ dataset compared to the ‘Interobserver’ dataset. Survival analysis showed similar separation of curves for three of four RF apart from ‘original_shape_Compactness2’, a feature with low ICC (0.61). The majority of RF are robust to IOV, with first order, GLCM and shape features being the least robust. Semi-automated contouring improves feature stability. Decreased robustness of a feature is significant as it may impact upon the features’ prognostic capability.

Repeatability and reproducibility of magnetic resonance imaging-based radiomic features in rectal cancer

Purpose: Radiomics of magnetic resonance images (MRIs) in rectal cancer can non-invasively characterize tumor heterogeneity with potential to discover new imaging biomarkers. However, for radiomics to be reliable, the imaging features measured must be stable and reproducible. The aim of this study is to quantify the repeatability and reproducibility of MRI-based radiomic features in rectal cancer. Approach: An MRI radiomics phantom was used to measure the longitudinal repeatability of radiomic features and the impact of post-processing changes related to image resolution and noise. Repeatability measurements in rectal cancers were also quantified in a cohort of 10 patients with test-retest imaging among two observers. Results: We found that many radiomic features, particularly from texture classes, were highly sensitive to changes in image resolution and noise. About 49% of features had coefficient of variations ≤ 10 % in longitudinal phantom measurements. About 75% of radiomic features in in vivo test-retest measurements had an intraclass correlation coefficient of ≥ 0.8 . We saw excellent interobserver agreement with mean Dice similarity coefficient of 0.95 ± 0.04 for test and retest scans. Conclusions: The results of this study show that even when using a consistent imaging protocol many radiomic features were unstable. Therefore, caution must be taken when selecting features for potential imaging biomarkers.

What Genetics Can Do for Oncological Imaging: A Systematic Review of the Genetic Validation Data Used in Radiomics Studies

(1) Background: Radiogenomics is motivated by the concept that biomedical images contain information that reflects underlying pathophysiology. This review focused on papers that used genetics to validate their radiomics models and outcomes and assess their contribution to this emerging field. (2) Methods: All original research with the words radiomics and genomics in English and performed in humans up to 31 January 2022, were identified on Medline and Embase. The quality of the studies was assessed with Radiomic Quality Score (RQS) and the Cochrane recommendation for diagnostic accuracy study Quality Assessment 2. (3) Results: 45 studies were included in our systematic review, and more than 50% were published in the last two years. The studies had a mean RQS of 12, and the studied tumors were very diverse. Up to 83% investigated the prognosis as the main outcome, with the rest focusing on response to treatment and risk assessment. Most applied either transcriptomics (54%) and/or genetics (35%) for genetic validation. (4) Conclusions: There is enough evidence to state that new science has emerged, focusing on establishing an association between radiological features and genomic/molecular expression to explain underlying disease mechanisms and enhance prognostic, risk assessment, and treatment response radiomics models in cancer patients.

The stability of oncologic MRI radiomic features and the potential role of deep learning: a review

The use of MRI radiomic models for the diagnosis, prognosis and treatment response prediction of tumors has been increasingly reported in literature. However, its widespread adoption in clinics is hampered by issues related to features stability. In the MRI radiomic workflow, the main factors that affect radiomic features computation can be found in the image acquisition and reconstruction phase, in the image pre-processing steps, and in the segmentation of the region of interest on which radiomic indices are extracted. Deep Neural Networks (DNNs), having shown their potentiality in the medical image processing and analysis field, can be seen as an attractive strategy to partially overcome the issues related to radiomic stability and mitigate their impact. In fact, DNN approaches can be prospectively integrated in the MRI radiomic workflow to improve image quality, obtain accurate and reproducible segmentations and generate standardized images. In this review, DNN methods that can be included in the image processing steps of the radiomic workflow are described and discussed, in the light of a detailed analysis of the literature in the context of MRI radiomic reliability.

Quantifying lung cancer heterogeneity using novel CT features: a cross-institute study

Background

Radiomics-based image metrics are not used in the clinic despite the rapidly growing literature. We selected eight promising radiomic features and validated their value in decoding lung cancer heterogeneity.

Methods

CT images of 236 lung cancer patients were obtained from three different institutes, whereupon radiomic features were extracted according to a standardized procedure. The predictive value for patient long-term prognosis and association with routinely used semantic, genetic (e.g., epidermal growth factor receptor (EGFR)), and histopathological cancer profiles were validated. Feature measurement reproducibility was assessed.

Results

All eight selected features were robust across repeat scans (intraclass coefficient range: 0.81–0.99), and were associated with at least one of the cancer profiles: prognostic, semantic, genetic, and histopathological. For instance, “kurtosis” had a high predictive value of early death (AUC at first year: 0.70–0.75 in two independent cohorts), negative association with histopathological grade (Spearman’s r: − 0.30), and altered expression levels regarding EGFR mutation and semantic characteristics (solid intensity, spiculated shape, juxtapleural location, and pleura tag; all p < 0.05). Combined as a radiomic score, the features had a higher area under curve for predicting 5-year survival (train: 0.855, test: 0.780, external validation: 0.760) than routine characteristics (0.733, 0.622, 0.613, respectively), and a better capability in patient death risk stratification (hazard ratio: 5.828, 95% confidence interval: 2.915–11.561) than histopathological staging and grading.

Conclusions

We highlighted the clinical value of radiomic features. Following confirmation, these features may change the way in which we approach CT imaging and improve the individualized care of lung cancer patients.

Reproducibility for Hepatocellular Carcinoma CT Radiomic Features: Influence of Delineation Variability Based on 3D-CT, 4D-CT and Multiple-Parameter MR Images

Purpose

Accurate lesion segmentation is a prerequisite for radiomic feature extraction. It helps to reduce the features variability so as to improve the reporting quality of radiomics study. In this research, we aimed to conduct a radiomic feature reproducibility test of inter-/intra-observer delineation variability in hepatocellular carcinoma using 3D-CT images, 4D-CT images and multiple-parameter MR images.

Materials and Methods

For this retrospective study, 19 HCC patients undergoing 3D-CT, 4D-CT and multiple-parameter MR scans were included in this study. The gross tumor volume (GTV) was independently delineated twice by two observers based on contrast-enhanced computed tomography (CECT), maximum intensity projection (MIP), LAVA-Flex, T2W FRFSE and DWI-EPI images. We also delineated the peritumoral region, which was defined as 0 to 5 mm radius surrounding the GTV. 107 radiomic features were automatically extracted from CECT images using 3D-Slicer software. Quartile coefficient of dispersion (QCD) and intraclass correlation coefficient (ICC) were applied to assess the variability of each radiomic feature. QCD<10% and ICC≥0.75 were considered small variations and excellent reliability. Finally, the principal component analysis (PCA) was used to test the feasibility of dimensionality reduction.

Results

For tumor tissues, the numbers of radiomic features with QCD<10% indicated no obvious inter-/intra-observer differences or discrepancies in 3D-CT, 4D-CT and multiple-parameter MR delineation. However, the number of radiomic features (mean 89) with ICC≥0.75 was the highest in the multiple-parameter MR group, followed by the 3DCT group (mean 77) and the MIP group (mean 73). The peritumor tissues also showed similar results. A total of 15 and 7 radiomic features presented excellent reproducibility and small variation in tumor and peritumoral tissues, respectively. Two robust features showed excellent reproducibility and small variation in tumor and peritumoral tissues. In addition, the values of the two features both represented statistically significant differences among tumor and peritumoral tissues (P<0.05). The PCA results indicated that the first seven principal components could preserve at least 90% of the variance of the original set of features.

Conclusion

Delineation on multiple-parameter MR images could help to improve the reproducibility of the HCC CT radiomic features and weaken the inter-/intra-observer influence.

Acquisition repeatability of MRI radiomics features in the head and neck: a dual-3D-sequence multi-scan study

Radiomics has increasingly been investigated as a potential biomarker in quantitative imaging to facilitate personalized diagnosis and treatment of head and neck cancer (HNC), a group of malignancies associated with high heterogeneity. However, the feature reliability of radiomics is a major obstacle to its broad validity and generality in application to the highly heterogeneous head and neck (HN) tissues. In particular, feature repeatability of radiomics in magnetic resonance imaging (MRI) acquisition, which is considered a crucial confounding factor of radiomics feature reliability, is still sparsely investigated. This study prospectively investigated the acquisition repeatability of 93 MRI radiomics features in ten HN tissues of 15 healthy volunteers, aiming for potential magnetic resonance-guided radiotherapy (MRgRT) treatment of HNC. Each subject underwent four MRI acquisitions with MRgRT treatment position and immobilization using two pulse sequences of 3D T1-weighed turbo spin-echo and 3D T2-weighed turbo spin-echo on a 1.5 T MRI simulator. The repeatability of radiomics feature acquisition was evaluated in terms of the intraclass correlation coefficient (ICC), whereas within-subject acquisition variability was evaluated in terms of the coefficient of variation (CV). The results showed that MRI radiomics features exhibited heterogeneous acquisition variability and uncertainty dependent on feature types, tissues, and pulse sequences. Only a small fraction of features showed excellent acquisition repeatability (ICC > 0.9) and low within-subject variability. Multiple MRI scans improved the accuracy and confidence of the identification of reliable features concerning MRI acquisition compared to simple test-retest repeated scans. This study contributes to the literature on the reliability of radiomics features with respect to MRI acquisition and the selection of reliable radiomics features for use in modeling in future HNC MRgRT applications.

CT Reconstruction Kernels and the Effect of Pre- and Post-Processing on the Reproducibility of Handcrafted Radiomic Features

Handcrafted radiomics features (HRFs) are quantitative features extracted from medical images to decode biological information to improve clinical decision making. Despite the potential of the field, limitations have been identified. The most important identified limitation, currently, is the sensitivity of HRF to variations in image acquisition and reconstruction parameters. In this study, we investigated the use of Reconstruction Kernel Normalization (RKN) and ComBat harmonization to improve the reproducibility of HRFs across scans acquired with different reconstruction kernels. A set of phantom scans (n = 28) acquired on five different scanner models was analyzed. HRFs were extracted from the original scans, and scans were harmonized using the RKN method. ComBat harmonization was applied on both sets of HRFs. The reproducibility of HRFs was assessed using the concordance correlation coefficient. The difference in the number of reproducible HRFs in each scenario was assessed using McNemar’s test. The majority of HRFs were found to be sensitive to variations in the reconstruction kernels, and only six HRFs were found to be robust with respect to variations in reconstruction kernels. The use of RKN resulted in a significant increment in the number of reproducible HRFs in 19 out of the 67 investigated scenarios (28.4%), while the ComBat technique resulted in a significant increment in 36 (53.7%) scenarios. The combination of methods resulted in a significant increment in 53 (79.1%) scenarios compared to the HRFs extracted from original images. Since the benefit of applying the harmonization methods depended on the data being harmonized, reproducibility analysis is recommended before performing radiomics analysis. For future radiomics studies incorporating images acquired with similar image acquisition and reconstruction parameters, except for the reconstruction kernels, we recommend the systematic use of the pre- and post-processing approaches (respectively, RKN and ComBat).

Identification of CT Imaging Phenotypes of Colorectal Liver Metastases from Radiomics Signatures-Towards Assessment of Interlesional Tumor Heterogeneity

(1) Background: Tumoral heterogeneity (TH) is a major challenge in the treatment of metastatic colorectal cancer (mCRC) and is associated with inferior response. Therefore, the identification of TH would be beneficial for treatment planning. TH can be assessed by identifying genetic alterations. In this work, a radiomics-based approach for assessment of TH in colorectal liver metastases (CRLM) in CT scans is demonstrated. (2) Methods: In this retrospective study, CRLM of mCRC were segmented and radiomics features extracted using pyradiomics. Unsupervised k-means clustering was applied to features and lesions. Feature redundancy was evaluated by principal component analysis and reduced by Pearson correlation coefficient cutoff. Feature selection was conducted by LASSO regression and visual analysis of the clusters by radiologists. (3) Results: A total of 47 patients’ (36% female, median age 64) CTs with 261 lesions were included. Five clusters were identified, and the categories small disseminated (n = 31), heterogeneous (n = 105), homogeneous (n = 64), mixed (n = 59), and very large type (n = 2) were assigned based on visual characteristics. Further statistical analysis showed correlation (p < 0.01) of clusters with sex, primary location, T- and N-status, and mutational status. Feature reduction and selection resulted in the identification of four features as a final set for cluster definition. (4) Conclusions: Radiomics features can characterize TH in liver metastases of mCRC in CT scans, and may be suitable for a better pretherapeutic classification of liver lesion phenotypes.