Intensity harmonization techniques influence radiomics features and radiomics-based predictions in sarcoma patients

Magnetic resonance imaging radiomic features stability in brain metastases: Impact of image preprocessing, image-, and feature-level harmonization

Background and purpose

Magnetic resonance imaging (MRI) scans are highly sensitive to acquisition and reconstruction parameters which affect feature stability and model generalizability in radiomic research. This work aims to investigate the effect of image pre-processing and harmonization methods on the stability of brain MRI radiomic features and the prediction performance of radiomic models in patients with brain metastases (BMs).

Materials and methods

Two T1 contrast enhanced brain MRI data-sets were used in this study. The first contained 25 BMs patients with scans at two different time points and was used for features stability analysis. The effect of gray level discretization (GLD), intensity normalization (Z-score, Nyul, WhiteStripe, and in house-developed method named N-Peaks), and ComBat harmonization on features stability was investigated and features with intraclass correlation coefficient >0.8 were considered as stable. The second data-set containing 64 BMs patients was used for a classification task to investigate the informativeness of stable features and the effects of harmonization methods on radiomic model performance.

Results

Applying fixed bin number (FBN) GLD, resulted in higher number of stable features compare to fixed bin size (FBS) discretization (10 ± 5.5 % higher). `Harmonization in feature domain improved the stability for non-normalized and normalized images with Z-score and WhiteStripe methods. For the classification task, keeping the stable features resulted in good performance only for normalized images with N-Peaks along with FBS discretization.

Conclusions

To develop a robust MRI based radiomic model we recommend using an intensity normalization method based on a reference tissue (e.g N-Peaks) and then using FBS discretization.

Role of MRI radiomics for the prediction of MYCN amplification in neuroblastomas

OBJECTIVES

We evaluate MR radiomics and develop machine learning-based classifiers to predict MYCN amplification in neuroblastomas.

METHODS

A total of 120 patients with neuroblastomas and baseline MR imaging examination available were identified of whom 74 (mean age ± standard deviation [SD] of 6 years and 2 months ± 4 years and 9 months; 43 females and 31 males, 14 MYCN amplified) underwent imaging at our institution. This was therefore used to develop radiomics models. The model was tested in a cohort of children with the same diagnosis but imaged elsewhere (n = 46, mean age ± SD: 5 years 11 months ± 3 years 9 months, 26 females and 14 MYCN amplified). Whole tumour volumes of interest were adopted to extract first-order histogram and second-order radiomics features. Interclass correlation coefficient and maximum relevance and minimum redundancy algorithm were applied for feature selection. Logistic regression, support vector machine, and random forest were employed as the classifiers. Receiver operating characteristic (ROC) analysis was performed to evaluate the diagnostic accuracy of the classifiers on the external test set.

RESULTS

The logistic regression model and the random forest both showed an AUC of 0.75. The support vector machine classifier obtained an AUC of 0.78 on the test set with a sensitivity of 64% and a specificity of 72%.

CONCLUSION

The study provides preliminary retrospective evidence demonstrating the feasibility of MRI radiomics in predicting MYCN amplification in neuroblastomas. Future studies are needed to explore the correlation between other imaging features and genetic markers and to develop multiclass predictive models.

KEY POINTS

• MYCN amplification in neuroblastomas is an important determinant of disease prognosis. • Radiomics analysis of pre-treatment MR examinations can be used to predict MYCN amplification in neuroblastomas. • Radiomics machine learning models showed good generalisability to external test set, demonstrating reproducibility of the computational models.

Development of a multi-feature-combined model: proof-of-concept with application to local failure prediction of post-SBRT or surgery early-stage NSCLC patients

Objective

To develop a Multi-Feature-Combined (MFC) model for proof-of-concept in predicting local failure (LR) in NSCLC patients after surgery or SBRT using pre-treatment CT images. This MFC model combines handcrafted radiomic features, deep radiomic features, and patient demographic information in an integrated machine learning workflow.

Methods

The MFC model comprised three key steps. (1) Extraction of 92 handcrafted radiomic features from the GTV segmented on pre-treatment CT images. (2) Extraction of 512 deep radiomic features from pre-trained U-Net encoder. (3) The extracted handcrafted radiomic features, deep radiomic features, along with 4 patient demographic information (i.e., gender, age, tumor volume, and Charlson comorbidity index), were concatenated as a multi-dimensional input to the classifiers for LR prediction. Two NSCLC patient cohorts from our institution were investigated: (1) the surgery cohort includes 83 patients with segmentectomy or wedge resection (7 LR), and (2) the SBRT cohort includes 84 patients with lung SBRT (9 LR). The MFC model was developed and evaluated independently for both cohorts, and was subsequently compared against the prediction models based on only handcrafted radiomic features (R models), patient demographic information (PI models), and deep learning modeling (DL models). ROC with AUC was adopted to evaluate model performance with leave-one-out cross-validation (LOOCV) and 100-fold Monte Carlo random validation (MCRV). The t-test was performed to identify the statistically significant differences.

Results

In LOOCV, the AUC range (surgery/SBRT) of the MFC model was 0.858-0.895/0.868-0.913, which was higher than the three other models: 0.356-0.480/0.322-0.650 for PI models, 0.559-0.618/0.639-0.682 for R models, and 0.809/0.843 for DL models. In 100-fold MCRV, the MFC model again showed the highest AUC results (surgery/SBRT): 0.742-0.825/0.888-0.920, which were significantly higher than PI models: 0.464-0.564/0.538-0.628, R models: 0.557-0.652/0.551-0.732, and DL models: 0.702/0.791.

Conclusion

We successfully developed an MFC model that combines feature information from multiple sources for proof-of-concept prediction of LR in patients with surgical and SBRT early-stage NSCLC. Initial results suggested that incorporating pre-treatment patient information from multiple sources improves the ability to predict the risk of local failure.

ComBat Harmonization of Myocardial Radiomic Features Sensitive to Cardiac MRI Acquisition Parameters

Purpose

To investigate the effect of ComBat harmonization methods on the robustness of cardiac MRI-derived radiomic features to variations in imaging parameters.

Materials and Methods

This Health Insurance Portability and Accountability Act-compliant retrospective study used a publicly available data set of 11 healthy controls (mean age, 33 years ± 16 [SD]; six men) and five patients (mean age, 52 years ± 16; four men). A single midventricular short-axis section was acquired with 3-T MRI using cine balanced steady-state free precision, T1-weighted, T2-weighted, T1 mapping, and T2 mapping imaging sequences. Each sequence was acquired using baseline parameters and after variations in flip angle, spatial resolution, section thickness, and parallel imaging. Image registration was performed for all sequences at a per-individual level. Manual myocardial contouring was performed, and 1652 radiomic features per sequence were extracted using baseline and variations in imaging parameters. Radiomic feature stability to change in imaging parameters was assessed using Cohen d sensitivity. The stability of radiomic features was assessed both without and after ComBat harmonization of radiomic features. Three ComBat methods were studied: parametric, nonparametric, and Gaussian mixture model (GMM).

Results

For all sequences combined, 51.4% of features were robust to changes in imaging parameters when no ComBat method was applied. ComBat harmonization substantially increased the number of stable features to 95.1% (95% CI: 94.9, 95.3) when parametric ComBat was used and 90.9% (95% CI: 90.6, 91.2) when nonparametric ComBat was used. GMM combat resulted in only 52.6% stable features.

Conclusion

ComBat harmonization improved the stability of radiomic features to changes in imaging parameters across all cardiac MRI sequences.Keywords: Cardiac MRI, Radiomics, ComBat, Harmonization Supplemental material is available for this article. © RSNA, 2023.

Image harmonization: A review of statistical and deep learning methods for removing batch effects and evaluation metrics for effective harmonization

Magnetic resonance imaging and computed tomography from multiple batches (e.g. sites, scanners, datasets, etc.) are increasingly used alongside complex downstream analyses to obtain new insights into the human brain. However, significant confounding due to batch-related technical variation, called batch effects, is present in this data; direct application of downstream analyses to the data may lead to biased results. Image harmonization methods seek to remove these batch effects and enable increased generalizability and reproducibility of downstream results. In this review, we describe and categorize current approaches in statistical and deep learning harmonization methods. We also describe current evaluation metrics used to assess harmonization methods and provide a standardized framework to evaluate newly-proposed methods for effective harmonization and preservation of biological information. Finally, we provide recommendations to end-users to advocate for more effective use of current methods and to methodologists to direct future efforts and accelerate development of the field.

Normalization Strategies in Multi-Center Radiomics Abdominal MRI: Systematic Review and Meta-Analyses

Goal: Artificial intelligence applied to medical image analysis has been extensively used to develop non-invasive diagnostic and prognostic signatures. However, these imaging biomarkers should be largely validated on multi-center datasets to prove their robustness before they can be introduced into clinical practice. The main challenge is represented by the great and unavoidable image variability which is usually addressed using different pre-processing techniques including spatial, intensity and feature normalization. The purpose of this study is to systematically summarize normalization methods and to evaluate their correlation with the radiomics model performances through meta-analyses. This review is carried out according to the PRISMA statement: 4777 papers were collected, but only 74 were included. Two meta-analyses were carried out according to two clinical aims: characterization and prediction of response. Findings of this review demonstrated that there are some commonly used normalization approaches, but not a commonly agreed pipeline that can allow to improve performance and to bridge the gap between bench and bedside.

DeepComBat: A Statistically Motivated, Hyperparameter-Robust, Deep Learning Approach to Harmonization of Neuroimaging Data

Neuroimaging data from multiple batches (i.e. acquisition sites, scanner manufacturer, datasets, etc.) are increasingly necessary to gain new insights into the human brain. However, multi-batch data, as well as extracted radiomic features, exhibit pronounced technical artifacts across batches. These batch effects introduce confounding into the data and can obscure biological effects of interest, decreasing the generalizability and reproducibility of findings. This is especially true when multi-batch data is used alongside complex downstream analysis models, such as machine learning methods. Image harmonization methods seeking to remove these batch effects are important for mitigating these issues; however, significant multivariate batch effects remain in the data following harmonization by current state-of-the-art statistical and deep learning methods. We present DeepCombat, a deep learning harmonization method based on a conditional variational autoencoder architecture and the ComBat harmonization model. DeepCombat learns and removes subject-level batch effects by accounting for the multivariate relationships between features. Additionally, DeepComBat relaxes a number of strong assumptions commonly made by previous deep learning harmonization methods and is empirically robust across a wide range of hyperparameter choices. We apply this method to neuroimaging data from a large cognitive-aging cohort and find that DeepCombat outperforms existing methods, as assessed by a battery of machine learning methods, in removing scanner effects from cortical thickness measurements while preserving biological heterogeneity. Additionally, DeepComBat provides a new perspective for statistically-motivated deep learning harmonization methods.

Machine Learning for Brain MRI Data Harmonisation: A Systematic Review

BACKGROUND

Magnetic Resonance Imaging (MRI) data collected from multiple centres can be heterogeneous due to factors such as the scanner used and the site location. To reduce this heterogeneity, the data needs to be harmonised. In recent years, machine learning (ML) has been used to solve different types of problems related to MRI data, showing great promise.

OBJECTIVE

This study explores how well various ML algorithms perform in harmonising MRI data, both implicitly and explicitly, by summarising the findings in relevant peer-reviewed articles. Furthermore, it provides guidelines for the use of current methods and identifies potential future research directions.

METHOD

This review covers articles published through PubMed, Web of Science, and IEEE databases through June 2022. Data from studies were analysed based on the criteria of Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). Quality assessment questions were derived to assess the quality of the included publications.

RESULTS

a total of 41 articles published between 2015 and 2022 were identified and analysed. In the review, MRI data has been found to be harmonised either in an implicit (n = 21) or an explicit (n = 20) way. Three MRI modalities were identified: structural MRI (n = 28), diffusion MRI (n = 7) and functional MRI (n = 6).

CONCLUSION

Various ML techniques have been employed to harmonise different types of MRI data. There is currently a lack of consistent evaluation methods and metrics used across studies, and it is recommended that the issue be addressed in future studies. Harmonisation of MRI data using ML shows promises in improving performance for ML downstream tasks, while caution should be exercised when using ML-harmonised data for direct interpretation.

Radiomics-Based Machine Learning Model for Predicting Overall and Progression-Free Survival in Rare Cancer: A Case Study for Primary CNS Lymphoma Patients

Primary Central Nervous System Lymphoma (PCNSL) is an aggressive neoplasm with a poor prognosis. Although therapeutic progresses have significantly improved Overall Survival (OS), a number of patients do not respond to HD–MTX-based chemotherapy (15–25%) or experience relapse (25–50%) after an initial response. The reasons underlying this poor response to therapy are unknown. Thus, there is an urgent need to develop improved predictive models for PCNSL. In this study, we investigated whether radiomics features can improve outcome prediction in patients with PCNSL. A total of 80 patients diagnosed with PCNSL were enrolled. A patient sub-group, with complete Magnetic Resonance Imaging (MRI) series, were selected for the stratification analysis. Following radiomics feature extraction and selection, different Machine Learning (ML) models were tested for OS and Progression-free Survival (PFS) prediction. To assess the stability of the selected features, images from 23 patients scanned at three different time points were used to compute the Interclass Correlation Coefficient (ICC) and to evaluate the reproducibility of each feature for both original and normalized images. Features extracted from Z-score normalized images were significantly more stable than those extracted from non-normalized images with an improvement of about 38% on average (p-value < 10−12). The area under the ROC curve (AUC) showed that radiomics-based prediction overcame prediction based on current clinical prognostic factors with an improvement of 23% for OS and 50% for PFS, respectively. These results indicate that radiomics features extracted from normalized MR images can improve prognosis stratification of PCNSL patients and pave the way for further study on its potential role to drive treatment choice.

Role of Imaging in Initial Prognostication of Locally Advanced Soft Tissue Sarcomas

BACKGROUND

Although imaging is central in the initial staging of patients with soft tissue sarcomas (STS), it remains underused and few radiological features are currently used in practice for prognostication and to help guide the best therapeutic strategy. Yet, several prognostic qualitative and quantitative characteristics from magnetic resonance imaging (MRI) and positron emission tomography (PET) have been identified over these last decades.

OBJECTIVE

After an overview of the current validated prognostic features based on baseline imaging and their integration into prognostic tools, such as nomograms used by clinicians, the aim of this review is to summarize more complex and innovative MRI, PET, and radiomics features, and to highlight their role to predict indirectly (through histologic grade) or directly the patients' outcomes.

Radiomics in clinical trials: perspectives on standardization

The term biomarker is used to describe a biological measure of the disease behavior. The existing imaging biomarkers are associated with the known tissue biological characteristics and follow a well-established roadmap to be implemented in routine clinical practice. Recently, a new quantitative imaging analysis approach named radiomics has emerged. It refers to the extraction of a large number of advanced imaging features with high-throughput computing. Extensive research has demonstrated its value in predicting disease behavior, progression, and response to therapeutic options. However, there are numerous challenges to establishing it as a clinically viable solution, including lack of reproducibility and transparency. The data-driven nature also does not offer insights into the underpinning biology of the observed relationships. As such, additional effort is needed to establish it as a qualified biomarker to inform clinical decisions. Here we review the technical difficulties encountered in the clinical applications of radiomics and current effort in addressing some of these challenges in clinical trial designs. By addressing these challenges, the true potential of radiomics can be unleashed.

Harmonization Strategies in Multicenter MRI-Based Radiomics

Radiomics analysis is a powerful tool aiming to provide diagnostic and prognostic patient information directly from images that are decoded into handcrafted features, comprising descriptors of shape, size and textural patterns. Although radiomics is gaining momentum since it holds great promise for accelerating digital diagnostics, it is susceptible to bias and variation due to numerous inter-patient factors (e.g., patient age and gender) as well as inter-scanner ones (different protocol acquisition depending on the scanner center). A variety of image and feature based harmonization methods has been developed to compensate for these effects; however, to the best of our knowledge, none of these techniques has been established as the most effective in the analysis pipeline so far. To this end, this review provides an overview of the challenges in optimizing radiomics analysis, and a concise summary of the most relevant harmonization techniques, aiming to provide a thorough guide to the radiomics harmonization process.

The diagnosis, classification, and treatment of sarcoma in this era of artificial intelligence and immunotherapy

Soft-tissue sarcomas (STS) represent a group of rare and heterogeneous tumors associated with several challenges, including incorrect or late diagnosis, the lack of clinical expertise, and limited therapeutic options. Digital pathology and radiomics represent transformative technologies that appear promising for improving the accuracy of cancer diagnosis, characterization and monitoring. Herein, we review the potential role of the application of digital pathology and radiomics in managing patients with STS. We have particularly described the main results and the limits of the studies using radiomics to refine diagnosis or predict the outcome of patients with soft-tissue sarcomas. We also discussed the current limitation of implementing radiomics in routine settings. Standard management approaches for STS have not improved since the early 1970s. Immunotherapy has revolutionized cancer treatment; nonetheless, immuno-oncology agents have not yet been approved for patients with STS. However, several lines of evidence indicate that immunotherapy may represent an efficient therapeutic strategy for this group of diseases. Thus, we emphasized the remarkable potential of immunotherapy in sarcoma treatment by focusing on recent data regarding the immune landscape of these tumors. We have particularly emphasized the fact that the development of immunotherapy for sarcomas is not an aspect of histology (except for alveolar soft-part sarcoma) but rather that of the tumor microenvironment. Future studies investigating immunotherapy strategies in sarcomas should incorporate at least the presence of tertiary lymphoid structures as a stratification factor in their design, besides including a strong translational program that will allow for a better understanding of the determinants involved in sensitivity and treatment resistance to immune-oncology agents.

The impact of harmonization on radiomic features in Parkinson’s disease and healthy controls: A multicenter study

Radiomics is a challenging development area in imaging field that is greatly capturing interest of radiologists and neuroscientists. However, radiomics features show a strong non-biological variability determined by different facilities and imaging protocols, limiting the reproducibility and generalizability of analysis frameworks. Our study aimed to investigate the usefulness of harmonization to reduce site-effects on radiomics features over specific brain regions. We selected T1-weighted magnetic resonance imaging (MRI) by using the MRI dataset Parkinson’s Progression Markers Initiative (PPMI) from different sites with healthy controls (HC) and Parkinson’s disease (PD) patients. First, the investigation of radiomics measure discrepancies were assessed on healthy brain regions-of-interest (ROIs) via a classification pipeline based on LASSO feature selection and support vector machine (SVM) model. Then, a ComBat-based harmonization approach was applied to correct site-effects. Finally, a validation step on PD subjects evaluated diagnostic accuracy before and after harmonization of radiomics data. Results on healthy subjects demonstrated a dependence from site-effects that could be corrected with ComBat harmonization. LASSO regressor after harmonization was unable to select any feature to distinguish controls by site. Moreover, harmonized radiomics features achieved an area under the receiving operating characteristic curve (AUC) of 0.77 (compared to AUC of 0.71 for raw radiomics measures) in distinguish Parkinson’s patients from HC. We found a not-negligible site-effect studying radiomics of HC pre- and post-harmonization of features. Our validation study on PD patients demonstrated a significant influence of non-biological noise source in diagnostic performances. Finally, harmonization of multicenter radiomic data represent a necessary step to make analysis pipelines reliable and replicable for multisite neuroimaging studies.

Impact of image quality on radiomics applications

Radiomics features extracted from medical images have been widely reported to be useful in the patient specific outcome modeling for variety of assessment and prediction purposes. Successful application of radiomics features as imaging biomarkers, however, is dependent on the robustness of the approach to the variation in each step of the modeling workflow. Variation in the input image quality is one of the main sources that impacts the reproducibility of radiomics analysis when a model is applied to broader range of medical imaging data. The quality of medical image is generally affected by both the scanner related factors such as image acquisition/reconstruction settings and the patient related factors such as patient motion. This article aimed to review the published literatures in this field that reported the impact of various imaging factors on the radiomics features through the change in image quality. The literatures were categorized by different imaging modalities and also tabulated based on the imaging parameters and the class of radiomics features included in the study. Strategies for image quality standardization were discussed based on the relevant literatures and recommendations for reducing the impact of image quality variation on the radiomics in multi-institutional clinical trial were summarized at the end of this article.

Soft Tissue Sarcomas: The Role of Quantitative MRI in Treatment Response Evaluation

BACKGROUND

Although curative surgery remains the cornerstone of the therapeutic strategy in patients with soft tissue sarcomas (STS), neoadjuvant radiotherapy and chemotherapy (NART and NACT, respectively) are increasingly used to improve operability, surgical margins and patient outcome. The best imaging modality for locoregional assessment of STS is MRI but these tumors are mostly evaluated in a qualitative manner.

OBJECTIVE

After an overview of the current standard of care regarding treatment for patients with locally advanced STS, this review aims to summarize the principles and limitations of (i) the current methods used to evaluate response to neoadjuvant treatment in clinical practice and clinical trials in STS (RECIST 1.1 and modified Choi criteria), (ii) quantitative MRI sequences (i.e., diffusion weighted imaging and dynamic contrast enhanced MRI), and (iii) texture analyses and (delta-) radiomics.

Robustness of radiomic features in magnetic resonance imaging for patients with glioblastoma: multi-center study

Background and purpose

Radiomics offers great potential in improving diagnosis and treatment for patients with glioblastoma multiforme. However, in order to implement radiomics in clinical routine, the features used for prognostic modelling need to be stable. This comprises significant challenge in multi-center studies. The aim of this study was to evaluate the impact of different image normalization methods on MRI features robustness in multi-center study.

Methods

Radiomics stability was checked on magnetic resonance images of eleven patients. The images were acquired in two different hospitals using contrast-enhanced T1 sequences. The images were normalized using one of five investigated approaches including grey-level discretization, histogram matching and z-score. Then, radiomic features were extracted and features stability was evaluated using intra-class correlation coefficients. In the second part of the study, improvement in the prognostic performance of features was tested on 60 patients derived from publicly available dataset.

Results

Depending on the normalization scheme, the percentage of stable features varied from 3.4% to 8%. The histogram matching based on the tumor region showed the highest amount of the stable features (113/1404); while normalization using fixed bin size resulted in 48 stable features. The histogram matching also led to better prognostic value (median c-index increase of 0.065) comparing to non-normalized images.

Conclusions

MRI normalization plays an important role in radiomics. Appropriate normalization helps to select robust features, which can be used for prognostic modelling in multicenter studies. In our study, histogram matching based on tumor region improved both stability of radiomic features and their prognostic value.

Challenges in ensuring the generalizability of image quantitation methods for MRI

Image quantitation methods including quantitative MRI, multiparametric MRI, and radiomics offer great promise for clinical use. However, many of these methods have limited clinical adoption, in part due to issues of generalizability, that is, the ability to translate methods and models across institutions. Researchers can assess generalizability through measurement of repeatability and reproducibility, thus quantifying different aspects of measurement variance. In this article, we review the challenges to ensuring repeatability and reproducibility of image quantitation methods as well as present strategies to minimize their variance to enable wider clinical implementation. We present possible solutions for achieving clinically acceptable performance of image quantitation methods and briefly discuss the impact of minimizing variance and achieving generalizability towards clinical implementation and adoption.

CT Reconstruction Kernels and the Effect of Pre- and Post-Processing on the Reproducibility of Handcrafted Radiomic Features

Handcrafted radiomics features (HRFs) are quantitative features extracted from medical images to decode biological information to improve clinical decision making. Despite the potential of the field, limitations have been identified. The most important identified limitation, currently, is the sensitivity of HRF to variations in image acquisition and reconstruction parameters. In this study, we investigated the use of Reconstruction Kernel Normalization (RKN) and ComBat harmonization to improve the reproducibility of HRFs across scans acquired with different reconstruction kernels. A set of phantom scans (n = 28) acquired on five different scanner models was analyzed. HRFs were extracted from the original scans, and scans were harmonized using the RKN method. ComBat harmonization was applied on both sets of HRFs. The reproducibility of HRFs was assessed using the concordance correlation coefficient. The difference in the number of reproducible HRFs in each scenario was assessed using McNemar’s test. The majority of HRFs were found to be sensitive to variations in the reconstruction kernels, and only six HRFs were found to be robust with respect to variations in reconstruction kernels. The use of RKN resulted in a significant increment in the number of reproducible HRFs in 19 out of the 67 investigated scenarios (28.4%), while the ComBat technique resulted in a significant increment in 36 (53.7%) scenarios. The combination of methods resulted in a significant increment in 53 (79.1%) scenarios compared to the HRFs extracted from original images. Since the benefit of applying the harmonization methods depended on the data being harmonized, reproducibility analysis is recommended before performing radiomics analysis. For future radiomics studies incorporating images acquired with similar image acquisition and reconstruction parameters, except for the reconstruction kernels, we recommend the systematic use of the pre- and post-processing approaches (respectively, RKN and ComBat).

Radiomic Phenotypes for Improving Early Prediction of Survival in Stage III Non-Small Cell Lung Cancer Adenocarcinoma after Chemoradiation

We evaluate radiomic phenotypes derived from CT scans as early predictors of overall survival (OS) after chemoradiation in stage III primary lung adenocarcinoma. We retrospectively analyzed 110 thoracic CT scans acquired between April 2012-October 2018. Patients received a median radiation dose of 66.6 Gy at 1.8 Gy/fraction delivered with proton (55.5%) and photon (44.5%) beam treatment, as well as concurrent chemotherapy (89%) with carboplatin-based (55.5%) and cisplatin-based (36.4%) doublets. A total of 56 death events were recorded. Using manual tumor segmentations, 107 radiomic features were extracted. Feature harmonization using ComBat was performed to mitigate image heterogeneity due to the presence or lack of intravenous contrast material and variability in CT scanner vendors. A binary radiomic phenotype to predict OS was derived through the unsupervised hierarchical clustering of the first principal components explaining 85% of the variance of the radiomic features. C-scores and likelihood ratio tests (LRT) were used to compare the performance of a baseline Cox model based on ECOG status and age, with a model integrating the radiomic phenotype with such clinical predictors. The model integrating the radiomic phenotype (C-score = 0.69, 95% CI = (0.62, 0.77)) significantly improved (p<0.005) upon the baseline model (C-score = 0.65, CI = (0.57, 0.73)). Our results suggest that harmonized radiomic phenotypes can significantly improve OS prediction in stage III NSCLC after chemoradiation.

Making Radiomics More Reproducible across Scanner and Imaging Protocol Variations: A Review of Harmonization Methods

Radiomics converts medical images into mineable data via a high-throughput extraction of quantitative features used for clinical decision support. However, these radiomic features are susceptible to variation across scanners, acquisition protocols, and reconstruction settings. Various investigations have assessed the reproducibility and validation of radiomic features across these discrepancies. In this narrative review, we combine systematic keyword searches with prior domain knowledge to discuss various harmonization solutions to make the radiomic features more reproducible across various scanners and protocol settings. Different harmonization solutions are discussed and divided into two main categories: image domain and feature domain. The image domain category comprises methods such as the standardization of image acquisition, post-processing of raw sensor-level image data, data augmentation techniques, and style transfer. The feature domain category consists of methods such as the identification of reproducible features and normalization techniques such as statistical normalization, intensity harmonization, ComBat and its derivatives, and normalization using deep learning. We also reflect upon the importance of deep learning solutions for addressing variability across multi-centric radiomic studies especially using generative adversarial networks (GANs), neural style transfer (NST) techniques, or a combination of both. We cover a broader range of methods especially GANs and NST methods in more detail than previous reviews.

A review in radiomics: Making personalized medicine a reality via routine imaging

Radiomics is the quantitative analysis of standard-of-care medical imaging; the information obtained can be applied within clinical decision support systems to create diagnostic, prognostic, and/or predictive models. Radiomics analysis can be performed by extracting hand-crafted radiomics features or via deep learning algorithms. Radiomics has evolved tremendously in the last decade, becoming a bridge between imaging and precision medicine. Radiomics exploits sophisticated image analysis tools coupled with statistical elaboration to extract the wealth of information hidden inside medical images, such as computed tomography (CT), magnetic resonance (MR), and/or Positron emission tomography (PET) scans, routinely performed in the everyday clinical practice. Many efforts have been devoted in recent years to the standardization and validation of radiomics approaches, to demonstrate their usefulness and robustness beyond any reasonable doubts. However, the booming of publications and commercial applications of radiomics approaches warrant caution and proper understanding of all the factors involved to avoid "scientific pollution" and overly enthusiastic claims by researchers and clinicians alike. For these reasons the present review aims to be a guidebook of sorts, describing the process of radiomics, its pitfalls, challenges, and opportunities, along with its ability to improve clinical decision-making, from oncology and respiratory medicine to pharmacological and genotyping studies.

The Challenge of Choosing the Best Classification Method in Radiomic Analyses: Recommendations and Applications to Lung Cancer CT Images

Radiomics uses high-dimensional sets of imaging features to predict biological characteristics of tumors and clinical outcomes. The choice of the algorithm used to analyze radiomic features and perform predictions has a high impact on the results, thus the identification of adequate machine learning methods for radiomic applications is crucial. In this study we aim to identify suitable approaches of analysis for radiomic-based binary predictions, according to sample size, outcome balancing and the features-outcome association strength. Simulated data were obtained reproducing the correlation structure among 168 radiomic features extracted from Computed Tomography images of 270 Non-Small-Cell Lung Cancer (NSCLC) patients and the associated to lymph node status. Performances of six classifiers combined with six feature selection (FS) methods were assessed on the simulated data using AUC (Area Under the Receiver Operating Characteristics Curves), sensitivity, and specificity. For all the FS methods and regardless of the association strength, the tree-based classifiers Random Forest and Extreme Gradient Boosting obtained good performances (AUC ≥ 0.73), showing the best trade-off between sensitivity and specificity. On small samples, performances were generally lower than in large-medium samples and with larger variations. FS methods generally did not improve performances. Thus, in radiomic studies, we suggest evaluating the choice of FS and classifiers, considering specific sample size, balancing, and association strength.

CT and MRI radiomics of bone and soft-tissue sarcomas: a systematic review of reproducibility and validation strategies

Background

Feature reproducibility and model validation are two main challenges of radiomics. This study aims to systematically review radiomic feature reproducibility and predictive model validation strategies in studies dealing with CT and MRI radiomics of bone and soft-tissue sarcomas. The ultimate goal is to promote achieving a consensus on these aspects in radiomic workflows and facilitate clinical transferability.

Results

Out of 278 identified papers, forty-nine papers published between 2008 and 2020 were included. They dealt with radiomics of bone (n = 12) or soft-tissue (n = 37) tumors. Eighteen (37%) studies included a feature reproducibility analysis. Inter-/intra-reader segmentation variability was the theme of reproducibility analysis in 16 (33%) investigations, outnumbering the analyses focused on image acquisition or post-processing (n = 2, 4%). The intraclass correlation coefficient was the most commonly used statistical method to assess reproducibility, which ranged from 0.6 and 0.9. At least one machine learning validation technique was used for model development in 25 (51%) papers, and K-fold cross-validation was the most commonly employed. A clinical validation of the model was reported in 19 (39%) papers. It was performed using a separate dataset from the primary institution (i.e., internal validation) in 14 (29%) studies and an independent dataset related to different scanners or from another institution (i.e., independent validation) in 5 (10%) studies.

Conclusions

The issues of radiomic feature reproducibility and model validation varied largely among the studies dealing with musculoskeletal sarcomas and should be addressed in future investigations to bring the field of radiomics from a preclinical research area to the clinical stage.

Radiomics in Oncology, Part 1: Technical Principles and Gastrointestinal Application in CT and MRI

Simple Summary

Part I is an overview aimed to investigate some technical principles and the main fields of radiomic application in gastrointestinal oncologic imaging (CT and MRI) with a focus on diagnosis, prediction prognosis, and assessment of response to therapy in gastrointestinal cancers, describing mostly the results for each pre-eminent tumor. In particular, this paper provides a general description of the main radiomic drawbacks and future challenges, which limit radiomic application in clinical setting as routine. Further investigations need to standardize and validate the Radiomics as a helpful tool in management of oncologic patients. In that context, Radiomics has been playing a relevant role and could be considered as a future imaging landscape.

Abstract

Radiomics has been playing a pivotal role in oncological translational imaging, particularly in cancer diagnosis, prediction prognosis, and therapy response assessment. Recently, promising results were achieved in management of cancer patients by extracting mineable high-dimensional data from medical images, supporting clinicians in decision-making process in the new era of target therapy and personalized medicine. Radiomics could provide quantitative data, extracted from medical images, that could reflect microenvironmental tumor heterogeneity, which might be a useful information for treatment tailoring. Thus, it could be helpful to overcome the main limitations of traditional tumor biopsy, often affected by bias in tumor sampling, lack of repeatability and possible procedure complications. This quantitative approach has been widely investigated as a non-invasive and an objective imaging biomarker in cancer patients; however, it is not applied as a clinical routine due to several limitations related to lack of standardization and validation of images acquisition protocols, features segmentation, extraction, processing, and data analysis. This field is in continuous evolution in each type of cancer, and results support the idea that in the future Radiomics might be a reliable application in oncologic imaging. The first part of this review aimed to describe some radiomic technical principles and clinical applications to gastrointestinal oncologic imaging (CT and MRI) with a focus on diagnosis, prediction prognosis, and assessment of response to therapy.

Treatment response prediction using MRI-based pre-, post-, and delta-radiomic features and machine learning algorithms in colorectal cancer

OBJECTIVES

We evaluate the feasibility of treatment response prediction using MRI-based pre-, post-, and delta-radiomic features for locally advanced rectal cancer (LARC) patients treated by neoadjuvant chemoradiation therapy (nCRT).

MATERIALS AND METHODS

This retrospective study included 53 LARC patients divided into a training set (Center#1, n = 36) and external validation set (Center#2, n = 17). T2-weighted (T2W) MRI was acquired for all patients, 2 weeks before and 4 weeks after nCRT. Ninety-six radiomic features, including intensity, morphological and second- and high-order texture features were extracted from segmented 3D volumes from T2W MRI. All features were harmonized using ComBat algorithm. Max-Relevance-Min-Redundancy (MRMR) algorithm was used as feature selector and k-nearest neighbors (KNN), Naïve Bayes (NB), Random forests (RF), and eXtreme Gradient Boosting (XGB) algorithms were used as classifiers. The evaluation was performed using the area under the receiver operator characteristic (ROC) curve (AUC), sensitivity, specificity and accuracy.

RESULTS

In univariate analysis, the highest AUC in pre-, post-, and delta-radiomic features were 0.78, 0.70, and 0.71, for GLCM_IMC1, shape (surface area and volume) and GLSZM_GLNU features, respectively. In multivariate analysis, RF and KNN achieved the highest AUC (0.85 ± 0.04 and 0.81 ± 0.14, respectively) among pre- and post-treatment features. The highest AUC was achieved for the delta-radiomic-based RF model (0.96 ± 0.01) followed by NB (0.96 ± 0.04). Overall. Delta-radiomics model, outperformed both pre- and post-treatment features (P-value <0.05).

CONCLUSION

Multivariate analysis of delta-radiomic T2W MRI features using machine learning algorithms could potentially be used for response prediction in LARC patients undergoing nCRT. We also observed that multivariate analysis of delta-radiomic features using RF classifiers can be used as powerful biomarkers for response prediction in LARC.

Radiomics and Magnetic Resonance Imaging of Rectal Cancer: From Engineering to Clinical Practice

While cross-sectional imaging has seen continuous progress and plays an undiscussed pivotal role in the diagnostic management and treatment planning of patients with rectal cancer, a largely unmet need remains for improved staging accuracy, assessment of treatment response and prediction of individual patient outcome. Moreover, the increasing availability of target therapies has called for developing reliable diagnostic tools for identifying potential responders and optimizing overall treatment strategy on a personalized basis. Radiomics has emerged as a promising, still fully evolving research topic, which could harness the power of modern computer technology to generate quantitative information from imaging datasets based on advanced data-driven biomathematical models, potentially providing an added value to conventional imaging for improved patient management. The present study aimed to illustrate the contribution that current radiomics methods applied to magnetic resonance imaging can offer to managing patients with rectal cancer.

Role of Machine Learning and Artificial Intelligence in Interventional Oncology

PURPOSE OF REVIEW

The purpose of this review is to highlight the current role of machine learning and artificial intelligence and in the field of interventional oncology.

RECENT FINDINGS

With advancements in technology, there is a significant amount of research regarding the application of artificial intelligence and machine learning in medicine. Interventional oncology is a field that can benefit greatly from this research through enhanced image analysis and intraprocedural guidance. These software developments can increase detection of cancers through routine screening and improve diagnostic accuracy in classifying tumors. They may also aid in selecting the most effective treatment for the patient by predicting outcomes based on a combination of both clinical and radiologic factors. Furthermore, machine learning and artificial intelligence can advance intraprocedural guidance for the interventional oncologist through more accurate needle tracking and image fusion technology. This minimizes damage to nearby healthy tissue and maximizes treatment of the tumor. While there are several exciting developments, this review also discusses limitations before incorporating machine learning and artificial intelligence in the field of interventional oncology. These include data capture and processing, lack of transparency among developers, validating models, integrating workflow, and ethical challenged. In summary, machine learning and artificial intelligence have the potential to positively impact interventional oncologists and how they provide cancer care treatments.

Assessment of Repeatability, Reproducibility, and Performances of T2 Mapping-Based Radiomics Features: A Comparative Study

BACKGROUND

Magnetic resonance imaging (MRI)-based radiomics features (RFs) quantify tumors radiological phenotypes but are sensitive to postprocessing parameters, including the intensity harmonization technique (IHT), while mappings enable objective quantitative assessment.

PURPOSE

To investigate whether T2 mapping could improve repeatability, reproducibility, and performances of radiomics compared to conventional T2-weighted imaging (T2WI).

STUDY TYPE

Prospective.

SUBJECTS

Twenty-six healthy adults.

FIELD STRENGTH/SEQUENCE

Respiratory-trigged radial turbo spin echo (TSE) multiecho T2 mapping (prototype) and conventional TSE T2WI of the abdomen were acquired twice at 1.5 T.

ASSESSMENT

T2 maps were reconstructed using a two-parameter exponential fitting model. Volumes-of-interest (VOIs) were manually drawn in six tissues: liver, kidney, pancreas, muscle, bone, and spleen. After co-registration, conventional T2WIs were processed with two IHTs (standardization [std] and histogram-matching [HM]) resulting in four paired input image types: initial T2WI, T2WI_std , T2WI_HM , and T2-map. VOIs were propagated to extract 45 RFs from MRI-1 and MRI-2 of each image type (LIFEx, v5.10).

STATISTICAL TESTS

Influence of the input data type on RF values was evaluated with analysis of variance. RFs test-retest repeatability and reproducibility over multiple segmentations were evaluated with intra-class correlation coefficient (ICC). Correlations between k-means clusters and the six tissues depending on the RFs dataset were investigated with adjusted-Rand-index (ARI).

RESULTS

About 41 of 45 (91.1%) RFs were significantly influenced by the input image type (P values < 0.05), which was the most influential factor on repeatability of RFs (P-value < 0.05). Repeatability ICCs from T2-map displayed intermediate values between the initial T2WI (range: 0.407-0.736) and the T2WI_HM (range: 0.724-0.817). The number of RFs with interobserver and intraobserver reproducibility ICCs ≥ 0.90 was 37/45 (82.2%) for T2WI_HM , 33/45 (73.3%) for T2WI_std , 31/45 (68.9%) for T2 map, and 25/45 (55.6%) for the initial T2WI. T2 map provided the best tissue discrimination (ARI = 0.414 vs. 0.157 with T2WI_HM ).

DATA CONCLUSION

T2 mapping provided RFs with moderate to substantial repeatability and reproducibility ICCs, along with the most preserved discriminative information.

LEVEL OF EVIDENCE

1 TECHNICAL EFFICACY: 1.