Influence of feature calculating parameters on the reproducibility of CT radiomic features: a thoracic phantom study

Pretherapy investigations using highly robust visualized biomarkers from CT imaging by multiple machine-learning techniques toward its prognosis prediction for ALK-inhibitor therapy in NSCLC: a feasibility study

PURPOSE

Molecularly targeted therapy has revolutionized the therapeutic landscape and is emerging as the first-line treatment option for ALK-rearranged non-small-cell lung cancer (NSCLC). In this study, the highly informative and robust biomarkers based on pre-treatment CT images and clinicopathologic features will be developed and validated to predict the prognosis for ALK-inhibitor therapy in NSCLC patients.

METHODS

A total of 161 ALK-positive NSCLC patients treated with ALK inhibitors were retrospectively collected as training, validation and test sets from multi-center institutions. Cox proportional hazard regression (CPH) penalized by LASSO and random survival forest (RSF) coupled with recursive feature elimination (RFE) were used for radiomics and clinical features identification and model construction. An overlapping post-processing method was extra added to training process to investigate the stronger biomarker on the whole set.

RESULTS

123 of the collected cases progressed after a median follow-up of 15.5 months (IQR, 8.3-25.3). The T and M staging, pericardial effusion, age and ALK inhibitor-alectinib were determined as significant predictors in the survival analysis. Furthermore, we visualized the finally retained 4 radiomics feature. The RSF models built from overlapping-processed clinical and radiomics features respectively reached the maximum C-index of 0.68 and 0.75,but the combination of them,radioclinical signature, improved the score to 0.78. The model on the validation and external test datasets yielded the C-index of 0.73 and 0.79, with the iAUC of 0.76 and 0.83, the IBS of 0.119 and 0.112.

CONCLUSION

With respect to a simple selection strategy of overlapping optimal radiomics and clinical features from different survival models may promote better progression-free survival(PFS) prediction than conventional survival analysis, which provides a potential method for guiding personalized pre-treatment options of NSCLC.

An ordinal radiomic model to predict the differentiation grade of invasive non-mucinous pulmonary adenocarcinoma based on low-dose computed tomography in lung cancer screening

OBJECTIVES

To construct a radiomic model of low-dose CT (LDCT) to predict the differentiation grade of invasive non-mucinous pulmonary adenocarcinoma (IPA) and compare its diagnostic performance with quantitative-semantic model and radiologists.

METHODS

A total of 682 pulmonary nodules were divided into the primary cohort (181 grade 1; 254 grade 2; 64 grade 3) and validation cohort (69 grade 1; 99 grade 2; 15 grade 3) according to scanners. The radiomic and quantitative-semantic models were built using ordinal logistic regression. The diagnostic performance of the models and radiologists was assessed by the area under the curve (AUC) of the receiver operating characteristic curve and accuracy.

RESULTS

The radiomic model demonstrated excellent diagnostic performance in the validation cohort (AUC, 0.900 (95%CI: 0.847-0.939) for Grade 1 vs. Grade 2/Grade 3; AUC, 0.929 (95%CI: 0.882-0.962) for Grade 1/Grade 2 vs. Grade 3; accuracy, 0.803 (95%CI: 0.737-0.857)). No significant difference in diagnostic performance was found between the radiomic model and radiological expert (AUC, 0.840 (95%CI: 0.779-0.890) for Grade 1 vs. Grade 2/Grade 3, p = 0.130; AUC, 0.852 (95%CI: 0.793-0.900) for Grade 1/Grade 2 vs. Grade 3, p = 0.170; accuracy, 0.743 (95%CI: 0.673-0.804), p = 0.079), but the radiomic model outperformed the quantitative-semantic model and inexperienced radiologists (all p < 0.05).

CONCLUSIONS

The radiomic model of LDCT can be used to predict the differentiation grade of IPA in lung cancer screening, and its diagnostic performance is comparable to that of radiological expert.

KEY POINTS

• Early identifying the novel differentiation grade of invasive non-mucinous pulmonary adenocarcinoma may provide guidance for further surveillance, surgical strategy, or more adjuvant treatment. • The diagnostic performance of the radiomic model is comparable to that of a radiological expert and superior to that of the quantitative-semantic model and inexperienced radiologists. • The radiomic model of low-dose CT can be used to predict the differentiation grade of invasive non-mucinous pulmonary adenocarcinoma in lung cancer screening.

Radiomics in clinical trials: perspectives on standardization

The term biomarker is used to describe a biological measure of the disease behavior. The existing imaging biomarkers are associated with the known tissue biological characteristics and follow a well-established roadmap to be implemented in routine clinical practice. Recently, a new quantitative imaging analysis approach named radiomics has emerged. It refers to the extraction of a large number of advanced imaging features with high-throughput computing. Extensive research has demonstrated its value in predicting disease behavior, progression, and response to therapeutic options. However, there are numerous challenges to establishing it as a clinically viable solution, including lack of reproducibility and transparency. The data-driven nature also does not offer insights into the underpinning biology of the observed relationships. As such, additional effort is needed to establish it as a qualified biomarker to inform clinical decisions. Here we review the technical difficulties encountered in the clinical applications of radiomics and current effort in addressing some of these challenges in clinical trial designs. By addressing these challenges, the true potential of radiomics can be unleashed.

Reproducibility assessment of radiomics features in various ultrasound scan settings and different scanner vendors

INTRODUCTION

Radiomics in Ultrasound (US) imaging has been investigated for the prediction and prognosis of cancers. However, inter-scanner and intra-scanner variations may affect the reproducibility of radiomics results. This study aims to evaluate the reproducibility of US textural radiomics features across various scan settings and scanner vendors.

MATERIALS AND METHODS

US images in quality control (QC) phantom were obtained by three scanners (Philips, Samsung, and Siemens) with different scan settings and parameters. Circular regions of interest (ROIs) inside isoechoic, hypoechoic, and hyperechoic objects were manually delineated. Forty textural radiomics features were extracted from each ROI, and then the robust features that could distinguish different echogenic objects were obtained by the Mann-Whitney U test. Reproducibility of the robust radiomics features was assessed by the intraclass correlation coefficient (ICC) and coefficient of variation (CV); ICC>0.90 and %CV<20 were considered reproducible.

RESULTS

According to the Mann-Whitney U test results, ten robust features could differentiate the hypoechoic, and 15 robust features could differentiate the hyperechoic objects from the isoechoic objects (P<0.001). The total ICC of the robust features for each echogenic object was >0.95 in different scanners and scan settings. Four and seven features were individually reproducible (%CV < 20, ICC>0.90) in hypoechoic and hyperechoic objects, respectively. Also, four features seem reproducible by changing the ROI location across the horizontal and vertical lines for both convex and linear array transducers.

CONCLUSIONS

Most of the US textural radiomics features in this study were not reproducible. However, several features showed high reproducibility at different scan settings and scanners. These features may also be reproducible when ROI size and location change slightly.

A tri-modal tissue-equivalent anthropomorphic phantom for PET, CT and multi-parametric MRI radiomics

PURPOSE

Radiomics has emerged as an advanced image processing methodology to define quantitative imaging biomarkers for prognosis and prediction of treatment response and outcome. The development of quantitative imaging biomarkers requires careful analysis to define their accuracy, stability and reproducibility through phantom measurements. Few efforts were devoted to develop realistic anthropomorphic phantoms. In this work, we developed a multimodality image phantom suitable for PET, CT and multiparametric MRI imaging.

METHODS

A tissue-equivalent gel-based mixture was designed and tested for compatibility with different imaging modalities. Calibration measurements allowed to assess gel composition to simulate PET, CT and MRI contrasts of oncological lesions. The characterized gel mixture was used to create realistic synthetic lesions (e.g. lesions with irregular shape and non-uniform image contrast), to be inserted in a standard anthropomorphic phantom. In order to show phantom usefulness, issues related to accuracy, stability and reproducibility of radiomic biomarkers were addressed as proofs-of-concept.

RESULTS

The procedure for gel preparation was straightforward and the characterized gel mixture allowed to mime simultaneously oncological lesion contrast in CT, PET and MRI imaging. Proofs-of-concept studies suggested that phantom measurements can be customized for specific clinical situations and radiomic protocols.

CONCLUSIONS

We developed a strategy to manufacture an anthropomorphic, tissue-equivalent, multimodal phantom to be customized on specific radiomics protocols, for addressing specific methodological issues both in mono and multicentric studies.

Deep Learning With Radiomics for Disease Diagnosis and Treatment: Challenges and Potential

The high-throughput extraction of quantitative imaging features from medical images for the purpose of radiomic analysis, i.e., radiomics in a broad sense, is a rapidly developing and emerging research field that has been attracting increasing interest, particularly in multimodality and multi-omics studies. In this context, the quantitative analysis of multidimensional data plays an essential role in assessing the spatio-temporal characteristics of different tissues and organs and their microenvironment. Herein, recent developments in this method, including manually defined features, data acquisition and preprocessing, lesion segmentation, feature extraction, feature selection and dimension reduction, statistical analysis, and model construction, are reviewed. In addition, deep learning-based techniques for automatic segmentation and radiomic analysis are being analyzed to address limitations such as rigorous workflow, manual/semi-automatic lesion annotation, and inadequate feature criteria, and multicenter validation. Furthermore, a summary of the current state-of-the-art applications of this technology in disease diagnosis, treatment response, and prognosis prediction from the perspective of radiology images, multimodality images, histopathology images, and three-dimensional dose distribution data, particularly in oncology, is presented. The potential and value of radiomics in diagnostic and therapeutic strategies are also further analyzed, and for the first time, the advances and challenges associated with dosiomics in radiotherapy are summarized, highlighting the latest progress in radiomics. Finally, a robust framework for radiomic analysis is presented and challenges and recommendations for future development are discussed, including but not limited to the factors that affect model stability (medical big data and multitype data and expert knowledge in medical), limitations of data-driven processes (reproducibility and interpretability of studies, different treatment alternatives for various institutions, and prospective researches and clinical trials), and thoughts on future directions (the capability to achieve clinical applications and open platform for radiomics analysis).

Radiomics feature reliability assessed by intraclass correlation coefficient: a systematic review

Radiomics research is rapidly growing in recent years, but more concerns on radiomics reliability are also raised. This review attempts to update and overview the current status of radiomics reliability research in the ever expanding medical literature from the perspective of a single reliability metric of intraclass correlation coefficient (ICC). To conduct this systematic review, Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed. After literature search and selection, a total of 481 radiomics studies using CT, PET, or MRI, covering a wide range of subject and disease types, were included for review. In these highly heterogeneous studies, feature reliability to image segmentation was much more investigated than reliability to other factors, such as image acquisition, reconstruction, post-processing, and feature quantification. The reported ICCs also suggested high radiomics feature reliability to image segmentation. Image acquisition was found to introduce much more feature variability than image segmentation, in particular for MRI, based on the reported ICC values. Image post-processing and feature quantification yielded different levels of radiomics reliability and might be used to mitigate image acquisition-induced variability. Some common flaws and pitfalls in ICC use were identified, and suggestions on better ICC use were given. Due to the extremely high study heterogeneities and possible risks of bias, the degree of radiomics feature reliability that has been achieved could not yet be safely synthesized or derived in this review. More future researches on radiomics reliability are warranted.

Quantitative assessment of acquisition imaging parameters on MRI radiomics features: a prospective anthropomorphic phantom study using a 3D-T2W-TSE sequence for MR-guided-radiotherapy

Background

MRI pulse sequences and imaging parameters substantially influence the variation of MRI radiomics features, thus impose a critical challenge on MRI radiomics reproducibility and reliability. This study aims to prospectively investigate the impact of various imaging parameters on MRI radiomics features in a 3D T2-weighted (T2W) turbo-spin-echo (TSE) pulse sequence for MR-guided-radiotherapy (MRgRT).

Methods

An anthropomorphic phantom was scanned using a 3D-T2W-TSE MRgRT sequence at 1.5T under a variety of acquisition imaging parameter changes. T1 and T2 relaxation times of the phantom were also measured. 93 first-order and texture radiomics features in the original and 14 transformed images, yielding 1,395 features in total, were extracted from 10 volumes-of-interest (VOIs). The percentage deviation (d%) of radiomics feature values from the baseline values and intra-class correlation coefficient (ICC) with the baseline were calculated. Robust radiomics features were identified based on the excellent agreement of radiomics feature values with the baseline, i.e., the averaged d% <5% and ICC >0.90 in all VOIs for all imaging parameter variations.

Results

The radiomics feature values changed considerably but to different degrees with different imaging parameter adjustments, in the ten VOIs. The deviation d% ranged from 0.02% to 321.3%, with a mean of 12.5% averaged for all original features in all ten VOIs. First-order and GLCM features were generally more robust to imaging parameters than other features in the original images. There were also significantly different radiomics feature values (ANOVA, P<0.001) between the original and the transformed images, exhibiting quite different robustness to imaging parameters. 330 out of 1395 features (23.7%) robust to imaging parameters were identified. GLCM and GLSZM features had the most (42.5%, 153/360) and least (3.8%, 9/240) robust features in the original and transformed images, respectively.

Conclusions

This study helps better understand the quantitative dependence of radiomics feature values on imaging parameters in a 3D-T2W-TSE sequence for MRgRT. Imaging parameter heterogeneity should be considered as a significant source of radiomics variability and uncertainty, which must be well harmonized for reliable clinical use. The identified robust features to imaging parameters are helpful for the pre-selection of radiomics features for reliable radiomics modeling.

Prediction of neoadjuvant chemotherapy response in high-grade osteosarcoma: added value of non-tumorous bone radiomics using CT images

Background

This study aimed to determine the impact of including radiomics analysis of non-tumorous bone region of interest in improving the performance of pathological response prediction to chemotherapy in high-grade osteosarcomas (HOS), compared to radiomics analysis of tumor region alone.

Methods

This retrospective study included 157 patients diagnosed with HOS between November 2013 and November 2017 (age range, 5-44 years; mean age, 16.99 ±7.42 years), in which 69 and 88 patients were diagnosed as pathological good response (pGR) and non-pGR, respectively. Radiomics features were extracted from tumor and non-tumorous bone regions based on diagnostic CT images. Pathological response classifiers were developed and validated via leave-one-out cross validation (LOOCV) and independent validation methods by using the area under the receiver operating characteristic curve (AUC) value as the figure of merit.

Results

Using the LOOCV, the classifiers combining features from tumor and non-tumorous regions showed better prediction performance than those from tumor region alone (AUC, 0.8207±0.0043 vs. 0.7799±0.0044). The combined classifier also showed better performance than the tumor feature-based classifier in both training and validation datasets [training dataset: 0.791, 95% confidence interval (CI), 0.706-0.860 vs. 0.766, 95% CI, 0.679-0.840; validation dataset: 0.816, 95% CI, 0.662-0.920 vs. 0.766, 95% CI, 0.606-0.885].

Conclusions

Radiomics analysis of combined tumor and non-tumorous bone features showed improved performance of pathological response prediction to chemotherapy in HOS compared to that of tumor features alone. Moreover, the proposed classifier had the potential to predict pathological response to chemotherapy for HOS patients.