Effects of variability in radiomics software packages on classifying patients with radiation pneumonitis

Automated machine learning for the identification of asymptomatic COVID-19 carriers based on chest CT images

BACKGROUND

Asymptomatic COVID-19 carriers with normal chest computed tomography (CT) scans have perpetuated the ongoing pandemic of this disease. This retrospective study aimed to use automated machine learning (AutoML) to develop a prediction model based on CT characteristics for the identification of asymptomatic carriers.

METHODS

Asymptomatic carriers were from Yangzhou Third People's Hospital from August 1st, 2020, to March 31st, 2021, and the control group included a healthy population from a nonepizootic area with two negative RT‒PCR results within 48 h. All CT images were preprocessed using MATLAB. Model development and validation were conducted in R with the H2O package. The models were built based on six algorithms, e.g., random forest and deep neural network (DNN), and a training set (n = 691). The models were improved by automatically adjusting hyperparameters for an internal validation set (n = 306). The performance of the obtained models was evaluated based on a dataset from Suzhou (n = 178) using the area under the curve (AUC), accuracy, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) and F1 score.

RESULTS

A total of 1,175 images were preprocessed with high stability. Six models were developed, and the performance of the DNN model ranked first, with an AUC value of 0.898 for the test set. The sensitivity, specificity, PPV, NPV, F1 score and accuracy of the DNN model were 0.820, 0.854, 0.849, 0.826, 0.834 and 0.837, respectively. A plot of a local interpretable model-agnostic explanation demonstrated how different variables worked in identifying asymptomatic carriers.

CONCLUSIONS

Our study demonstrates that AutoML models based on CT images can be used to identify asymptomatic carriers. The most promising model for clinical implementation is the DNN-algorithm-based model.

Development of a prediction model for head and neck volume reduction by clinical factors, dose-volume histogram parameters and radiomics in head and neck cancer†

In external radiotherapy of head and neck (HN) cancers, the reduction of irradiation accuracy due to HN volume reduction often causes a problem. Adaptive radiotherapy (ART) can effectively solve this problem; however, its application to all cases is impractical because of cost and time. Therefore, finding priority cases is essential. This study aimed to predict patients with HN cancers are more likely to need ART based on a quantitative measure of large HN volume reduction and evaluate model accuracy. The study included 172 cases of patients with HN cancer who received external irradiation. The HN volume was calculated using cone-beam computed tomography (CT) for irradiation-guided radiotherapy for all treatment fractions and classified into two groups: cases with a large reduction in the HN volume and cases without a large reduction. Radiomic features were extracted from the primary gross tumor volume (GTV) and nodal GTV of the planning CT. To develop the prediction model, four feature selection methods and two machine-learning algorithms were tested. Predictive performance was evaluated by the area under the curve (AUC), accuracy, sensitivity and specificity. Predictive performance was the highest for the random forest, with an AUC of 0.662. Furthermore, its accuracy, sensitivity and specificity were 0.692, 0.700 and 0.813, respectively. Selected features included radiomic features of the primary GTV, human papillomavirus in oropharyngeal cancer and the implementation of chemotherapy; thus, these features might be related to HN volume change. Our model suggested the potential to predict ART requirements based on HN volume reduction .

The Promise and Future of Radiomics for Personalized Radiotherapy Dosing and Adaptation

Quantitative image analysis, also known as radiomics, aims to analyze large-scale quantitative features extracted from acquired medical images using hand-crafted or machine-engineered feature extraction approaches. Radiomics has great potential for a variety of clinical applications in radiation oncology, an image-rich treatment modality that utilizes computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET) for treatment planning, dose calculation, and image guidance. A promising application of radiomics is in predicting treatment outcomes after radiotherapy such as local control and treatment-related toxicity using features extracted from pretreatment and on-treatment images. Based on these individualized predictions of treatment outcomes, radiotherapy dose can be sculpted to meet the specific needs and preferences of each patient. Radiomics can aid in tumor characterization for personalized targeting, especially for identifying high-risk regions within a tumor that cannot be easily discerned based on size or intensity alone. Radiomics-based treatment response prediction can aid in developing personalized fractionation and dose adjustments. In order to make radiomics models more applicable across different institutions with varying scanners and patient populations, further efforts are needed to harmonize and standardize the acquisition protocols by minimizing uncertainties within the imaging data.

Role of radiomics in the diagnosis and treatment of gastrointestinal cancer

Gastrointestinal cancer (GIC) has high morbidity and mortality as one of the main causes of cancer death. Preoperative risk stratification is critical to guide patient management, but traditional imaging studies have difficulty predicting its biological behavior. The emerging field of radiomics allows the conversion of potential pathophysiological information in existing medical images that cannot be visually recognized into high-dimensional quantitative image features. Tumor lesion characterization, therapeutic response evaluation, and survival prediction can be achieved by analyzing the relationships between these features and clinical and genetic data. In recent years, the clinical application of radiomics to GIC has increased dramatically. In this editorial, we describe the latest progress in the application of radiomics to GIC and discuss the value of its potential clinical applications, as well as its limitations and future directions.

Harmonization Strategies in Multicenter MRI-Based Radiomics

Radiomics analysis is a powerful tool aiming to provide diagnostic and prognostic patient information directly from images that are decoded into handcrafted features, comprising descriptors of shape, size and textural patterns. Although radiomics is gaining momentum since it holds great promise for accelerating digital diagnostics, it is susceptible to bias and variation due to numerous inter-patient factors (e.g., patient age and gender) as well as inter-scanner ones (different protocol acquisition depending on the scanner center). A variety of image and feature based harmonization methods has been developed to compensate for these effects; however, to the best of our knowledge, none of these techniques has been established as the most effective in the analysis pipeline so far. To this end, this review provides an overview of the challenges in optimizing radiomics analysis, and a concise summary of the most relevant harmonization techniques, aiming to provide a thorough guide to the radiomics harmonization process.

A deep look into radiomics

Radiomics is a process that allows the extraction and analysis of quantitative data from medical images. It is an evolving field of research with many potential applications in medical imaging. The purpose of this review is to offer a deep look into radiomics, from the basis, deeply discussed from a technical point of view, through the main applications, to the challenges that have to be addressed to translate this process in clinical practice. A detailed description of the main techniques used in the various steps of radiomics workflow, which includes image acquisition, reconstruction, pre-processing, segmentation, features extraction and analysis, is here proposed, as well as an overview of the main promising results achieved in various applications, focusing on the limitations and possible solutions for clinical implementation. Only an in-depth and comprehensive description of current methods and applications can suggest the potential power of radiomics in fostering precision medicine and thus the care of patients, especially in cancer detection, diagnosis, prognosis and treatment evaluation.

A Multicentre Evaluation of Dosiomics Features Reproducibility, Stability and Sensitivity

Simple Summary

Dosiomics is born directly as an extension of radiomics: it entails extracting features from the patients’ three-dimensional (3D) radiotherapy dose distribution rather than from conventional medical images to obtain specific spatial and statistical information. Dosiomic studies, in a multicentre setting, require assessing the features’ stability to dose calculation settings and the features’ capability in distinguishing different dose distributions. This study provides the first multicentre evaluation of the dosiomic features in terms of reproducibility, stability and sensitivity across various dose distributions obtained from multiple technologies and techniques and considering different dose calculation algorithms of TPS and two different resolutions of the dose grid. Harmonisation strategies to account for a possible variation in the dose distribution due to these confounding factors should be adopted when investigating a correlation between dosiomic features and clinical outcomes in multicentre studies.

Abstract

Dosiomics is a texture analysis method to produce dose features that encode the spatial 3D distribution of radiotherapy dose. Dosiomic studies, in a multicentre setting, require assessing the features’ stability to dose calculation settings and the features’ capability in distinguishing different dose distributions. Dose distributions were generated by eight Italian centres on a shared image dataset acquired on a dedicated phantom. Treatment planning protocols, in terms of planning target volume coverage and dose–volume constraints to the organs at risk, were shared among the centres to produce comparable dose distributions for measuring reproducibility/stability and sensitivity of dosiomic features. In addition, coefficient of variation (CV) was employed to evaluate the dosiomic features’ variation. We extracted 38,160 features from 30 different dose distributions from six regions of interest, grouped by four features’ families. A selected group of features (CV < 3 for the reproducibility/stability studies, CV > 1 for the sensitivity studies) were identified to support future multicentre studies, assuring both stable features when dose distributions variation is minimal and sensitive features when dose distribution variations need to be clearly identified. Dosiomic is a promising tool that could support multicentre studies, especially for predictive models, and encode the spatial and statistical characteristics of the 3D dose distribution.

Comparison of three freeware software packages for 18F-FDG PET texture feature calculation

PURPOSE

To compare texture feature estimates obtained from ¹⁸F-FDG-PET images using three different software packages.

METHODS

PET images from 15 patients with head and neck cancer were processed with three different freeware software: CGITA, LIFEx, and Metavol. For each lesion, 38 texture features were extracted from each software package. To evaluate the statistical agreement among the features across packages a non-parametric Kruskal-Wallis test was used. Differences in the features between each couple of software were assessed using a subsequent Dunn test. Correlation between texture features was evaluated via the Spearman coefficient.

RESULTS

Twenty-three of 38 features showed a significant agreement across the three software (P < 0.05). The agreement was better between LIFEx vs. Metavol (36 of 38) and worse between CGITA and Metavol (24 of 38), and CGITA vs. LIFEx (23 of 38). All features resulted correlated (ρ >  = 0.70, P < 0.001) in comparing LIFEx vs. Metavol. Seven of 38 features were found not in agreement and slightly or not correlated (ρ < 0.70, P < 0.001) in comparing CGITA vs. LIFEx, and CGITA vs. Metavol.

CONCLUSION

Some texture discrepancies across software packages exist. Our findings reinforce the need to continue the standardization process, and to succeed in building a reference dataset to be used for comparisons.

Effect of an iterative reconstruction quantum noise reduction technique on computed tomography radiomic features

Purpose: The goal of this study was to quantify the effects of iterative reconstruction on radiomics features of normal anatomic structures on head and neck computed tomography (CT) scans. Methods: Regions of interest (ROI) containing five different tissue types and an ROI containing only air were extracted from CT scans of the head and neck from 108 patients. Each scan was reconstructed using three different iDose 4 reconstruction levels (2, 4, and 6) in addition to bone, thin slice (1-mm slice thickness), and thin-bone reconstructions. From each ROI in all reconstructions, 142 radiomic features were calculated. For each of the six ROIs, features were compared between combinations of iDose levels (2v4, 4v6, and 2v6) with a threshold of α = 0.05 after correcting for multiple comparisons ( p < 0.00006 ). Features from iDose 4 - 2 reconstructions were also compared to bone, thin slice, and thin-bone reconstructions. Spearman's rank correlation coefficient, ρ , quantified the relative feature value agreement across iDose 4 reconstructions. Results: When comparing radiomics features across the three iDose 4 reconstruction levels, over half of all features reflected significant differences for all tissue types, while no features demonstrated significant differences when extracted from air ROIs. When assessing feature value agreement, at least 97% of features reflected excellent agreement ( ρ > 0.9 ) when comparing the three iDose levels for all ROIs. When comparing iDose 4 - 2 to bone, thin slice, and thin-bone reconstructions, more than half of all features demonstrated significant differences for all ROIs and 89 % of features reflected excellent agreement for all ROIs. Conclusion: Many radiomics features are dependent on the iterative reconstruction level, and the magnitude of this dependency is affected by the tissue from which features are extracted. For studies using images reconstructed using varying iDose 4 reconstruction levels, features robust to these should be used.

The study of automatic machine learning base on radiomics of non-focus area in the first chest CT of different clinical types of COVID-19 pneumonia

To explore the possibility of predicting the clinical types of Corona-Virus-Disease-2019 (COVID-19) pneumonia by analyzing the non-focus area of the lung in the first chest CT image of patients with COVID-19 by using automatic machine learning (Auto-ML). 136 moderate and 83 severe patients were selected from the patients with COVID-19 pneumonia. The clinical and laboratory data were collected for statistical analysis. The texture features of the Non-focus area of the first chest CT of patients with COVID-19 pneumonia were extracted, and then the classification model of the first chest CT of COVID-19 pneumonia was constructed by using these texture features based on the Auto-ML method of radiomics, The area under curve(AUC), true positive rate(TPR), true negative rate (TNR), positive predictive value(PPV) and negative predictive value (NPV) of the operating characteristic curve (ROC) were used to evaluate the accuracy of the first chest CT image classification model in patients with COVID-19 pneumonia. The TPR, TNR, PPV, NPV and AUC of the training cohort and test cohort of the moderate group and the control group, the severe group and the control group, the moderate group and the severe group were all greater than 95% and 0.95 respectively. The non-focus area of the first CT image of COVID-19 pneumonia has obvious difference in different clinical types. The AUTO-ML classification model of Radiomics based on this difference can be used to predict the clinical types of COVID-19 pneumonia.

Harmonization of radiomic feature variability resulting from differences in CT image acquisition and reconstruction: assessment in a cadaveric liver

Studies investigating the effects of computed tomography (CT) image acquisition and reconstruction parameters have mostly been limited to non-human phantoms to limit exposure to patients. This study investigates these variations using a cadaveric liver and determines harmonization methods to mitigate these variations. A reference CT scan of a cadaveric liver was acquired along with 16 modified scans. Modified scans were obtained with altered image acquisition and reconstruction parameters. In each slice, the liver was segmented and used to calculate 142 features. Student's t-tests assessed differences between reference and modified scans for each feature after correcting for multiple comparisons. Features were harmonized between reference and modified scans using histogram normalization, pixel resampling, Butterworth filtering, resampling and filtering combined, and ComBat harmonization. The number of features reflecting significant differences before and after harmonization were compared across imaging parameters. Reducing the field-of-view (FOV) and using coronal instead of axial scans resulted in the greatest number of features reflecting significant differences (67.6%, and 35.9%, respectively) and resulted in the greatest median relative change in feature values (25.4% and 18.2%, respectively). Changes in tube voltage, pitch, and slice interval resulted in the smallest number of features reflecting significance (0.7%) with median relative changes in feature <2%. Histogram normalization reduced or maintained the number of significantly different features for all scans, while ComBat reduced the number of significantly different features to zero for all scans. The remaining harmonization methods had mixed effects: resampling reduced the number of features reflecting significant differences for half of the imaging parameters, while filtering alone and filtering combined with resampling both reduced the number of features reflecting significance for 10 of the 16 parameters. The dependence of radiomic features on image acquisition and reconstruction parameters varies in a cadaveric liver; however, various harmonization methods have shown promise in mitigating these dependencies, particularly ComBat.

Radiomics as a personalized medicine tool in lung cancer: Separating the hope from the hype

Radiomics has become a popular image analysis method in the last few years. Its key hypothesis is that medical images harbor biological, prognostic and predictive information that is not revealed upon visual inspection. In contrast to previous work with a priori defined imaging biomarkers, radiomics instead calculates image features at scale and uses statistical methods to identify those most strongly associated to outcome. This builds on years of research into computer aided diagnosis and pattern recognition. While the potential of radiomics to aid personalized medicine is widely recognized, several technical limitations exist which hinder biomarker translation. Aspects of the radiomic workflow lack repeatability or reproducibility under particular circumstances, which is a key requirement for the translation of imaging biomarkers into clinical practice. One of the most commonly studied uses of radiomics is for personalized medicine applications in Non-Small Cell Lung Cancer (NSCLC). In this review, we summarize reported methodological limitations in CT based radiomic analyses together with suggested solutions. We then evaluate the current NSCLC radiomics literature to assess the risk associated with accepting the published conclusions with respect to these limitations. We review different complementary scoring systems and initiatives that can be used to critically appraise data from radiomics studies. Wider awareness should improve the quality of ongoing and future radiomics studies and advance their potential as clinically relevant biomarkers for personalized medicine in patients with NSCLC.