Deep learning reconstruction improves radiomics feature stability and discriminative power in abdominal CT imaging: a phantom study

A novel loss function to reproduce texture features for deep learning-based MRI-to-CT synthesis

BACKGROUND

Studies on computed tomography (CT) synthesis based on magnetic resonance imaging (MRI) have mainly focused on pixel-wise consistency, but the texture features of regions of interest (ROIs) have not received appropriate attention.

PURPOSE

This study aimed to propose a novel loss function to reproduce texture features of ROIs and pixel-wise consistency for deep learning-based MRI-to-CT synthesis. The method was expected to assist the multi-modality studies for radiomics.

METHODS

The study retrospectively enrolled 127 patients with nasopharyngeal carcinoma. CT and MRI images were collected for each patient, and then rigidly registered as pre-procession. We proposed a gray-level co-occurrence matrix (GLCM)-based loss function to improve the reproducibility of texture features. This novel loss function could be embedded into the present deep learning-based framework for image synthesis. In this study, a typical image synthesis model was selected as the baseline, which contained a Unet trained mean square error (MSE) loss function. We embedded the proposed loss function and designed experiments to supervise different ROIs to prove its effectiveness. The concordance correlation coefficient (CCC) of the GLCM feature was employed to evaluate the reproducibility of GLCM features, which are typical texture features. Besides, we used a publicly available dataset of brain tumors to verify our loss function.

RESULTS

Compared with the baseline, the proposed method improved the pixel-wise image quality metrics (MAE: 107.5 to 106.8 HU; SSIM: 0.9728 to 0.9730). CCC values of the GLCM features in GTVnx were significantly improved from 0.78 ± 0.12 to 0.82 ± 0.11 (p < 0.05 for paired t-test). Generally, > 90% (22/24) of the GLCM-based features were improved compared with the baseline, where the Informational Measure of Correlation feature was improved the most (CCC: 0.74 to 0.83). For the public dataset, the loss function also shows its effectiveness. With our proposed loss function added, the ability to reproduce texture features was improved in the ROIs.

CONCLUSIONS

The proposed method reproduced texture features for MRI-to-CT synthesis, which would benefit radiomics studies based on image multi-modality synthesis.

Impacts of Adaptive Statistical Iterative Reconstruction-V and Deep Learning Image Reconstruction Algorithms on Robustness of CT Radiomics Features: Opportunity for Minimizing Radiomics Variability Among Scans of Different Dose Levels

This study aims to investigate the influence of adaptive statistical iterative reconstruction-V (ASIR-V) and deep learning image reconstruction (DLIR) on CT radiomics feature robustness. A standardized phantom was scanned under single-energy CT (SECT) and dual-energy CT (DECT) modes at standard and low (20 and 10 mGy) dose levels. Images of SECT 120 kVp and corresponding DECT 120 kVp-like virtual monochromatic images were generated with filtered back-projection (FBP), ASIR-V at 40% (AV-40) and 100% (AV-100) blending levels, and DLIR algorithm at low (DLIR-L), medium (DLIR-M), and high (DLIR-H) strength levels. Ninety-four features were extracted via Pyradiomics. Reproducibility of features was calculated between standard and low dose levels, between reconstruction algorithms in reference to FBP images, and within scan mode, using intraclass correlation coefficient (ICC) and concordance correlation coefficient (CCC). The average percentage of features with ICC > 0.90 and CCC > 0.90 between the two dose levels was 21.28% and 20.75% in AV-40 images, and 39.90% and 35.11% in AV-100 images, respectively, and increased from 15.43 to 45.22% and from 15.43 to 44.15% with an increasing strength level of DLIR. The average percentage of features with ICC > 0.90 and CCC > 0.90 in reference to FBP images was 26.07% and 25.80% in AV-40 images, and 18.88% and 18.62% in AV-100 images, respectively, and decreased from 27.93 to 17.82% and from 27.66 to 17.29% with an increasing strength level of DLIR. DLIR and ASIR-V algorithms showed low reproducibility in reference to FBP images, while the high-strength DLIR algorithm provides an opportunity for minimizing radiomics variability due to dose reduction.

Comprehensive evaluation of similarity between synthetic and real CT images for nasopharyngeal carcinoma

BACKGROUND

Although magnetic resonance imaging (MRI)-to-computed tomography (CT) synthesis studies based on deep learning have significantly progressed, the similarity between synthetic CT (sCT) and real CT (rCT) has only been evaluated in image quality metrics (IQMs). To evaluate the similarity between synthetic CT (sCT) and real CT (rCT) comprehensively, we comprehensively evaluated IQMs and radiomic features for the first time.

METHODS

This study enrolled 127 patients with nasopharyngeal carcinoma who underwent CT and MRI scans. Supervised-learning (Unet) and unsupervised-learning (CycleGAN) methods were applied to build MRI-to-CT synthesis models. The regions of interest (ROIs) included nasopharynx gross tumor volume (GTVnx), brainstem, parotid glands, and temporal lobes. The peak signal-to-noise ratio (PSNR), mean absolute error (MAE), root mean square error (RMSE), and structural similarity (SSIM) were used to evaluate image quality. Additionally, 837 radiomic features were extracted for each ROI, and the correlation was evaluated using the concordance correlation coefficient (CCC).

RESULTS

The MAE, RMSE, SSIM, and PSNR of the body were 91.99, 187.12, 0.97, and 51.15 for Unet and 108.30, 211.63, 0.96, and 49.84 for CycleGAN. For the metrics, Unet was superior to CycleGAN (P < 0.05). For the radiomic features, the percentage of four levels (i.e., excellent, good, moderate, and poor, respectively) were as follows: GTVnx, 8.5%, 14.6%, 26.5%, and 50.4% for Unet and 12.3%, 25%, 38.4%, and 24.4% for CycleGAN; other ROIs, 5.44% ± 3.27%, 5.56% ± 2.92%, 21.38% ± 6.91%, and 67.58% ± 8.96% for Unet and 5.16% ± 1.69%, 3.5% ± 1.52%, 12.68% ± 7.51%, and 78.62% ± 8.57% for CycleGAN.

CONCLUSIONS

Unet-sCT was superior to CycleGAN-sCT for the IQMs. However, neither exhibited absolute superiority in radiomic features, and both were far less similar to rCT. Therefore, further work is required to improve the radiomic similarity for MRI-to-CT synthesis.

TRIAL REGISTRATION

This study was a retrospective study, so it was free from registration.

Radiomics and machine learning analysis by computed tomography and magnetic resonance imaging in colorectal liver metastases prognostic assessment

OBJECTIVE

The aim of this study was the evaluation radiomics analysis efficacy performed using computed tomography (CT) and magnetic resonance imaging in the prediction of colorectal liver metastases patterns linked to patient prognosis: tumor growth front; grade; tumor budding; mucinous type. Moreover, the prediction of liver recurrence was also evaluated.

METHODS

The retrospective study included an internal and validation dataset; the first was composed by 119 liver metastases from 49 patients while the second consisted to 28 patients with single lesion. Radiomic features were extracted using PyRadiomics. Univariate and multivariate approaches including machine learning algorithms were employed.

RESULTS

The best predictor to identify tumor growth was the Wavelet_HLH_glcm_MaximumProbability with an accuracy of 84% and to detect recurrence the best predictor was wavelet_HLH_ngtdm_Complexity with an accuracy of 90%, both extracted by T1-weigthed arterial phase sequence. The best predictor to detect tumor budding was the wavelet_LLH_glcm_Imc1 with an accuracy of 88% and to identify mucinous type was wavelet_LLH_glcm_JointEntropy with an accuracy of 92%, both calculated on T2-weigthed sequence. An increase statistically significant of accuracy (90%) was obtained using a linear weighted combination of 15 predictors extracted by T2-weigthed images to detect tumor front growth. An increase statistically significant of accuracy at 93% was obtained using a linear weighted combination of 11 predictors by the T1-weigthed arterial phase sequence to classify tumor budding. An increase statistically significant of accuracy at 97% was obtained using a linear weighted combination of 16 predictors extracted on CT to detect recurrence. An increase statistically significant of accuracy was obtained in the tumor budding identification considering a K-nearest neighbors and the 11 significant features extracted T1-weigthed arterial phase sequence.

CONCLUSIONS

The results confirmed the Radiomics capacity to recognize clinical and histopathological prognostic features that should influence the choice of treatments in colorectal liver metastases patients to obtain a more personalized therapy.

Computed Tomography 2.0: New Detector Technology, AI, and Other Developments

ABSTRACT

Computed tomography (CT) dramatically improved the capabilities of diagnostic and interventional radiology. Starting in the early 1970s, this imaging modality is still evolving, although tremendous improvements in scan speed, volume coverage, spatial and soft tissue resolution, as well as dose reduction have been achieved. Tube current modulation, automated exposure control, anatomy-based tube voltage (kV) selection, advanced x-ray beam filtration, and iterative image reconstruction techniques improved image quality and decreased radiation exposure. Cardiac imaging triggered the demand for high temporal resolution, volume acquisition, and high pitch modes with electrocardiogram synchronization. Plaque imaging in cardiac CT as well as lung and bone imaging demand for high spatial resolution. Today, we see a transition of photon-counting detectors from experimental and research prototype setups into commercially available systems integrated in patient care. Moreover, with respect to CT technology and CT image formation, artificial intelligence is increasingly used in patient positioning, protocol adjustment, and image reconstruction, but also in image preprocessing or postprocessing. The aim of this article is to give an overview of the technical specifications of up-to-date available whole-body and dedicated CT systems, as well as hardware and software innovations for CT systems in the near future.

Artificial intelligence-driven radiomics study in cancer: the role of feature engineering and modeling

Modern medicine is reliant on various medical imaging technologies for non-invasively observing patients' anatomy. However, the interpretation of medical images can be highly subjective and dependent on the expertise of clinicians. Moreover, some potentially useful quantitative information in medical images, especially that which is not visible to the naked eye, is often ignored during clinical practice. In contrast, radiomics performs high-throughput feature extraction from medical images, which enables quantitative analysis of medical images and prediction of various clinical endpoints. Studies have reported that radiomics exhibits promising performance in diagnosis and predicting treatment responses and prognosis, demonstrating its potential to be a non-invasive auxiliary tool for personalized medicine. However, radiomics remains in a developmental phase as numerous technical challenges have yet to be solved, especially in feature engineering and statistical modeling. In this review, we introduce the current utility of radiomics by summarizing research on its application in the diagnosis, prognosis, and prediction of treatment responses in patients with cancer. We focus on machine learning approaches, for feature extraction and selection during feature engineering and for imbalanced datasets and multi-modality fusion during statistical modeling. Furthermore, we introduce the stability, reproducibility, and interpretability of features, and the generalizability and interpretability of models. Finally, we offer possible solutions to current challenges in radiomics research.

Clinical applications of artificial intelligence in liver imaging

This review outlines the current status and challenges of the clinical applications of artificial intelligence in liver imaging using computed tomography or magnetic resonance imaging based on a topic analysis of PubMed search results using latent Dirichlet allocation. LDA revealed that "segmentation," "hepatocellular carcinoma and radiomics," "metastasis," "fibrosis," and "reconstruction" were current main topic keywords. Automatic liver segmentation technology using deep learning is beginning to assume new clinical significance as part of whole-body composition analysis. It has also been applied to the screening of large populations and the acquisition of training data for machine learning models and has resulted in the development of imaging biomarkers that have a significant impact on important clinical issues, such as the estimation of liver fibrosis, recurrence, and prognosis of malignant tumors. Deep learning reconstruction is expanding as a new technological clinical application of artificial intelligence and has shown results in reducing contrast and radiation doses. However, there is much missing evidence, such as external validation of machine learning models and the evaluation of the diagnostic performance of specific diseases using deep learning reconstruction, suggesting that the clinical application of these technologies is still in development.

Colorectal liver metastases patients prognostic assessment: prospects and limits of radiomics and radiogenomics

In this narrative review, we reported un up-to-date on the role of radiomics to assess prognostic features, which can impact on the liver metastases patient treatment choice. In the liver metastases patients, the possibility to assess mutational status (RAS or MSI), the tumor growth pattern and the histological subtype (NOS or mucinous) allows a better treatment selection to avoid unnecessary therapies. However, today, the detection of these features require an invasive approach. Recently, radiomics analysis application has improved rapidly, with a consequent growing interest in the oncological field. Radiomics analysis allows the textural characteristics assessment, which are correlated to biological data. This approach is captivating since it should allow to extract biological data from the radiological images, without invasive approach, so that to reduce costs and time, avoiding any risk for the patients. Several studies showed the ability of Radiomics to identify mutational status, tumor growth pattern and histological type in colorectal liver metastases. Although, radiomics analysis in a non-invasive and repeatable way, however features as the poor standardization and generalization of clinical studies results limit the translation of this analysis into clinical practice. Clear limits are data-quality control, reproducibility, repeatability, generalizability of results, and issues related to model overfitting.

Risk Assessment and Cholangiocarcinoma: Diagnostic Management and Artificial Intelligence

Intrahepatic cholangiocarcinoma (iCCA) is the second most common primary liver tumor, with a median survival of only 13 months. Surgical resection remains the only curative therapy; however, at first detection, only one-third of patients are at an early enough stage for this approach to be effective, thus rendering early diagnosis as an efficient approach to improving survival. Therefore, the identification of higher-risk patients, whose risk is correlated with genetic and pre-cancerous conditions, and the employment of non-invasive-screening modalities would be appropriate. For several at-risk patients, such as those suffering from primary sclerosing cholangitis or fibropolycystic liver disease, the use of periodic (6-12 months) imaging of the liver by ultrasound (US), magnetic Resonance Imaging (MRI)/cholangiopancreatography (MRCP), or computed tomography (CT) in association with serum CA19-9 measurement has been proposed. For liver cirrhosis patients, it has been proposed that at-risk iCCA patients are monitored in a similar fashion to at-risk HCC patients. The possibility of using Artificial Intelligence models to evaluate higher-risk patients could favor the diagnosis of these entities, although more data are needed to support the practical utility of these applications in the field of screening. For these reasons, it would be appropriate to develop screening programs in the research protocols setting. In fact, the success of these programs reauires patient compliance and multidisciplinary cooperation.

Risk Assessment and Pancreatic Cancer: Diagnostic Management and Artificial Intelligence

Pancreatic cancer (PC) is one of the deadliest cancers, and it is responsible for a number of deaths almost equal to its incidence. The high mortality rate is correlated with several explanations; the main one is the late disease stage at which the majority of patients are diagnosed. Since surgical resection has been recognised as the only curative treatment, a PC diagnosis at the initial stage is believed the main tool to improve survival. Therefore, patient stratification according to familial and genetic risk and the creation of screening protocol by using minimally invasive diagnostic tools would be appropriate. Pancreatic cystic neoplasms (PCNs) are subsets of lesions which deserve special management to avoid overtreatment. The current PC screening programs are based on the annual employment of magnetic resonance imaging with cholangiopancreatography sequences (MR/MRCP) and/or endoscopic ultrasonography (EUS). For patients unfit for MRI, computed tomography (CT) could be proposed, although CT results in lower detection rates, compared to MRI, for small lesions. The actual major limit is the incapacity to detect and characterize the pancreatic intraepithelial neoplasia (PanIN) by EUS and MR/MRCP. The possibility of utilizing artificial intelligence models to evaluate higher-risk patients could favour the diagnosis of these entities, although more data are needed to support the real utility of these applications in the field of screening. For these motives, it would be appropriate to realize screening programs in research settings.

Radiomics in clinical trials: perspectives on standardization

The term biomarker is used to describe a biological measure of the disease behavior. The existing imaging biomarkers are associated with the known tissue biological characteristics and follow a well-established roadmap to be implemented in routine clinical practice. Recently, a new quantitative imaging analysis approach named radiomics has emerged. It refers to the extraction of a large number of advanced imaging features with high-throughput computing. Extensive research has demonstrated its value in predicting disease behavior, progression, and response to therapeutic options. However, there are numerous challenges to establishing it as a clinically viable solution, including lack of reproducibility and transparency. The data-driven nature also does not offer insights into the underpinning biology of the observed relationships. As such, additional effort is needed to establish it as a qualified biomarker to inform clinical decisions. Here we review the technical difficulties encountered in the clinical applications of radiomics and current effort in addressing some of these challenges in clinical trial designs. By addressing these challenges, the true potential of radiomics can be unleashed.

Evaluation of radiomics feature stability in abdominal monoenergetic photon counting CT reconstructions

Feature stability and standardization remain challenges that impede the clinical implementation of radiomics. This study investigates the potential of spectral reconstructions from photon-counting computed tomography (PCCT) regarding organ-specific radiomics feature stability. Abdominal portal-venous phase PCCT scans of 10 patients in virtual monoenergetic (VM) (keV 40-120 in steps of 10), polyenergetic, virtual non-contrast (VNC), and iodine maps were acquired. Two 2D and 3D segmentations measuring 1 and 2 cm in diameter of the liver, lung, spleen, psoas muscle, subcutaneous fat, and air were obtained for spectral reconstructions. Radiomics features were extracted with pyradiomics. The calculation of feature-specific intraclass correlation coefficients (ICC) was performed by comparing all segmentation approaches and organs. Feature-wise and organ-wise correlations were evaluated. Segmentation-resegmentation stability was evaluated by concordance correlation coefficient (CCC). Compared to non-VM, VM-reconstruction features tended to be more stable. For VM reconstructions, 3D 2 cm segmentation showed the highest average ICC with 0.63. Based on a criterion of ≥ 3 stable organs and an ICC of ≥ 0.75, 12-mainly non-first-order features-are shown to be stable between the VM reconstructions. In a segmentation-resegmentation analysis in 3D 2 cm, three features were identified as stable based on a CCC of > 0.6 in ≥ 3 organs in ≥ 6 VM reconstructions. Certain radiomics features vary between monoenergetic reconstructions and depend on the ROI size. Feature stability was also shown to differ between different organs. Yet, glcm_JointEntropy, gldm_GrayLevelNonUniformity, and firstorder_Entropy could be identified as features that could be interpreted as energy-independent and segmentation-resegmentation stable in this PCCT collective. PCCT may support radiomics feature standardization and comparability between sites.

Image quality improvement in low-dose chest CT with deep learning image reconstruction

OBJECTIVES

To investigate the clinical utility of deep learning image reconstruction (DLIR) for improving image quality in low-dose chest CT in comparison with 40% adaptive statistical iterative reconstruction-Veo (ASiR-V40%) algorithm.

METHODS

This retrospective study included 86 patients who underwent low-dose CT for lung cancer screening. Images were reconstructed with ASiR-V40% and DLIR at low (DLIR-L), medium (DLIR-M), and high (DLIR-H) levels. CT value and standard deviation of lung tissue, erector spinae muscles, aorta, and fat were measured and compared across the four reconstructions. Subjective image quality was evaluated by two blind readers from three aspects: image noise, artifact, and visualization of small structures.

RESULTS

The effective dose was 1.03 ± 0.36 mSv. There was no significant difference in CT values of erector spinae muscles and aorta, whereas the maximum difference for lung tissue and fat was less than 5 HU among the four reconstructions. Compared with ASiR-V40%, the DLIR-L, DLIR-M, and DLIR-H reconstructions reduced the noise in aorta by 11.44%, 33.03%, and 56.1%, respectively, and had significantly higher subjective quality scores in image artifacts (all p < 0.001). ASiR-V40%, DLIR-L, and DLIR-M had equivalent score in visualizing small structures (all p > 0.05), whereas DLIR-H had slightly lower score.

CONCLUSIONS

Compared with ASiR-V40%, DLIR significantly reduces image noise in low-dose chest CT. DLIR strength is important and should be adjusted for different diagnostic needs in clinical application.

Deep learning-based reconstruction on cardiac CT yields distinct radiomic features compared to iterative and filtered back projection reconstructions

We aimed to determine the effects of deep learning-based reconstruction (DLR) on radiomic features obtained from cardiac computed tomography (CT) by comparing with iterative reconstruction (IR), and filtered back projection (FBP). A total of 284 consecutive patients with 285 cardiac CT scans that were reconstructed with DLR, IR, and FBP, were retrospectively enrolled. Radiomic features were extracted from the left ventricular (LV) myocardium, and from the periprosthetic mass if patients had cardiac valve replacement. Radiomic features of LV myocardium from each reconstruction were compared using a fitting linear mixed model. Radiomics models were developed to diagnose periprosthetic abnormality, and the performance was evaluated using the area under the receiver characteristics curve (AUC). Most radiomic features of LV myocardium (73 of 88) were significantly different in pairwise comparisons between all three reconstruction methods (P < 0.05). The radiomics model on IR exhibited the best diagnostic performance (AUC 0.948, 95% CI 0.880-1), relative to DLR (AUC 0.873, 95% CI 0.735-1) and FBP (AUC 0.875, 95% CI 0.731-1), but these differences did not reach significance (P > 0.05). In conclusion, applying DLR to cardiac CT scans yields radiomic features distinct from those obtained with IR and FBP, implying that feature robustness is not guaranteed when applying DLR.

Magnetic Resonance Features of Liver Mucinous Colorectal Metastases: What the Radiologist Should Know

Purpose: The aim of this study is to assess MRI features of mucinous liver metastases compared to non-mucinous metastases and hepatic hemangioma. Methods: A radiological archive was assessed from January 2017 to June 2021 to select patients subjected to liver resection for CRCLM and MRI in the staging phase. We selected 20 patients with hepatic hemangioma (study group B). We evaluated (a) the maximum diameter of the lesions, in millimeters, on T1-W flash 2D in phase and out phase, on axial HASTE T2-W and on portal phase axial VIBE T1 W; and (b) the signal intensity (SI) in T1-W sequences, in T2-W sequences, Diffusion-Weighted Imaging (DWI) sequences and apparent diffusion coefficient (ADC) maps so as to observe (c) the presence and the type of contrast enhancement during the contrast study. The chi-square test was employed to analyze differences in percentage values of the categorical variable, while the non-parametric Kruskal−Wallis test was used to test for statistically significant differences between the median values of the continuous variables. A p-value < 0.05 was considered statistically significant. Results: The final study population included 52 patients (33 men and 19 women) with 63 years of median age (range 37−82 years) and 157 metastases. In 35 patients, we found 118 non-mucinous type metastases (control group), and in 17 patients, we found 39 mucinous type metastases (study group A). During follow-up, recurrence occurred in 12 patients, and three exhibited mucinous types among them. In the study group, all lesions (100%) showed hypointense SI on T1-W, very high SI (similar to hepatic hemangioma) in T2-W with restricted diffusion and iso-hypointense signals in the ADC map. During the contrast study, the main significant feature is the peripheral progressive enhancement.

Identification of CT Imaging Phenotypes of Colorectal Liver Metastases from Radiomics Signatures-Towards Assessment of Interlesional Tumor Heterogeneity

(1) Background: Tumoral heterogeneity (TH) is a major challenge in the treatment of metastatic colorectal cancer (mCRC) and is associated with inferior response. Therefore, the identification of TH would be beneficial for treatment planning. TH can be assessed by identifying genetic alterations. In this work, a radiomics-based approach for assessment of TH in colorectal liver metastases (CRLM) in CT scans is demonstrated. (2) Methods: In this retrospective study, CRLM of mCRC were segmented and radiomics features extracted using pyradiomics. Unsupervised k-means clustering was applied to features and lesions. Feature redundancy was evaluated by principal component analysis and reduced by Pearson correlation coefficient cutoff. Feature selection was conducted by LASSO regression and visual analysis of the clusters by radiologists. (3) Results: A total of 47 patients’ (36% female, median age 64) CTs with 261 lesions were included. Five clusters were identified, and the categories small disseminated (n = 31), heterogeneous (n = 105), homogeneous (n = 64), mixed (n = 59), and very large type (n = 2) were assigned based on visual characteristics. Further statistical analysis showed correlation (p < 0.01) of clusters with sex, primary location, T- and N-status, and mutational status. Feature reduction and selection resulted in the identification of four features as a final set for cluster definition. (4) Conclusions: Radiomics features can characterize TH in liver metastases of mCRC in CT scans, and may be suitable for a better pretherapeutic classification of liver lesion phenotypes.