Reproducibility and Prognosis of Quantitative Features Extracted from CT Images. Transl Oncol. 2014;7:72-87. [PMID: 24772210 DOI: 10.1593/tlo.13844]

Extracellular microvesicle microRNAs, along with imaging metrics, improve detection of aggressive prostate cancer

Prostate cancer is the most commonly diagnosed cancer in men worldwide. Early diagnosis of the disease provides better treatment options for these patients. Magnetic resonance imaging (MRI) provides an overall assessment of prostate disease. Quantitative metrics (radiomics) from the MRI provide a better evaluation of the tumor and have been shown to improve disease detection. Recent studies have demonstrated that plasma extracellular vesicle microRNAs (miRNAs) are functionally linked to cancer progression, metastasis, and aggressiveness. In our study, we analyzed a matched cohort with baseline blood plasma and MRI to access tumor morphology using imaging-based radiomics and cellular characteristics using miRNAs-based transcriptomics. Our findings indicate that the univariate feature-based model with the highest Youden's index achieved average areas under the receiver operating characteristic curve (AUC) of 0.76, 0.82, and 0.84 for miRNA, MR-T2W, and MR-ADC features, respectively, in identifying clinically aggressive (Gleason grade) disease. The multivariable feature-based model demonstrated an average AUC of 0.88 and 0.95 using combinations of miRNA markers with imaging features in MR-ADC and MR-T2W, respectively. Our study demonstrates combining miRNA markers with MRI-based radiomics improves predictability of clinically aggressive prostate cancer.

Stability of Radiomic Features against Variations in Lesion Segmentations Computed on Apparent Diffusion Coefficient Maps of Breast Lesions

Diffusion-weighted imaging (DWI) combined with radiomics can aid in the differentiation of breast lesions. Segmentation characteristics, however, might influence radiomic features. To evaluate feature stability, we implemented a standardized pipeline featuring shifts and shape variations of the underlying segmentations. A total of 103 patients were retrospectively included in this IRB-approved study after multiparametric diagnostic breast 3T MRI with a spin-echo diffusion-weighted sequence with echoplanar readout (b-values: 50, 750 and 1500 s/mm2). Lesion segmentations underwent shifts and shape variations, with >100 radiomic features extracted from apparent diffusion coefficient (ADC) maps for each variation. These features were then compared and ranked based on their stability, measured by the Overall Concordance Correlation Coefficient (OCCC) and Dynamic Range (DR). Results showed variation in feature robustness to segmentation changes. The most stable features, excluding shape-related features, were FO (Mean, Median, RootMeanSquared), GLDM (DependenceNonUniformity), GLRLM (RunLengthNonUniformity), and GLSZM (SizeZoneNonUniformity), which all had OCCC and DR > 0.95 for both shifting and resizing the segmentation. Perimeter, MajorAxisLength, MaximumDiameter, PixelSurface, MeshSurface, and MinorAxisLength were the most stable features in the Shape category with OCCC and DR > 0.95 for resizing. Considering the variability in radiomic feature stability against segmentation variations is relevant when interpreting radiomic analysis of breast DWI data.

Simulated deep CT characterization of liver metastases with high-resolution filtered back projection reconstruction

Early diagnosis and accurate prognosis of colorectal cancer is critical for determining optimal treatment plans and maximizing patient outcomes, especially as the disease progresses into liver metastases. Computed tomography (CT) is a frontline tool for this task; however, the preservation of predictive radiomic features is highly dependent on the scanning protocol and reconstruction algorithm. We hypothesized that image reconstruction with a high-frequency kernel could result in a better characterization of liver metastases features via deep neural networks. This kernel produces images that appear noisier but preserve more sinogram information. A simulation pipeline was developed to study the effects of imaging parameters on the ability to characterize the features of liver metastases. This pipeline utilizes a fractal approach to generate a diverse population of shapes representing virtual metastases, and then it superimposes them on a realistic CT liver region to perform a virtual CT scan using CatSim. Datasets of 10,000 liver metastases were generated, scanned, and reconstructed using either standard or high-frequency kernels. These data were used to train and validate deep neural networks to recover crafted metastases characteristics, such as internal heterogeneity, edge sharpness, and edge fractal dimension. In the absence of noise, models scored, on average, 12.2% ( α = 0.012 ) and 7.5% ( α = 0.049 ) lower squared error for characterizing edge sharpness and fractal dimension, respectively, when using high-frequency reconstructions compared to standard. However, the differences in performance were statistically insignificant when a typical level of CT noise was simulated in the clinical scan. Our results suggest that high-frequency reconstruction kernels can better preserve information for downstream artificial intelligence-based radiomic characterization, provided that noise is limited. Future work should investigate the information-preserving kernels in datasets with clinical labels.

Implementation of Artificial Intelligence in Personalized Prognostic Assessment of Lung Cancer: A Narrative Review

Artificial Intelligence (AI) has revolutionized the management of non-small-cell lung cancer (NSCLC) by enhancing different aspects, including staging, prognosis assessment, treatment prediction, response evaluation, recurrence/prognosis prediction, and personalized prognostic assessment. AI algorithms may accurately classify NSCLC stages using machine learning techniques and deep imaging data analysis. This could potentially improve precision and efficiency in staging, facilitating personalized treatment decisions. Furthermore, there are data suggesting the potential application of AI-based models in predicting prognosis in terms of survival rates and disease progression by integrating clinical, imaging and molecular data. In the present narrative review, we will analyze the preliminary studies reporting on how AI algorithms could predict responses to various treatment modalities, such as surgery, radiotherapy, chemotherapy, targeted therapy, and immunotherapy. There is robust evidence suggesting that AI also plays a crucial role in predicting the likelihood of tumor recurrence after surgery and the pattern of failure, which has significant implications for tailoring adjuvant treatments. The successful implementation of AI in personalized prognostic assessment requires the integration of different data sources, including clinical, molecular, and imaging data. Machine learning (ML) and deep learning (DL) techniques enable AI models to analyze these data and generate personalized prognostic predictions, allowing for a precise and individualized approach to patient care. However, challenges relating to data quality, interpretability, and the ability of AI models to generalize need to be addressed. Collaboration among clinicians, data scientists, and regulators is critical for the responsible implementation of AI and for maximizing its benefits in providing a more personalized prognostic assessment. Continued research, validation, and collaboration are essential to fully exploit the potential of AI in NSCLC management and improve patient outcomes. Herein, we have summarized the state of the art of applications of AI in lung cancer for predicting staging, prognosis, and pattern of recurrence after treatment in order to provide to the readers a large comprehensive overview of this challenging issue.

Reproducibility in Radiomics: A Comparison of Feature Extraction Methods and Two Independent Datasets

Radiomics involves the extraction of information from medical images that are not visible to the human eye. There is evidence that these features can be used for treatment stratification and outcome prediction. However, there is much discussion about the reproducibility of results between different studies. This paper studies the reproducibility of CT texture features used in radiomics, comparing two feature extraction implementations, namely the MATLAB toolkit and Pyradiomics, when applied to independent datasets of CT scans of patients: (i) the open access RIDER dataset containing a set of repeat CT scans taken 15 min apart for 31 patients (RIDER Scan 1 and Scan 2, respectively) treated for lung cancer; and (ii) the open access HN1 dataset containing 137 patients treated for head and neck cancer. Gross tumor volume (GTV), manually outlined by an experienced observer available on both datasets, was used. The 43 common radiomics features available in MATLAB and Pyradiomics were calculated using two intensity-level quantization methods with and without an intensity threshold. Cases were ranked for each feature for all combinations of quantization parameters, and the Spearman's rank coefficient, rs, calculated. Reproducibility was defined when a highly correlated feature in the RIDER dataset also correlated highly in the HN1 dataset, and vice versa. A total of 29 out of the 43 reported stable features were found to be highly reproducible between MATLAB and Pyradiomics implementations, having a consistently high correlation in rank ordering for RIDER Scan 1 and RIDER Scan 2 (rs > 0.8). 18/43 reported features were common in the RIDER and HN1 datasets, suggesting they may be agnostic to disease site. Useful radiomics features should be selected based on reproducibility. This study identified a set of features that meet this requirement and validated the methodology for evaluating reproducibility between datasets.

Rank acquisition impact on radiomics estimation (AсquIRE) in chest CT imaging: A retrospective multi-site, multi-use-case study

BACKGROUND

Radiomics is a method within medical image analysis that involves the extraction of quantitative data from radiologic scans, often in conjunction with machine learning algorithms to phenotype disease appearance, prognosticate disease outcome, and predict treatment response. However, variance in CT scanner acquisition parameters, such as convolution kernels or pixel spacing, can impact radiomics texture feature values.

PURPOSE

The extent to which the parameters influence radiomics features continues to be an active area of investigation. In this study, we describe a novel approach, Acquisition Impact on Radiomics Estimation (AcquIRE), to rank the impact of CT acquisition parameters on radiomic texture features.

METHODS

In this work, we used three chest CT imaging datasets (n = 749 patients) from nine sites comprising: i) lung granulomas and adenocarcinomas (D1) (10 and 52 patients, respectively); ii) minimal and frank invasive adenocarcinoma (D2) (74 and 145 patients); and iii) early-stage NSCLC patients (D3) (315 patients). Datasets D2 and D3 were collected from four sites each, and D1 from a single site. For each patient, 744 texture features and nine acquisition parameters were extracted and utilized to evaluate which parameters impact radiomic features the most. The AcquIRE method establishes a relative assessment between acquisition parameters and radiomic texture featuresa through the creation of a classification model, which is then utilized to assess the rank of the acquisition parameters.

RESULTS

Across the use cases, CT software version and convolution kernel parameters were found to have the most variance. In D1, it was observed that the Haralick texture feature family was the least affected by variations in acquisition parameters, while the Gabor feature family was the most impacted. However, in datasets D2 and D3, the Gabor features were found to be the least affected. Our findings suggest that the impact on radiomic parameters is as much a function of the problem in question as it is acquisition parameters.

CONCLUSIONS

The software version and convolution kernel parameters impacted the radiomics feature the most.

An Informative Review of Radiomics Studies on Cancer Imaging: The Main Findings, Challenges and Limitations of the Methodologies

The aim of this informative review was to investigate the application of radiomics in cancer imaging and to summarize the results of recent studies to support oncological imaging with particular attention to breast cancer, rectal cancer and primitive and secondary liver cancer. This review also aims to provide the main findings, challenges and limitations of the current methodologies. Clinical studies published in the last four years (2019-2022) were included in this review. Among the 19 studies analyzed, none assessed the differences between scanners and vendor-dependent characteristics, collected images of individuals at additional points in time, performed calibration statistics, represented a prospective study performed and registered in a study database, conducted a cost-effectiveness analysis, reported on the cost-effectiveness of the clinical application, or performed multivariable analysis with also non-radiomics features. Seven studies reached a high radiomic quality score (RQS), and seventeen earned additional points by using validation steps considering two datasets from two distinct institutes and open science and data domains (radiomics features calculated on a set of representative ROIs are open source). The potential of radiomics is increasingly establishing itself, even if there are still several aspects to be evaluated before the passage of radiomics into routine clinical practice. There are several challenges, including the need for standardization across all stages of the workflow and the potential for cross-site validation using real-world heterogeneous datasets. Moreover, multiple centers and prospective radiomics studies with more samples that add inter-scanner differences and vendor-dependent characteristics will be needed in the future, as well as the collecting of images of individuals at additional time points, the reporting of calibration statistics and the performing of prospective studies registered in a study database.

Imaging Evaluation of Peritoneal Metastasis: Current and Promising Techniques

Early diagnosis, accurate assessment, and localization of peritoneal metastasis (PM) are essential for the selection of appropriate treatments and surgical guidance. However, available imaging modalities (computed tomography [CT], conventional magnetic resonance imaging [MRI], and 18fluorodeoxyglucose positron emission tomography [PET]/CT) have limitations. The advent of new imaging techniques and novel molecular imaging agents have revealed molecular processes in the tumor microenvironment as an application for the early diagnosis and assessment of PM as well as real-time guided surgical resection, which has changed clinical management. In contrast to clinical imaging, which is purely qualitative and subjective for interpreting macroscopic structures, radiomics and artificial intelligence (AI) capitalize on high-dimensional numerical data from images that may reflect tumor pathophysiology. A predictive model can be used to predict the occurrence, recurrence, and prognosis of PM, thereby avoiding unnecessary exploratory surgeries. This review summarizes the role and status of different imaging techniques, especially new imaging strategies such as spectral photon-counting CT, fibroblast activation protein inhibitor (FAPI) PET/CT, near-infrared fluorescence imaging, and PET/MRI, for early diagnosis, assessment of surgical indications, and recurrence monitoring in patients with PM. The clinical applications, limitations, and solutions for fluorescence imaging, radiomics, and AI are also discussed.

Fusion-based tensor radiomics using reproducible features: Application to survival prediction in head and neck cancer

BACKGROUND

Numerous features are commonly generated in radiomics applications as applied to medical imaging, and identification of robust radiomics features (RFs) can be an important step to derivation of reliable, reproducible solutions. In this work, we utilize a tensor radiomics (TR) framework, where numerous fusions are explored, to generate different flavours of RFs, and we aimed to identify RFs that are robust to fusion techniques in head and neck cancer. Overall, we aimed to predict progression-free survival (PFS) using Hybrid Machine Learning Systems (HMLS) and reproducible RFs.

METHODS

The study was performed on 408 patients with head and neck cancer from The Cancer Imaging Archive. After image preprocessing, 15 fusion techniques were employed to combine Positron Emission Tomography (PET) and Computed Tomography (CT) images. Subsequently, 215 RFs were extracted through a standardized radiomics software, with 17 'flavours' generated using PET-only, CT-only, and 15 fused PET&CT images. The variability of RFs across flavours was studied using the Intraclass Correlation Coefficient (ICC). Furthermore, the features were categorized into seven reliability groups, 106 reproducible RFs with ICC>0.75 were selected, highly correlated flavours were removed, Principal Component Analysis was used to convert 17 flavours to 1 attribute, the polynomial function was utilized to increase RFs, and Analysis of variance (ANOVA) was used to select the relevant attributes. Finally, 3 classifiers including Random Forest (RFC), Logistic regression (LR), and Multi-layer perceptron were applied to the preselected relevant attributes to predict binary PFS. In 5-fold cross-validation, 80% of 4 divisions were utilized to train the model, and the remaining 20% was utilized to evaluate the model. Further, the remaining fold was used for external nested testing.

RESULTS

Reliability analysis indicated that most morphological features belong to the high-reliability category. By contrast, local intensity and statistical features extracted from images belong to the low-reliability category. In the tensor framework, the highest 5-fold cross-validation accuracy of 76.7%±3.3% with an external nested testing of 70.6%±6.7% resulted from the reproducible TR+polynomial function+ANOVA+LR algorithm while the accuracy of 70.0%±4.2% with the external nested testing of 67.7%±4.9% was achieved through the PCA fusion+RFC (non-tensor paradigm).

CONCLUSIONS

This study demonstrated that using reproducible RFs as utilized within a tensor fusion radiomics framework, linked with ANOVA and LR, added value to prediction of progression-free survival outcome in head and neck cancer patients.

CT-based radiomics model to predict spread through air space in resectable lung cancer

BACKGROUND

Spread through air space (STAS) has been identified as a pathological pattern associated with lung cancer progression. Patients with STAS were related to a worse prognosis compared with patients without STAS. The objective of this study was to establish a radiomics model capable of forecasting STAS before surgery, which can assist surgeons in selecting the most appropriate operation type for patients with STAS.

METHOD

There were 537 eligible patients retrospectively included in this study. ROI segmentation was performed manually on all CT images to identify the region of interest. From each segmented lesion, a total of 1688 features were extracted. The tumor size, maximum tumor diameters, and tumor type were also recorded. Using Spearman's correlation coefficient to calculate the correlation and redundancy of elements, and redundant features less than 0.80 were removed. In order to reduce the level of overfitting and avoid statistical biases, a dimension reduction process of the dataset was conducted to decrease the number of features. Finally, a radiomics model included 44 features was established to predict STAS. To evaluate the performance of the model, the receiver operating characteristic (ROC) curve was used, and the area under the curve (AUC) was calculated, and the accuracy of the model was verified by 10-fold cross-validation.

RESULTS

The incidence of STAS was 38.2% (205/537). The tumor type, maximum tumor diameters, and consolidation tumor ratio were significantly different between STAS group and non-STAS group. The training group included 430 patients, while the test group was consisted with 107. The training group achieved an AUC of 0.825 (sensitivity, 0.875; specificity, 0.621; and accuracy, 0.749) and the test group had an AUC of 0.802 (sensitivity, 0.797; specificity,0.688; and accuracy, 0.748). The 10-fold cross-validation had an AUC of 0.834.

CONCLUSION

CT-based radiomic model can predict STAS effectively, which is of great importance to guide the selection of operation types before surgery.

Review of the use of radiomics to assess the risk of recurrence in early-stage non-small cell lung cancer

Background and Objective

Radiomics is an emerging field of advanced image analysis that has shown promise as a non-invasive, companion diagnostic in predicting clinical outcomes and response assessments in solid tumors. Radiomics aims to extract high-content information from medical images not visible to the naked eye, especially in early-stage non-small cell lung cancer (NSCLC) patients. Although these patients are being identified by early detection programs, it remains unclear which patients would benefit from adjuvant treatment versus active surveillance. Having a radiomic signature(s) that could predict early recurrence would be beneficial. In this review, an overview of the basic radiomic approaches used to evaluate solid tumors on radiologic scans, including NSCLC is provided followed by a review of relevant literature that supports the use of radiomics to help predict tumor recurrence in early-stage NSCLC patients.

Methods

A review of the radiomic literature from 1985 to present focusing on the prediction of disease recurrence in early-stage NSCLC was conducted. PubMed database was searched using key terms for radiomics and NSCLC. A total of 41 articles were identified and 13 studies were considered suitable for inclusion based upon study population, patient number (n>50), use of well described radiomic methodologies, suitable model building features, and well-defined testing/training and validation where feasible.

Key Content and Findings

Examples of using radiomics in early-stage NSCLC patients will be presented, where disease free survival is a primary consideration. A summary of the findings demonstrates the importance of both the intratumor and peritumoral radiomic signals as a marker of outcomes.

Conclusions

The value of radiomic information for predicting disease recurrence in early-stage NSCLC patients is accumulating. However, overcoming several challenges along with the lack of prospective trials, has inhibited it use as a clinical decision-making support tool in early-stage NSCLC.

Stability of Multi-Parametric Prostate MRI Radiomic Features to Variations in Segmentation

Stability analysis remains a fundamental step in developing a successful imaging biomarker to personalize oncological strategies. This study proposes an in silico contour generation method for simulating segmentation variations to identify stable radiomic features. Ground-truth annotation provided for the whole prostate gland on the multi-parametric MRI sequences (T2w, ADC, and SUB-DCE) were perturbed to mimic segmentation differences observed among human annotators. In total, we generated 15 synthetic contours for a given image-segmentation pair. One thousand two hundred twenty-four unfiltered/filtered radiomic features were extracted applying Pyradiomics, followed by stability assessment using ICC(1,1). Stable features identified in the internal population were then compared with an external population to discover and report robust features. Finally, we also investigated the impact of a wide range of filtering strategies on the stability of features. The percentage of unfiltered (filtered) features that remained robust subjected to segmentation variations were T2w-36% (81%), ADC-36% (94%), and SUB-43% (93%). Our findings suggest that segmentation variations can significantly impact radiomic feature stability but can be mitigated by including pre-filtering strategies as part of the feature extraction pipeline.

Computerized Diagnosis of Liver Tumors From CT Scans Using a Deep Neural Network Approach

The liver is a frequent site of benign and malignant, primary and metastatic tumors. Hepatocellular carcinoma (HCC) and intrahepatic cholangiocarcinoma (ICC) are the most common primary liver cancers, and colorectal liver metastasis (CRLM) is the most common secondary liver cancer. Although the imaging characteristic of these tumors is central to optimal clinical management, it relies on imaging features that are often non-specific, overlap, and are subject to inter-observer variability. Thus, in this study, we aimed to categorize liver tumors automatically from CT scans using a deep learning approach that objectively extracts discriminating features not visible to the naked eye. Specifically, we used a modified Inception v3 network-based classification model to classify HCC, ICC, CRLM, and benign tumors from pretreatment portal venous phase computed tomography (CT) scans. Using a multi-institutional dataset of 814 patients, this method achieved an overall accuracy rate of 96%, with sensitivity rates of 96%, 94%, 99%, and 86% for HCC, ICC, CRLM, and benign tumors, respectively, using an independent dataset. These results demonstrate the feasibility of the proposed computer-assisted system as a novel non-invasive diagnostic tool to classify the most common liver tumors objectively.

Multiparametric Data-driven Imaging Markers: Guidelines for Development, Application and Reporting of Model Outputs in Radiomics

This paper is the fifth in a five-part series on statistical methodology for performance assessment of multi-parametric quantitative imaging biomarkers (mpQIBs) for radiomic analysis. Radiomics is the process of extracting visually imperceptible features from radiographic medical images using data-driven algorithms. We refer to the radiomic features as data-driven imaging markers (DIMs), which are quantitative measures discovered under a data-driven framework from images beyond visual recognition but evident as patterns of disease processes irrespective of whether or not ground truth exists for the true value of the DIM. This paper aims to set guidelines on how to build machine learning models using DIMs in radiomics and to apply and report them appropriately. We provide a list of recommendations, named RANDAM (an abbreviation of "Radiomic ANalysis and DAta Modeling"), for analysis, modeling, and reporting in a radiomic study to make machine learning analyses in radiomics more reproducible. RANDAM contains five main components to use in reporting radiomics studies: design, data preparation, data analysis and modeling, reporting, and material availability. Real case studies in lung cancer research are presented along with simulation studies to compare different feature selection methods and several validation strategies.

A comprehensive machine-learning model applied to MRI to classify germinomas of the pineal region

BACKGROUND

Pineal region tumors (PRTs) are highly histologically heterogeneous. Germinoma is the most common PRT and is treatable with radiotherapy and chemotherapy. A non-invasive system that helps identify germinoma in the pineal region could reduce lab exams and traumatic therapies.

METHODS

In this retrospective study, 122 patients with histologically confirmed PRTs and pre-operative multi-modal MR images were included. Radiomics features were extracted from different ROIs and image sequences separately. A computational framework that combines a few classification and feature selection algorithms were used to predict histology with radiomics features and demographics. We systemically benchmarked performance of models with feature matrices from all possible combinations of ROIs and image sequences. The Area under the ROC Curve (AUC) was then used to evaluate model performance.

RESULTS

Models with demographics and radiomics features outperform radiomics-only or demographics-only models. The best demographical-radiomics model reached the highest AUC of 0.88 (CI95%: 0.81-0.96). Through the comprehensive evaluation of possible sequence combinations in the differential diagnosis of pineal tumor, T1 and T2 emerged as the most informative sequences for the task. There is imbalanced usage of feature classes as we analyze their proportion in all models.

CONCLUSIONS

The demographical-radiomics model can accurately and efficiently identify germinomas in the pineal region. The preference for MRI sequences, radiomics feature classes, features selection and classification algorithms provide a valuable reference for future attempts at developing classifiers on medical images.

Development of Deep Learning Technique of Features for the Analysis of Clinical Images Integrated with CANN

Computer tomography is an extensively used method for the detection of the disease in the subjects. Basically, computer-aided tomography depending on the artificial intelligence reveals its significance in smart health care monitoring system. Owing to its security and the private issue, analyzing the computed tomography dataset has become a tedious process. This study puts forward the convolutional autoencrypted deep learning neural network to assist unsupervised learning technique. By carrying out various experiments, our proposed method produces better results comparative to other traditional methods, which efficaciously solves the issues related to the artificial image description. Hence, the convolutional autoencoder is widely used in measuring the lumps in the bronchi. With the unsupervised machine learning, the extracted features are used for various applications.

Robustness of radiomics to variations in segmentation methods in multimodal brain MRI

Radiomics in neuroimaging uses fully automatic segmentation to delineate the anatomical areas for which radiomic features are computed. However, differences among these segmentation methods affect radiomic features to an unknown extent. A scan-rescan dataset (n = 46) of T1-weighted and diffusion tensor images was used. Subjects were split into a sleep-deprivation and a control group. Scans were segmented using four segmentation methods from which radiomic features were computed. First, we measured segmentation agreement using the Dice-coefficient. Second, robustness and reproducibility of radiomic features were measured using the intraclass correlation coefficient (ICC). Last, difference in predictive power was assessed using the Friedman-test on performance in a radiomics-based sleep deprivation classification application. Segmentation agreement was generally high (interquartile range = 0.77–0.90) and median feature robustness to segmentation method variation was higher (ICC > 0.7) than scan-rescan reproducibility (ICC 0.3–0.8). However, classification performance differed significantly among segmentation methods (p < 0.001) ranging from 77 to 84%. Accuracy was higher for more recent deep learning-based segmentation methods. Despite high agreement among segmentation methods, subtle differences significantly affected radiomic features and their predictive power. Consequently, the effect of differences in segmentation methods should be taken into account when designing and evaluating radiomics-based research methods.

Uniqueness of radiomic features in non-small cell lung cancer

PURPOSE

The uniqueness of radiomic features, combined with their reproducibility, determines the reliability of radiomic studies. This study is to test the hypothesis that radiomic features extracted from a defined region of interest (ROI) are unique to the underlying structure (e.g., tumor).

APPROACH

Two cohorts of non-small cell lung cancer (NSCLC) patients were retrospectively retrieved from a GE and a Siemens CT scanner. The lung nodules (ROI) were delineated manually and radiomic features were extracted using IBEX. The same ROI was then translocated randomly to four other tissue regions of the same set of images: adipose, heart, lung beyond nodule, and muscle for radiomic feature extraction. Coefficient of variation (CV) within different ROIs and concordance correlation coefficient (CCC) between lung nodule and a given tissue region were calculated to test to determine feature uniqueness. The radiomic features were considered nonunique when (1) the CV < 10% and CCC > 0.85 for over 50% of patients; and (2) the CCC > 0.85 appeared in ≥2 tissue regions beyond the defined region.

RESULTS

In total, 14 patients from GE and 18 patients from Siemens are analyzed. The results show that 12 features fall below the 10% CV threshold for over 50% of patients in the GE cohort and 29 features in the Siemens cohort. According to CCC, 18 radiomic features in GE and 16 features in Siemens are identified as nonunique, with 11 overlapping features. Combining CV and CCC, 9 of 123 calculated features (7.3%) are identified as nonunique to a defined ROI.

CONCLUSIONS

Radiomic feature uniqueness should be considered to improve the reliability of radiomics study.

Detection on Cell Cancer Using the Deep Transfer Learning and Histogram Based Image Focus Quality Assessment

In recent years, the number of studies using whole-slide imaging (WSIs) of histopathology slides has expanded significantly. For the development and validation of artificial intelligence (AI) systems, glass slides from retrospective cohorts including patient follow-up data have been digitized. It has become crucial to determine that the quality of such resources meets the minimum requirements for the development of AI in the future. The need for automated quality control is one of the obstacles preventing the clinical implementation of digital pathology work processes. As a consequence of the inaccuracy of scanners in determining the focus of the image, the resulting visual blur can render the scanned slide useless. Moreover, when scanned at a resolution of 20× or higher, the resulting picture size of a scanned slide is often enormous. Therefore, for digital pathology to be clinically relevant, computational algorithms must be used to rapidly and reliably measure the picture's focus quality and decide if an image requires re-scanning. We propose a metric for evaluating the quality of digital pathology images that uses a sum of even-derivative filter bases to generate a human visual-system-like kernel, which is described as the inverse of the lens' point spread function. This kernel is then used for a digital pathology image to change high-frequency image data degraded by the scanner's optics and assess the patch-level focus quality. Through several studies, we demonstrate that our technique correlates with ground-truth z-level data better than previous methods, and is computationally efficient. Using deep learning techniques, our suggested system is able to identify positive and negative cancer cells in images. We further expand our technique to create a local slide-level focus quality heatmap, which can be utilized for automated slide quality control, and we illustrate our method's value in clinical scan quality control by comparing it to subjective slide quality ratings. The proposed method, GoogleNet, VGGNet, and ResNet had accuracy values of 98.5%, 94.5%, 94.00%, and 95.00% respectively.

Enhancing the stability of CT radiomics across different volume of interest sizes using parametric feature maps: a phantom study

BACKGROUND

In radiomics studies, differences in the volume of interest (VOI) are often inevitable and may confound the extracted features. We aimed to correct this confounding effect of VOI variability by applying parametric maps with a fixed voxel size.

METHODS

Ten scans of a cup filled with sodium chloride solution were scanned using a multislice computed tomography (CT) unit. Sphere-shaped VOIs with different diameters (4, 8, or 16 mm) were drawn centrally into the phantom. A total of 93 features were extracted conventionally from the original images using PyRadiomics. Using a self-designed and pretested software tool, parametric maps for the same 93 features with a fixed voxel size of 4 mm3 were created. To retrieve the feature values from the maps, VOIs were copied from the original images to preserve the position. Differences in feature quantities between the VOI sizes were tested with the Mann-Whitney U-test and agreement with overall concordance correlation coefficients (OCCC).

RESULTS

Fifty-five conventionally extracted features were significantly different between the VOI sizes, and none of the features showed excellent agreement in terms of OCCCs. When read from the parametric maps, only 8 features showed significant differences, and 3 features showed an excellent OCCC (≥ 0.85). The OCCCs for 89 features substantially increased using the parametric maps.

CONCLUSIONS

This phantom study shows that converting CT images into parametric maps resolves the confounding effect of VOI variability and increases feature reproducibility across VOI sizes.

Deep learning analysis to predict EGFR mutation status in lung adenocarcinoma manifesting as pure ground-glass opacity nodules on CT

Background

Epidermal growth factor receptor-tyrosine kinase inhibitors (EGFR-TKIs) showed potency as a non-invasive therapeutic approach in pure ground-glass opacity nodule (pGGN) lung adenocarcinoma. However, optimal methods of extracting information about EGFR mutation from pGGN lung adenocarcinoma images remain uncertain. We aimed to develop, validate, and evaluate the clinical utility of a deep learning model for predicting EGFR mutation status in lung adenocarcinoma manifesting as pGGN on computed tomography (CT).

Methods

We included 185 resected pGGN lung adenocarcinomas in the primary cohort. The patients were divided into training (n = 125), validation (n = 23), and test sets (n = 37). A preoperative CT-based deep learning model with clinical factors as well as clinical and radiomics models was constructed and applied to the test set. We evaluated the clinical utility of the deep learning model by applying it to 83 GGNs that received EGFR-TKI from an independent cohort (clinical validation set), and treatment response was regarded as the reference standard.

Results

The prediction efficiencies of each model were compared in terms of area under the curve (AUC). Among the 185 pGGN lung adenocarcinomas, 122 (65.9%) were EGFR-mutant and 63 (34.1%) were EGFR-wild type. The AUC of the clinical, radiomics, and deep learning with clinical models to predict EGFR mutations were 0.50, 0.64, and 0.85, respectively, for the test set. The AUC of deep learning with the clinical model in the validation set was 0.72.

Conclusions

Deep learning approach of CT images combined with clinical factors can predict EGFR mutations in patients with lung adenocarcinomas manifesting as pGGN, and its clinical utility was demonstrated in a real-world sample.

Fully automatic prognostic biomarker extraction from metastatic prostate lesion segmentations in whole-body [68Ga]Ga-PSMA-11 PET/CT images

PURPOSE

This study aimed to develop and assess an automated segmentation framework based on deep learning for metastatic prostate cancer (mPCa) lesions in whole-body [⁶⁸Ga]Ga-PSMA-11 PET/CT images for the purpose of extracting patient-level prognostic biomarkers.

METHODS

Three hundred thirty-seven [⁶⁸Ga]Ga-PSMA-11 PET/CT images were retrieved from a cohort of biochemically recurrent PCa patients. A fully 3D convolutional neural network (CNN) is proposed which is based on the self-configuring nnU-Net framework, and was trained on a subset of these scans, with an independent test set reserved for model evaluation. Voxel-level segmentation results were assessed using the dice similarity coefficient (DSC), positive predictive value (PPV), and sensitivity. Sensitivity and PPV were calculated to assess lesion level detection; patient-level classification results were assessed by the accuracy, PPV, and sensitivity. Whole-body biomarkers total lesional volume (TLV_auto) and total lesional uptake (TLU_auto) were calculated from the automated segmentations, and Kaplan-Meier analysis was used to assess biomarker relationship with patient overall survival.

RESULTS

At the patient level, the accuracy, sensitivity, and PPV were all > 90%, with the best metric being the PPV (97.2%). PPV and sensitivity at the lesion level were 88.2% and 73.0%, respectively. DSC and PPV measured at the voxel level performed within measured inter-observer variability (DSC, median = 50.7% vs. second observer = 32%, p = 0.012; PPV, median = 64.9% vs. second observer = 25.7%, p < 0.005). Kaplan-Meier analysis of TLV_auto and TLU_auto showed they were significantly associated with patient overall survival (both p < 0.005).

CONCLUSION

The fully automated assessment of whole-body [⁶⁸Ga]Ga-PSMA-11 PET/CT images using deep learning shows significant promise, yielding accurate scan classification, voxel-level segmentations within inter-observer variability, and potentially clinically useful prognostic biomarkers associated with patient overall survival.

TRIAL REGISTRATION

This study was registered with the Australian New Zealand Clinical Trials Registry (ACTRN12615000608561) on 11 June 2015.

Impact of image quality on radiomics applications

Radiomics features extracted from medical images have been widely reported to be useful in the patient specific outcome modeling for variety of assessment and prediction purposes. Successful application of radiomics features as imaging biomarkers, however, is dependent on the robustness of the approach to the variation in each step of the modeling workflow. Variation in the input image quality is one of the main sources that impacts the reproducibility of radiomics analysis when a model is applied to broader range of medical imaging data. The quality of medical image is generally affected by both the scanner related factors such as image acquisition/reconstruction settings and the patient related factors such as patient motion. This article aimed to review the published literatures in this field that reported the impact of various imaging factors on the radiomics features through the change in image quality. The literatures were categorized by different imaging modalities and also tabulated based on the imaging parameters and the class of radiomics features included in the study. Strategies for image quality standardization were discussed based on the relevant literatures and recommendations for reducing the impact of image quality variation on the radiomics in multi-institutional clinical trial were summarized at the end of this article.

Stable and Discriminatory Radiomic Features from the Tumor and Its Habitat Associated with Progression-Free Survival in Glioblastoma: A Multi-Institutional Study

BACKGROUND AND PURPOSE

Glioblastoma is an aggressive brain tumor, with no validated prognostic biomarkers for survival before surgical resection. Although recent approaches have demonstrated the prognostic ability of tumor habitat (constituting necrotic core, enhancing lesion, T2/FLAIR hyperintensity subcompartments) derived radiomic features for glioblastoma survival on treatment-naive MR imaging scans, radiomic features are known to be sensitive to MR imaging acquisitions across sites and scanners. In this study, we sought to identify the radiomic features that are both stable across sites and discriminatory of poor and improved progression-free survival in glioblastoma tumors.

MATERIALS AND METHODS

We used 150 treatment-naive glioblastoma MR imaging scans (Gadolinium-T1w, T2w, FLAIR) obtained from 5 sites. For every tumor subcompartment (enhancing tumor, peritumoral FLAIR-hyperintensities, necrosis), a total of 316 three-dimensional radiomic features were extracted. The training cohort constituted studies from 4 sites (n = 93) to select the most stable and discriminatory radiomic features for every tumor subcompartment. These features were used on a hold-out cohort (n = 57) to evaluate their ability to discriminate patients with poor survival from those with improved survival.

RESULTS

Incorporating the most stable and discriminatory features within a linear discriminant analysis classifier yielded areas under the curve of 0.71, 0.73, and 0.76 on the test set for distinguishing poor and improved survival compared with discriminatory features alone (areas under the curve of 0.65, 0.54, 0.62) from the necrotic core, enhancing tumor, and peritumoral T2/FLAIR hyperintensity, respectively.

CONCLUSIONS

Incorporating stable and discriminatory radiomic features extracted from tumors and associated habitats across multisite MR imaging sequences may yield robust prognostic classifiers of patient survival in glioblastoma tumors.

Deep learning versus iterative reconstruction on image quality and dose reduction in abdominal CT: a live animal study

Objective. While simulated low-dose CT images and phantom studies cannot fully approximate subjective and objective effects of deep learning (DL) denoising on image quality, live animal models may afford this assessment. This study is to investigate the potential of DL in CT dose reduction on image quality compared to iterative reconstruction (IR). Approach. The upper abdomen of a live 4 year old sheep was scanned on a CT scanner at different exposure levels. Images were reconstructed using FBP and ADMIRE with 5 strengths. A modularized DL network with 5 modules was used for image reconstruction via progressive denoising. Radiomic features were extracted from a region over the liver. Concordance correlation coefficient (CCC) was applied to quantify agreement between any two sets of radiomic features. Coefficient of variation was calculated to measure variation in a radiomic feature series. Structural similarity index (SSIM) was used to measure the similarity between any two images. Diagnostic quality, low-contrast detectability, and image texture were qualitatively evaluated by two radiologists. Pearson correlation coefficient was computed across all dose-reconstruction/denoising combinations. Results. A total of 66 image sets, with 405 radiomic features extracted from each, are analyzed. IR and DL can improve diagnostic quality and low-contrast detectability and similarly modulate image texture features. In terms of SSIM, DL has higher potential in preserving image structure. There is strong correlation between SSIM and radiologists’ evaluations for diagnostic quality (0.559) and low-contrast detectability (0.635) but moderate correlation for texture (0.313). There is moderate correlation between CCC of radiomic features and radiologists’ evaluation for diagnostic quality (0.397), low-contrast detectability (0.417), and texture (0.326), implying that improvement of image features may not relate to improvement of diagnostic quality. Conclusion. DL shows potential to further reduce radiation dose while preserving structural similarity, while IR is favored by radiologists and more predictably alters radiomic features.

Radiomics model for preoperative prediction of 3-year survival-based CT image biomarkers in esophageal cancer

OBJECTIVE

This work aimed to develop a radiomics nomogram to predict 3-year overall survival of esophageal cancer patients after chemoradiotherapy.

METHODS

A total of 109 esophageal cancer patients, diagnosed from November 2012 to February 2015, were enrolled in this retrospective study. They were randomly divided into training set (77 cases) and verification set (32 cases). Image standardization was performed prior to feature extraction. And then, about 1670 radiomics features were extracted from the pretreatment diagnostic computed tomography image. A radiomics signature was constructed with the lasso algorithm; then, a radiomics score was calculated to reflect survival probability using the radiomics signature for each patient. A radiomics nomogram was developed by incorporating the radiomics score and clinical factors. A clinical model was constructed using clinical factors only. The performance of the nomogram was assessed with respect to its calibration and discrimination. Kaplan-Meier survival analysis was performed.

RESULTS

Sixteen radiomics features were selected to build the radiomics signature. The radiomics nomogram showed better calibration and classification capacity than the clinical model with AUC 0.96 vs. 0.72 for the training cohort, and 0.87 vs. 0.67 for the validation cohort. The model showed good discrimination with a Harrell's Concordance Index of 0.76 in the training cohort and 0.81 in the validation cohort. Decision curve analysis demonstrated the clinical usefulness of the radiomics nomogram. A significant difference (p value < 0.05; log-rank test) was observed between the survival curves of the nomogram-predicted survival and non-survival groups.

CONCLUSIONS

The present study proposed a radiomics-based nomogram involving the radiomics signature and clinical factors. It can be potentially applied in the individual preoperative prediction of 3-year survival in esophageal cancer patients.

EGFR Mutation Status and Subtypes Predicted by CT-Based 3D Radiomic Features in Lung Adenocarcinoma

Objective

In this study, we aim to establish a non-invasive tool to predict epidermal growth factor receptor (EGFR) mutation status and subtypes based on radiomic features of computed tomography (CT).

Methods

A total of 233 lung adenocarcinoma patients were investigated and randomly divided into the training and test cohorts. In this study, 2300 radiomic features were extracted from original and filtered (Exponential, Laplacian of Gaussian, Logarithm, Gabor, Wavelet) CT images. The radiomic features were divided into four categories, including histogram, volumetric, morphologic, and texture features. An RF-BFE algorithm was developed to select the features for building the prediction models. Clinicopathological features (including age, gender, smoking status, TNM staging, maximum diameter, location, and growth pattern) were combined to establish an integrated model with radiomic features. ROC curve and AUC quantified the effectiveness of the predictor of EGFR mutation status and subtypes.

Results

A set of 10 features were selected to predict EGFR mutation status between EGFR mutant and wild type, while 9 selected features were used to predict mutation subtypes between exon 19 deletion and exon 21 L858R mutation. To predict the EGFR mutation status, the AUC of the training cohort was 0.778 and the AUC of the test cohort was 0.765. To predict the EGFR mutation subtypes, the AUC of training cohort was 0.725 and the AUC of test cohort was 0.657. The integrated model showed the most optimal predictive performance with EGFR mutation status (AUC = 0.870 and 0.759) and subtypes (AUC = 0.797 and 0.554) in the training and test cohorts.

Conclusion

CT-based radiomic features can extract information on tumor heterogeneity in lung adenocarcinoma. In addition, we have established a radiomic model and an integrated model to non-invasively predict the EGFR mutation status and subtypes of lung adenocarcinoma, which is conducive to saving clinical costs and guiding targeted therapy.

Assessing radiomics feature stability with simulated CT acquisitions

Medical imaging quantitative features had once disputable usefulness in clinical studies. Nowadays, advancements in analysis techniques, for instance through machine learning, have enabled quantitative features to be progressively useful in diagnosis and research. Tissue characterisation is improved via the “radiomics” features, whose extraction can be automated. Despite the advances, stability of quantitative features remains an important open problem. As features can be highly sensitive to variations of acquisition details, it is not trivial to quantify stability and efficiently select stable features. In this work, we develop and validate a Computed Tomography (CT) simulator environment based on the publicly available ASTRA toolbox (www.astra-toolbox.com). We show that the variability, stability and discriminative power of the radiomics features extracted from the virtual phantom images generated by the simulator are similar to those observed in a tandem phantom study. Additionally, we show that the variability is matched between a multi-center phantom study and simulated results. Consequently, we demonstrate that the simulator can be utilised to assess radiomics features’ stability and discriminative power.

Combining Hepatic and Splenic CT Radiomic Features Improves Radiomic Analysis Performance for Liver Fibrosis Staging

Background: The exact focus of computed tomography (CT)-based artificial intelligence techniques when staging liver fibrosis is still not exactly known. This study aimed to determine both the added value of splenic information to hepatic information, and the correlation between important radiomic features and information exploited by deep learning models for liver fibrosis staging by CT-based radiomics. Methods: The study design is retrospective. Radiomic features were extracted from both liver and spleen on portal venous phase CT images of 252 consecutive patients with histologically proven liver fibrosis stages between 2006 and 2018. The radiomics analyses for liver fibrosis staging were done by hepatic and hepatic–splenic features, respectively. The most predictive radiomic features were automatically selected by machine learning models. Results: When using splenic–hepatic features in the CT-based radiomics analysis, the average accuracy rates for significant fibrosis, advanced fibrosis, and cirrhosis were 88%, 82%, and 86%, and area under the receiver operating characteristic curves (AUCs) were 0.92, 0.81, and 0.85. The AUC of hepatic–splenic-based radiomics analysis with the ensemble classifier was 7% larger than that of hepatic-based analysis (p < 0.05). The most important features selected by machine learning models included both hepatic and splenic features, and they were consistent with the location maps indicating the focus of deep learning when predicting liver fibrosis stage. Conclusions: Adding CT-based splenic radiomic features to hepatic radiomic features increases radiomics analysis performance for liver fibrosis staging. The most important features of the radiomics analysis were consistent with the information exploited by deep learning.

A novel graphical evaluation of agreement

Background

The Bland-Altman plot with the limits of agreement has been widely used as an absolute index for assessing test-retest reliability or reproducibility between two measurements. We have observed that in the settings where the relative index such as concordance correlation coefficient (CCC) or intraclass correlation coefficient is employed, the limits of agreement approach may be inconsistent with the scaled index. Particularly, the broad width of the limits of agreement may indicate a lack of agreement when the two measurements are highly concordant but an acceptable difference is not known and the common variance of the data is large. This research aims to create a novel, CCC-based guidance for graphical evaluation of reproducibility or reliability.

Methods

The concordance correlation coefficient is used to create a 100(1-α)% reference band from two measurements. Simulation studies and real examples, including the peak expiratory flow rate data in Bland and Altman’s paper and the test-retest reproducibility data of the Radiomics study, are implemented to assess the use of the reference band.

Results

In the absence of an acceptable difference between measurements, we found that the limits of agreement may not be consistent with the concordance correlation coefficient. Our simulation study results and real data application show that the proposed method can provide practitioners with a novel graphical evaluation that is consistent with results from the concordance correlation coefficient.

Conclusions

Our proposed novel scaled index-based guidance can be used for the graphical evaluation of reproducibility or reliability and may have advantages over the limits of agreement in settings where the concordance correlation coefficient is employed.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12874-022-01532-w.

Molecular typing of lung adenocarcinoma with computed tomography and CT image-based radiomics: a narrative review of research progress and prospects

Objective

The purpose of this paper was to perform a narrative review of current research evidence on conventional computed tomography (CT) imaging features and CT image-based radiomic features for predicting gene mutations in lung adenocarcinoma and discuss how to translate the research findings to guide future practice.

Background

Lung cancer, especially lung adenocarcinoma, is the leading cause of cancer-related deaths. With advances in the diagnosis and treatment of lung adenocarcinoma with the emergence of molecular testing, the prediction of oncogenes and even drug resistance gene mutations have become key to individualized and precise clinical treatment in order to prolong survival and improve quality of life. The progress of imageological examination includes the development of CT and radiomics are promising quantitative methods for predicting different gene mutations in lung adenocarcinoma, especially common mutations, such as epidermal growth factor receptor (EGFR) mutation, anaplastic lymphoma kinase (ALK) mutation and Kirsten rat sarcoma viral oncogene (KRAS) mutation.

Methods

The PubMed electronic database was searched along with a set of terms specific to lung adenocarcinoma, radiomics (including texture analysis), CT, computed tomography, EGFR, ALK, KRAS, rearranging transfection (RET) rearrangement and c-ros oncogene 1 (ROS-1), v-raf murine sarcoma viral oncogene homolog B1 (BRAF), and human epidermal growth factor receptor 2 (HER2) mutations et al. This review has been reported in compliance with the Narrative Review checklist guidelines. From each full-text article, information was extracted regarding a set of terms above.

Conclusions

Research on the application of conventional CT features and CT image-based radiomic features for predicting the gene mutation status of lung adenocarcinoma is still in a preliminary stage. Noninvasively determination of mutation status in lung adenocarcinoma before targeted therapy with conventional CT features and CT image-based radiomic features remains both hopes and challenges. Before radiomics could be applied in clinical practice, more work needs to be done.

Can Peritumoral Radiomics Improve the Prediction of Malignancy of Solid Pulmonary Nodule Smaller Than 2 cm?

RATIONALE AND OBJECTIVES

To compare the ability of radiomics models including the perinodular parenchyma and standard nodular radiomics model in lung cancer diagnosis of solid pulmonary nodules smaller than 2 cm.

MATERIALS AND METHODS

In this retrospective study, the computed tomography (CT) scans of 206 patients with a lung nodule from a single institution in 2012-2019 were collected. For each nodule, four volumes of interest were defined using the gross tumor volume (GTV) and peritumoral volumes (PTVs) of 5, 10, and 15 mm around the tumor.

RESULTS

Radiomics models created from GTV, GTV plus 5 mm of PTV, GTV plus 10 mm of PTV, and GTV plus 15 mm of PTV achieved AUCs of 0.89, 0.81, 0.81, and 0.73, respectively, in the validation cohort for the diagnostic classification of benign and malignant pulmonary nodules. The performance of the models gradually decreased as the PTV increased. Wavelet features were the primary features identified in optimal radiomics signatures (2/3 in R, 4/5 in GTV plus 5 mm PTV, 3/4 in GTV plus 10 mm PTV, 2/3 in GTV plus 15 mm PTV).

CONCLUSION

Our study indicated that the radiomics signatures of GTV had a good prediction ability in distinguishing benign and malignant solid pulmonary nodules smaller than 2 cm on CT. However, the radiomics feature of the surrounding parenchyma of the nodule did not enhance the effectiveness of the diagnostic model.

Radiomics in Triple Negative Breast Cancer: New Horizons in an Aggressive Subtype of the Disease

In the last decade, the analysis of the medical images has evolved significantly, applications and tools capable to extract quantitative characteristics of the images beyond the discrimination capacity of the investigator's eye being developed. The applications of this new research field, called radiomics, presented an exponential growth with direct implications in the diagnosis and prediction of response to therapy. Triple negative breast cancer (TNBC) is an aggressive breast cancer subtype with a severe prognosis, despite the aggressive multimodal treatments applied according to the guidelines. Radiomics has already proven the ability to differentiate TNBC from fibroadenoma. Radiomics features extracted from digital mammography may also distinguish between TNBC and non-TNBC. Recent research has identified three distinct subtypes of TNBC using IRM breast images voxel-level radiomics features (size/shape related features, texture features, sharpness). The correlation of these TNBC subtypes with the clinical response to neoadjuvant therapy may lead to the identification of biomarkers in order to guide the clinical decision. Furthermore, the variation of some radiomics features in the neoadjuvant settings provides a tool for the rapid evaluation of treatment efficacy. The association of radiomics features with already identified biomarkers can generate complex predictive and prognostic models. Standardization of image acquisition and also of radiomics feature extraction is required to validate this method in clinical practice.

The Influence of Different Ultrasonic Machines on Radiomics Models in Prediction Lymph Node Metastasis for Patients with Cervical Cancer

Objective To investigate the effects of different ultrasonic machines on the performance of radiomics models using ultrasound (US) images in the prediction of lymph node metastasis (LNM) for patients with cervical cancer (CC) preoperatively. Methods A total of 536 CC patients with confirmed histological characteristics and lymph node status after radical hysterectomy and pelvic lymphadenectomy were enrolled. Radiomics features were extracted and selected with US images acquired with ATL HDI5000, Voluson E8, MyLab classC, ACUSON S2000, and HI VISION Preirus to build radiomics models for LNM prediction using support vector machine (SVM) and logistic regression, respectively. Results There were 148 patients (training vs validation: 102:46) scanned in machine HDI5000, 75 patients (53:22) in machine Voluson E8, 100 patients (69:31) in machine MyLab classC, 110 patients (76:34) in machine ACUSON S2000, and 103 patients (73:30) in machine HI VISION Preirus, respectively. Few radiomics features were reproducible among different machines. The area under the curves (AUCs) ranged from 0.75 to 0.86, 0.73 to 0.86 in the training cohorts, and from 0.71 to 0.82, 0.70 to 0.80 in the validation cohorts for SVM and logistic regression models, respectively. The highest difference in AUCs for different machines reaches 17.8% and 15.5% in the training and validation cohorts, respectively. Conclusions The performance of radiomics model is dependent on the type of scanner. The problem of scanner dependency on radiomics features should be considered, and their effects should be minimized in future studies for US images.

Predicting response to radiotherapy of head and neck squamous cell carcinoma using radiomics from cone-beam CT images

INTRODUCTION

Radiotherapy (RT) for head and neck cancer is now guided by cone-beam computed tomography (CBCT). We aim to identify a CBCT radiomic signature predictive of progression to RT.

MATERIAL AND METHODS

A cohort of 93 patients was split into training (n = 60) and testing (n = 33) sets. A total of 88 features were extracted from the gross tumor volume (GTV) on each CBCT. Receiver operating characteristic (ROC) curves were used to determine the power of each feature at each week of treatment to predict progression to radio(chemo)therapy. Only features with AUC > 0.65 at each week were pre-selected. Absolute differences were calculated between features from each weekly CBCT and baseline CBCT1 images. The smallest detectable change (C = 1.96 × SD, SD being the standard deviation of differences between feature values calculated on CBCT1 and CBCTn) with its confidence interval (95% confidence interval [CI]) was determined for each feature. The features for which the change was larger than C for at least 5% of patients were then selected. A radiomics-based model was built at the time-point that showed the highest AUC and compared with models relying on clinical variables.

RESULTS

Seven features had an AUC > 0.65 at each week, and six exhibited a change larger than the predefined CI 95%. After exclusion of inter-correlated features, only one parameter remains, Coarseness. Among clinical variable, only hemoglobin value was significant. AUC for predicting the treatment response were 0.78 (p = .006), 0.85 (p < .001), and 0.99 (p < .001) for clinical, CBCT4-radiomics (Coarseness) and clinical + radiomics based models respectively. The mean AUC of this last model on a 5-fold cross-validation was 0.80 (±0.09). On the testing cohort, the best prediction was given by the combined model (balanced accuracy [BAcc] 0.67 , p < .001).

CONCLUSIONS

We described a feature selection methodology for delta-radiomics that is able to select reproducible features which are informative due to their change during treatment. A selected delta radiomics feature may improve clinical-based prediction models.

Radiomics Analysis of Computed Tomography for Prediction of Thyroid Capsule Invasion in Papillary Thyroid Carcinoma: A Multi-Classifier and Two-Center Study

OBJECTIVE

To investigate the application of computed tomography (CT)-based radiomics model for prediction of thyroid capsule invasion (TCI) in papillary thyroid carcinoma (PTC).

METHODS

This retrospective study recruited 412 consecutive PTC patients from two independent institutions and randomly assigned to training (n=265), internal test (n=114) and external test (n=33) cohorts. Radiomics features were extracted from non-contrast (NC) and artery phase (AP) CT scans. We also calculated delta radiomics features, which are defined as the absolute differences between the extracted radiomics features. One-way analysis of variance and least absolute shrinkage and selection operator were used to select optimal radiomics features. Then, six supervised machine learning radiomics models (k-nearest neighbor, logistic regression, decision tree, linear support vector machine [L-SVM], Gaussian-SVM, and polynomial-SVM) were constructed. Univariate was used to select clinicoradiological risk factors. Combined models including optimal radiomics features and clinicoradiological risk factors were constructed by these six classifiers. The prediction performance was evaluated using the receiver operating characteristic (ROC) curve, calibration curve, and decision curve analysis (DCA).

RESULTS

In the internal test cohort, the best combined model (L-SVM, AUC=0.820 [95% CI 0.758-0.888]) performed better than the best radiomics model (L-SVM, AUC = 0.733 [95% CI 0.654-0.812]) and the clinical model (AUC = 0.709 [95% CI 0.649-0.783]). Combined-L-SVM model combines 23 radiomics features and 1 clinicoradiological risk factor (CT-reported TCI). In the external test cohort, the AUC was 0.776 (0.625-0.904) in the combined-L-SVM model, showing that the model is stable. DCA demonstrated that the combined model was clinically useful.

CONCLUSIONS

Our combined model based on machine learning incorporated with CT radiomics features and the clinicoradiological risk factor shows good predictive ability for TCI in PTC.

Stability of Liver Radiomics across Different 3D ROI Sizes-An MRI In Vivo Study

We aimed to evaluate the stability of radiomic features in the liver of healthy individuals across different three-dimensional regions of interest (3D ROI) sizes in T1-weighted (T1w) and T2-weighted (T2w) images from different MR scanners. We retrospectively included 66 examinations of patients without known diseases or pathological imaging findings acquired on three MRI scanners (3 Tesla I: 25 patients, 3 Tesla II: 19 patients, 1.5 Tesla: 22 patients). 3D ROIs of different diameters (10, 20, 30 mm) were drawn on T1w GRE and T2w TSE images into the liver parenchyma (segment V–VIII). We extracted 93 radiomic features from the different ROIs and tested features for significant differences with the Mann–Whitney-U (MWU)-test. The MWU-test revealed significant differences for most second- and higher-order features, indicating a systematic difference dependent on the ROI size. The features mean, median, root mean squared (RMS), 10th percentile, and 90th percentile were not significantly different. We also assessed feature robustness to ROI size variation with overall concordance correlation coefficients (OCCCs). OCCCs across the different ROI-sizes for mean, median, and RMS were excellent (>0.90) in both sequences on all three scanners. These features, therefore, seem robust to ROI-size variation and suitable for radiomic studies of liver MRI.

Radiomics for Identification and Prediction in Metastatic Prostate Cancer: A Review of Studies

Metastatic Prostate Cancer (mPCa) is associated with a poor patient prognosis. mPCa spreads throughout the body, often to bones, with spatial and temporal variations that make the clinical management of the disease difficult. The evolution of the disease leads to spatial heterogeneity that is extremely difficult to characterise with solid biopsies. Imaging provides the opportunity to quantify disease spread. Advanced image analytics methods, including radiomics, offer the opportunity to characterise heterogeneity beyond what can be achieved with simple assessment. Radiomics analysis has the potential to yield useful quantitative imaging biomarkers that can improve the early detection of mPCa, predict disease progression, assess response, and potentially inform the choice of treatment procedures. Traditional radiomics analysis involves modelling with hand-crafted features designed using significant domain knowledge. On the other hand, artificial intelligence techniques such as deep learning can facilitate end-to-end automated feature extraction and model generation with minimal human intervention. Radiomics models have the potential to become vital pieces in the oncology workflow, however, the current limitations of the field, such as limited reproducibility, are impeding their translation into clinical practice. This review provides an overview of the radiomics methodology, detailing critical aspects affecting the reproducibility of features, and providing examples of how artificial intelligence techniques can be incorporated into the workflow. The current landscape of publications utilising radiomics methods in the assessment and treatment of mPCa are surveyed and reviewed. Associated studies have incorporated information from multiple imaging modalities, including bone scintigraphy, CT, PET with varying tracers, multiparametric MRI together with clinical covariates, spanning the prediction of progression through to overall survival in varying cohorts. The methodological quality of each study is quantified using the radiomics quality score. Multiple deficits were identified, with the lack of prospective design and external validation highlighted as major impediments to clinical translation. These results inform some recommendations for future directions of the field.

A deep learning- and CT image-based prognostic model for the prediction of survival in non-small cell lung cancer

OBJECTIVE

To assist clinicians in arranging personalized treatment, planning follow-up programs and extending survival times for non-small cell lung cancer (NSCLC) patients, a method of deep learning combined with computed tomography (CT) imaging for survival prediction was designed.

METHODS

Data were collected from 484 patients from four research centers. The data from 344 patients were utilized to build the A_CNN survival prognosis model to classify 2-year overall survival time ranges (730 days cut-off). Data from 140 patients, including independent internal and external test sets, were utilized for model testing. First, a series of preprocessing techniques were used to process the original CT images and generate training and test data sets from the axial, coronal, and sagittal planes. Second, the structure of the A_CNN model was designed based on asymmetric convolution, bottleneck blocks, the uniform cross-entropy (UC) loss function, and other advanced techniques. After that, the A_CNN model was trained, and numerous comparative experiments were designed to obtain the best prognostic survival model. Last, the model performance was evaluated, and the predicted survival curves were analyzed.

RESULTS

The A_CNN survival prognosis model yielded a high patient-level accuracy of 88.8%, a patch-level accuracy of 82.9%, and an area under the receiver operating characteristic (ROC) curve (AUC) of 0.932. When tested on an external data set, the maximum patient-level accuracy was 80.0%.

CONCLUSIONS

The results suggest that using a deep learning method can improve prognosis in patients with NSCLC and has important application value in establishing individualized prognostic models.

CT Radiomics for the Preoperative Prediction of Ki67 Index in Gastrointestinal Stromal Tumors: A Multi-Center Study

Purpose

This study established and verified a radiomics model for the preoperative prediction of the Ki67 index of gastrointestinal stromal tumors (GISTs).

Materials and Methods

A total of 344 patients with GISTs from three hospitals were divided into a training set and an external validation set. The tumor region of interest was delineated based on enhanced computed-tomography (CT) images to extract radiomic features. The Boruta algorithm was used for dimensionality reduction of the features, and the random forest algorithm was used to construct the model for radiomics prediction of the Ki67 index. The receiver operating characteristic (ROC) curve was used to evaluate the model’s performance and generalization ability.

Results

After dimensionality reduction, a feature subset having 21 radiomics features was generated. The generated radiomics model had an the area under curve (AUC) value of 0.835 (95% confidence interval(CI): 0.761–0.908) in the training set and 0.784 (95% CI: 0.691–0.874) in the external validation cohort.

Conclusion

The radiomics model of this study had the potential to predict the Ki67 index of GISTs preoperatively.

Radiomics and Digital Image Texture Analysis in Oncology (Review)

One of the most promising areas of diagnosis and prognosis of diseases is radiomics, a science combining radiology, mathematical modeling, and deep machine learning. The main concept of radiomics is image biomarkers (IBMs), the parameters characterizing various pathological changes and calculated based on the analysis of digital image texture. IBMs are used for quantitative assessment of digital imaging results (CT, MRI, ultrasound, PET). The use of IBMs in the form of “virtual biopsy” is of particular relevance in oncology.

The article provides the basic concepts of radiomics identifying the main stages of obtaining IBMs: data collection and preprocessing, tumor segmentation, data detection and extraction, modeling, statistical processing, and data validation. The authors have analyzed the possibilities of using IBMs in oncology, describing the currently known features and advantages of using radiomics and image texture analysis in the diagnosis and prognosis of cancer. The limitations and problems associated with the use of radiomics data are considered.

Although the novel effective tool for performing virtual biopsy of human tissue is at the development stage, quite a few projects have already been implemented, and medical software packages for radiomics analysis of digital images have been created.

Radiomics, aptamers and nanobodies: New insights in cancer diagnostics and imaging

At present, cancer is a major health issue and the second leading cause of mortality worldwide. Researchers have been working hard on investigating not only improved therapeutics but also on early detection methods, both critical to increasing treatment efficacy and developing methods for disease prevention. Diagnosis of cancers at an early stage can promote timely medical intervention and effective treatment and will result in inhibiting tumor growth and development. Several advances have been made in the diagnostics and imagining technologies for early tumor detection and deciding an effective therapy these include radiomics, nanobodies, and aptamers. Here in this review, we summarize the main applications of radiomics, aptamers, and the use of nanobody-based probes for molecular imaging applications in diagnosis, treatment planning, and evaluations in the field of oncology to develop quantitative and personalized medicine. The preclinical data reported to date are quite promising, and it is predicted that nanobody-based molecular imaging agents will play an important role in the diagnosis and management of different cancer types in near future.

Making Radiomics More Reproducible across Scanner and Imaging Protocol Variations: A Review of Harmonization Methods

Radiomics converts medical images into mineable data via a high-throughput extraction of quantitative features used for clinical decision support. However, these radiomic features are susceptible to variation across scanners, acquisition protocols, and reconstruction settings. Various investigations have assessed the reproducibility and validation of radiomic features across these discrepancies. In this narrative review, we combine systematic keyword searches with prior domain knowledge to discuss various harmonization solutions to make the radiomic features more reproducible across various scanners and protocol settings. Different harmonization solutions are discussed and divided into two main categories: image domain and feature domain. The image domain category comprises methods such as the standardization of image acquisition, post-processing of raw sensor-level image data, data augmentation techniques, and style transfer. The feature domain category consists of methods such as the identification of reproducible features and normalization techniques such as statistical normalization, intensity harmonization, ComBat and its derivatives, and normalization using deep learning. We also reflect upon the importance of deep learning solutions for addressing variability across multi-centric radiomic studies especially using generative adversarial networks (GANs), neural style transfer (NST) techniques, or a combination of both. We cover a broader range of methods especially GANs and NST methods in more detail than previous reviews.

Application of Radiomics and Artificial Intelligence for Lung Cancer Precision Medicine

Medical imaging is the standard-of-care for early detection, diagnosis, treatment planning, monitoring, and image-guided interventions of lung cancer patients. Most medical images are stored digitally in a standardized Digital Imaging and Communications in Medicine format that can be readily accessed and used for qualitative and quantitative analysis. Over the several last decades, medical images have been shown to contain complementary and interchangeable data orthogonal to other sources such as pathology, hematology, genomics, and/or proteomics. As such, "radiomics" has emerged as a field of research that involves the process of converting standard-of-care images into quantitative image-based data that can be merged with other data sources and subsequently analyzed using conventional biostatistics or artificial intelligence (AI) methods. As radiomic features capture biological and pathophysiological information, these quantitative radiomic features have shown to provide rapid and accurate noninvasive biomarkers for lung cancer risk prediction, diagnostics, prognosis, treatment response monitoring, and tumor biology. In this review, radiomics and emerging AI methods in lung cancer research are highlighted and discussed including advantages, challenges, and pitfalls.

Deep Learning Segmentation of Triple-Negative Breast Cancer (TNBC) Patient Derived Tumor Xenograft (PDX) and Sensitivity of Radiomic Pipeline to Tumor Probability Boundary

Simple Summary

Co-clinical trials are an emerging area of investigation in which a clinical trial is coupled with a corresponding preclinical trial to inform the corresponding clinical trial. The preclinical arm aids in assessing therapeutic efficacy, patient stratification, and designing optimal imaging strategies. There is much interest in harmonizing preclinical and clinical quantitative imaging pipelines. Radiomics is widely explored in clinical imaging to predict response to therapy. In preclinical imaging, high-throughput radiomic analysis is limited by manual delineation of tumor boundaries, which is labor intensive with poor reproducibility. Our proposed deep-learning-based system was trained to automatically segment tumors from multi-contrast MR images and extract radiomic features. The proposed method is highly reproducible with significant correlation in radiomic features. The deployment of this pipeline in the preclinical arm would provide high throughput and reproducible radiomic analysis.

Abstract

Preclinical magnetic resonance imaging (MRI) is a critical component in a co-clinical research pipeline. Importantly, segmentation of tumors in MRI is a necessary step in tumor phenotyping and assessment of response to therapy. However, manual segmentation is time-intensive and suffers from inter- and intra- observer variability and lack of reproducibility. This study aimed to develop an automated pipeline for accurate localization and delineation of TNBC PDX tumors from preclinical T1w and T2w MR images using a deep learning (DL) algorithm and to assess the sensitivity of radiomic features to tumor boundaries. We tested five network architectures including U-Net, dense U-Net, Res-Net, recurrent residual UNet (R2UNet), and dense R2U-Net (D-R2UNet), which were compared against manual delineation by experts. To mitigate bias among multiple experts, the simultaneous truth and performance level estimation (STAPLE) algorithm was applied to create consensus maps. Performance metrics (F1-Score, recall, precision, and AUC) were used to assess the performance of the networks. Multi-contrast D-R2UNet performed best with F1-score = 0.948; however, all networks scored within 1–3% of each other. Radiomic features extracted from D-R2UNet were highly corelated to STAPLE-derived features with 67.13% of T1w and 53.15% of T2w exhibiting correlation ρ ≥ 0.9 (p ≤ 0.05). D-R2UNet-extracted features exhibited better reproducibility relative to STAPLE with 86.71% of T1w and 69.93% of T2w features found to be highly reproducible (CCC ≥ 0.9, p ≤ 0.05). Finally, 39.16% T1w and 13.9% T2w features were identified as insensitive to tumor boundary perturbations (Spearman correlation (−0.4 ≤ ρ ≤ 0.4). We developed a highly reproducible DL algorithm to circumvent manual segmentation of T1w and T2w MR images and identified sensitivity of radiomic features to tumor boundaries.

A review in radiomics: Making personalized medicine a reality via routine imaging

Radiomics is the quantitative analysis of standard-of-care medical imaging; the information obtained can be applied within clinical decision support systems to create diagnostic, prognostic, and/or predictive models. Radiomics analysis can be performed by extracting hand-crafted radiomics features or via deep learning algorithms. Radiomics has evolved tremendously in the last decade, becoming a bridge between imaging and precision medicine. Radiomics exploits sophisticated image analysis tools coupled with statistical elaboration to extract the wealth of information hidden inside medical images, such as computed tomography (CT), magnetic resonance (MR), and/or Positron emission tomography (PET) scans, routinely performed in the everyday clinical practice. Many efforts have been devoted in recent years to the standardization and validation of radiomics approaches, to demonstrate their usefulness and robustness beyond any reasonable doubts. However, the booming of publications and commercial applications of radiomics approaches warrant caution and proper understanding of all the factors involved to avoid "scientific pollution" and overly enthusiastic claims by researchers and clinicians alike. For these reasons the present review aims to be a guidebook of sorts, describing the process of radiomics, its pitfalls, challenges, and opportunities, along with its ability to improve clinical decision-making, from oncology and respiratory medicine to pharmacological and genotyping studies.

Comparison of Radiomic Features in a Diverse Cohort of Patients With Pancreatic Ductal Adenocarcinomas

Background

Significant racial disparities in pancreatic cancer incidence and mortality rates exist, with the highest rates in African Americans compared to Non-Hispanic Whites and Hispanic/Latinx populations. Computer-derived quantitative imaging or “radiomic” features may serve as non-invasive surrogates for underlying biological factors and heterogeneity that characterize pancreatic tumors from African Americans, yet studies are lacking in this area. The objective of this pilot study was to determine if the radiomic tumor profile extracted from pretreatment computed tomography (CT) images differs between African Americans, Non-Hispanic Whites, and Hispanic/Latinx with pancreatic cancer.

Methods

We evaluated a retrospective cohort of 71 pancreatic cancer cases (23 African American, 33 Non-Hispanic White, and 15 Hispanic/Latinx) who underwent pretreatment CT imaging at Moffitt Cancer Center and Research Institute. Whole lesion semi-automated segmentation was performed on each slice of the lesion on all pretreatment venous phase CT exams using Healthmyne Software (Healthmyne, Madison, WI, USA) to generate a volume of interest. To reduce feature dimensionality, 135 highly relevant non-texture and texture features were extracted from each segmented lesion and analyzed for each volume of interest.

Results

Thirty features were identified and significantly associated with race/ethnicity based on Kruskal-Wallis test. Ten of the radiomic features were highly associated with race/ethnicity independent of tumor grade, including sphericity, volumetric mean Hounsfield units (HU), minimum HU, coefficient of variation HU, four gray level texture features, and two wavelet texture features. A radiomic signature summarized by the first principal component partially differentiated African American from non-African American tumors (area underneath the curve = 0.80). Poorer survival among African Americans compared to Non-African Americans was observed for tumors with lower volumetric mean CT [HR: 3.90 (95% CI:1.19–12.78), p=0.024], lower GLCM Avg Column Mean [HR:4.75 (95% CI: 1.44,15.37), p=0.010], and higher GLCM Cluster Tendency [HR:3.36 (95% CI: 1.06–10.68), p=0.040], and associations persisted in volumetric mean CT and GLCM Avg Column after adjustment for key clinicopathologic factors.

Conclusions

This pilot study identified several textural radiomics features associated with poor overall survival among African Americans with PDAC, independent of other prognostic factors such as grade. Our findings suggest that CT radiomic features may serve as surrogates for underlying biological factors and add value in predicting clinical outcomes when integrated with other parameters in ongoing and future studies of cancer health disparities.

Impact of Lesion Delineation and Intensity Quantisation on the Stability of Texture Features from Lung Nodules on CT: A Reproducible Study

Computer-assisted analysis of three-dimensional imaging data (radiomics) has received a lot of research attention as a possible means to improve the management of patients with lung cancer. Building robust predictive models for clinical decision making requires the imaging features to be stable enough to changes in the acquisition and extraction settings. Experimenting on 517 lung lesions from a cohort of 207 patients, we assessed the stability of 88 texture features from the following classes: first-order (13 features), Grey-level Co-Occurrence Matrix (24), Grey-level Difference Matrix (14), Grey-level Run-length Matrix (16), Grey-level Size Zone Matrix (16) and Neighbouring Grey-tone Difference Matrix (five). The analysis was based on a public dataset of lung nodules and open-access routines for feature extraction, which makes the study fully reproducible. Our results identified 30 features that had good or excellent stability relative to lesion delineation, 28 to intensity quantisation and 18 to both. We conclude that selecting the right set of imaging features is critical for building clinical predictive models, particularly when changes in lesion delineation and/or intensity quantisation are involved.

Radiomics in Lung Diseases Imaging: State-of-the-Art for Clinicians

Artificial intelligence (AI) has increasingly been serving the field of radiology over the last 50 years. As modern medicine is evolving towards precision medicine, offering personalized patient care and treatment, the requirement for robust imaging biomarkers has gradually increased. Radiomics, a specific method generating high-throughput extraction of a tremendous amount of quantitative imaging data using data-characterization algorithms, has shown great potential in individuating imaging biomarkers. Radiomic analysis can be implemented through the following two methods: hand-crafted radiomic features extraction or deep learning algorithm. Its application in lung diseases can be used in clinical decision support systems, regarding its ability to develop descriptive and predictive models in many respiratory pathologies. The aim of this article is to review the recent literature on the topic, and briefly summarize the interest of radiomics in chest Computed Tomography (CT) and its pertinence in the field of pulmonary diseases, from a clinician's perspective.