Radiomics in Nuclear Medicine Applied to Radiation Therapy: Methods, Pitfalls, and Challenges

Prognostic Value of a Combined Nomogram Model Integrating 3-Dimensional Deep Learning and Radiomics for Head and Neck Cancer

OBJECTIVE

The preoperative prediction of the overall survival (OS) status of patients with head and neck cancer (HNC) is significant value for their individualized treatment and prognosis. This study aims to evaluate the impact of adding 3D deep learning features to radiomics models for predicting 5-year OS status.

METHODS

Two hundred twenty cases from The Cancer Imaging Archive public dataset were included in this study; 2212 radiomics features and 304 deep features were extracted from each case. The features were selected by univariate analysis and the least absolute shrinkage and selection operator, and then grouped into a radiomics model containing Positron Emission Tomography /Computed Tomography (PET/CT) radiomics features score, a deep model containing deep features score, and a combined model containing PET/CT radiomics features score +3D deep features score. TumorStage model was also constructed using initial patient tumor node metastasis stage to compare the performance of the combined model. A nomogram was constructed to analyze the influence of deep features on the performance of the model. The 10-fold cross-validation of the average area under the receiver operating characteristic curve and calibration curve were used to evaluate performance, and Shapley Additive exPlanations (SHAP) was developed for interpretation.

RESULTS

The TumorStage model, radiomics model, deep model, and the combined model achieved areas under the receiver operating characteristic curve of 0.604, 0.851, 0.840, and 0.895 on the train set and 0.571, 0.849, 0.832, and 0.900 on the test set. The combined model showed better performance of predicting the 5-year OS status of HNC patients than the radiomics model and deep model. The combined model was shown to provide a favorable fit in calibration curves and be clinically useful in decision curve analysis. SHAP summary plot and SHAP The SHAP summary plot and SHAP force plot visually interpreted the influence of deep features and radiomics features on the model results.

CONCLUSIONS

In predicting 5-year OS status in patients with HNC, 3D deep features could provide richer features for combined model, which showed outperformance compared with the radiomics model and deep model.

Develop a radiomics-based machine learning model to predict the stone-free rate post-percutaneous nephrolithotomy

Radiomics and machine learning have been extensively utilized in the realm of urinary stones, particularly in forecasting stone treatment outcomes. The objective of this study was to integrate clinical variables and radiomic features to develop a machine learning model for predicting the stone-free rate (SFR) following percutaneous nephrolithotomy (PCNL). A total of 212 eligible patients who underwent PCNL surgery at the Second Affiliated Hospital of Nanchang University were included in a retrospective analysis. Preoperative clinical variables and non-contrast-enhanced CT images of all patients were collected, and radiomic features were extracted after delineating the stone ROI. Univariate analysis was conducted to identify clinical variables strongly correlated with the stone-free rate after PCNL, and the least absolute shrinkage and selection operator algorithm (lasso regression) was utilized to screen radiomic features. Four supervised machine learning algorithms, including Logistic Regression, Random Forest (RF), Extreme Gradient Boosting (XGBoost), and Gradient Boosting Decision Tree (GBDT), were employed. The clinical variables with strong correlation and screened radiomic features were integrated into the four machine learning algorithms to construct a prediction model, and the receiver operating curve was plotted. The area under the receiver operating curve (AUC), the accuracy rate, the specificity, etc., were used to evaluate the predictive performance of the four models. After analyzing postoperative statistics, the stone-free rate following the procedure was found to be 70.3% (n = 149). Among the various clinical variables examined, factors, such as stone number, stone diameter, stone CT value, stone location, and history of stone surgery, were identified as statistically significant in relation to the stone-free rate after PCNL. A total of 121 radiomic features were extracted, and through lasso regression, 7 features most closely associated with the stone-free rate post-PCNL were identified. The predictive accuracy of different models (Logistic Regression, RF, XGBoost, and GBDT) for determining the stone-free rate after PCNL was evaluated, yielding accuracies of 78.1%, 76.6%, 75.0%, and 73.4%, respectively. The corresponding area under the curve AUC (95%CI) were 0.85 (0.83-0.89), 0.81 (0.76-0.85), 0.82 (0.78-0.85), and 0.77 (0.73-0.81), positioning these models among the top performers in logistic regression prediction. In terms of predictive importance scores, the key factors identified by the logistic regression model were number of stone, zone percentage, stone diameter, and surface area. Similarly, the RF model highlighted number of stone, stone CT value, stone diameter, and surface area as the top predictors. Among the four machine learning models, the logistic regression model demonstrated the highest accuracy and discrimination ability in predicting the stone-free rate following PCNL. In comparison to XGBoost and GBDT, RF also exhibited superior accuracy and a certain level of discrimination ability. However, based on the performance of all four models, logistic regression is more likely to aid in clinical decision-making by assisting clinicians in diagnosing PCNL in patients. This enables us to effectively predict the presence of residual stones post-surgery and ultimately select patients who are suitable candidates for PCNL.

Radiomic features of the hippocampal based on magnetic resonance imaging in the menopausal mouse model linked to neuronal damage and cognitive deficits

Estrogen deficiency in the early postmenopausal phase is associated with an increased long-term risk of cognitive decline or dementia. Non-invasive characterization of the pathological features of the pathological hallmarks in the brain associated with postmenopausal women (PMW) could enhance patient management and the development of therapeutic strategies. Radiomics is a means to quantify the radiographic phenotype of a diseased tissue via the high-throughput extraction and mining of quantitative features from images acquired from modalities such as CT and magnetic resonance imaging (MRI). This study set out to explore the correlation between radiomics features based on MRI and pathological features of the hippocampus and cognitive function in the PMW mouse model. Ovariectomized (OVX) mice were used as PWM models. MRI scans were performed two months after surgery. The brain's hippocampal region was manually annotated, and the radiomic features were extracted with PyRadiomics. Chemiluminescence was used to evaluate the peripheral blood estrogen level of mice, and the Morris water maze test was used to evaluate the cognitive ability of mice. Nissl staining and immunofluorescence were used to quantify neuronal damage and COX1 expression in brain sections of mice. The OVX mice exhibited marked cognitive decline, brain neuronal damage, and increased expression of mitochondrial complex IV subunit COX1, which are pathological phenomena commonly observed in the brains of AD patients, and these phenotypes were significantly correlated with radiomics features (p < 0.05, |r|>0.5), including Original_firstorder_Interquartile Range, Original_glcm_Difference Average, Original_glcm_Difference Average and Wavelet-LHH_glszm_Small Area Emphasis. Meanwhile, the above radiomics features were significantly different between the sham-operated and OVX groups (p < 0.01) and were associated with decreased serum estrogen levels (p < 0.05, |r|>0.5). This initial study indicates that the above radiomics features may have a role in the assessment of the pathology of brain damage caused by estrogen deficiency using routinely acquired structural MR images.

Developing a clinical-radiomic prediction model for 3-year cancer-specific survival in lung cancer patients treated with stereotactic body radiation therapy

PURPOSE

The study aims to develop and validate a combined model for predicting 3-year cancer-specific survival (CSS) in lung cancer patients treated with stereotactic body radiation therapy (SBRT) by integrating clinical and radiomic parameters.

METHODS

Clinical data and pre-treatment CT images were collected from 102 patients treated with lung SBRT. Multivariate logistic regression and the least absolute shrinkage and selection operator were used to determine the clinical and radiomic factors associated with 3-year CSS. Three prediction models were developed using clinical factors, radiomic factors, and a combination of both. The performance of the models was assessed using receiver operating characteristic curve and calibration curve. A nomogram was also created to visualize the 3-year CSS prediction.

RESULTS

With a 36-month follow-up, 40 patients (39.2%) died of lung cancer and 62 patients (60.8%) survived. Three clinical factors, including gender, clinical stage, and lymphocyte ratio, along with three radiomic features, were found to be independent factors correlated with 3-year CSS. The area under the curve values for the clinical, radiomic, and combined model were 0.839 (95% CI 0.735-0.914), 0.886 (95% CI 0.790-0.948), and 0.914 (95% CI 0.825-0.966) in the training cohort, and 0.757 (95% CI 0.580-0.887), 0.818 (95% CI 0.648-0.929), and 0.843 (95% CI 0.677-0.944) in the validation cohort, respectively. Additionally, the calibration curve demonstrated good calibration performance and the nomogram created from the combined model showed potential for clinical utility.

CONCLUSION

A clinical-radiomic model was developed to predict the 3-year CSS for lung cancer patients treated with SBRT.

Radiomics and Artificial Intelligence in Radiotheranostics: A Review of Applications for Radioligands Targeting Somatostatin Receptors and Prostate-Specific Membrane Antigens

Radiotheranostics refers to the pairing of radioactive imaging biomarkers with radioactive therapeutic compounds that deliver ionizing radiation. Given the introduction of very promising radiopharmaceuticals, the radiotheranostics approach is creating a novel paradigm in personalized, targeted radionuclide therapies (TRTs), also known as radiopharmaceuticals (RPTs). Radiotherapeutic pairs targeting somatostatin receptors (SSTR) and prostate-specific membrane antigens (PSMA) are increasingly being used to diagnose and treat patients with metastatic neuroendocrine tumors (NETs) and prostate cancer. In parallel, radiomics and artificial intelligence (AI), as important areas in quantitative image analysis, are paving the way for significantly enhanced workflows in diagnostic and theranostic fields, from data and image processing to clinical decision support, improving patient selection, personalized treatment strategies, response prediction, and prognostication. Furthermore, AI has the potential for tremendous effectiveness in patient dosimetry which copes with complex and time-consuming tasks in the RPT workflow. The present work provides a comprehensive overview of radiomics and AI application in radiotheranostics, focusing on pairs of SSTR- or PSMA-targeting radioligands, describing the fundamental concepts and specific imaging/treatment features. Our review includes ligands radiolabeled by 68Ga, 18F, 177Lu, 64Cu, 90Y, and 225Ac. Specifically, contributions via radiomics and AI towards improved image acquisition, reconstruction, treatment response, segmentation, restaging, lesion classification, dose prediction, and estimation as well as ongoing developments and future directions are discussed.

Quantitation of Oncologic Image Features for Radiomic Analyses in PET

Radiomics is an emerging and exciting field of study involving the extraction of many quantitative features from radiographic images. Positron emission tomography (PET) images are used in cancer diagnosis and staging. Utilizing radiomics on PET images can better quantify the spatial relationships between image voxels and generate more consistent and accurate results for diagnosis, prognosis, treatment, etc. This chapter gives the general steps a researcher would take to extract PET radiomic features from medical images and properly develop models to implement.

Radiogenomics: Contemporary Applications in the Management of Rectal Cancer

Radiogenomics, a sub-domain of radiomics, refers to the prediction of underlying tumour biology using non-invasive imaging markers. This novel technology intends to reduce the high costs, workload and invasiveness associated with traditional genetic testing via the development of 'imaging biomarkers' that have the potential to serve as an alternative 'liquid-biopsy' in the determination of tumour biological characteristics. Radiogenomics also harnesses the potential to unlock aspects of tumour biology which are not possible to assess by conventional biopsy-based methods, such as full tumour burden, intra-/inter-lesion heterogeneity and the possibility of providing the information of tumour biology longitudinally. Several studies have shown the feasibility of developing a radiogenomic-based signature to predict treatment outcomes and tumour characteristics; however, many lack prospective, external validation. We performed a systematic review of the current literature surrounding the use of radiogenomics in rectal cancer to predict underlying tumour biology.

Nuclear medicine radiomics in digestive system tumors: Concept, applications, challenges, and future perspectives

Radiomics aims to develop novel biomarkers and provide relevant deeper subvisual information about pathology, immunophenotype, and tumor microenvironment. It uses automated or semiautomated quantitative analysis of high-dimensional images to improve characterization, diagnosis, and prognosis. Recent years have seen a rapid increase in radiomics applications in nuclear medicine, leading to some promising research results in digestive system oncology, which have been driven by big data analysis and the development of artificial intelligence. Although radiomics advances one step further toward the non-invasive precision medical analysis, it is still a step away from clinical application and faces many challenges. This review article summarizes the available literature on digestive system tumors regarding radiomics in nuclear medicine. First, we describe the workflow and steps involved in radiomics analysis. Subsequently, we discuss the progress in clinical application regarding the utilization of radiomics for distinguishing between various diseases and evaluating their prognosis, and demonstrate how radiomics advances this field. Finally, we offer our viewpoint on how the field can progress by addressing the challenges facing clinical implementation.

Radiomics and Radiogenomics in Pelvic Oncology: Current Applications and Future Directions

Radiomics refers to the conversion of medical imaging into high-throughput, quantifiable data in order to analyse disease patterns, guide prognosis and aid decision making. Radiogenomics is an extension of radiomics that combines conventional radiomics techniques with molecular analysis in the form of genomic and transcriptomic data, serving as an alternative to costly, labour-intensive genetic testing. Data on radiomics and radiogenomics in the field of pelvic oncology remain novel concepts in the literature. We aim to perform an up-to-date analysis of current applications of radiomics and radiogenomics in the field of pelvic oncology, particularly focusing on the prediction of survival, recurrence and treatment response. Several studies have applied these concepts to colorectal, urological, gynaecological and sarcomatous diseases, with individual efficacy yet poor reproducibility. This article highlights the current applications of radiomics and radiogenomics in pelvic oncology, as well as the current limitations and future directions. Despite a rapid increase in publications investigating the use of radiomics and radiogenomics in pelvic oncology, the current evidence is limited by poor reproducibility and small datasets. In the era of personalised medicine, this novel field of research has significant potential, particularly for predicting prognosis and guiding therapeutic decisions. Future research may provide fundamental data on how we treat this cohort of patients, with the aim of reducing the exposure of high-risk patients to highly morbid procedures.

Prognostic value of pre-therapeutic FDG-PET radiomic analysis in gastro-esophageal junction cancer

The main aim of this study was to evaluate the prognostic value of radiomic approach in pre-therapeutic ¹⁸F-fluorodeoxyglucose positron-emission tomography (FDG-PET/CT) in a large cohort of patients with gastro-esophageal junction cancer (GEJC). This was a retrospective monocenter study including 97 consecutive patients with GEJC who underwent a pre-therapeutic FDG-PET and were followed up for 3 years. Standard first-order radiomic PET indices including SUV_max, SUV_mean, SUV_peak, MTV and TLG and 32 textural features (TFs) were calculated using LIFEx software on PET imaging. Prognostic significance of these parameters was assessed in univariate and multivariate analysis. Relapse-free survival (RFS) and overall survival (OS) were respectively chosen as primary and secondary endpoints. An internal validation cohort was used by randomly drawing one-third of included patients. The main characteristics of this cohort were: median age of 65 years [41-88], sex ratio H/F = 83/14, 81.5% of patients with a histopathology of adenocarcinoma and 43.3% with a stage IV disease. The median follow-up was 28.5 months [4.2-108.5]. Seventy-seven (79.4%) patients had locoregional or distant progression or recurrence and 71 (73.2%) died. In univariate analysis, SUV_mean, Histogram-Entropy and 2 TFs (GLCM-Homogeneity and GLCM-Energy) were significantly correlated with RFS and OS, as well as 2 others TFs (GLRLM-LRE and GLRLM-GLNU) with OS only. In multivariate analysis, Histogram-Entropy remained an independent prognostic factor of both RFS and OS whereas SUV_mean was an independent prognostic factor of OS only. These results were partially confirmed in our internal validation cohort of 33 patients. Our results suggest that radiomic approach reveals independent prognostic factors for survival in patients with GEJC.

Prognostic analysis of curatively resected pancreatic cancer using harmonized positron emission tomography radiomic features

BACKGROUND

Texture features reflecting tumour heterogeneity enable us to investigate prognostic factors. The R package ComBat can harmonize the quantitative texture features among several positron emission tomography (PET) scanners. We aimed to identify prognostic factors among harmonized PET radiomic features and clinical information from pancreatic cancer patients who underwent curative surgery.

METHODS

Fifty-eight patients underwent preoperative enhanced dynamic computed tomography (CT) scanning and fluorodeoxyglucose PET/CT using four PET scanners. Using LIFEx software, we measured PET radiomic parameters including texture features with higher order and harmonized these PET parameters. For progression-free survival (PFS) and overall survival (OS), we evaluated clinical information, including age, TNM stage, and neural invasion, and the harmonized PET radiomic features based on univariate Cox proportional hazard regression. Next, we analysed the prognostic indices by multivariate Cox proportional hazard regression (1) by using either significant (p < 0.05) or borderline significant (p = 0.05-0.10) indices in the univariate analysis (first multivariate analysis) or (2) by using the selected features with random forest algorithms (second multivariate analysis). Finally, we checked these multivariate results by log-rank test.

RESULTS

Regarding the first multivariate analysis for PFS after univariate analysis, age was the significant prognostic factor (p = 0.020), and MTV and GLCM contrast were borderline significant (p = 0.051 and 0.075, respectively). Regarding the first multivariate analysis of OS, neural invasion, Shape sphericity and GLZLM LZLGE were significant (p = 0.019, 0.042 and 0.0076). In the second multivariate analysis, only MTV was significant (p = 0.046) for PFS, whereas GLZLM LZLGE was significant (p = 0.047), and Shape sphericity was borderline significant (p = 0.088) for OS. In the log-rank test, age, MTV and GLCM contrast were borderline significant for PFS (p = 0.08, 0.06 and 0.07, respectively), whereas neural invasion and Shape sphericity were significant (p = 0.03 and 0.04, respectively), and GLZLM LZLGE was borderline significant for OS (p = 0.08).

CONCLUSIONS

Other than the clinical factors, MTV and GLCM contrast for PFS and Shape sphericity and GLZLM LZLGE for OS may be prognostic PET parameters. A prospective multicentre study with a larger sample size may be warranted.

Primary tumor heterogeneity on pretreatment 18F-FDG PET/CT to predict outcome in patients with rectal cancer who underwent surgery after neoadjuvant therapy

PURPOSE

This retrospective study aimed to investigate the value of texture features of primary tumors in pretreatment ¹⁸F-FDG PET/CT in the prediction of response to treatment, progression, and overall survival in patients with rectal cancer who underwent surgery after neoadjuvant therapy(NAT).

METHODS

Patients with rectal cancer who had pretreatment ¹⁸F-FDG PET/CT, and underwent surgery after NAT were included in this study. Clinicopathologic features, date of last follow-up, progression, and death were recorded. Textural and conventional PET parameters(maximum standardized uptake value-SUVmax, metabolic tumor volume-MTV, total lesion glycolysis-TLG) were obtained from PET/CT images using LifeX program. Parameters were grouped using Youden index in ROC analysis. Factors predicting the pathological response to treatment, progression, and overall survival were determined using logistic regression and Cox regression analyses.

RESULTS

Forty-four patients (26(59%) male, 18(41%) female; 60.1±11.4 years) with rectal cancer were included in this study. The numbers of patients with responders and non-responders to NAT were 15(34.9%) and 28(65.1%), respectively. One patient' pathology report did not contain the response status to NAT. The median of follow-up duration was 29.9 months. 9(20.5%) showed disease progression, and 8(18.2%) died during the follow-up period. Difference entropy_GLCM and correlation_GLCM parameters were found as independent predictors for response to NAT. The positivity of surgical margin, intensity interquartile range_CONV and AUC-CSH_DISC texture parameters were independent predictors of progression, while normalized inverse difference_GLCM and LZLGE_GLZLM parameters were independent predictors of mortality.

CONCLUSION

The texture parameters obtained from pretreatment ¹⁸F-FDG PET/CT have presented a more robust predictive value than conventional parameters in patients with rectal cancer who underwent surgery after NAT.

Radiomics in Cardiac Computed Tomography

In recent years, there has been an increasing recognition of coronary computed tomographic angiography (CCTA) and gated non-contrast cardiac CT in the workup of coronary artery disease in patients with low and intermediate pretest probability, through the readjustment guidelines by medical societies. However, in routine clinical practice, these CT data sets are usually evaluated dominantly regarding relevant coronary artery stenosis and calcification. The implementation of radiomics analysis, which provides visually elusive quantitative information from digital images, has the potential to open a new era for cardiac CT that goes far beyond mere stenosis or calcification grade estimation. This review offers an overview of the results obtained from radiomics analyses in cardiac CT, including the evaluation of coronary plaques, pericoronary adipose tissue, and the myocardium itself. It also highlights the advantages and disadvantages of use in routine clinical practice.

Predicting pathological highly invasive lung cancer from preoperative [18F]FDG PET/CT with multiple machine learning models

PURPOSE

The efficacy of sublobar resection of primary lung cancer have been proven in recent years. However, sublobar resection for highly invasive lung cancer increases local recurrence. We developed and validated multiple machine learning models predicting pathological invasiveness of lung cancer based on preoperative [¹⁸F]fluorodeoxyglucose (FDG) positron emission tomography (PET) and computed tomography (CT) radiomic features.

METHODS

Overall, 873 patients who underwent lobectomy or segmentectomy for primary lung cancer were enrolled. Radiomics features were extracted from preoperative PET/CT images with the PyRadiomics package. Seven machine learning models and an ensemble of all models (ENS) were evaluated after 100 iterations. In addition, the probability of highly invasive lung cancer was calculated in a nested cross-validation to assess the calibration plot and clinical usefulness and to compare to consolidation tumour ratio (CTR) on CT images, one of the generally used diagnostic criteria.

RESULTS

In the training set, when PET and CT features were combined, all models achieved an area under the curve (AUC) of ≥ 0.880. In the test set, ENS showed the highest mean AUC of 0.880 and smallest standard deviation of 0.0165, and when the cutoff was 0.5, accuracy of 0.804, F1 of 0.851, precision of 0.821, and recall of 0.885. In the nested cross-validation, the AUC of 0.882 (95% CI: 0.860-0.905) showed a high discriminative ability, and the calibration plot indicated consistency with a Brier score of 0.131. A decision curve analysis showed that the ENS was valid with a threshold probability ranging from 3 to 98%. Accuracy showed an improvement of more than 8% over the CTR.

CONCLUSION

The machine learning model based on preoperative [¹⁸F]FDG PET/CT images was able to predict pathological highly invasive lung cancer with high discriminative ability and stability. The calibration plot showed good consistency, suggesting its usefulness in quantitative risk assessment.

A Review of Radiomics and Artificial Intelligence and Their Application in Veterinary Diagnostic Imaging

Simple Summary

The goal of this paper is to provide an overview of current radiomic and AI applications in veterinary diagnostic imaging. We discuss the essential elements of AI for veterinary practitioners with the aim of helping them make informed decisions in applying AI technologies to their practices and that veterinarians will play an integral role in ensuring the appropriate uses and suitable curation of data. The expertise of veterinary professionals will be vital to ensuring suitable data and, subsequently, AI that meets the needs of the profession.

Abstract

Great advances have been made in human health care in the application of radiomics and artificial intelligence (AI) in a variety of areas, ranging from hospital management and virtual assistants to remote patient monitoring and medical diagnostics and imaging. To improve accuracy and reproducibility, there has been a recent move to integrate radiomics and AI as tools to assist clinical decision making and to incorporate it into routine clinical workflows and diagnosis. Although lagging behind human medicine, the use of radiomics and AI in veterinary diagnostic imaging is becoming more frequent with an increasing number of reported applications. The goal of this paper is to provide an overview of current radiomic and AI applications in veterinary diagnostic imaging.

Measures of Corticalization

After the insertion of dental implants into living bone, the condition of the peri-implant bone changes with time. Implant-loading phenomena can induce bone remodeling in the form of the corticalization of the trabecular bone. The aim of this study was to see how bone index (BI) values behave in areas of bone loss (radiographically translucent non-trabecular areas) and to propose other indices specifically dedicated to detecting corticalization in living bone. Eight measures of corticalization in clinical standardized intraoral radiographs were studied: mean optical density, entropy, differential entropy, long-run emphasis moment, BI, corticalization index ver. 1 and ver. 2 (CI v.1, CI v.2) and corticalization factor (CF). The analysis was conducted on 40 cortical bone image samples, 40 cancellous bone samples and 40 soft tissue samples. It was found that each measure distinguishes corticalization significantly (p < 0.001), but only CI v.1 and CI v.2 do so selectively. CF or the inverse of BI can serve as a measure of peri-implant bone corticalization. However, better measures are CIs as they are dedicated to detecting this phenomenon and allowing clear clinical deduction.

Production Review of Accelerator-Based Medical Isotopes

The production of reactor-based medical isotopes is fragile, which has meant supply shortages from time to time. This paper reviews alternative production methods in the form of cyclotrons, linear accelerators and neutron generators. Finally, the status of the production of medical isotopes in China is described.

Imaging approaches and radiomics: toward a new era of ultraprecision radioimmunotherapy?

Strong rationale and a growing number of preclinical and clinical studies support combining radiotherapy and immunotherapy to improve patient outcomes. However, several critical questions remain, such as the identification of patients who will benefit from immunotherapy and the identification of the best modalities of treatment to optimize patient response. Imaging biomarkers and radiomics have recently emerged as promising tools for the non-invasive assessment of the whole disease of the patient, allowing comprehensive analysis of the tumor microenvironment, the spatial heterogeneity of the disease and its temporal changes. This review presents the potential applications of medical imaging and the challenges to address, in order to help clinicians choose the optimal modalities of both radiotherapy and immunotherapy, to predict patient’s outcomes and to assess response to these promising combinations.

Volumetric parameters from [18 F]FDG PET/CT predicts survival in patients with high-grade gastroenteropancreatic neuroendocrine neoplasms

A positive fluorine-18 labelled 2-deoxy-2-fluoroglucose ([¹⁸ F]FDG) positron emission tomography/computed tomography (PET/CT) has been associated with more aggressive disease and less differentiated neuroendocrine neoplasms (NEN). Although a high maximum standardized uptake value (SUV_max ) predicts poor outcome in NEN, volumetric parameters from [¹⁸ F]FDG PET have not been evaluated for prognostication in a pure high-grade gastroenteropancreatic (GEP) NEN cohort. In this retrospective observational study, we evaluated the volumetric PET parameters total metabolic tumour volume (tMTV) and total total lesion glycolysis (tTLG) for independent prognostication of overall survival (OS). High-grade GEP NEN patients with [¹⁸ F]FDG PET/CT examination and biopsy within 90 days were included. Total MTV and tTLG were calculated using an adaptive thresholding software. Patients were dichotomised into low and high metabolic groups based on median tMTV and tTLG. OS was compared using Kaplan-Meier estimator and log-rank test. Uni and multivariable Cox regression was used to estimate effect sizes and adjust for tumour differentiation and SUV_max . Sixty-six patients (median age 64 years) were included with 14 NET G3 and 52 NEC cases after histological re-evaluation. Median tMTV was 208 cm³ and median tTLG 1899 g. Median OS in the low versus high tMTV-group was 21.2 versus 5.7 months (HR 2.53, p = 0.0007) and 22.8 versus 5.7 months (HR 2.42, p = 0.0012) in the tTLG-group. Adjusted for tumour differentiation and SUV_max , tMTV and tTLG still predicted for poor OS, and both tMTV and tTLG were stronger prognostic parameters than SUV_max . Both regression models showed a strong association between volumetric parameters and OS for both neuroendocrine tumours (NET) G3 and neuroendocrine carcinomas (NEC). OS for the tTLG low metabolic NEC was much higher than for the tTLG high metabolic NET G3 (18.3 vs. 5.7 months). High-grade GEP NEN patients with high tMTV or tTLG had a worse OS regardless of tumour differentiation (NET G3 or NEC). Volumetric PET parameters were stronger prognostic parameters than SUV_max .

Dopamine transporter single-photon emission computed tomography-derived radiomics signature for detecting Parkinson's disease

BACKGROUND

We hypothesised that the radiomics signature, which includes texture information of dopamine transporter single-photon emission computed tomography (DAT-SPECT) images for Parkinson's disease (PD), may assist semi-quantitative indices. Herein, we constructed a radiomics signature using DAT-SPECT-derived radiomics features that effectively discriminated PD from healthy individuals and evaluated its classification performance.

RESULTS

We analysed 413 cases of both normal control (NC, n = 101) and PD (n = 312) groups from the Parkinson's Progression Markers Initiative database. Data were divided into the training and two test datasets with different SPECT manufacturers. DAT-SPECT images were spatially normalised to the Montreal Neurologic Institute space. We calculated 930 radiomics features, including intensity- and texture-based features in the caudate, putamen, and pallidum volumes of interest. The striatum uptake ratios (SURs) of the caudate, putamen, and pallidum were also calculated as conventional semi-quantification indices. The least absolute shrinkage and selection operator was used for feature selection and construction of the radiomics signature. The four classification models were constructed using a radiomics signature and/or semi-quantitative indicator. Furthermore, we compared the classification performance of the semi-quantitative indicator alone and the combination with the radiomics signature for the classification models. The receiver operating characteristics (ROC) analysis was used to evaluate the classification performance. The classification performance of SUR_putamen was higher than that of other semi-quantitative indicators. The radiomics signature resulted in a slightly increased area under the ROC curve (AUC) compared to SUR_putamen in each test dataset. When combined with SUR_putamen and radiomics signature, all classification models showed slightly higher AUCs than that of SUR_putamen alone.

CONCLUSION

We constructed a DAT-SPECT image-derived radiomics signature. Performance analysis showed that the current radiomics signature would be helpful for the diagnosis of PD and has the potential to provide robust diagnostic performance.

Radiomics-guided radiation therapy: opportunities and challenges

Radiomics is an advanced image-processing framework, which extracts image features and considers them as biomarkers towards personalized medicine. Applications include disease detection, diagnosis, prognosis, and therapy response assessment/prediction. As radiation therapy aims for further individualized treatments, radiomics could play a critical role in various steps before, during and after treatment. Elucidation of the concept of radiomics-guided radiation therapy (RGRT) is the aim of this review, attempting to highlight opportunities and challenges underlying the use of radiomics to guide clinicians and physicists towards more effective radiation treatments. This work identifies the value of RGRT in various steps of radiotherapy from patient selection to follow-up, and subsequently provides recommendations to improve future radiotherapy using quantitative imaging features.

Potential advantages of FDG-PET radiomic feature map for target volume delineation in lung cancer radiotherapy

PURPOSE

To investigate the potential benefits of FDG PET radiomic feature maps (RFMs) for target delineation in non-small cell lung cancer (NSCLC) radiotherapy.

METHODS

Thirty-two NSCLC patients undergoing FDG PET/CT imaging were included. For each patient, nine grey-level co-occurrence matrix (GLCM) RFMs were generated. gross target volume (GTV) and clinical target volume (CTV) were contoured on CT (GTV_CT , CTV_CT ), PET (GTV_PET40 , CTV_PET40 ), and RFMs (GTV_RFM , CTV_RFM ,). Intratumoral heterogeneity areas were segmented as GTV_PET50-Boost and radiomic boost target volume (RTV_Boost ) on PET and RFMs, respectively. GTV_CT in homogenous tumors and GTV_PET40 in heterogeneous tumors were considered as GTV_{gold standard} (GTV_GS ). One-way analysis of variance was conducted to determine the threshold that finds the best conformity for GTV_RFM with GTV_GS . Dice similarity coefficient (DSC) and mean absolute percent error (MAPE) were calculated. Linear regression analysis was employed to report the correlations between the gold standard and RFM-derived target volumes.

RESULTS

Entropy, contrast, and Haralick correlation (H-correlation) were selected for tumor segmentation. The threshold values of 80%, 50%, and 10% have the best conformity of GTV_RFM-entropy , GTV_RFM-contrast , and GTV_{RFM-H-correlation} with GTV_GS , respectively. The linear regression results showed a positive correlation between GTV_GS and GTV_RFM-entropy (r = 0.98, p < 0.001), between GTV_GS and GTV_RFM-contrast (r = 0.93, p < 0.001), and between GTV_GS and GTV_{RFM-H-correlation} (r = 0.91, p < 0.001). The average threshold values of 45% and 15% were resulted in the best segmentation matching between CTV_RFM-entropy and CTV_RFM-contrast with CTV_GS , respectively. Moreover, we used RFM to determine RTV_Boost in the heterogeneous tumors. Comparison of RTV_Boost with GTV_PET50-Boost MAPE showed the volume error differences of 31.7%, 36%, and 34.7% in RTV_{Boost-entropy} , RTV_{Boost-contrast} , and RTV_{Boost-H-correlation} , respectively.

CONCLUSIONS

FDG PET-based radiomics features in NSCLC demonstrated a promising potential for decision support in radiotherapy, helping radiation oncologists delineate tumors and generate accurate segmentation for heterogeneous region of tumors.

Noise-Based Image Harmonization Significantly Increases Repeatability and Reproducibility of Radiomics Features in PET Images: A Phantom Study

For multicenter clinical studies, characterizing the robustness of image-derived radiomics features is essential. Features calculated on PET images have been shown to be very sensitive to image noise. The purpose of this work was to investigate the efficacy of a relatively simple harmonization strategy on feature robustness and agreement. A purpose-built texture pattern phantom was scanned on 10 different PET scanners in 7 institutions with various different image acquisition and reconstruction protocols. An image harmonization technique based on equalizing a contrast-to-noise ratio was employed to generate a "harmonized" alongside a "standard" dataset for a reproducibility study. In addition, a repeatability study was performed with images from a single PET scanner of variable image noise, varying the binning time of the reconstruction. Feature agreement was measured using the intraclass correlation coefficient (ICC). In the repeatability study, 81/93 features had a lower ICC on the images with the highest image noise as compared to the images with the lowest image noise. Using the harmonized dataset significantly improved the feature agreement for five of the six investigated feature classes over the standard dataset. For three feature classes, high feature agreement corresponded with higher sensitivity to the different patterns, suggesting a way to select suitable features for predictive models.

Context-Aware Saliency Guided Radiomics: Application to Prediction of Outcome and HPV-Status from Multi-Center PET/CT Images of Head and Neck Cancer

Simple Summary

This study investigated the ability of context-aware saliency-guided PET/CT radiomics in the prediction of outcome and HPV status for head and neck cancer. In total, 806 HNC patients (training vs. validation vs. external testing: 500 vs. 97 vs. 209) from 9 centers were collected from The Cancer Imaging Archive (TCIA). Saliency-guided radiomics showed enhanced performance for both outcome and HPV-status predictions relative to conventional radiomics. The radiomics-predicted HPV status also showed complementary prognostic value. This multi-center study highlights the feasibility of saliency-guided PET/CT radiomics in outcome predictions of head and neck cancer, confirming that certain regions are more relevant to tumor aggressiveness and prognosis.

Abstract

Purpose: This multi-center study aims to investigate the prognostic value of context-aware saliency-guided radiomics in ¹⁸F-FDG PET/CT images of head and neck cancer (HNC). Methods: 806 HNC patients (training vs. validation vs. external testing: 500 vs. 97 vs. 209) from 9 centers were collected from The Cancer Imaging Archive (TCIA). There were 100/384 and 60/123 oropharyngeal carcinoma (OPC) patients with human papillomavirus (HPV) status in training and testing cohorts, respectively. Six types of images were used for radiomics feature extraction and further model construction, namely (i) the original image (Origin), (ii) a context-aware saliency map (SalMap), (iii, iv) high- or low-saliency regions in the original image (highSal or lowSal), (v) a saliency-weighted image (SalxImg), and finally, (vi) a fused PET-CT image (FusedImg). Four outcomes were evaluated, i.e., recurrence-free survival (RFS), metastasis-free survival (MFS), overall survival (OS), and disease-free survival (DFS), respectively. Multivariate Cox analysis and logistic regression were adopted to construct radiomics scores for the prediction of outcome (Rad_Ocm) and HPV-status (Rad_HPV), respectively. Besides, the prognostic value of their integration (Rad_Ocm_HPV) was also investigated. Results: In the external testing cohort, compared with the Origin model, SalMap and SalxImg achieved the highest C-indices for RFS (0.621 vs. 0.559) and MFS (0.785 vs. 0.739) predictions, respectively, while FusedImg performed the best for both OS (0.685 vs. 0.659) and DFS (0.641 vs. 0.582) predictions. In the OPC HPV testing cohort, FusedImg showed higher AUC for HPV-status prediction compared with the Origin model (0.653 vs. 0.484). In the OPC testing cohort, compared with Rad_Ocm or Rad_HPV alone, Rad_Ocm_HPV performed the best for OS and DFS predictions with C-indices of 0.702 (p = 0.002) and 0.684 (p = 0.006), respectively. Conclusion: Saliency-guided radiomics showed enhanced performance for both outcome and HPV-status predictions relative to conventional radiomics. The radiomics-predicted HPV status also showed complementary prognostic value.

The Role of Radiomics in the Era of Immune Checkpoint Inhibitors: A New Protagonist in the Jungle of Response Criteria

Simple Summary

The introduction of immune checkpoint inhibitors has represented a milestone in cancer treatment. Despite PD-L1 expression being the standard biomarker used before the start of therapy, there is still a strict need to identify complementary non-invasive biomarkers in order to better select patients. In this context, radiomics is an emerging approach for examining medical images and clinical data by capturing multiple features hidden from human eye and is potentially able to predict response assessment and survival in the course of immunotherapy. We reviewed the available studies investigating the role of radiomics in cancer patients, focusing on non-small cell lung cancer treated with immune checkpoint inhibitors. Although preliminary research shows encouraging results, different issues need to be solved before radiomics can enter into clinical practice.

Abstract

Immune checkpoint inhibitors (ICI) have demonstrated encouraging results in terms of durable clinical benefit and survival in several malignancies. Nevertheless, the search to identify an “ideal” biomarker for predicting response to ICI is still far from over. Radiomics is a new translational field of study aiming to extract, by dedicated software, several features from a given medical image, ranging from intensity distribution and spatial heterogeneity to higher-order statistical parameters. Based on these premises, our review aims to summarize the current status of radiomics as a potential predictor of clinical response following immunotherapy treatment. A comprehensive search of PubMed results was conducted. All studies published in English up to and including December 2021 were selected, comprising those that explored computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET) for radiomic analyses in the setting of ICI. Several studies have demonstrated the potential applicability of radiomic features in the monitoring of the therapeutic response beyond the traditional morphologic and metabolic criteria, as well as in the prediction of survival or non-invasive assessment of the tumor microenvironment. Nevertheless, important limitations emerge from our review in terms of standardization in feature selection, data sharing, and methods, as well as in external validation. Additionally, there is still need for prospective clinical trials to confirm the potential significant role of radiomics during immunotherapy.

Voxel-wise supervised analysis of tumors with multimodal engineered features to highlight interpretable biological patterns

Background

Translation of predictive and prognostic image‐based learning models to clinical applications is challenging due in part to their lack of interpretability. Some deep‐learning‐based methods provide information about the regions driving the model output. Yet, due to the high‐level abstraction of deep features, these methods do not completely solve the interpretation challenge. In addition, low sample size cohorts can lead to instabilities and suboptimal convergence for models involving a large number of parameters such as convolutional neural networks.

Purpose

Here, we propose a method for designing radiomic models that combines the interpretability of handcrafted radiomics with a sub‐regional analysis.

Materials and methods

Our approach relies on voxel‐wise engineered radiomic features with average global aggregation and logistic regression. The method is illustrated using a small dataset of 51 soft tissue sarcoma (STS) patients where the task is to predict the risk of lung metastasis occurrence during the follow‐up period.

Results

Using positron emission tomography/computed tomography and two magnetic resonance imaging sequences separately to build two radiomic models, we show that our approach produces quantitative maps that highlight the signal that contributes to the decision within the tumor region of interest. In our STS example, the analysis of these maps identified two biological patterns that are consistent with STS grading systems and knowledge: necrosis development and glucose metabolism of the tumor.

Conclusions

We demonstrate how that method makes it possible to spatially and quantitatively interpret radiomic models amenable to sub‐regions identification and biological interpretation for patient stratification.

Multi-center evaluation of artificial intelligent imaging and clinical models for predicting neoadjuvant chemotherapy response in breast cancer

BACKGROUND

Neoadjuvant chemotherapy (NAC) plays an important role in the management of locally advanced breast cancer. It allows for downstaging of tumors, potentially allowing for breast conservation. NAC also allows for in-vivo testing of the tumors' response to chemotherapy and provides important prognostic information. There are currently no clearly defined clinical models that incorporate imaging with clinical data to predict response to NAC. Thus, the aim of this work is to develop a predictive AI model based on routine CT imaging and clinical parameters to predict response to NAC.

METHODS

The CT scans of 324 patients with NAC from multiple centers in Singapore were used in this study. Four different radiomics models were built for predicting pathological complete response (pCR): first two were based on textural features extracted from peri-tumoral and tumoral regions, the third model based on novel space-resolved radiomics which extract feature maps using voxel-based radiomics and the fourth model based on deep learning (DL). Clinical parameters were included to build a final prognostic model.

RESULTS

The best performing models were based on space-resolved and DL approaches. Space-resolved radiomics improves the clinical AUCs of pCR prediction from 0.743 (0.650 to 0.831) to 0.775 (0.685 to 0.860) and our DL model improved it from 0.743 (0.650 to 0.831) to 0.772 (0.685 to 0.853). The tumoral radiomics model performs the worst with no improvement of the AUC from the clinical model. The peri-tumoral combined model gives moderate performance with an AUC of 0.765 (0.671 to 0.855).

CONCLUSIONS

Radiomics features extracted from diagnostic CT augment the predictive ability of pCR when combined with clinical features. The novel space-resolved radiomics and DL radiomics approaches outperformed conventional radiomics techniques.

Joint EANM/SNMMI/ESTRO practice recommendations for the use of 2-[18F]FDG PET/CT external beam radiation treatment planning in lung cancer V1.0

Purpose

2-[¹⁸F]FDG PET/CT is of utmost importance for radiation treatment (RT) planning and response monitoring in lung cancer patients, in both non-small and small cell lung cancer (NSCLC and SCLC). This topic has been addressed in guidelines composed by experts within the field of radiation oncology. However, up to present, there is no procedural guideline on this subject, with involvement of the nuclear medicine societies.

Methods

A literature review was performed, followed by a discussion between a multidisciplinary team of experts in the different fields involved in the RT planning of lung cancer, in order to guide clinical management. The project was led by experts of the two nuclear medicine societies (EANM and SNMMI) and radiation oncology (ESTRO).

Results and conclusion

This guideline results from a joint and dynamic collaboration between the relevant disciplines for this topic. It provides a worldwide, state of the art, and multidisciplinary guide to 2-[¹⁸F]FDG PET/CT RT planning in NSCLC and SCLC. These practical recommendations describe applicable updates for existing clinical practices, highlight potential flaws, and provide solutions to overcome these as well. Finally, the recent developments considered for future application are also reviewed.

Cardiac SPECT radiomic features repeatability and reproducibility: A multi-scanner phantom study

BACKGROUND

The aim of this work was to assess the robustness of cardiac SPECT radiomic features against changes in imaging settings, including acquisition, and reconstruction parameters.

METHODS

Four commercial SPECT and SPECT/CT cameras were used to acquire images of a static cardiac phantom mimicking typical myorcardial perfusion imaging using 185 MBq of 99mTc. The effects of different image acquisition and reconstruction parameters, including number of views, view matrix size, attenuation correction, as well as image reconstruction related parameters (algorithm, number of iterations, number of subsets, type of post-reconstruction filter, and its associated parameters, including filter order and cut-off frequency) were studied. In total, 5,063 transverse views were reconstructed by varying the aforementioned factors. Eighty-seven radiomic features including first-, second-, and high-order textures were extracted from these images. To assess reproducibility and repeatability, the coefficient of variation (COV), as a widely adopted metric, was measured for each of the radiomic features over the different imaging settings.

RESULTS

The Inverse Difference Moment Normalized (IDMN) and Inverse Difference Normalized (IDN) features from the Gray Level Co-occurrence Matrix (GLCM), Run Percentage (RP) from the Gray Level Co-occurrence Matrix (GLRLM), Zone Entropy (ZE) from the Gray Level Size Zone Matrix (GLSZM), and Dependence Entropy (DE) from the Gray Level Dependence Matrix (GLDM) feature sets were the only features that exhibited high reproducibility (COV ≤ 5%) against changes in all imaging settings. In addition, Large Area Low Gray Level Emphasis (LALGLE), Small Area Low Gray Level Emphasis (SALGLE) and Low Gray Level Zone Emphasis (LGLZE) from GLSZM, and Small Dependence Low Gray Level Emphasis (SDLGLE) from GLDM feature sets turned out to be less reproducible (COV > 20%) against changes in imaging settings. The GLRLM (31.88%) and GLDM feature set (54.2%) had the highest (COV < 5%) and lowest (COV > 20%) number of the reproducible features, respectively. Matrix size had the largest impact on feature variability as most of the features were not repeatable when matrix size was modified with 82.8% of them having a COV > 20%.

CONCLUSION

The repeatability and reproducibility of SPECT/CT cardiac radiomic features under different imaging settings is feature-dependent. Different image acquisition and reconstruction protocols have variable effects on radiomic features. The radiomic features exhibiting low COV are potential candidates for future clinical studies.

[Artificial intelligence and medical imaging]

The use of artificial intelligence methods for image recognition is one of the most developed branches of the AI field and these technologies are now commonly used in our daily lives. In the field of medical imaging, approaches based on artificial intelligence are particularly promising, with numerous applications and a strong interest in the search for new biomarkers. Here, we will present the general methods used in these approaches as well as the potential areas of application.

Decoding intra-tumoral spatial heterogeneity on radiological images using the Hilbert curve

Background

Current intra-tumoral heterogeneous feature extraction in radiology is limited to the use of a single slice or the region of interest within a few context-associated slices, and the decoding of intra-tumoral spatial heterogeneity using whole tumor samples is rare. We aim to propose a mathematical model of space-filling curve-based spatial correspondence mapping to interpret intra-tumoral spatial locality and heterogeneity.

Methods

A Hilbert curve-based approach was employed to decode and visualize intra-tumoral spatial heterogeneity by expanding the tumor volume to a two-dimensional (2D) matrix in voxels while preserving the spatial locality of the neighboring voxels. The proposed method was validated using three-dimensional (3D) volumes constructed from lung nodules from the LIDC-IDRI dataset, regular axial plane images, and 3D blocks.

Results

Dimensionality reduction of the Hilbert volume with a single regular axial plane image showed a sparse and scattered pixel distribution on the corresponding 2D matrix. However, for 3D blocks and lung tumor inside the volume, the dimensionality reduction to the 2D matrix indicated regular and concentrated squares and rectangles. For classification into benign and malignant masses using lung nodules from the LIDC-IDRI dataset, the Inception-V4 indicated that the Hilbert matrix images improved accuracy (85.54% vs. 73.22%, p < 0.001) compared to the original CT images of the test dataset.

Conclusions

Our study indicates that Hilbert curve-based spatial correspondence mapping is promising for decoding intra-tumoral spatial heterogeneity of partial or whole tumor samples on radiological images. This spatial-locality-preserving approach for voxel expansion enables existing radiomics and convolution neural networks to filter structured and spatially correlated high-dimensional intra-tumoral heterogeneity.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13244-021-01100-8.

Radiomics feature reliability assessed by intraclass correlation coefficient: a systematic review

Radiomics research is rapidly growing in recent years, but more concerns on radiomics reliability are also raised. This review attempts to update and overview the current status of radiomics reliability research in the ever expanding medical literature from the perspective of a single reliability metric of intraclass correlation coefficient (ICC). To conduct this systematic review, Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed. After literature search and selection, a total of 481 radiomics studies using CT, PET, or MRI, covering a wide range of subject and disease types, were included for review. In these highly heterogeneous studies, feature reliability to image segmentation was much more investigated than reliability to other factors, such as image acquisition, reconstruction, post-processing, and feature quantification. The reported ICCs also suggested high radiomics feature reliability to image segmentation. Image acquisition was found to introduce much more feature variability than image segmentation, in particular for MRI, based on the reported ICC values. Image post-processing and feature quantification yielded different levels of radiomics reliability and might be used to mitigate image acquisition-induced variability. Some common flaws and pitfalls in ICC use were identified, and suggestions on better ICC use were given. Due to the extremely high study heterogeneities and possible risks of bias, the degree of radiomics feature reliability that has been achieved could not yet be safely synthesized or derived in this review. More future researches on radiomics reliability are warranted.

Radiomics in PET Imaging:: A Practical Guide for Newcomers

Radiomics has undergone considerable development in recent years. In PET imaging, very promising results concerning the ability of handcrafted features to predict the biological characteristics of lesions and to assess patient prognosis or response to treatment have been reported in the literature. This article presents a checklist for designing a reliable radiomic study, gives an overview of the steps of the pipeline, and outlines approaches for data harmonization. Tips are provided for critical reading of the content of articles. The advantages and limitations of handcrafted radiomics compared with deep-learning approaches for the characterization of PET images are also discussed.

Artificial intelligence in medical imaging: A radiomic guide to precision phenotyping of cardiovascular disease

ABSTRACT

Rapid technological advances in non-invasive imaging, coupled with the availability of large data sets and the expansion of computational models and power, have revolutionized the role of imaging in medicine. Non-invasive imaging is the pillar of modern cardiovascular diagnostics, with modalities such as cardiac computed tomography (CT) now recognized as first-line options for cardiovascular risk stratification and the assessment of stable or even unstable patients. To date, cardiovascular imaging has lagged behind other fields, such as oncology, in the clinical translational of artificial intelligence (AI)-based approaches. We hereby review the current status of AI in non-invasive cardiovascular imaging, using cardiac CT as a running example of how novel machine learning (ML)-based radiomic approaches can improve clinical care. The integration of ML, deep learning, and radiomic methods has revealed direct links between tissue imaging phenotyping and tissue biology, with important clinical implications. More specifically, we discuss the current evidence, strengths, limitations, and future directions for AI in cardiac imaging and CT, as well as lessons that can be learned from other areas. Finally, we propose a scientific framework in order to ensure the clinical and scientific validity of future studies in this novel, yet highly promising field. Still in its infancy, AI-based cardiovascular imaging has a lot to offer to both the patients and their doctors as it catalyzes the transition towards a more precise phenotyping of cardiovascular disease.

Incorporating radiomics into clinical trials: expert consensus endorsed by the European Society of Radiology on considerations for data-driven compared to biologically driven quantitative biomarkers

Existing quantitative imaging biomarkers (QIBs) are associated with known biological tissue characteristics and follow a well-understood path of technical, biological and clinical validation before incorporation into clinical trials. In radiomics, novel data-driven processes extract numerous visually imperceptible statistical features from the imaging data with no a priori assumptions on their correlation with biological processes. The selection of relevant features (radiomic signature) and incorporation into clinical trials therefore requires additional considerations to ensure meaningful imaging endpoints. Also, the number of radiomic features tested means that power calculations would result in sample sizes impossible to achieve within clinical trials. This article examines how the process of standardising and validating data-driven imaging biomarkers differs from those based on biological associations. Radiomic signatures are best developed initially on datasets that represent diversity of acquisition protocols as well as diversity of disease and of normal findings, rather than within clinical trials with standardised and optimised protocols as this would risk the selection of radiomic features being linked to the imaging process rather than the pathology. Normalisation through discretisation and feature harmonisation are essential pre-processing steps. Biological correlation may be performed after the technical and clinical validity of a radiomic signature is established, but is not mandatory. Feature selection may be part of discovery within a radiomics-specific trial or represent exploratory endpoints within an established trial; a previously validated radiomic signature may even be used as a primary/secondary endpoint, particularly if associations are demonstrated with specific biological processes and pathways being targeted within clinical trials. KEY POINTS: • Data-driven processes like radiomics risk false discoveries due to high-dimensionality of the dataset compared to sample size, making adequate diversity of the data, cross-validation and external validation essential to mitigate the risks of spurious associations and overfitting. • Use of radiomic signatures within clinical trials requires multistep standardisation of image acquisition, image analysis and data mining processes. • Biological correlation may be established after clinical validation but is not mandatory.

[Artificial intelligence, radiomics and pathomics to predict response and survival of patients treated with radiations]

Artificial intelligence approaches in medicine are more and more used and are extremely promising due to the growing number of data produced and the variety of data they allow to exploit. Thus, the computational analysis of medical images in particular, radiological (radiomics), or anatomopathological (pathomics), has shown many very interesting results for the prediction of the prognosis and the response of cancer patients. Radiotherapy is a discipline that particularly benefits from these new approaches based on computer science and imaging. This review will present the main principles of an artificial intelligence approach and in particular machine learning, the principles of a radiomic and pathomic approach and the potential of their use for the prediction of the prognosis of patients treated with radiotherapy.

Target Heterogeneity in Oncology: The Best Predictor for Differential Response to Radioligand Therapy in Neuroendocrine Tumors and Prostate Cancer

Simple Summary

In the era of precision medicine, novel targets have emerged on the surface of cancer cells, which have been exploited for the purpose of radioligand therapy. However, there have been variations in the way these receptors are expressed, especially in prostate cancers and neuroendocrine tumors. This variable expression of receptors across the grades of cancers led to the concept of ‘target heterogeneity’, which has not just impacted therapeutic decisions but also their outcomes. Radiopharmaceuticals targeting receptors need to be used when there are specific indicators—either clinical, radiological, or at molecular level—warranting their use. In addition, response to these radioligands can be assessed using different techniques, whereby we can prognosticate further outcomes. We shall also discuss, in this review, the conventional as well as novel approaches of detecting heterogeneity in prostate cancers and neuroendocrine tumors.

Abstract

Tumor or target heterogeneity (TH) implies presence of variable cellular populations having different genomic characteristics within the same tumor, or in different tumor sites of the same patient. The challenge is to identify this heterogeneity, as it has emerged as the most common cause of ‘treatment resistance’, to current therapeutic agents. We have focused our discussion on ‘Prostate Cancer’ and ‘Neuroendocrine Tumors’, and looked at the established methods for demonstrating heterogeneity, each with its advantages and drawbacks. Also, the available theranostic radiotracers targeting PSMA and somatostatin receptors combined with targeted systemic agents, have been described. Lu-177 labeled PSMA and DOTATATE are the ‘standard of care’ radionuclide therapeutic tracers for management of progressive treatment-resistant prostate cancer and NET. These approved therapies have shown reasonable benefit in treatment outcome, with improvement in quality of life parameters. Various biomarkers and predictors of response to radionuclide therapies targeting TH which are currently available and those which can be explored have been elaborated in details. Imaging-based features using artificial intelligence (AI) need to be developed to further predict the presence of TH. Also, novel theranostic tools binding to newer targets on surface of cancer cell should be explored to overcome the treatment resistance to current treatment regimens.

Development of a Machine Learning Classifier Based on Radiomic Features Extracted From Post-Contrast 3D T1-Weighted MR Images to Distinguish Glioblastoma From Solitary Brain Metastasis

Objectives

To differentiate Glioblastomas (GBM) and Brain Metastases (BM) using a radiomic features-based Machine Learning (ML) classifier trained from post-contrast three-dimensional T1-weighted (post-contrast 3DT1) MR imaging, and compare its performance in medical diagnosis versus human experts, on a testing cohort.

Methods

We enrolled 143 patients (71 GBM and 72 BM) in a retrospective bicentric study from January 2010 to May 2019 to train the classifier. Post-contrast 3DT1 MR images were performed on a 3-Tesla MR unit and 100 radiomic features were extracted. Selection and optimization of the Machine Learning (ML) classifier was performed using a nested cross-validation. Sensitivity, specificity, balanced accuracy, and area under the receiver operating characteristic curve (AUC) were calculated as performance metrics. The model final performance was cross-validated, then evaluated on a test set of 37 patients, and compared to human blind reading using a McNemar’s test.

Results

The ML classifier had a mean [95% confidence interval] sensitivity of 85% [77; 94], a specificity of 87% [78; 97], a balanced accuracy of 86% [80; 92], and an AUC of 92% [87; 97] with cross-validation. Sensitivity, specificity, balanced accuracy and AUC were equal to 75, 86, 80 and 85% on the test set. Sphericity 3D radiomic index highlighted the highest coefficient in the logistic regression model. There were no statistical significant differences observed between the performance of the classifier and the experts’ blinded examination.

Conclusions

The proposed diagnostic support system based on radiomic features extracted from post-contrast 3DT1 MR images helps in differentiating solitary BM from GBM with high diagnosis performance and generalizability.

18F-FMISO-PET Hypoxia Monitoring for Head-and-Neck Cancer Patients: Radiomics Analyses Predict the Outcome of Chemo-Radiotherapy

Tumor hypoxia is associated with radiation resistance and can be longitudinally monitored by 18F-fluoromisonidazole (18F-FMISO)-PET/CT. Our study aimed at evaluating radiomics dynamics of 18F-FMISO-hypoxia imaging during chemo-radiotherapy (CRT) as predictors for treatment outcome in head-and-neck squamous cell carcinoma (HNSCC) patients. We prospectively recruited 35 HNSCC patients undergoing definitive CRT and longitudinal 18F-FMISO-PET/CT scans at weeks 0, 2 and 5 (W0/W2/W5). Patients were classified based on peritherapeutic variations of the hypoxic sub-volume (HSV) size (increasing/stable/decreasing) and location (geographically-static/geographically-dynamic) by a new objective classification parameter (CP) accounting for spatial overlap. Additionally, 130 radiomic features (RF) were extracted from HSV at W0, and their variations during CRT were quantified by relative deviations (∆RF). Prediction of treatment outcome was considered statistically relevant after being corrected for multiple testing and confirmed for the two 18F-FMISO-PET/CT time-points and for a validation cohort. HSV decreased in 64% of patients at W2 and in 80% at W5. CP distinguished earlier disease progression (geographically-dynamic) from later disease progression (geographically-static) in both time-points and cohorts. The texture feature low grey-level zone emphasis predicted local recurrence with AUCW2 = 0.82 and AUCW5 = 0.81 in initial cohort (N = 25) and AUCW2 = 0.79 and AUCW5 = 0.80 in validation cohort. Radiomics analysis of 18F-FMISO-derived hypoxia dynamics was able to predict outcome of HNSCC patients after CRT.

Next-Generation Radiogenomics Sequencing for Prediction of EGFR and KRAS Mutation Status in NSCLC Patients Using Multimodal Imaging and Machine Learning Algorithms

PURPOSE

Considerable progress has been made in the assessment and management of non-small cell lung cancer (NSCLC) patients based on mutation status in the epidermal growth factor receptor (EGFR) and Kirsten rat sarcoma viral oncogene (KRAS). At the same time, NSCLC management through KRAS and EGFR mutation profiling faces challenges. In the present work, we aimed to evaluate a comprehensive radiomics framework that enabled prediction of EGFR and KRAS mutation status in NSCLC patients based on radiomic features from low-dose computed tomography (CT), contrast-enhanced diagnostic quality CT (CTD), and positron emission tomography (PET) imaging modalities and use of machine learning algorithms.

METHODS

Our study involved NSCLC patients including 150 PET, low-dose CT, and CTD images. Radiomic features from original and preprocessed (including 64 bin discretizing, Laplacian-of-Gaussian (LOG), and Wavelet) images were extracted. Conventional clinically used standard uptake value (SUV) parameters and metabolic tumor volume (MTV) were also obtained from PET images. Highly correlated features were pre-eliminated, and false discovery rate (FDR) correction was performed with the resulting q-values reported for univariate analysis. Six feature selection methods and 12 classifiers were then used for multivariate prediction of gene mutation status (provided by polymerase chain reaction (PCR)) in patients. We performed 10-fold cross-validation for model tuning to improve robustness, and our developed models were assessed on an independent validation set with 68 patients (common in all three imaging modalities). The average area under the receiver operator characteristic curve (AUC) was utilized for performance evaluation.

RESULTS

The best predictive power for conventional PET parameters was achieved by SUV_peak (AUC 0.69, p value = 0.0002) and MTV (AUC 0.55, p value = 0.0011) for EGFR and KRAS, respectively. Univariate analysis of extracted radiomics features improved AUC performance to 0.75 (q-value 0.003, Short-Run Emphasis feature of GLRLM from LOG preprocessed image of PET with sigma value 1.5) and 0.71 (q-value 0.00005, Large Dependence Low Gray-Level Emphasis feature of GLDM in LOG preprocessed image of CTD with sigma value 5) for EGFR and KRAS, respectively. Furthermore, multivariate machine learning-based AUC performances were significantly improved to 0.82 for EGFR (LOG preprocessed image of PET with sigma 3 with variance threshold (VT) feature selector and stochastic gradient descent (SGD) classifier (q-value = 4.86E-05) and 0.83 for KRAS (LOG preprocessed image of CT with sigma 3.5 with select model (SM) feature selector and SGD classifier (q-value = 2.81E-09).

CONCLUSION

Our work demonstrated that non-invasive and reliable radiomics analysis can be successfully used to predict EGFR and KRAS mutation status in NSCLC patients. We demonstrated that radiomic features extracted from different image-feature sets could be used for EGFR and KRAS mutation status prediction in NSCLC patients and showed improved predictive power relative to conventional image-derived metrics.

Experimental phantom evaluation to identify robust positron emission tomography (PET) radiomic features

Background

Radiomics analysis usually involves, especially in multicenter and large hospital studies, different imaging protocols for acquisition, reconstruction, and processing of data. Differences in protocols can lead to differences in the quantification of the biomarker distribution, leading to radiomic feature variability. The aim of our study was to identify those radiomic features robust to the different degrading factors in positron emission tomography (PET) studies. We proposed the use of the standardized measurements of the European Association Research Ltd. (EARL) accreditation to retrospectively identify the radiomic features having low variability to the different systems and reconstruction protocols. In addition, we presented a reproducible procedure to identify PET radiomic features robust to PET/CT imaging metal artifacts. In 27 heterogeneous homemade phantoms for which ground truth was accurately defined by CT segmentation, we evaluated the segmentation accuracy and radiomic feature reliability given by the contrast-oriented algorithm (COA) and the 40% threshold PET segmentation. In the comparison of two data sets, robustness was defined by Wilcoxon rank tests, bias was quantified by Bland–Altman (BA) plot analysis, and strong correlations were identified by Spearman correlation test (r > 0.8 and p satisfied multiple test Bonferroni correction).

Results

Forty-eight radiomic features were robust to system, 22 to resolution, 102 to metal artifacts, and 42 to different PET segmentation tools. Overall, only 4 radiomic features were simultaneously robust to all degrading factors. Although both segmentation approaches significantly underestimated the volume with respect to the ground truth, with relative deviations of −62 ± 36% for COA and −50 ± 44% for 40%, radiomic features derived from the ground truth were strongly correlated and/or robust to 98 radiomic features derived from COA and to 102 from 40%.

Conclusion

In multicenter studies, we recommend the analysis of EARL accreditation measurements in order to retrospectively identify the robust PET radiomic features. Furthermore, 4 radiomic features (area under the curve of the cumulative SUV volume histogram, skewness, kurtosis, and gray-level variance derived from GLRLM after application of an equal probability quantization algorithm on the voxels within lesion) were robust to all degrading factors. In addition, the feasibility of 40% and COA segmentations for their use in radiomics analysis has been demonstrated.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40658-021-00390-7.

Current and Future Role of Medical Imaging in Guiding the Management of Patients With Relapsed and Refractory Non-Hodgkin Lymphoma Treated With CAR T-Cell Therapy

Chimeric antigen receptor (CAR) T-cells are a novel immunotherapy available for patients with refractory/relapsed non-Hodgkin lymphoma. In this indication, clinical trials have demonstrated that CAR T-cells achieve high rates of response, complete response, and long-term response (up to 80%, 60%, and 40%, respectively). Nonetheless, the majority of patients ultimately relapsed. This review provides an overview about the current and future role of medical imaging in guiding the management of non-Hodgkin lymphoma patients treated with CAR T-cells. It discusses the value of predictive and prognostic biomarkers to better stratify the risk of relapse, and provide a patient-tailored therapeutic strategy. At baseline, high tumor volume (assessed on CT-scan or on [18F]-FDG PET/CT) is a prognostic factor associated with treatment failure. Response assessment has not been studied extensively yet. Available data suggests that current response assessment developed on CT-scan or on [18F]-FDG PET/CT for cytotoxic systemic therapies remains relevant to estimate lymphoma response to CAR T-cell therapy. Nonetheless, atypical patterns of response and progression have been observed and should be further analyzed. The potential advantages as well as limitations of artificial intelligence and radiomics as tools providing high throughput quantitative imaging features is described.

Improved 18-FDG PET/CT diagnosis of multiple myeloma diffuse disease by radiomics analysis

OBJECTIVES

In multiple myeloma, the diagnosis of diffuse bone marrow infiltration on 18-FDG PET/CT can be challenging. We aimed to develop a PET/CT radiomics-based model that could improve the diagnosis of multiple myeloma diffuse disease on 18-FDG PET/CT.

METHODS

We prospectively performed PET/CT and whole-body diffusion-weighted MRI in 30 newly diagnosed multiple myeloma. MRI was the reference standard for diffuse disease assessment. Twenty patients were randomly assigned to a training set and 10 to an independent test set. Visual analysis of PET/CT was performed by two nuclear medicine physicians. Spine volumes were automatically segmented, and a total of 174 Imaging Biomarker Standardisation Initiative-compliant radiomics features were extracted from PET and CT. Selection of best features was performed with random forest features importance and correlation analysis. Machine-learning algorithms were trained on the selected features with cross-validation and evaluated on the independent test set.

RESULTS

Out of the 30 patients, 18 had established diffuse disease on MRI. The sensitivity, specificity and accuracy of visual analysis were 67, 75 and 70%, respectively, with a moderate kappa coefficient of agreement of 0.6. Five radiomics features were selected. On the training set, random forest classifier reached a sensitivity, specificity and accuracy of 93, 86 and 91%, respectively, with an area under the curve of 0.90 (95% confidence interval, 0.89-0.91). On the independent test set, the model achieved an accuracy of 80%.

CONCLUSIONS

Radiomics analysis of 18-FDG PET/CT images with machine-learning overcame the limitations of visual analysis, providing a highly accurate and more reliable diagnosis of diffuse bone marrow infiltration in multiple myeloma patients.

Radiomics in radiation oncology for gynecological malignancies: a review of literature

Radiomics is the extraction of a significant number of quantitative imaging features with the aim of detecting information in correlation with useful clinical outcomes. Features are extracted, after delineation of an area of interest, from a single or a combined set of imaging modalities (including X-ray, US, CT, PET/CT and MRI). Given the high dimensionality, the analytical process requires the use of artificial intelligence algorithms. Firstly developed for diagnostic performance in radiology, it has now been translated to radiation oncology mainly to predict tumor response and patient outcome but other applications have been developed such as dose painting, prediction of side-effects, and quality assurance. In gynecological cancers, most studies have focused on outcomes of cervical cancers after chemoradiation. This review highlights the role of this new tool for the radiation oncologists with particular focus on female GU oncology.

Prognostic value of 18F-FDG PET/CT with texture analysis in patients with rectal cancer treated by surgery

PURPOSE

The aim of this study was to evaluate the ability of texture analysis using pretreatment ¹⁸F-FDG PET/CT to predict prognosis in patients with surgically treated rectal cancer.

METHODS

We analyzed 94 patients with pathologically proven rectal cancer who underwent pretreatment ¹⁸F-FDG PET/CT and were subsequently treated with surgery. The volume of interest of the primary tumor was defined using a threshold of 40% of the maximum standardized uptake value (SUVmax), and conventional (SUVmax, metabolic tumor volume [MTV], total lesion glycolysis [TLG]) and textural PET features were extracted. Harmonization of PET features was performed with the ComBat method. The study endpoints were overall survival (OS) and progression-free survival (PFS), and the prognostic value of PET features was evaluated by Cox regression analysis.

RESULTS

In the follow-up period (median 41.7 [interquartile range, 30.5-60.4] months), 21 (22.3%) and 30 (31.9%) patients had cancer-related death or disease progression, respectively. Univariate analysis revealed a significant association of (1) MTV, TLG, and gray-level co-occurrence matrix (GLCM) entropy with OS; and (2) SUVmax, MTV, TLG, and GLCM entropy with PFS. In multivariate analysis including clinical characteristics, GLCM entropy (≥ 2.13) was the only relevant prognostic PET feature for poor OS (hazard ratio [HR]: 4.16, p = 0.035) and PFS (HR: 2.70, p = 0.046).

CONCLUSION

GLCM entropy, which indicates metabolic intratumoral heterogeneity, was an independent prognostic factor in patients with surgically treated rectal cancer. Compared with conventional PET features, GLCM entropy has better predictive value and shows potential to facilitate precision medicine.

Quantitative assessment of acquisition imaging parameters on MRI radiomics features: a prospective anthropomorphic phantom study using a 3D-T2W-TSE sequence for MR-guided-radiotherapy

Background

MRI pulse sequences and imaging parameters substantially influence the variation of MRI radiomics features, thus impose a critical challenge on MRI radiomics reproducibility and reliability. This study aims to prospectively investigate the impact of various imaging parameters on MRI radiomics features in a 3D T2-weighted (T2W) turbo-spin-echo (TSE) pulse sequence for MR-guided-radiotherapy (MRgRT).

Methods

An anthropomorphic phantom was scanned using a 3D-T2W-TSE MRgRT sequence at 1.5T under a variety of acquisition imaging parameter changes. T1 and T2 relaxation times of the phantom were also measured. 93 first-order and texture radiomics features in the original and 14 transformed images, yielding 1,395 features in total, were extracted from 10 volumes-of-interest (VOIs). The percentage deviation (d%) of radiomics feature values from the baseline values and intra-class correlation coefficient (ICC) with the baseline were calculated. Robust radiomics features were identified based on the excellent agreement of radiomics feature values with the baseline, i.e., the averaged d% <5% and ICC >0.90 in all VOIs for all imaging parameter variations.

Results

The radiomics feature values changed considerably but to different degrees with different imaging parameter adjustments, in the ten VOIs. The deviation d% ranged from 0.02% to 321.3%, with a mean of 12.5% averaged for all original features in all ten VOIs. First-order and GLCM features were generally more robust to imaging parameters than other features in the original images. There were also significantly different radiomics feature values (ANOVA, P<0.001) between the original and the transformed images, exhibiting quite different robustness to imaging parameters. 330 out of 1395 features (23.7%) robust to imaging parameters were identified. GLCM and GLSZM features had the most (42.5%, 153/360) and least (3.8%, 9/240) robust features in the original and transformed images, respectively.

Conclusions

This study helps better understand the quantitative dependence of radiomics feature values on imaging parameters in a 3D-T2W-TSE sequence for MRgRT. Imaging parameter heterogeneity should be considered as a significant source of radiomics variability and uncertainty, which must be well harmonized for reliable clinical use. The identified robust features to imaging parameters are helpful for the pre-selection of radiomics features for reliable radiomics modeling.

Radiomics: The Next Frontier of Cardiac Computed Tomography

Radiomics uses advanced image analysis to extract massive amounts of quantitative information from digital images, which is not otherwise distinguishable to the human eye. The mined data can be used to explore and establish new and undiscovered correlations between these imaging features and clinical end points. Cardiac computed tomography (CT) is a first-line imaging modality for evaluating coronary artery disease and has a primary role in the assessment of cardiac structures. Conventional interpretation of cardiac CT images relies mostly on subjective and qualitative analysis, as well as basic geometric quantification. To date, some proof-of-concept studies have demonstrated the feasibility and diagnostic performance of cardiac CT radiomics analysis. This review describes the current literature on radiomics in cardiac CT and discusses its advantages, challenges, and future directions. Although much evidences are needed in this field, cardiac CT radiomics has a lot to offer to patients and physicians with potential to define cardiac disease phenotypes on imaging with higher precision.

FET-PET radiomics in recurrent glioblastoma: prognostic value for outcome after re-irradiation?

Purpose

The value of O-(2-[18F]fluoroethyl)-L-tyrosine (FET)-positron emission tomography (PET)-radiomics in the outcome assessment of patients with recurrent glioblastoma (rGBM) has not been evaluated until now. The aim of this study was to evaluate whether a prognostic model based on FET-PET radiomics features (RF) is feasible and can identify rGBM patients that would most benefit from re-irradiation.

Methods

We prospectively recruited rGBM patients who underwent FET-PET before re-irradiation (GLIAA-Pilot trial, DRKS00000633). Tumor volume was delineated using a semi-automatic method with a threshold of 1.8 times the standardized-uptake-value of the background. 135 FET-RF (histogram parameters, shape and texture features) were extracted. The analysis involved the characterization of tumor and non-tumor tissue with FET-RF and the evaluation of the prognostic value of FET-RF for time-to-progression (TTP), overall survival (OS) and recurrence location (RL).

Results

Thirty-two rGBM patients constituted our cohort. FET-RF discriminated significantly between tumor and non-tumor. The texture feature Small-Zone-Low-Gray-Level-Emphasis (SZLGE) showed the best performance for the prediction of TTP (p = 0.001, satisfying Bonferroni-multiple-test significance level). Additionally, two radiomics signatures could predict TTP (TTP-radiomics-signature, p = 0.001) and OS (OS-radiomics-signature, p = 0.038). SZLGE and the TTP-radiomics-signature additionally predicted RL. Specifically, high values for TTP-radiomics-signature and for SZLGE indicated not only earlier progression, but also a RL within the initial FET-PET active volume.

Conclusion

Our findings suggest that FET-PET radiomics could contribute to the prognostic assessment and selection of rGBM-patients benefiting from re-irradiation.

Trial registration DRKS00000633. Registered on 8th of December in 2010.

https://www.drks.de/drks_web/navigate.do?navigationId=trial.HTML&TRIAL_ID=DRKS00000633.