MRI-based delta-radiomics predicts pathologic complete response in high-grade soft-tissue sarcoma patients treated with neoadjuvant therapy

Integration of pre-treatment computational radiomics, deep radiomics, and transcriptomics enhances soft-tissue sarcoma patient prognosis

Our objective was to capture subgroups of soft-tissue sarcoma (STS) using handcraft and deep radiomics approaches to understand their relationship with histopathology, gene-expression profiles, and metastatic relapse-free survival (MFS). We included all consecutive adults with newly diagnosed locally advanced STS (N = 225, 120 men, median age: 62 years) managed at our sarcoma reference center between 2008 and 2020, with contrast-enhanced baseline MRI. After MRI postprocessing, segmentation, and reproducibility assessment, 175 handcrafted radiomics features (h-RFs) were calculated. Convolutional autoencoder neural network (CAE) and half-supervised CAE (HSCAE) were trained in repeated cross-validation on representative contrast-enhanced slices to extract 1024 deep radiomics features (d-RFs). Gene-expression levels were calculated following RNA sequencing (RNAseq) of 110 untreated samples from the same cohort. Unsupervised classifications based on h-RFs, CAE, HSCAE, and RNAseq were built. The h-RFs, CAE, and HSCAE grouping were not associated with the transcriptomics groups but with prognostic radiological features known to correlate with lower survivals and higher grade and SARCULATOR groups (a validated prognostic clinical-histological nomogram). HSCAE and h-RF groups were also associated with MFS in multivariable Cox regressions. Combining HSCAE and transcriptomics groups significantly improved the prognostic performances compared to each group alone, according to the concordance index. The combined radiomic-transcriptomic group with worse MFS was characterized by the up-regulation of 707 genes and 292 genesets related to inflammation, hypoxia, apoptosis, and cell differentiation. Overall, subgroups of STS identified on pre-treatment MRI using handcrafted and deep radiomics were associated with meaningful clinical, histological, and radiological characteristics, and could strengthen the prognostic value of transcriptomics signatures.

Development and benchmarking of a Deep Learning-based MRI-guided gross tumor segmentation algorithm for Radiomics analyses in extremity soft tissue sarcomas

BACKGROUND

Volume of interest (VOI) segmentation is a crucial step for Radiomics analyses and radiotherapy (RT) treatment planning. Because it can be time-consuming and subject to inter-observer variability, we developed and tested a Deep Learning-based automatic segmentation (DLBAS) algorithm to reproducibly predict the primary gross tumor as VOI for Radiomics analyses in extremity soft tissue sarcomas (STS).

METHODS

A DLBAS algorithm was trained on a cohort of 157 patients and externally tested on an independent cohort of 87 patients using contrast-enhanced MRI. Manual tumor delineations by a radiation oncologist served as ground truths (GTs). A benchmark study with 20 cases from the test cohort compared the DLBAS predictions against manual VOI segmentations of two residents (ERs) and clinical delineations of two radiation oncologists (ROs). The ROs rated DLBAS predictions regarding their direct applicability.

RESULTS

The DLBAS achieved a median dice similarity coefficient (DSC) of 0.88 against the GTs in the entire test cohort (interquartile range (IQR): 0.11) and a median DSC of 0.89 (IQR 0.07) and 0.82 (IQR 0.10) in comparison to ERs and ROs, respectively. Radiomics feature stability was high with a median intraclass correlation coefficient of 0.97, 0.95 and 0.94 for GTs, ERs, and ROs, respectively. DLBAS predictions were deemed clinically suitable by the two ROs in 35% and 20% of cases, respectively.

CONCLUSION

The results demonstrate that the DLBAS algorithm provides reproducible VOI predictions for radiomics feature extraction. Variability remains regarding direct clinical applicability of predictions for RT treatment planning.

Radiomics in Diagnosis, Grading, and Treatment Response Assessment of Soft Tissue Sarcomas: A Systematic Review and Meta-analysis

RATIONALE AND OBJECTIVES

To evaluate radiomics in soft tissue sarcomas (STSs) for diagnostic accuracy, grading, and treatment response assessment, with a focus on clinical relevance.

METHODS

In this diagnostic accuracy study, radiomics was applied using multiple MRI sequences and AI classifiers, with histopathological diagnosis as the reference standard. Statistical analysis involved meta-analysis, random-effects model, and Deeks' funnel plot asymmetry test.

RESULTS

Among 579 unique titles and abstracts, 24 articles were included in the systematic review, with 21 used for meta-analysis. Radiomics demonstrated a pooled sensitivity of 84% (95% CI: 80-87) and specificity of 63% (95% CI: 56-70), AUC of 0.93 for diagnosis, sensitivity of 84% (95% CI: 82-87) and specificity of 73% (95% CI: 68-77), AUC of 0.91 for grading, and sensitivity of 83% (95% CI: 67-94) and specificity of 67% (95% CI: 59-74), AUC of 0.87 for treatment response assessment.

CONCLUSION

Radiomics exhibits potential for accurate diagnosis, grading, and treatment response assessment in STSs, emphasizing the need for standardization and prospective trials.

CLINICAL RELEVANCE STATEMENT

Radiomics offers precise tools for STS diagnosis, grading, and treatment response assessment, with implications for optimizing patient care and treatment strategies in this complex malignancy.

Radiomics-based nomogram guides adaptive de-intensification in locoregionally advanced nasopharyngeal carcinoma following induction chemotherapy

OBJECTIVES

This study aimed to construct a radiomics-based model for prognosis and benefit prediction of concurrent chemoradiotherapy (CCRT) versus intensity-modulated radiotherapy (IMRT) in locoregionally advanced nasopharyngeal carcinoma (LANPC) following induction chemotherapy (IC).

MATERIALS AND METHODS

A cohort of 718 LANPC patients treated with IC + IMRT or IC + CCRT were retrospectively enrolled and assigned to a training set (n = 503) and a validation set (n = 215). Radiomic features were extracted from pre-IC and post-IC MRI. After feature selection, a delta-radiomics signature was built with LASSO-Cox regression. A nomogram incorporating independent clinical indicators and the delta-radiomics signature was then developed and evaluated for calibration and discrimination. Risk stratification by the nomogram was evaluated with Kaplan-Meier methods.

RESULTS

The delta-radiomics signature, which comprised 19 selected features, was independently associated with prognosis. The nomogram, composed of the delta-radiomics signature, age, T category, N category, treatment, and pre-treatment EBV DNA, showed great calibration and discrimination with an area under the receiver operator characteristic curve of 0.80 (95% CI 0.75-0.85) and 0.75 (95% CI 0.64-0.85) in the training and validation sets. Risk stratification by the nomogram, excluding the treatment factor, resulted in two groups with distinct overall survival. Significantly better outcomes were observed in the high-risk patients with IC + CCRT compared to those with IC + IMRT, while comparable outcomes between IC + IMRT and IC + CCRT were shown for low-risk patients.

CONCLUSION

The radiomics-based nomogram can predict prognosis and survival benefits from concurrent chemotherapy for LANPC following IC. Low-risk patients determined by the nomogram may be potential candidates for omitting concurrent chemotherapy during IMRT.

CLINICAL RELEVANCE STATEMENT

The radiomics-based nomogram was constructed for risk stratification and patient selection. It can help guide clinical decision-making for patients with locoregionally advanced nasopharyngeal carcinoma following induction chemotherapy, and avoid unnecessary toxicity caused by overtreatment.

KEY POINTS

• The benefits from concurrent chemotherapy remained controversial for locoregionally advanced nasopharyngeal carcinoma following induction chemotherapy. • Radiomics-based nomogram achieved prognosis and benefits prediction of concurrent chemotherapy. • Low-risk patients defined by the nomogram were candidates for de-intensification.

The impact of radiomics in the management of soft tissue sarcoma

INTRODUCTION

Soft tissue sarcomas (STSs) are rare malignancies. Pre-therapeutic tumour grading and assessment are crucial in making treatment decisions. Radiomics is a high-throughput method for analysing imaging data, providing quantitative information beyond expert assessment. This review highlights the role of radiomic texture analysis in STSs evaluation.

MATERIALS AND METHODS

We conducted a systematic review according to the Systematic Reviews and Meta-Analyses (PRISMA) guidelines. A comprehensive search was conducted in PubMed/MEDLINE and Scopus using the search terms: 'radiomics [All Fields] AND ("soft tissue sarcoma" [All Fields] OR "soft tissue sarcomas" [All Fields])'. Only original articles, referring to humans, were included.

RESULTS

A preliminary search conducted on PubMed/MEDLINE and Scopus provided 74 and 93 studies respectively. Based on the previously described criteria, 49 papers were selected, with a publication range from July 2015 to June 2023. The main domains of interest were risk stratification, histological grading prediction, technical feasibility/reproductive aspects, treatment response.

CONCLUSIONS

With an increasing interest over the last years, the use of radiomics appears to have potential for assessing STSs from initial diagnosis to predicting treatment response. However, additional and extensive research is necessary to validate the effectiveness of radiomics parameters and to integrate them into a comprehensive decision support system.

CT and MRI radiomics of bone and soft-tissue sarcomas: an updated systematic review of reproducibility and validation strategies

OBJECTIVE

To systematically review radiomic feature reproducibility and model validation strategies in recent studies dealing with CT and MRI radiomics of bone and soft-tissue sarcomas, thus updating a previous version of this review which included studies published up to 2020.

METHODS

A literature search was conducted on EMBASE and PubMed databases for papers published between January 2021 and March 2023. Data regarding radiomic feature reproducibility and model validation strategies were extracted and analyzed.

RESULTS

Out of 201 identified papers, 55 were included. They dealt with radiomics of bone (n = 23) or soft-tissue (n = 32) tumors. Thirty-two (out of 54 employing manual or semiautomatic segmentation, 59%) studies included a feature reproducibility analysis. Reproducibility was assessed based on intra/interobserver segmentation variability in 30 (55%) and geometrical transformations of the region of interest in 2 (4%) studies. At least one machine learning validation technique was used for model development in 34 (62%) papers, and K-fold cross-validation was employed most frequently. A clinical validation of the model was reported in 38 (69%) papers. It was performed using a separate dataset from the primary institution (internal test) in 22 (40%), an independent dataset from another institution (external test) in 14 (25%) and both in 2 (4%) studies.

CONCLUSIONS

Compared to papers published up to 2020, a clear improvement was noted with almost double publications reporting methodological aspects related to reproducibility and validation. Larger multicenter investigations including external clinical validation and the publication of databases in open-access repositories could further improve methodology and bring radiomics from a research area to the clinical stage.

CRITICAL RELEVANCE STATEMENT

An improvement in feature reproducibility and model validation strategies has been shown in this updated systematic review on radiomics of bone and soft-tissue sarcomas, highlighting efforts to enhance methodology and bring radiomics from a research area to the clinical stage.

KEY POINTS

• 2021-2023 radiomic studies on CT and MRI of musculoskeletal sarcomas were reviewed. • Feature reproducibility was assessed in more than half (59%) of the studies. • Model clinical validation was performed in 69% of the studies. • Internal (44%) and/or external (29%) test datasets were employed for clinical validation.

Radiomics in Musculoskeletal Tumors

Sarcomas are heterogeneous rare tumors predominantly affecting the musculoskeletal (MSK) system. Due to significant variations in their natural history and variable response to conventional treatments, the discovery of novel diagnostic and prognostic biomarkers to guide therapeutic decision-making is an active and ongoing field of research. As new cellular, molecular, and metabolic biomarkers continue to be discovered, quantitative radiologic imaging is becoming increasingly important in sarcoma management. Radiomics offers the potential for discovering novel imaging diagnostic and predictive biomarkers using standard-of-care medical imaging. In this review, we detail the core concepts of radiomics and the application of radiomics to date in MSK sarcoma research. Also described are specific challenges related to radiomic studies, as well as viewpoints on clinical adoption and future perspectives in the field.

Cancer immunotherapy efficacy and machine learning

INTRODUCTION

Immunotherapy is one of the major breakthroughs in the treatment of cancer, and it has become a powerful clinical strategy, however, not all patients respond to immune checkpoint blockade and other immunotherapy strategies. Applying machine learning (ML) techniques to predict the efficacy of cancer immunotherapy is useful for clinical decision-making.

AREAS COVERED

Applying ML including deep learning (DL) in radiomics, pathomics, tumor microenvironment (TME) and immune-related genes analysis to predict immunotherapy efficacy. The studies in this review were searched from PubMed and ClinicalTrials.gov (January 2023).

EXPERT OPINION

An increasing number of studies indicate that ML has been applied to various aspects of oncology research, with the potential to provide more effective individualized immunotherapy strategies and enhance treatment decisions. With advances in ML technology, more efficient methods of predicting the efficacy of immunotherapy may become available in the future.

Radiomics and artificial intelligence for soft-tissue sarcomas: Current status and perspectives

This article proposes a summary of the current status of the research regarding the use of radiomics and artificial intelligence to improve the radiological assessment of patients with soft tissue sarcomas (STS), a heterogeneous group of rare and ubiquitous mesenchymal malignancies. After a first part explaining the principle of radiomics approaches, from raw image post-processing to extraction of radiomics features mined with unsupervised and supervised machine-learning algorithms, and the current research involving deep learning algorithms in STS, especially convolutional neural networks, this review details their main research developments since the formalisation of 'radiomics' in oncologic imaging in 2010. This review focuses on CT and MRI and does not involve ultrasonography. Radiomics and deep radiomics have been successfully applied to develop predictive models to discriminate between benign soft-tissue tumors and STS, to predict the histologic grade (i.e., the most important prognostic marker of STS), the response to neoadjuvant chemotherapy and/or radiotherapy, and the patients' survivals and probability for presenting distant metastases. The main findings, limitations and expectations are discussed for each of these outcomes. Overall, after a first decade of publications emphasizing the potential of radiomics through retrospective proof-of-concept studies, almost all positive but with heterogeneous and often non-replicable methods, radiomics is now at a turning point in order to provide robust demonstrations of its clinical impact through open-science, independent databases, and application of good and standardized practices in radiomics such as those provided by the Image Biomarker Standardization Initiative, without forgetting innovative research paths involving other '-omics' data to better understand the relationships between imaging of STS, gene-expression profiles and tumor microenvironment.

Predicting visual recovery in pituitary adenoma patients post-endoscopic endonasal transsphenoidal surgery: Harnessing delta-radiomics of the optic chiasm from MRI

OBJECTIVES

To investigate whether morphological changes after surgery and delta-radiomics of the optic chiasm obtained from routine MRI could help predict postoperative visual recovery of pituitary adenoma patients.

METHODS

A total of 130 pituitary adenoma patients were retrospectively enrolled and divided into the recovery group (n = 87) and non-recovery group (n = 43) according to visual outcome 1 year after endoscopic endonasal transsphenoidal surgery. Morphological parameters of the optic chiasm were measured preoperatively and postoperatively, including chiasmal thickness, deformed angle, and suprasellar extension. Delta-radiomics of the optic chiasm were calculated based on features extracted from preoperative and postoperative coronal T2-weighted images, followed by machine learning modeling using least absolute shrinkage and selection operator wrapped with support vector machine through fivefold cross-validation in the development set. The delta-radiomic model was independently evaluated in the test set, and compared with the combined model that incorporated delta-radiomics, significant clinical and morphological parameters.

RESULTS

Postoperative morphological changes of the optic chiasm could not significantly be used as predictors for the visual outcome. In contrast, the delta-radiomics model represented good performances in predicting visual recovery, with an AUC of 0.821 in the development set and 0.811 in the independent test set. Moreover, the combined model that incorporated age and delta-radiomics features of the optic chiasm achieved the highest AUC of 0.841 and 0.840 in the development set and independent test set, respectively.

CONCLUSIONS

Our proposed machine learning models based on delta-radiomics of the optic chiasm can be used to predict postoperative visual recovery of pituitary adenoma patients.

CLINICAL RELEVANCE STATEMENT

Our delta-radiomics-based models from MRI enable accurate visual recovery predictions in pituitary adenoma patients who underwent endoscopic endonasal transsphenoidal surgery, facilitating better clinical decision-making and ultimately improving patient outcomes.

KEY POINTS

• Prediction of the postoperative visual outcome for pituitary adenoma patients is important but challenging. • Delta-radiomics of the optic chiasm after surgical decompression represented better prognostic performances compared with its morphological changes. • The proposed machine learning models can serve as novel approaches to predict visual recovery for pituitary adenoma patients in clinical practice.

Radiomics Based on DCE-MRI for Predicting Response to Neoadjuvant Therapy in Breast Cancer

RATIONALE AND OBJECTIVES

To compare the value of radiomics and diameter% based on pre- and early-treatment dynamic enhanced MR (DCE-MRI) of the breast in predicting response to neoadjuvant therapy (NAT) in breast cancer and to construct a tool for early noninvasive prediction of NAT outcomes.

MATERIALS AND METHODS

Retrospective analysis of clinical and imaging data of 142 patients with primary invasive breast cancer who underwent DCE-MRI before and after two cycles of NAT at our institution. Enroled patients were randomly assigned in a 7:3 ratio to the training group and the test group. Patients were divided into pathological complete response (pCR) and non-pathological complete response groups based on surgical pathology findings after NAT. The maximum diameter relative regression values (Diameter%) before and after treatment were calculated and the conventional imaging Diameter% model was constructed. Based on pre- and early-NAT DCE-MRI, the optimal features of pre-NAT, early-NAT, and delta radiomics were screened using redundancy analysis, least absolute shrinkage, and selection operator methods to construct the corresponding radiomics model and calculate the Radscores. Indicators that were statistically significant in the univariate analysis of clinical data were further screened by stepwise regression and combined with Radscores to construct the fusion model. All models were evaluated and compared.

RESULTS

In the test set, the area under the curve (AUC) of the delta radiomics model (0.87) was higher than that of the pre-NAT, early-NAT radiomics models (0.57, 0.78) and the Diameter% model (0.83). The fusion model had the best efficacy in predicting pCR after NAT, with AUCs of 0.91 in the training and test sets. And its nomogram plot showed that Radscore of early-NAT radiomics had the greatest weight. In the test set, the fusion model and Delta radiomics model improved the efficacy of predicting pCR by 35.56% and 14.19%, respectively, compared to the Diameter% model (P = 0 and .039). Clinical decision curves showed the highest overall clinical benefit for the fusion model.

CONCLUSION

Radiomics, especially delta and early-NAT radiomics, may be potential biomarkers for early noninvasive prediction of NAT outcomes. And a fusion model constructed from meaningful clinicopathological indicators combined with radiomics can effectively predict NAT response.

Machine learning-based radiomics analysis for predicting local recurrence of primary dermatofibrosarcoma protuberans after surgical treatment

BACKGROUND AND PURPOSE

Dermatofibrosarcoma protuberans (DFSP) is characterized by locally invasive growth patterns and high local recurrence rates. Accurately identifying patients with high local recurrence risk may benefit patients during follow-up and has potential value for making treatment decisions. This study aimed to investigate whether machine learning-based radiomics models could accurately predict the local recurrence of primary DFSP after surgical treatment.

MATERIALS AND METHODS

This retrospective study included a total of 146 patients with DFSP who underwent MRI scans between 2010 and 2016 from two different institutions: institution 1 (n = 104) for the training set and institution 2 (n = 42) for the external test set. Three radiomics random survival forest (RSF) models were developed using MRI images. Additionally, the performance of the Ki67 index was compared with the three RSF models in the external validation set.

RESULTS

The average concordance index (C-index) scores of the RSF models based on fat-saturation T2W (FS-T2W) images, fat-saturation T1W with gadolinium contrast (FS-T1W + C) images, and both FS-T2W and FS-T1W + C images from 10-fold cross-validation in the training set were 0.855 (95% CI: 0.629, 1.00), 0.873 (95% CI: 0.711, 1.00), and 0.875 (95% CI: 0.688, 1.00), respectively. In the external validation set, the C-indexes of the three trained RSF models were higher than that of the Ki67 index (0.838, 0.754, and 0.866 vs. 0.601, respectively).

CONCLUSION

Random survival forest models developed using radiomics features derived from MRI images were proven helpful for accurate prediction of local recurrence of primary DFSP after surgical treatment and showed better predicting performance than the Ki67 index.

Spatial assessments in texture analysis: what the radiologist needs to know

To date, studies investigating radiomics-based predictive models have tended to err on the side of data-driven or exploratory analysis of many thousands of extracted features. In particular, spatial assessments of texture have proven to be especially adept at assessing for features of intratumoral heterogeneity in oncologic imaging, which likewise may correspond with tumor biology and behavior. These spatial assessments can be generally classified as spatial filters, which detect areas of rapid change within the grayscale in order to enhance edges and/or textures within an image, or neighborhood-based methods, which quantify gray-level differences of neighboring pixels/voxels within a set distance. Given the high dimensionality of radiomics datasets, data dimensionality reduction methods have been proposed in an attempt to optimize model performance in machine learning studies; however, it should be noted that these approaches should only be applied to training data in order to avoid information leakage and model overfitting. While area under the curve of the receiver operating characteristic is perhaps the most commonly reported assessment of model performance, it is prone to overestimation when output classifications are unbalanced. In such cases, confusion matrices may be additionally reported, whereby diagnostic cut points for model predicted probability may hold more clinical significance to clinical colleagues with respect to related forms of diagnostic testing.

Development of PSMA-PET-guided CT-based radiomic signature to predict biochemical recurrence after salvage radiotherapy

PURPOSE

To develop a CT-based radiomic signature to predict biochemical recurrence (BCR) in prostate cancer patients after sRT guided by positron-emission tomography targeting prostate-specific membrane antigen (PSMA-PET).

MATERIAL AND METHODS

Consecutive patients, who underwent 68Ga-PSMA11-PET/CT-guided sRT from three high-volume centers in Germany, were included in this retrospective multicenter study. Patients had PET-positive local recurrences and were treated with intensity-modulated sRT. Radiomic features were extracted from volumes of interests on CT guided by focal PSMA-PET uptakes. After preprocessing, clinical, radiomics, and combined clinical-radiomic models were developed combining different feature reduction techniques and Cox proportional hazard models within a nested cross validation approach.

RESULTS

Among 99 patients, median interval until BCR was the radiomic models outperformed clinical models and combined clinical-radiomic models for prediction of BCR with a C-index of 0.71 compared to 0.53 and 0.63 in the test sets, respectively. In contrast to the other models, the radiomic model achieved significantly improved patient stratification in Kaplan-Meier analysis. The radiomic and clinical-radiomic model achieved a significantly better time-dependent net reclassification improvement index (0.392 and 0.762, respectively) compared to the clinical model. Decision curve analysis demonstrated a clinical net benefit for both models. Mean intensity was the most predictive radiomic feature.

CONCLUSION

This is the first study to develop a PSMA-PET-guided CT-based radiomic model to predict BCR after sRT. The radiomic models outperformed clinical models and might contribute to guide personalized treatment decisions.

Development and Evaluation of MR-Based Radiogenomic Models to Differentiate Atypical Lipomatous Tumors from Lipomas

Background: The aim of this study was to develop and validate radiogenomic models to predict the MDM2 gene amplification status and differentiate between ALTs and lipomas on preoperative MR images. Methods: MR images were obtained in 257 patients diagnosed with ALTs (n = 65) or lipomas (n = 192) using histology and the MDM2 gene analysis as a reference standard. The protocols included T2-, T1-, and fat-suppressed contrast-enhanced T1-weighted sequences. Additionally, 50 patients were obtained from a different hospital for external testing. Radiomic features were selected using mRMR. Using repeated nested cross-validation, the machine-learning models were trained on radiomic features and demographic information. For comparison, the external test set was evaluated by three radiology residents and one attending radiologist. Results: A LASSO classifier trained on radiomic features from all sequences performed best, with an AUC of 0.88, 70% sensitivity, 81% specificity, and 76% accuracy. In comparison, the radiology residents achieved 60–70% accuracy, 55–80% sensitivity, and 63–77% specificity, while the attending radiologist achieved 90% accuracy, 96% sensitivity, and 87% specificity. Conclusion: A radiogenomic model combining features from multiple MR sequences showed the best performance in predicting the MDM2 gene amplification status. The model showed a higher accuracy compared to the radiology residents, though lower compared to the attending radiologist.

Dosiomics and radiomics to predict pneumonitis after thoracic stereotactic body radiotherapy and immune checkpoint inhibition

Introduction

Pneumonitis is a relevant side effect after radiotherapy (RT) and immunotherapy with checkpoint inhibitors (ICIs). Since the effect is radiation dose dependent, the risk increases for high fractional doses as applied for stereotactic body radiation therapy (SBRT) and might even be enhanced for the combination of SBRT with ICI therapy. Hence, patient individual pre-treatment prediction of post-treatment pneumonitis (PTP) might be able to support clinical decision making. Dosimetric factors, however, use limited information and, thus, cannot exploit the full potential of pneumonitis prediction.

Methods

We investigated dosiomics and radiomics model based approaches for PTP prediction after thoracic SBRT with and without ICI therapy. To overcome potential influences of different fractionation schemes, we converted physical doses to 2 Gy equivalent doses (EQD2) and compared both results. In total, four single feature models (dosiomics, radiomics, dosimetric, clinical factors) were tested and five combinations of those (dosimetric+clinical factors, dosiomics+radiomics, dosiomics+dosimetric+clinical factors, radiomics+dosimetric+clinical factors, radiomics+dosiomics+dosimetric+clinical factors). After feature extraction, a feature reduction was performed using pearson intercorrelation coefficient and the Boruta algorithm within 1000-fold bootstrapping runs. Four different machine learning models and the combination of those were trained and tested within 100 iterations of 5-fold nested cross validation.

Results

Results were analysed using the area under the receiver operating characteristic curve (AUC). We found the combination of dosiomics and radiomics features to outperform all other models with AUCradiomics+dosiomics, D = 0.79 (95% confidence interval 0.78-0.80) and AUCradiomics+dosiomics, EQD2 = 0.77 (0.76-0.78) for physical dose and EQD2, respectively. ICI therapy did not impact the prediction result (AUC ≤ 0.5). Clinical and dosimetric features for the total lung did not improve the prediction outcome.

Conclusion

Our results suggest that combined dosiomics and radiomics analysis can improve PTP prediction in patients treated with lung SBRT. We conclude that pre-treatment prediction could support clinical decision making on an individual patient basis with or without ICI therapy.

Distinct patterns of the natural evolution of soft tissue sarcomas on pre-treatment MRIs captured with delta-radiomics correlate with gene expression profiles

OBJECTIVES

Radiomics of soft tissue sarcomas (STS) is assumed to correlate with histologic and molecular tumor features, but radiogenomics analyses are lacking. Our aim was to identify if distinct patterns of natural evolution of STS obtained from consecutive pre-treatment MRIs are associated with differential gene expression (DGE) profiling in a pathway analysis.

METHODS

All patients with newly diagnosed STS treated in a curative intent in our sarcoma reference center between 2008 and 2019 and with two available pre-treatment contrast-enhanced MRIs were included in this retrospective study. Radiomics features (RFs) were extracted from fat-sat contrast-enhanced T1-weighted imaging. Log ratio and relative change in RFs were calculated and used to determine grouping of samples based on a consensus hierarchical clustering. DGE and oncogenesis pathway analysis were performed in the delta-radiomics groups identified in order to detect associations between delta-radiomics patterns and transcriptomics features of STS. Secondarily, the prognostic value of the delta-radiomics groups was investigated.

RESULTS

Sixty-three patients were included (median age: 63 years, interquartile range: 52.5-70). The consensus clustering identified 3 reliable delta-radiomics patient groups (A, B, and C). On imaging, group B patients were characterized by increase in tumor heterogeneity, necrotic signal, infiltrative margins, peritumoral edema, and peritumoral enhancement before the treatment start (p value range: 0.0019-0.0244), and, molecularly, by downregulation of natural killer cell-mediated cytotoxicity genes and upregulation of Hedgehog and Hippo signaling pathways. Group A patients were characterized by morphological stability of pre-treatment MRI traits and no local relapse (log-rank p = 0.0277).

CONCLUSIONS

This study highlights radiomics and transcriptomics convergence in STS. Proliferation and immune response inhibition were hyper-activated in the STS that were the most evolving on consecutive imaging.

KEY POINTS

• Three consensual and stable delta-radiomics clusters were identified and captured the natural patterns of morphological evolution of STS on pre-treatment MRIs. • These 3 patterns were explainable and correlated with different well-known semantic radiological features with an ascending gradient of pejorative characteristics from the A group to C group to B group. • Gene expression profiling stressed distinct patterns of up/downregulated oncogenetic pathways in STS from B group in keeping with its most aggressive radiological evolution.

Predicting Soft Tissue Sarcoma Response to Neoadjuvant Chemotherapy Using an MRI-Based Delta-Radiomics Approach

OBJECTIVES

To evaluate the performance of machine learning-augmented MRI-based radiomics models for predicting response to neoadjuvant chemotherapy (NAC) in soft tissue sarcomas.

METHODS

Forty-four subjects were identified retrospectively from patients who received NAC at our institution for pathologically proven soft tissue sarcomas. Only subjects who had both a baseline MRI prior to initiating chemotherapy and a post-treatment scan at least 2 months after initiating chemotherapy and prior to surgical resection were included. 3D ROIs were used to delineate whole-tumor volumes on pre- and post-treatment scans, from which 1708 radiomics features were extracted. Delta-radiomics features were calculated by subtraction of baseline from post-treatment values and used to distinguish treatment response through univariate analyses as well as machine learning-augmented radiomics analyses.

RESULTS

Though only 4.74% of variables overall reached significance at p ≤ 0.05 in univariate analyses, Laws Texture Energy (LTE)-derived metrics represented 46.04% of all such features reaching statistical significance. ROC analyses similarly failed to predict NAC response, with AUCs of 0.40 (95% CI 0.22-0.58) and 0.44 (95% CI 0.26-0.62) for RF and AdaBoost, respectively.

CONCLUSION

Overall, while our result was not able to separate NAC responders from non-responders, our analyses did identify a subset of LTE-derived metrics that show promise for further investigations. Future studies will likely benefit from larger sample size constructions so as to avoid the need for data filtering and feature selection techniques, which have the potential to significantly bias the machine learning procedures.

Predicting pathological complete response of neoadjuvant radiotherapy and targeted therapy for soft tissue sarcoma by whole-tumor texture analysis of multisequence MRI imaging

OBJECTIVES

To construct effective prediction models for neoadjuvant radiotherapy (RT) and targeted therapy based on whole-tumor texture analysis of multisequence MRI for soft tissue sarcoma (STS) patients.

METHODS

Thirty patients with STS of the extremities or trunk from a prospective phase II trial were enrolled for this analysis. All patients underwent pre- and post-neoadjuvant RT MRI examinations from which whole-tumor texture features were extracted, including T₁-weighted with fat saturation and contrast enhancement (T₁FSGd), T₂-weighted with fat saturation (T₂FS), and diffusion-weighted imaging (DWI) sequences and their corresponding apparent diffusion coefficient (ADC) maps. According to the postoperative pathological results, the patients were divided into pathological complete response (pCR) and non-pCR (N-pCR) groups. pCR was defined as less than 5% of residual tumor cells by postoperative pathology. Delta features were defined as the percentage change in a texture feature from pre- to post-neoadjuvant RT MRI. After data reduction and feature selection, logistic regression was used to build prediction models. ROC analysis was performed to assess the diagnostic performance.

RESULTS

Five of 30 patients (16.7%) achieved pCR. The Delta_Model (AUC 0.92) had a better predictive ability than the Pre_Model (AUC 0.78) and Post_Model (AUC 0.76) and was better than AJCC staging (AUC 0.52) and RECIST 1.1 criteria (AUC 0.52). The Combined_Model (pre, post, and delta features) had the best predictive performance (AUC 0.95).

CONCLUSION

Whole-tumor texture analysis of multisequence MRI can well predict pCR status after neoadjuvant RT and targeted therapy in STS patients, with better performance than RECIST 1.1 and AJCC staging.

KEY POINTS

• MRI multisequence texture analysis could predict the efficacy of neoadjuvant RT and targeted therapy for STS patients. • Texture features showed incremental value beyond routine clinical factors. • The Combined_Model with features at multiple time points showed the best performance.

Clinical-Radiomics Nomogram from T1W, T1CE, and T2FS MRI for Improving Diagnosis of Soft-Tissue Sarcoma

PURPOSE

To compare values of multiparametric magnetic resonance imaging (MRI) sequences and propose clinical-radiomics nomogram for diagnosis of soft-tissue sarcoma (STS).

PROCEDURES

This study enrolled 148 patients from Dec. 2017 to Feb. 2021. All patients underwent T1-weighted (T1W), contrast-enhanced T1-weighted (T1CE), and T2-weighted fat-suppressed (T2FS) MRI scans. A total of 1967 radiomic features were extracted from the segmented regions of interest (ROIs) in each MRI sequence. Highly diagnostic radiomic features were selected with Mann-Whitney U test, elastic net, and Akaike's information criterion (AIC) based on MRI images. Logistical regression was used to build Rad scores. Clinical factors were analyzed using the chi-square test or Mann-Whitney U test. The performance of the Rad scores was judged using the area under the receiver operating characteristic area under the curve (ROC AUC), sensitivity, specificity, and accuracy. The nomogram was developed by integrating the Rad score and the most important clinical factor.

RESULTS

By combining the three MRI sequences, the Rad-Com was developed consisting of twelve features selected by with Mann-Whitney U test, elastic net, and AIC: four from T1W, three from TICE, and five from T2FS MRI. The margin (P < 0.05) demonstrated a statistically significant difference between patients with benign and malignant soft-tissue tumors (STT). The nomogram was constructed by integrating the Rad-Com and margin, which yielded favorable diagnostic AUCs of 0.919 (sensitivity (Sen) = 0.784, specificity (Spe) = 0.936) and 0.913 (Sen = 0.923, Spe = 0.792) in the training and validation cohort.

CONCLUSION

The proposed nomogram may have potential as a noninvasive marker for STS diagnosis.

Systemic therapies in hepatocellular carcinoma: Existing and emerging biomarkers for treatment response

Hepatocellular carcinoma (HCC) is the fifth most common malignancy and the third most common cause of cancer-related death worldwide. Due to asymptomatic patients in the early stage, most patients are diagnosed at an advanced stage and lose the opportunity for radical resection. In addition, for patients who underwent procedures with curative intent for early-stage HCC, up to 70% of patients may have disease recurrence within 5 years. With the advent of an increasing number of systemic therapy medications, we now have more options for the treatment of HCC. However, data from clinical studies show that with different combinations of regimens, the objective response rate is approximately 40%, and most patients will not respond to treatment. In this setting, biomarkers for predicting treatment response are of great significance for precise treatment, reducing drug side effects and saving medical resources. In this review, we summarized the existing and emerging biomarkers in the literature, with special emphasis on the pathways and mechanism underlying the prediction value of those biomarkers for systemic treatment response.

Real-world clinical outcomes with daily image-guided IMRT in extremity soft tissue sarcomas

PURPOSE

We report the clinical outcomes of patients with soft tissue sarcomas (STS) arising in extremities treated with image-guided intensity modulated radiotherapy (IG-IMRT) at our institute. Local control of the tumors treated with RT was the primary end point of this study. Analyzing overall survival and long-term toxicities were the secondary objectives.

METHODS AND MATERIALS

The database of the patients with STS who received wide local excision and IG-IMRT at our institution from January 2012 to December 2020 was reviewed. Radiation was offered either preoperatively or postoperatively as part of multi-modality treatment.

RESULTS

Thirty-three consecutive patients were identified and included for analysis. Twenty-eight patients (84.8%) received postoperative adjuvant radiotherapy. Dedicated MRI simulation studies were performed in 31 patients (93.9%) in the treatment position. RapidArc IMRT technique was used in 31 patients (93.9%). A total of 2954 images were acquired during 991 treatment sessions. Errors exceeding 1 mm in the x, y and z directions were corrected online before the treatment. With a median follow-up of 36 months, two patients (6.1%) developed local recurrence. The 3-year local control was 90.9% (95% CI, 0.76 - 0.98), and the 5-year overall survival was 71.7% (95% CI, 0.44 - 0.88). One patient (3.03%) sustained a pathological fracture during the follow-up period.

CONCLUSION

Our results showed that IMRT with daily imaging offered excellent local control with acceptable long-term toxicity, as well as being feasible and practical to implement in our routine clinical practice.

The diagnosis, classification, and treatment of sarcoma in this era of artificial intelligence and immunotherapy

Soft-tissue sarcomas (STS) represent a group of rare and heterogeneous tumors associated with several challenges, including incorrect or late diagnosis, the lack of clinical expertise, and limited therapeutic options. Digital pathology and radiomics represent transformative technologies that appear promising for improving the accuracy of cancer diagnosis, characterization and monitoring. Herein, we review the potential role of the application of digital pathology and radiomics in managing patients with STS. We have particularly described the main results and the limits of the studies using radiomics to refine diagnosis or predict the outcome of patients with soft-tissue sarcomas. We also discussed the current limitation of implementing radiomics in routine settings. Standard management approaches for STS have not improved since the early 1970s. Immunotherapy has revolutionized cancer treatment; nonetheless, immuno-oncology agents have not yet been approved for patients with STS. However, several lines of evidence indicate that immunotherapy may represent an efficient therapeutic strategy for this group of diseases. Thus, we emphasized the remarkable potential of immunotherapy in sarcoma treatment by focusing on recent data regarding the immune landscape of these tumors. We have particularly emphasized the fact that the development of immunotherapy for sarcomas is not an aspect of histology (except for alveolar soft-part sarcoma) but rather that of the tumor microenvironment. Future studies investigating immunotherapy strategies in sarcomas should incorporate at least the presence of tertiary lymphoid structures as a stratification factor in their design, besides including a strong translational program that will allow for a better understanding of the determinants involved in sensitivity and treatment resistance to immune-oncology agents.

The CT delta-radiomics based machine learning approach in evaluating multiple primary lung adenocarcinoma

Object

To evaluate the difference between multiple primary lung adenocarcinoma (MPLA) and solitary primary lung adenocarcinoma (SPLA) by delta-radiomics based machine learning algorithms in CT images.

Methods

A total of 1094 patients containing 268 MPLAs and 826 SPLAs were recruited for this retrospective study between 2014 to 2020. After the segmentation of volume of interest, the radiomic features were automatically calculated. The patients were categorized into the training set and testing set by a random proportion of 7:3. After feature selection, the relevant classifiers were constructed by the machine learning algorithms of Bayes, forest, k-nearest neighbor, logistic regression, support vector machine, and decision tree. The relative standard deviation (RSD) was calculated and the classification model with minimal RSD was chosen for delta-radiomics analysis to explore the variation of tumor during follow-up surveillance in the cohort of 225 MPLAs and 320 SPLAs. According to the different follow-up duration, it was divided into group A (3–12 months), group B (13–24 months), and group C (25–48 months). Then the corresponding delta-radiomics classifiers were developed to predict MPLAs. The area under the receiver operator characteristic curve (AUC) with 95% confidence interval (CI) was quantified to evaluate the efficiency of the model.

Results

To radiomics analysis, the forest classifier (FC-radio) with the minimal RSD showed the better stability with AUCs of 0.840 (95%CI, 0.810–0.867) and 0.670 (95%CI, 0.611–0.724) in the training and testing set. The AUCs of the forest classifier based on delta-radiomics (FC-delta) were higher than those of FC-radio. In addition, with the extension of follow-up duration, the performance of FC-delta in Group C were the best with AUCs of 0.998 (95%CI, 0.993–1.000) in the training set and 0.853 (95%CI, 0.752–0.940) in the testing set.

Conclusions

The machine-learning approach based on radiomics and delta-radiomics helped to differentiate SPLAs from MPLAs. The FC-delta with a longer follow-up duration could better distinguish between SPLAs and MPLAs.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12885-022-10036-1.

The impact of inter-observer variation in delineation on robustness of radiomics features in non-small cell lung cancer

Artificial intelligence and radiomics have the potential to revolutionise cancer prognostication and personalised treatment. Manual outlining of the tumour volume for extraction of radiomics features (RF) is a subjective process. This study investigates robustness of RF to inter-observer variation (IOV) in contouring in lung cancer. We utilised two public imaging datasets: ‘NSCLC-Radiomics’ and ‘NSCLC-Radiomics-Interobserver1’ (‘Interobserver’). For ‘NSCLC-Radiomics’, we created an additional set of manual contours for 92 patients, and for ‘Interobserver’, there were five manual and five semi-automated contours available for 20 patients. Dice coefficients (DC) were calculated for contours. 1113 RF were extracted including shape, first order and texture features. Intraclass correlation coefficient (ICC) was computed to assess robustness of RF to IOV. Cox regression analysis for overall survival (OS) was performed with a previously published radiomics signature. The median DC ranged from 0.81 (‘NSCLC-Radiomics’) to 0.85 (‘Interobserver’—semi-automated). The median ICC for the ‘NSCLC-Radiomics’, ‘Interobserver’ (manual) and ‘Interobserver’ (semi-automated) were 0.90, 0.88 and 0.93 respectively. The ICC varied by feature type and was lower for first order and gray level co-occurrence matrix (GLCM) features. Shape features had a lower median ICC in the ‘NSCLC-Radiomics’ dataset compared to the ‘Interobserver’ dataset. Survival analysis showed similar separation of curves for three of four RF apart from ‘original_shape_Compactness2’, a feature with low ICC (0.61). The majority of RF are robust to IOV, with first order, GLCM and shape features being the least robust. Semi-automated contouring improves feature stability. Decreased robustness of a feature is significant as it may impact upon the features’ prognostic capability.

Prediction of the therapeutic efficacy of epirubicin combined with ifosfamide in patients with lung metastases from soft tissue sarcoma based on contrast-enhanced CT radiomics features

Objective

To investigate the value of contrast-enhanced computed tomography (CECT) radiomics features in predicting the efficacy of epirubicin combined with ifosfamide in patients with pulmonary metastases from soft tissue sarcoma.

Methods

A retrospective analysis of 51 patients with pulmonary metastases from soft tissue sarcoma who received the chemotherapy regimen of epirubicin combined with ifosfamide was performed, and efficacy was evaluated by Recist1.1. ROIs (1 or 2) were selected for each patient. Lung metastases were used as target lesions (86 target lesions total), and the patients were divided into a progression group (n = 29) and a non-progressive group (n = 57); the latter included a stable group (n = 34) and a partial response group (n = 23). Information on lung metastases was extracted from CECT images before chemotherapy, and all lesions were delineated by ITK-SNAP software manually or semiautomatically. The decision tree classifier had a better performance in all radiomics models. A receiver operating characteristic curve was plotted to evaluate the predictive performance of the radiomics model.

Results

In total, 851 CECT radiomics features were extracted for each target lesion and finally reduced to 2 radiomics features, which were then used to construct a radiomics model. Areas under the curves of the model for predicting lesion progression were 0.917 and 0.856 in training and testing groups, respectively.

Conclusion

The model established based on the radiomics features of CECT before treatment has certain predictive value for assessing the efficacy of chemotherapy for patients with soft tissue sarcoma lung metastases.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12880-022-00859-6.

A comparative study for the evaluation of CT-based conventional, radiomic, combined conventional and radiomic, and delta-radiomic features, and the prediction of the invasiveness of lung adenocarcinoma manifesting as ground-glass nodules

AIM

To investigate and compare the performance of conventional, radiomic, combined, and delta-radiomic features to predict the invasiveness of lung adenocarcinoma manifesting as ground-glass nodules (GGNs).

MATERIALS AND METHODS

The present retrospective study included 216 GGNs confirmed surgically as pulmonary adenocarcinomas. All the thin-section computed tomography (CT) images were imported into the software of the United Imaging Intelligence research portal, and radiomic features were extracted with three-dimensional (3D) regions of interest. Least Absolute Shrinkage and Selection Operator was used to select the optimal radiomic features. Four models were constructed, including conventional, radiomic, combined conventional and radiomic, and delta-radiomic models. The receiver operating characteristic curves were built to evaluate the validity of these.

RESULTS

The type, long diameter, shape, margin, vacuole, air bronchus, vascular convergence, and pleural traction exhibited significant differences between pre-invasive lesions (PILs)/minimally invasive adenocarcinoma (MIA), and invasive adenocarcinoma (IA) groups were selected for conventional model building. Nine radiomic features were selected to build the radiomic model. The four models indicated optimal performance (AUC > 0.7). The radiomic and combined models exhibited the highest diagnostic efficiency, and their AUC were 0.89 and 0.88 in the training set, and 0.87 and 0.88 in the validation set, respectively. The delta-radiomic model indicated that the AUC was 0.83 in the training set, and 0.76 in the validation set. Finally, the conventional model exhibited an AUC in the training and validation sets of 0.78 and 0.76.

CONCLUSIONS

The radiomic model and combined model, in particular, and the delta-radiomic model all demonstrated improved diagnostic efficiency in differentiating IA from PIL/MIA than that of the conventional model.

Multi-parametric MRI-based radiomics for the diagnosis of malignant soft-tissue tumor

PURPOSE

To develop and validate a multiparametric magnetic resonance imaging-based radiomics nomogram for differentiating malignant and benign soft-tissue tumors.

METHODS

A total of 91 patients with pathologically confirmed soft-tissue tumors were enrolled between January 2017 and October 2020. Forty-eight patients were consecutively enrolled between November 2020 and March 2022, as a time-independent cohort. All patients underwent contrast-enhanced T1-weighted and T2-weighted fat-suppression magnetic resonance scans at 3.0 T. Radiomics features were extracted and selected from the two modalities to develop the radiomics signature. Significant clinical/morphological characteristics were identified using a multivariate logistic regression analysis. The least absolute shrinkage and selection operator regression were applied to identify discriminative features. A clinical-radiomics nomogram was constructed based on clinical/morphological characteristics and radiomics features. Finally, the performance of the nomogram was validated using the receiver operating characteristic and decision curve analysis (DCA).

RESULTS

Six features were selected to establish the combined RS. Size, margin, and peritumoral edema were identified as the most important clinical and morphological factors, respectively. The radiomics signature outperformed the clinical model in terms of AUC and sensitivity. The nomogram integrating the combined RS, size, margin, and peritumoral edema achieved favorable predictive efficacy, generating AUCs of 0.954 (95% confidence interval [CI]: 0.907-1.000, Sen = 0.861, Spe = 0.917), 0.962 (95% CI: 0.901-1.000, Sen = 0.944, Spe = 0.923), and 0.935 (95% CI: 0.871-0.998, Sen = 0.815, Spe = 0.952) in the training (n = 60), validation (n = 31) and time-independent (n = 48) cohorts, respectively. The DCA curve indicated good clinical usefulness of the nomogram.

CONCLUSIONS

Our study demonstrated the clinical potential of multiparametric MRI-based radiomics in distinguishing malignant from benign soft-tissue tumors, which can be considered as a noninvasive tool for individual treatment management.

Intracranial Aneurysm Rupture Risk Estimation With Multidimensional Feature Fusion

The rupture of aneurysms is the main cause of spontaneous subarachnoid hemorrhage (SAH), which is a serious life-threatening disease with high mortality and permanent disability rates. Therefore, it is highly desirable to evaluate the rupture risk of aneurysms. In this study, we proposed a novel semiautomatic prediction model for the rupture risk estimation of aneurysms based on the CADA dataset, including 108 datasets with 125 annotated aneurysms. The model consisted of multidimensional feature fusion, feature selection, and the construction of classification methods. For the multidimensional feature fusion, we extracted four kinds of features and combined them into the feature set, including morphological features, radiomics features, clinical features, and deep learning features. Specifically, we applied the feature extractor 3D EfficientNet-B0 to extract and analyze the classification capabilities of three different deep learning features, namely, no-sigmoid features, sigmoid features, and binarization features. In the experiment, we constructed five distinct classification models, among which the k-nearest neighbor classifier showed the best performance for aneurysm rupture risk estimation, reaching an F2-score of 0.789. Our results suggest that the full use of multidimensional feature fusion can improve the performance of aneurysm rupture risk assessment. Compared with other methods, our method achieves the state-of-the-art performance for aneurysm rupture risk assessment methods based on CADA 2020.

Deep Learning With Radiomics for Disease Diagnosis and Treatment: Challenges and Potential

The high-throughput extraction of quantitative imaging features from medical images for the purpose of radiomic analysis, i.e., radiomics in a broad sense, is a rapidly developing and emerging research field that has been attracting increasing interest, particularly in multimodality and multi-omics studies. In this context, the quantitative analysis of multidimensional data plays an essential role in assessing the spatio-temporal characteristics of different tissues and organs and their microenvironment. Herein, recent developments in this method, including manually defined features, data acquisition and preprocessing, lesion segmentation, feature extraction, feature selection and dimension reduction, statistical analysis, and model construction, are reviewed. In addition, deep learning-based techniques for automatic segmentation and radiomic analysis are being analyzed to address limitations such as rigorous workflow, manual/semi-automatic lesion annotation, and inadequate feature criteria, and multicenter validation. Furthermore, a summary of the current state-of-the-art applications of this technology in disease diagnosis, treatment response, and prognosis prediction from the perspective of radiology images, multimodality images, histopathology images, and three-dimensional dose distribution data, particularly in oncology, is presented. The potential and value of radiomics in diagnostic and therapeutic strategies are also further analyzed, and for the first time, the advances and challenges associated with dosiomics in radiotherapy are summarized, highlighting the latest progress in radiomics. Finally, a robust framework for radiomic analysis is presented and challenges and recommendations for future development are discussed, including but not limited to the factors that affect model stability (medical big data and multitype data and expert knowledge in medical), limitations of data-driven processes (reproducibility and interpretability of studies, different treatment alternatives for various institutions, and prospective researches and clinical trials), and thoughts on future directions (the capability to achieve clinical applications and open platform for radiomics analysis).

AI-Based Detection, Classification and Prediction/Prognosis in Medical Imaging:: Towards Radiophenomics

Artificial intelligence (AI) techniques have significant potential to enable effective, robust, and automated image phenotyping including the identification of subtle patterns. AI-based detection searches the image space to find the regions of interest based on patterns and features. There is a spectrum of tumor histologies from benign to malignant that can be identified by AI-based classification approaches using image features. The extraction of minable information from images gives way to the field of "radiomics" and can be explored via explicit (handcrafted/engineered) and deep radiomics frameworks. Radiomics analysis has the potential to be used as a noninvasive technique for the accurate characterization of tumors to improve diagnosis and treatment monitoring. This work reviews AI-based techniques, with a special focus on oncological PET and PET/CT imaging, for different detection, classification, and prediction/prognosis tasks. We also discuss needed efforts to enable the translation of AI techniques to routine clinical workflows, and potential improvements and complementary techniques such as the use of natural language processing on electronic health records and neuro-symbolic AI techniques.