Image-Guided Radiooncology: The Potential of Radiomics in Clinical Application

Radiomics-based prediction of local control in patients with brain metastases following postoperative stereotactic radiotherapy

BACKGROUND

Surgical resection is the standard of care for patients with large or symptomatic brain metastases (BMs). Despite improved local control after adjuvant stereotactic radiotherapy, the risk of local failure (LF) persists. Therefore, we aimed to develop and externally validate a pre-therapeutic radiomics-based prediction tool to identify patients at high LF risk.

METHODS

Data were collected from A Multicenter Analysis of Stereotactic Radiotherapy to the Resection Cavity of BMs (AURORA) retrospective study (training cohort: 253 patients from 2 centers; external test cohort: 99 patients from 5 centers). Radiomic features were extracted from the contrast-enhancing BM (T1-CE MRI sequence) and the surrounding edema (T2-FLAIR sequence). Different combinations of radiomic and clinical features were compared. The final models were trained on the entire training cohort with the best parameter set previously determined by internal 5-fold cross-validation and tested on the external test set.

RESULTS

The best performance in the external test was achieved by an elastic net regression model trained with a combination of radiomic and clinical features with a concordance index (CI) of 0.77, outperforming any clinical model (best CI: 0.70). The model effectively stratified patients by LF risk in a Kaplan-Meier analysis (P < .001) and demonstrated an incremental net clinical benefit. At 24 months, we found LF in 9% and 74% of the low and high-risk groups, respectively.

CONCLUSIONS

A combination of clinical and radiomic features predicted freedom from LF better than any clinical feature set alone. Patients at high risk for LF may benefit from stricter follow-up routines or intensified therapy.

CT-based radiomics for predicting breast cancer radiotherapy side effects

Skin inflammation with the potential sequel of moist epitheliolysis and edema constitute the most frequent breast radiotherapy (RT) acute side effects. The aim of this study was to compare the predictive value of tissue-derived radiomics features to the total breast volume (TBV) for the moist cells epitheliolysis as a surrogate for skin inflammation, and edema. Radiomics features were extracted from computed tomography (CT) scans of 252 breast cancer patients from two volumes of interest: TBV and glandular tissue (GT). Machine learning classifiers were trained on radiomics and clinical features, which were evaluated for both side effects. The best radiomics model was a least absolute shrinkage and selection operator (LASSO) classifier, using TBV features, predicting moist cells epitheliolysis, achieving an area under the receiver operating characteristic (AUROC) of 0.74. This was comparable to TBV breast volume (AUROC of 0.75). Combined models of radiomics and clinical features did not improve performance. Exclusion of volume-correlated features slightly reduced the predictive performance (AUROC 0.71). We could demonstrate the general propensity of planning CT-based radiomics models to predict breast RT-dependent side effects. Mammary tissue was more predictive than glandular tissue. The radiomics features performance was influenced by their high correlation to TBV volume.

Development and benchmarking of a Deep Learning-based MRI-guided gross tumor segmentation algorithm for Radiomics analyses in extremity soft tissue sarcomas

BACKGROUND

Volume of interest (VOI) segmentation is a crucial step for Radiomics analyses and radiotherapy (RT) treatment planning. Because it can be time-consuming and subject to inter-observer variability, we developed and tested a Deep Learning-based automatic segmentation (DLBAS) algorithm to reproducibly predict the primary gross tumor as VOI for Radiomics analyses in extremity soft tissue sarcomas (STS).

METHODS

A DLBAS algorithm was trained on a cohort of 157 patients and externally tested on an independent cohort of 87 patients using contrast-enhanced MRI. Manual tumor delineations by a radiation oncologist served as ground truths (GTs). A benchmark study with 20 cases from the test cohort compared the DLBAS predictions against manual VOI segmentations of two residents (ERs) and clinical delineations of two radiation oncologists (ROs). The ROs rated DLBAS predictions regarding their direct applicability.

RESULTS

The DLBAS achieved a median dice similarity coefficient (DSC) of 0.88 against the GTs in the entire test cohort (interquartile range (IQR): 0.11) and a median DSC of 0.89 (IQR 0.07) and 0.82 (IQR 0.10) in comparison to ERs and ROs, respectively. Radiomics feature stability was high with a median intraclass correlation coefficient of 0.97, 0.95 and 0.94 for GTs, ERs, and ROs, respectively. DLBAS predictions were deemed clinically suitable by the two ROs in 35% and 20% of cases, respectively.

CONCLUSION

The results demonstrate that the DLBAS algorithm provides reproducible VOI predictions for radiomics feature extraction. Variability remains regarding direct clinical applicability of predictions for RT treatment planning.

Identifying core MRI sequences for reliable automatic brain metastasis segmentation

BACKGROUND

Many automatic approaches to brain tumor segmentation employ multiple magnetic resonance imaging (MRI) sequences. The goal of this project was to compare different combinations of input sequences to determine which MRI sequences are needed for effective automated brain metastasis (BM) segmentation.

METHODS

We analyzed preoperative imaging (T1-weighted sequence ± contrast-enhancement (T1/T1-CE), T2-weighted sequence (T2), and T2 fluid-attenuated inversion recovery (T2-FLAIR) sequence) from 339 patients with BMs from seven centers. A baseline 3D U-Net with all four sequences and six U-Nets with plausible sequence combinations (T1-CE, T1, T2-FLAIR, T1-CE + T2-FLAIR, T1-CE + T1 + T2-FLAIR, T1-CE + T1) were trained on 239 patients from two centers and subsequently tested on an external cohort of 100 patients from five centers.

RESULTS

The model based on T1-CE alone achieved the best segmentation performance for BM segmentation with a median Dice similarity coefficient (DSC) of 0.96. Models trained without T1-CE performed worse (T1-only: DSC = 0.70 and T2-FLAIR-only: DSC = 0.73). For edema segmentation, models that included both T1-CE and T2-FLAIR performed best (DSC = 0.93), while the remaining four models without simultaneous inclusion of these both sequences reached a median DSC of 0.81-0.89.

CONCLUSIONS

A T1-CE-only protocol suffices for the segmentation of BMs. The combination of T1-CE and T2-FLAIR is important for edema segmentation. Missing either T1-CE or T2-FLAIR decreases performance. These findings may improve imaging routines by omitting unnecessary sequences, thus allowing for faster procedures in daily clinical practice while enabling optimal neural network-based target definitions.

The importance of planning CT-based imaging features for machine learning-based prediction of pain response

Patients suffering from painful spinal bone metastases (PSBMs) often undergo palliative radiation therapy (RT), with an efficacy of approximately two thirds of patients. In this exploratory investigation, we assessed the effectiveness of machine learning (ML) models trained on radiomics, semantic and clinical features to estimate complete pain response. Gross tumour volumes (GTV) and clinical target volumes (CTV) of 261 PSBMs were segmented on planning computed tomography (CT) scans. Radiomics, semantic and clinical features were collected for all patients. Random forest (RFC) and support vector machine (SVM) classifiers were compared using repeated nested cross-validation. The best radiomics classifier was trained on CTV with an area under the receiver-operator curve (AUROC) of 0.62 ± 0.01 (RFC; 95% confidence interval). The semantic model achieved a comparable AUROC of 0.63 ± 0.01 (RFC), significantly below the clinical model (SVM, AUROC: 0.80 ± 0.01); and slightly lower than the spinal instability neoplastic score (SINS; LR, AUROC: 0.65 ± 0.01). A combined model did not improve performance (AUROC: 0,74 ± 0,01). We could demonstrate that radiomics and semantic analyses of planning CTs allowed for limited prediction of therapy response to palliative RT. ML predictions based on established clinical parameters achieved the best results.

Development of PSMA-PET-guided CT-based radiomic signature to predict biochemical recurrence after salvage radiotherapy

PURPOSE

To develop a CT-based radiomic signature to predict biochemical recurrence (BCR) in prostate cancer patients after sRT guided by positron-emission tomography targeting prostate-specific membrane antigen (PSMA-PET).

MATERIAL AND METHODS

Consecutive patients, who underwent 68Ga-PSMA11-PET/CT-guided sRT from three high-volume centers in Germany, were included in this retrospective multicenter study. Patients had PET-positive local recurrences and were treated with intensity-modulated sRT. Radiomic features were extracted from volumes of interests on CT guided by focal PSMA-PET uptakes. After preprocessing, clinical, radiomics, and combined clinical-radiomic models were developed combining different feature reduction techniques and Cox proportional hazard models within a nested cross validation approach.

RESULTS

Among 99 patients, median interval until BCR was the radiomic models outperformed clinical models and combined clinical-radiomic models for prediction of BCR with a C-index of 0.71 compared to 0.53 and 0.63 in the test sets, respectively. In contrast to the other models, the radiomic model achieved significantly improved patient stratification in Kaplan-Meier analysis. The radiomic and clinical-radiomic model achieved a significantly better time-dependent net reclassification improvement index (0.392 and 0.762, respectively) compared to the clinical model. Decision curve analysis demonstrated a clinical net benefit for both models. Mean intensity was the most predictive radiomic feature.

CONCLUSION

This is the first study to develop a PSMA-PET-guided CT-based radiomic model to predict BCR after sRT. The radiomic models outperformed clinical models and might contribute to guide personalized treatment decisions.

Deep Learning Aided Neuroimaging and Brain Regulation

Currently, deep learning aided medical imaging is becoming the hot spot of AI frontier application and the future development trend of precision neuroscience. This review aimed to render comprehensive and informative insights into the recent progress of deep learning and its applications in medical imaging for brain monitoring and regulation. The article starts by providing an overview of the current methods for brain imaging, highlighting their limitations and introducing the potential benefits of using deep learning techniques to overcome these limitations. Then, we further delve into the details of deep learning, explaining the basic concepts and providing examples of how it can be used in medical imaging. One of the key strengths is its thorough discussion of the different types of deep learning models that can be used in medical imaging including convolutional neural networks (CNNs), recurrent neural networks (RNNs), and generative adversarial network (GAN) assisted magnetic resonance imaging (MRI), positron emission tomography (PET)/computed tomography (CT), electroencephalography (EEG)/magnetoencephalography (MEG), optical imaging, and other imaging modalities. Overall, our review on deep learning aided medical imaging for brain monitoring and regulation provides a referrable glance for the intersection of deep learning aided neuroimaging and brain regulation.

Development and Evaluation of MR-Based Radiogenomic Models to Differentiate Atypical Lipomatous Tumors from Lipomas

Background: The aim of this study was to develop and validate radiogenomic models to predict the MDM2 gene amplification status and differentiate between ALTs and lipomas on preoperative MR images. Methods: MR images were obtained in 257 patients diagnosed with ALTs (n = 65) or lipomas (n = 192) using histology and the MDM2 gene analysis as a reference standard. The protocols included T2-, T1-, and fat-suppressed contrast-enhanced T1-weighted sequences. Additionally, 50 patients were obtained from a different hospital for external testing. Radiomic features were selected using mRMR. Using repeated nested cross-validation, the machine-learning models were trained on radiomic features and demographic information. For comparison, the external test set was evaluated by three radiology residents and one attending radiologist. Results: A LASSO classifier trained on radiomic features from all sequences performed best, with an AUC of 0.88, 70% sensitivity, 81% specificity, and 76% accuracy. In comparison, the radiology residents achieved 60–70% accuracy, 55–80% sensitivity, and 63–77% specificity, while the attending radiologist achieved 90% accuracy, 96% sensitivity, and 87% specificity. Conclusion: A radiogenomic model combining features from multiple MR sequences showed the best performance in predicting the MDM2 gene amplification status. The model showed a higher accuracy compared to the radiology residents, though lower compared to the attending radiologist.

Dosiomics and radiomics to predict pneumonitis after thoracic stereotactic body radiotherapy and immune checkpoint inhibition

Introduction

Pneumonitis is a relevant side effect after radiotherapy (RT) and immunotherapy with checkpoint inhibitors (ICIs). Since the effect is radiation dose dependent, the risk increases for high fractional doses as applied for stereotactic body radiation therapy (SBRT) and might even be enhanced for the combination of SBRT with ICI therapy. Hence, patient individual pre-treatment prediction of post-treatment pneumonitis (PTP) might be able to support clinical decision making. Dosimetric factors, however, use limited information and, thus, cannot exploit the full potential of pneumonitis prediction.

Methods

We investigated dosiomics and radiomics model based approaches for PTP prediction after thoracic SBRT with and without ICI therapy. To overcome potential influences of different fractionation schemes, we converted physical doses to 2 Gy equivalent doses (EQD2) and compared both results. In total, four single feature models (dosiomics, radiomics, dosimetric, clinical factors) were tested and five combinations of those (dosimetric+clinical factors, dosiomics+radiomics, dosiomics+dosimetric+clinical factors, radiomics+dosimetric+clinical factors, radiomics+dosiomics+dosimetric+clinical factors). After feature extraction, a feature reduction was performed using pearson intercorrelation coefficient and the Boruta algorithm within 1000-fold bootstrapping runs. Four different machine learning models and the combination of those were trained and tested within 100 iterations of 5-fold nested cross validation.

Results

Results were analysed using the area under the receiver operating characteristic curve (AUC). We found the combination of dosiomics and radiomics features to outperform all other models with AUCradiomics+dosiomics, D = 0.79 (95% confidence interval 0.78-0.80) and AUCradiomics+dosiomics, EQD2 = 0.77 (0.76-0.78) for physical dose and EQD2, respectively. ICI therapy did not impact the prediction result (AUC ≤ 0.5). Clinical and dosimetric features for the total lung did not improve the prediction outcome.

Conclusion

Our results suggest that combined dosiomics and radiomics analysis can improve PTP prediction in patients treated with lung SBRT. We conclude that pre-treatment prediction could support clinical decision making on an individual patient basis with or without ICI therapy.

Development and external validation of an MRI-based neural network for brain metastasis segmentation in the AURORA multicenter study

BACKGROUND

Stereotactic radiotherapy is a standard treatment option for patients with brain metastases. The planning target volume is based on gross tumor volume (GTV) segmentation. The aim of this work is to develop and validate a neural network for automatic GTV segmentation to accelerate clinical daily routine practice and minimize interobserver variability.

METHODS

We analyzed MRIs (T1-weighted sequence ± contrast-enhancement, T2-weighted sequence, and FLAIR sequence) from 348 patients with at least one brain metastasis from different cancer primaries treated in six centers. To generate reference segmentations, all GTVs and the FLAIR hyperintense edematous regions were segmented manually. A 3D-U-Net was trained on a cohort of 260 patients from two centers to segment the GTV and the surrounding FLAIR hyperintense region. During training varying degrees of data augmentation were applied. Model validation was performed using an independent international multicenter test cohort (n = 88) including four centers.

RESULTS

Our proposed U-Net reached a mean overall Dice similarity coefficient (DSC) of 0.92 ± 0.08 and a mean individual metastasis-wise DSC of 0.89 ± 0.11 in the external test cohort for GTV segmentation. Data augmentation improved the segmentation performance significantly. Detection of brain metastases was effective with a mean F1-Score of 0.93 ± 0.16. The model performance was stable independent of the center (p = 0.3). There was no correlation between metastasis volume and DSC (Pearson correlation coefficient 0.07).

CONCLUSION

Reliable automated segmentation of brain metastases with neural networks is possible and may support radiotherapy planning by providing more objective GTV definitions.

Value assessment of artificial intelligence in medical imaging: a scoping review

BACKGROUND

Artificial intelligence (AI) is seen as one of the major disrupting forces in the future healthcare system. However, the assessment of the value of these new technologies is still unclear, and no agreed international health technology assessment-based guideline exists. This study provides an overview of the available literature in the value assessment of AI in the field of medical imaging.

METHODS

We performed a systematic scoping review of published studies between January 2016 and September 2020 using 10 databases (Medline, Scopus, ProQuest, Google Scholar, and six related databases of grey literature). Information about the context (country, clinical area, and type of study) and mentioned domains with specific outcomes and items were extracted. An existing domain classification, from a European assessment framework, was used as a point of departure, and extracted data were grouped into domains and content analysis of data was performed covering predetermined themes.

RESULTS

Seventy-nine studies were included out of 5890 identified articles. An additional seven studies were identified by searching reference lists, and the analysis was performed on 86 included studies. Eleven domains were identified: (1) health problem and current use of technology, (2) technology aspects, (3) safety assessment, (4) clinical effectiveness, (5) economics, (6) ethical analysis, (7) organisational aspects, (8) patients and social aspects, (9) legal aspects, (10) development of AI algorithm, performance metrics and validation, and (11) other aspects. The frequency of mentioning a domain varied from 20 to 78% within the included papers. Only 15/86 studies were actual assessments of AI technologies. The majority of data were statements from reviews or papers voicing future needs or challenges of AI research, i.e. not actual outcomes of evaluations.

CONCLUSIONS

This review regarding value assessment of AI in medical imaging yielded 86 studies including 11 identified domains. The domain classification based on European assessment framework proved useful and current analysis added one new domain. Included studies had a broad range of essential domains about addressing AI technologies highlighting the importance of domains related to legal and ethical aspects.

Artificial intelligence applied to musculoskeletal oncology: a systematic review

Developments in artificial intelligence have the potential to improve the care of patients with musculoskeletal tumors. We performed a systematic review of the published scientific literature to identify the current state of the art of artificial intelligence applied to musculoskeletal oncology, including both primary and metastatic tumors, and across the radiology, nuclear medicine, pathology, clinical research, and molecular biology literature. Through this search, we identified 252 primary research articles, of which 58 used deep learning and 194 used other machine learning techniques. Articles involving deep learning have mostly involved bone scintigraphy, histopathology, and radiologic imaging. Articles involving other machine learning techniques have mostly involved transcriptomic analyses, radiomics, and clinical outcome prediction models using medical records. These articles predominantly present proof-of-concept work, other than the automated bone scan index for bone metastasis quantification, which has translated to clinical workflows in some regions. We systematically review and discuss this literature, highlight opportunities for multidisciplinary collaboration, and identify potentially clinically useful topics with a relative paucity of research attention. Musculoskeletal oncology is an inherently multidisciplinary field, and future research will need to integrate and synthesize noisy siloed data from across clinical, imaging, and molecular datasets. Building the data infrastructure for collaboration will help to accelerate progress towards making artificial intelligence truly useful in musculoskeletal oncology.

MRI-based delta-radiomics predicts pathologic complete response in high-grade soft-tissue sarcoma patients treated with neoadjuvant therapy

PURPOSE

In high-grade soft-tissue sarcomas (STS) the standard of care encompasses multimodal therapy regimens. While there is a growing body of evidence for prognostic pretreatment radiomic models, we hypothesized that temporal changes in radiomic features following neoadjuvant treatment ("delta-radiomics") may be able to predict the pathological complete response (pCR).

METHODS

MRI scans (T1-weighted with fat-saturation and contrast-enhancement (T1FSGd) and T2-weighted with fat-saturation (T2FS)) of patients with STS of the extremities and trunk treated with neoadjuvant therapy were gathered from two independent institutions (training: 103, external testing: 53 patients). pCR was defined as <5% viable cells. After segmentation and preprocessing, 105 radiomic features were extracted. Delta-radiomic features were calculated by subtraction of features derived from MRI scans obtained before and after neoadjuvant therapy. After feature reduction, machine learning modeling was performed in 100 iterations of 3-fold nested cross-validation. Delta-radiomic models were compared with single timepoint models in the testing cohort.

RESULTS

The combined delta-radiomic models achieved the best area under the receiver operating characteristic curve (AUC) of 0.75. Pre-therapeutic tumor volume was the best conventional predictor (AUC 0.70). The T2FS-based delta-radiomic model had the most balanced classification performance with a balanced accuracy of 0.69. Delta-radiomic models achieved better reproducibility than single timepoint radiomic models, RECIST or the peri-therapeutic volume change. Delta-radiomic models were significantly associated with survival in multivariate Cox regression.

CONCLUSION

This exploratory analysis demonstrated that MRI-based delta-radiomics improves prediction of pCR over tumor volume and RECIST. Delta-radiomics may one day function as a biomarker for personalized treatment adaptations.

Radiomics in cervical and endometrial cancer

Radiomics is an emerging field of research that aims to find associations between quantitative information extracted from imaging examinations and clinical data to support the best clinical decision. In the last few years, some papers have been evaluating the role of radiomics in gynecological malignancies, mainly focusing on ovarian cancer. Nonetheless, cervical cancer is the most frequent gynecological malignancy in developing countries and endometrial cancer is the most common in western countries. The purpose of this narrative review is to give an overview of the latest published papers evaluating the role of radiomics in cervical and endometrial cancer, mostly evaluating association with tumor prognostic factors, with response to therapy and with prediction of recurrence and distant metastasis.

Activation of anti-oxidant Keap1/Nrf2 pathway modulates efficacy of dihydroartemisinin-based monotherapy and combinatory therapy with ionizing radiation

The efficacy of radiotherapy depends not only on DNA damage but also on ROS production, both induced by ionizing radiation. Massive ROS production can induce cell death or activate protective pathways such as Keap1/Nrf2 pathway, which regulates intracellular cysteine availability through upregulation of SLC7A11, a subunit of xCT transporter, and subsequently glutathione synthesis, thus improving antioxidative defense. The anti-malaria drug dihydroartemisinin (DHA) shows anti-neoplastic potential. Previous publications suggested that DHA increased ROS production. We intended to enhance oxidative stress with DHA to improve the efficacy of radiotherapy. Therefore, we first analyzed the oxidative response to DHA in HCT116 colorectal and NCI-H460 lung adenocarcinoma cells. In response to DHA, we detected lipid peroxidation and protein oxidation, which resulted in mitochondrial damage and eventually in iron-dependent cell death. Concurrently, DHA activated Keap1/Nrf2 pathway in HCT116 cells, leading to increased SLC7A11 expression and glutathione level. In Keap1-mutant NCI-H460 cells, Nrf2 was constantly activated and responsible for high SLC7A11 and glutathione levels. Pancancer analysis revealed that lung cancer is the tumor entity with the most frequent Keap1 alterations. Although NCI-H460 cells reacted more refractory to DHA-induced cell death than HCT116 cells, eradication of clonogenic cells by DHA was more efficient in both cell lines when Keap1/Nrf2 pathway was inhibited. When applied simultaneously, radiotherapy and DHA more efficiently eradicated clonogenic cells than either therapy alone, but treatment schedule can mitigate the combinatory effect in HCT116 cells. In summary, DHA improved efficacy of radiotherapy, but treatment schedule must be considered with care especially in Keap1-wildtype cells.

Deep Learning Based HPV Status Prediction for Oropharyngeal Cancer Patients

Simple Summary

Determination of human papillomavirus (HPV) status for oropharyngeal cancer patients depicts a essential diagnostic factor and is important for treatment decisions. Current histological methods are invasive, time consuming and costly. We tested the ability of deep learning models for HPV status testing based on routinely acquired diagnostic CT images. A network trained for sports video clip classification was modified and then fine tuned for HPV status prediction. In this way, very basic information about image structures is induced into the model before training is started, while still allowing for exploitation of full 3D information in the CT images. Usage of this approach helps the network to cope with a small number of training examples and makes it more robust. For comparison, two other models were trained, one not relying on a pre-training task and another one pre-trained on 2D Data. The pre-trained video model preformed best.

Abstract

Infection with the human papillomavirus (HPV) has been identified as a major risk factor for oropharyngeal cancer (OPC). HPV-related OPCs have been shown to be more radiosensitive and to have a reduced risk for cancer related death. Hence, the histological determination of HPV status of cancer patients depicts an essential diagnostic factor. We investigated the ability of deep learning models for imaging based HPV status detection. To overcome the problem of small medical datasets, we used a transfer learning approach. A 3D convolutional network pre-trained on sports video clips was fine-tuned, such that full 3D information in the CT images could be exploited. The video pre-trained model was able to differentiate HPV-positive from HPV-negative cases, with an area under the receiver operating characteristic curve (AUC) of 0.81 for an external test set. In comparison to a 3D convolutional neural network (CNN) trained from scratch and a 2D architecture pre-trained on ImageNet, the video pre-trained model performed best. Deep learning models are capable of CT image-based HPV status determination. Video based pre-training has the ability to improve training for 3D medical data, but further studies are needed for verification.