Combined CT radiomics of primary tumor and metastatic lymph nodes improves prediction of loco-regional control in head and neck cancer. Sci Rep. 2019;9:15198. [PMID: 31645603 PMCID: PMC6811564 DOI: 10.1038/s41598-019-51599-7]

Development and Validation of a 3D Resnet Model for Prediction of Lymph Node Metastasis in Head and Neck Cancer Patients

The accurate diagnosis and staging of lymph node metastasis (LNM) are crucial for determining the optimal treatment strategy for head and neck cancer patients. We aimed to develop a 3D Resnet model and investigate its prediction value in detecting LNM. This study enrolled 156 head and neck cancer patients and analyzed 342 lymph nodes segmented from surgical pathologic reports. The patients' clinical and pathological data related to the primary tumor site and clinical and pathology T and N stages were collected. To predict LNM, we developed a dual-pathway 3D Resnet model incorporating two Resnet models with different depths to extract features from the input data. To assess the model's performance, we compared its predictions with those of radiologists in a test dataset comprising 38 patients. The study found that the dimensions and volume of LNM + were significantly larger than those of LNM-. Specifically, the Y and Z dimensions showed the highest sensitivity of 84.6% and specificity of 72.2%, respectively, in predicting LNM + . The analysis of various variations of the proposed 3D Resnet model demonstrated that Dual-3D-Resnet models with a depth of 34 achieved the highest AUC values of 0.9294. In the validation test of 38 patients and 86 lymph nodes dataset, the 3D Resnet model outperformed both physical examination and radiologists in terms of sensitivity (80.8% compared to 50.0% and 91.7%, respectively), specificity(90.0% compared to 88.5% and 65.4%, respectively), and positive predictive value (77.8% compared to 66.7% and 55.0%, respectively) in detecting individual LNM + . These results suggest that the 3D Resnet model can be valuable for accurately identifying LNM + in head and neck cancer patients. A prospective trial is needed to evaluate further the role of the 3D Resnet model in determining LNM + in head and neck cancer patients and its impact on treatment strategies and patient outcomes.

The Use of Artificial Intelligence in Head and Neck Cancers: A Multidisciplinary Survey

Artificial intelligence (AI) approaches have been introduced in various disciplines but remain rather unused in head and neck (H&N) cancers. This survey aimed to infer the current applications of and attitudes toward AI in the multidisciplinary care of H&N cancers. From November 2020 to June 2022, a web-based questionnaire examining the relationship between AI usage and professionals' demographics and attitudes was delivered to different professionals involved in H&N cancers through social media and mailing lists. A total of 139 professionals completed the questionnaire. Only 49.7% of the respondents reported having experience with AI. The most frequent AI users were radiologists (66.2%). Significant predictors of AI use were primary specialty (V = 0.455; p < 0.001), academic qualification and age. AI's potential was seen in the improvement of diagnostic accuracy (72%), surgical planning (64.7%), treatment selection (57.6%), risk assessment (50.4%) and the prediction of complications (45.3%). Among participants, 42.7% had significant concerns over AI use, with the most frequent being the 'loss of control' (27.6%) and 'diagnostic errors' (57.0%). This survey reveals limited engagement with AI in multidisciplinary H&N cancer care, highlighting the need for broader implementation and further studies to explore its acceptance and benefits.

Risk Stratification for Oropharyngeal Squamous Cell Carcinoma Using Texture Analysis on CT - A Step Beyond HPV Status

Background and Purpose: Human papillomavirus-associated oropharyngeal squamous cell carcinoma (OPSCC) is increasingly prevalent. Despite the overall more favorable outcome, the observed heterogeneous treatment response within this patient group highlights the need for additional means to prognosticate and guide clinical decision-making. Promising prediction models using radiomics from primary OPSCC have been derived. However, no model/s using metastatic lymphadenopathy exist to allow prognostication in those instances when the primary tumor is not seen. The aim of our study was to evaluate whether radiomics using metastatic lymphadenopathy allows for the development of a useful risk assessment model comparable to the primary tumor and whether additional knowledge of the HPV status further improves its prognostic efficacy. Materials and Methods: 80 consecutive patients diagnosed with stage III-IV OPSCC between February 2009 and October 2015, known human papillomavirus status, and pre-treatment CT images were retrospectively identified. Manual segmentation of primary tumor and metastatic lymphadenopathy was performed and the extracted texture features were used to develop multivariate assessment models to prognosticate treatment response. Results: Texture analysis of either the primary or metastatic lymphadenopathy from pre-treatment enhanced CT images can be used to develop models for the stratification of treatment outcomes in OPSCC patients. AUCs range from .78 to .85 for the various OPSCC groups tested, indicating high predictive capability of the models. Conclusions: This preliminary study can form the basis multi-centre trial that may help optimize treatment and improve quality of life in patients with OPSCC in the era of personalized medicine.

Recurrence prediction with local binary pattern-based dosiomics in patients with head and neck squamous cell carcinoma

We investigated an approach for predicting recurrence after radiation therapy using local binary pattern (LBP)-based dosiomics in patients with head and neck squamous cell carcinoma (HNSCC). Recurrence/non-recurrence data were collected from 131 patients after intensity-modulated radiation therapy. The cases were divided into training (80%) and test (20%) datasets. A total of 327 dosiomics features, including cold spot volume, first-order features, and texture features, were extracted from the original dose distribution (ODD) and LBP on gross tumor volume, clinical target volume, and planning target volume. The CoxNet algorithm was employed in the training dataset for feature selection and dosiomics signature construction. Based on a dosiomics score (DS)-based Cox proportional hazard model, two recurrence prediction models (DS_ODD and DS_LBP) were constructed using the ODD and LBP dosiomics features. These models were used to evaluate the overall adequacy of the recurrence prediction using the concordance index (CI), and the prediction performance was assessed based on the accuracy and area under the receiver operating characteristic curve (AUC). The CIs for the test dataset were 0.71 and 0.76 for DS_ODD and DS_LBP, respectively. The accuracy and AUC for the test dataset were 0.71 and 0.76 for the DS_ODD model and 0.79 and 0.81 for the DS_LBP model, respectively. LBP-based dosiomics models may be more accurate in predicting recurrence after radiation therapy in patients with HNSCC.

Prognostic radiomic signature for head and neck cancer: development and validation on a multi-centric MRI dataset

BACKGROUND AND PURPOSE

Prognosis in locally advanced head and neck cancer (HNC) is currently based on TNM staging system and tumor subsite. However, quantitative imaging features (i.e., radiomic features) from magnetic resonance imaging (MRI) may provide additional prognostic info. The aim of this work is to develop and validate an MRI-based prognostic radiomic signature for locally advanced HNC.

MATERIALS AND METHODS

Radiomic features were extracted from T1- and T2-weighted MRI (T1w and T2w) using the segmentation of the primary tumor as mask. In total 1072 features (536 per image type) were extracted for each tumor. A retrospective multi-centric dataset (n=285) was used for features selection and model training. The selected features were used to fit a Cox proportional hazard regression model for overall survival (OS) that outputs the radiomic signature. The signature was then validated on a prospective multi-centric dataset (n=234). Prognostic performance for OS and disease-free survival (DFS) was evaluated using C-index. Additional prognostic value of the radiomic signature was explored.

RESULTS

The radiomic signature had C-index=0.64 for OS and C-index=0.60 for DFS in the validation set. The addition of the radiomic signature to other clinical features (TNM staging and tumor subsite) increased prognostic ability for both OS (HPV- C-index 0.63 to 0.65; HPV+ C-index 0.75 to 0.80) and DFS (HPV- C-index 0.58 to 0.61; HPV+ C-index 0.64 to 0.65).

CONCLUSION

An MRI-based prognostic radiomic signature was developed and prospectively validated. Such signature can successfully integrate clinical factors in both HPV+ and HPV- tumors. Grant support: European Union Horizon 2020 Framework Programme, Grant/Award, Number: 689715.

Gross tumour volume radiomics for prognostication of recurrence & death following radical radiotherapy for NSCLC

Recurrence occurs in up to 36% of patients treated with curative-intent radiotherapy for NSCLC. Identifying patients at higher risk of recurrence for more intensive surveillance may facilitate the earlier introduction of the next line of treatment. We aimed to use radiotherapy planning CT scans to develop radiomic classification models that predict overall survival (OS), recurrence-free survival (RFS) and recurrence two years post-treatment for risk-stratification. A retrospective multi-centre study of >900 patients receiving curative-intent radiotherapy for stage I-III NSCLC was undertaken. Models using radiomic and/or clinical features were developed, compared with 10-fold cross-validation and an external test set, and benchmarked against TNM-stage. Respective validation and test set AUCs (with 95% confidence intervals) for the radiomic-only models were: (1) OS: 0.712 (0.592–0.832) and 0.685 (0.585–0.784), (2) RFS: 0.825 (0.733–0.916) and 0.750 (0.665–0.835), (3) Recurrence: 0.678 (0.554–0.801) and 0.673 (0.577–0.77). For the combined models: (1) OS: 0.702 (0.583–0.822) and 0.683 (0.586–0.78), (2) RFS: 0.805 (0.707–0.903) and 0·755 (0.672–0.838), (3) Recurrence: 0·637 (0.51–0.·765) and 0·738 (0.649–0.826). Kaplan-Meier analyses demonstrate OS and RFS difference of >300 and >400 days respectively between low and high-risk groups. We have developed validated and externally tested radiomic-based prediction models. Such models could be integrated into the routine radiotherapy workflow, thus informing a personalised surveillance strategy at the point of treatment. Our work lays the foundations for future prospective clinical trials for quantitative personalised risk-stratification for surveillance following curative-intent radiotherapy for NSCLC.

Inferring FDG-PET-positivity of lymph node metastases in proven lung cancer from contrast-enhanced CT using radiomics and machine learning

Background

We evaluated the role of radiomics applied to contrast-enhanced computed tomography (CT) in the detection of lymph node (LN) metastases in patients with known lung cancer compared to ¹⁸F-fluorodeoxyglucose positron emission tomography (PET)/CT as a reference.

Methods

This retrospective analysis included 381 patients with 1,799 lymph nodes (450 malignant, 1,349 negative). The data set was divided into a training and validation set. A radiomics analysis with 4 filters and 6 algorithms resulting in 24 different radiomics signatures and a bootstrap algorithm (Bagging) with 30 bootstrap iterations was performed. A decision curve analysis was applied to generate a net benefit to compare the radiomics signature to two expert radiologists as one-by-one and as a prescreening tool in combination with the respective radiologist and only the radiologists.

Results

All 24 modeling methods showed good and reliable discrimination for malignant/benign LNs (area under the curve 0.75−0.87). The decision curve analysis showed a net benefit for the least absolute shrinkage and selection operator (LASSO) classifier for the entire probability range and outperformed the expert radiologists except for the high probability range. Using the radiomics signature as a prescreening tool for the radiologists did not improve net benefit.

Conclusions

Radiomics showed good discrimination power irrespective of the modeling technique in detecting LN metastases in patients with known lung cancer. The LASSO classifier was a suitable diagnostic tool and even outperformed the expert radiologists, except for high probabilities. Radiomics failed to improve clinical benefit as a prescreening tool.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41747-022-00296-8.

Improving workflow for adaptive proton therapy with predictive anatomical modelling: A proof of concept

PURPOSE

To demonstrate predictive anatomical modelling for improving the clinical workflow of adaptive intensity-modulated proton therapy (IMPT) for head and neck cancer.

METHODS

10 radiotherapy patients with nasopharyngeal cancer were included in this retrospective study. Each patient had a planning CT, weekly verification CTs during radiotherapy and predicted weekly CTs from our anatomical model. Predicted CTs were used to create predicted adaptive plans in advance with the aim of maintaining clinically acceptable dosimetry. Adaption was triggered when the increase in mean dose (Dmean) to the parotid glands exceeded 3 Gy(RBE). We compared the accumulated dose of two adaptive IMPT strategies: 1) Predicted plan adaption: One adaptive plan per patient was optimised on a predicted CT triggered by replan criteria. 2) Standard replan: One adaptive plan was created reactively in response to the triggering weekly CT.

RESULTS

Statistical analysis demonstrates that the accumulated dose differences between two adaptive strategies are not significant (p > 0.05) for CTVs and OARs. We observed no meaningful differences in D95 between the accumulated dose and the planned dose for the CTVs, with mean differences to the high-risk CTV of -1.20 %, -1.23 % and -1.25 % for no adaption, standard and predicted plan adaption, respectively. The accumulated parotid Dmean using predicted plan adaption is within 3 Gy(RBE) of the planned dose and 0.31 Gy(RBE) lower than the standard replan approach on average.

CONCLUSION

Prediction-based replanning could potentially enable adaptive therapy to be delivered without treatment gaps or sub-optimal fractions, as can occur during a standard replanning strategy, though the benefit of using predicted plan adaption over the standard replan was not shown to be statistically significant with respect to accumulated dose in this study. Nonetheless, a predictive replan approach can offer advantages in improving clinical workflow efficiency.

Locoregional recurrence prediction in head and neck cancer based on multi-modality and multi-view feature expansion

Objective. Locoregional recurrence (LRR) is one of the leading causes of treatment failure in head and neck (H&N) cancer. Accurately predicting LRR after radiotherapy is essential to achieving better treatment outcomes for patients with H&N cancer through developing personalized treatment strategies. We aim to develop an end-to-end multi-modality and multi-view feature extension method (MMFE) to predict LRR in H&N cancer. Approach. Deep learning (DL) has been widely used for building prediction models and has achieved great success. Nevertheless, 2D-based DL models inherently fail to utilize the contextual information from adjacent slices, while complicated 3D models have a substantially larger number of parameters, which require more training samples, memory and computing resources. In the proposed MMFE scheme, through the multi-view feature expansion and projection dimension reduction operations, we are able to reduce the model complexity while preserving volumetric information. Additionally, we designed a multi-modality convolutional neural network that can be trained in an end-to-end manner and can jointly optimize the use of deep features of CT, PET and clinical data to improve the model’s prediction ability. Main results. The dataset included 206 eligible patients, of which, 49 had LRR while 157 did not. The proposed MMFE method obtained a higher AUC value than the other four methods. The best prediction result was achieved when using all three modalities, which yielded an AUC value of 0.81. Significance. Comparison experiments demonstrated the superior performance of the MMFE as compared to other 2D/3D-DL-based methods. By combining CT, PET and clinical features, the MMFE could potentially identify H&N cancer patients at high risk for LRR such that personalized treatment strategy can be developed accordingly.

DIR-based models to predict weekly anatomical changes in head and neck cancer proton therapy

Objective. We proposed two anatomical models for head and neck patients to predict anatomical changes during the course of radiotherapy.Approach. Deformable image registration was used to build two anatomical models: (1) the average model (AM) simulated systematic progressive changes across the patient cohort; (2) the refined individual model (RIM) used a patient's CT images acquired during treatment to update the prediction for each individual patient. Planning CTs and weekly CTs were used from 20 nasopharynx patients. This dataset included 15 training patients and 5 test patients. For each test patient, a spot scanning proton plan was created. Models were evaluated using CT number differences, contours, proton spot location deviations and dose distributions.Main results. If no model was used, the CT number difference between the planning CT and the repeat CT at week 6 of treatment was on average 128.9 Hounsfield Units (HU) over the test population. This can be reduced to 115.5 HU using the AM, and to 110.5 HU using the RIM3(RIM, updated at week (3). When the predicted contours from the models were used, the average mean surface distance of parotid glands can be reduced from 1.98 (no model) to 1.16 mm (AM) and 1.19 mm (RIM3) at week 6. Using the proton spot range, the average anatomical uncertainty over the test population reduced from 4.47 ± 1.23 (no model) to 2.41 ± 1.12 mm (AM), and 1.89 ± 0.96 mm (RIM3). Based on the gamma analysis, the average gamma index over the test patients was improved from 93.87 ± 2.48 % (no model) to 96.16 ± 1.84% (RIM3) at week 6.Significance. The AM and the RIM both demonstrated the ability to predict anatomical changes during the treatment. The RIM can gradually refine the prediction of anatomical changes based on the AM. The proton beam spots provided an accurate and effective way for uncertainty evaluation.

Radiomics and machine learning for the diagnosis of pediatric cervical non-tuberculous mycobacterial lymphadenitis

Non-tuberculous mycobacterial (NTM) infection is an emerging infectious entity that often presents as lymphadenitis in the pediatric age group. Current practice involves invasive testing and excisional biopsy to diagnose NTM lymphadenitis. In this study, we performed a retrospective analysis of 249 lymph nodes selected from 143 CT scans of pediatric patients presenting with lymphadenopathy at the Montreal Children’s Hospital between 2005 and 2018. A Random Forest classifier was trained on the ten most discriminative features from a set of 1231 radiomic features. The model classifying nodes as pyogenic, NTM, reactive, or proliferative lymphadenopathy achieved an accuracy of 72%, a precision of 68%, and a recall of 70%. Between NTM and all other causes of lymphadenopathy, the model achieved an area under the curve (AUC) of 89%. Between NTM and pyogenic lymphadenitis, the model achieved an AUC of 90%. Between NTM and the reactive and proliferative lymphadenopathy groups, the model achieved an AUC of 93%. These results indicate that radiomics can achieve a high accuracy for classification of NTM lymphadenitis. Such a non-invasive highly accurate diagnostic approach has the potential to reduce the need for invasive procedures in the pediatric population.

Secondary primary malignancy in patients with head and neck squamous cell carcinoma: 27-year experience from the perspective of diagnostic tools

Background

The survival rate of head and neck squamous cell carcinoma (HNSCC) patients with secondary primary malignancy (SPM) showed no significant improvement for decades, however, the impact of advances in diagnostic tools is rarely mentioned. This study investigated the clinical characteristic of HNSCC with SPM over a 27-year period especially from the perspective of diagnostic tools.

Methods

This study evaluated 157 HNSCC patients with SPM. The patients were divided into two groups according to the time of SPM diagnosis (Group A:1992–2003; Group B: 2004–2014). Age, gender, stage of first primary malignancy (FPM), SPM interval, overall survival, and disease-free survival were compared between groups.

Results

Group B had significantly more SPM developed rate (p = 0.002), more SPM patients with advanced stage of FPM (p = 0.001), synchronous SPM (p = 0.006), and shorter SPM interval (p<0.001) compared to Group A. The survival rate in Group B was not significantly better than Group A.

Conclusion

Among patients diagnosed with HNSCC recently, more SPMs are diagnosed in a shorter time interval and in a more advanced stage. The overall advances in diagnostic tools cannot significantly improve SPM survival, however, it enables more patients to receive corresponding treatment.

Predictive Value of a Combined Model Based on Pre-Treatment and Mid-Treatment MRI-Radiomics for Disease Progression or Death in Locally Advanced Nasopharyngeal Carcinoma

Purpose

A combined model was established based on the MRI-radiomics of pre- and mid-treatment to assess the risk of disease progression or death in locally advanced nasopharyngeal carcinoma.

Materials and Methods

A total of 243 patients were analyzed. We extracted 10,400 radiomics features from the primary nasopharyngeal tumors and largest metastatic lymph nodes on the axial contrast-enhanced T1 weighted and T2 weighted in pre- and mid-treatment MRI, respectively. We used the SMOTE algorithm, center and scale and box-cox, Pearson correlation coefficient, and LASSO regression to construct the pre- and mid-treatment MRI-radiomics prediction model, respectively, and the risk scores named P score and M score were calculated. Finally, univariate and multivariate analyses were used for P score, M score, and clinical data to build the combined model and grouped the patients into two risk levels, namely, high and low.

Result

A combined model of pre- and mid-treatment MRI-radiomics successfully categorized patients into high- and low-risk groups. The log-rank test showed that the high- and low-risk groups had good prognostic performance in PFS (P<0.0001, HR: 19.71, 95% CI: 12.77–30.41), which was better than TNM stage (P=0.004, HR:1.913, 95% CI:1.250–2.926), and also had an excellent predictive effect in LRFS, DMFS, and OS.

Conclusion

Risk grouping of LA-NPC using a combined model of pre- and mid-treatment MRI-radiomics can better predict disease progression or death.

Exploratory ensemble interpretable model for predicting local failure in head and neck cancer: the additive benefit of CT and intra-treatment cone-beam computed tomography features

BACKGROUND

Local failure (LF) following chemoradiation (CRT) for head and neck cancer is associated with poor overall survival. If machine learning techniques could stratify patients at risk of treatment failure based on baseline and intra-treatment imaging, such a model could facilitate response-adapted approaches to escalate, de-escalate, or switch therapy.

METHODS

A 1:2 retrospective case control cohort of patients treated at a single institution with definitive radiotherapy for head and neck cancer who failed locally, in-field at a primary or nodal structure were included. Radiomic features were extracted from baseline CT and CBCT scans at fractions 1 and 21 (delta) of radiotherapy with PyRadiomics and were selected for by: reproducibility (intra-class correlation coefficients ≥0.95), redundancy [maximum relevance and minimum redundancy (mRMR)], and informativeness [recursive feature elimination (RFE)]. Separate models predicting LF of primaries or nodes were created using the explainable boosting machine (EBM) classifier with 5-fold cross-validation for (I) clinical only, (II) radiomic only (CT1 and delta features), and (III) fused models (clinical + radiomic). Twenty-five iterations were performed, and predicted scores were averaged with a parallel ensemble design. Receiver operating characteristic curves were compared between models with paired-samples t-tests.

RESULTS

The fused ensemble model for primaries (using clinical, CT1, and delta features) achieved an AUC of 0.871 with a sensitivity of 78.3% and specificity of 90.9% at the maximum Youden J statistic. The fused ensemble model trended towards improvement when compared to the clinical only ensemble model (AUC =0.788, P=0.134) but reached significance when compared to the radiomic ensemble model (AUC =0.770, P=0.017). The fused ensemble model for nodes achieved an AUC of 0.910 with a sensitivity of 100.0% and specificity of 68.0%, which also trended towards improvement when compared to the clinical model (AUC =0.865, P=0.080).

CONCLUSIONS

The fused ensemble EBM model achieved high discriminatory ability at predicting LF for head and neck cancer in independent primary and nodal structures. Although an additive benefit of delta radiomics over clinical factors could not be proven, the results trended towards improvement with the fused ensemble model, which are promising and worthy of prospective investigation in a larger cohort.

Radiomics Predicts for Distant Metastasis in Locally Advanced Human Papillomavirus-Positive Oropharyngeal Squamous Cell Carcinoma

Simple Summary

There is strong evidence that locally advanced human papillomavirus positive (HPV+) oropharyngeal squamous cell carcinoma (OPSCC) carries a significantly better prognosis than HPV negative OPSCC, suggesting the possibility of treatment de-escalation and, therefore, toxicity reduction in this patient population. The lack of success in clinical trials towards this end presses the need to risk stratify locally advanced HPV+ OPSCC patients who can safely have treatment de-escalated. The present study had recourse to radiomics for this purpose and showed that radiomics has the ability to discriminate patients with locally advanced HPV+ OPSCC who went on to develop distant metastasis after completion of definitive chemoradiation or radiation alone. The implications of this study aid in demonstrating the potential pivotal role of radiomics in predictive risk assessment and personalizing therapy for this patient population.

Abstract

(1) Background and purpose: clinical trials have unsuccessfully tried to de-escalate treatment in locally advanced human papillomavirus positive (HPV+) oropharyngeal squamous cell carcinoma (OPSCC) with the goal of reducing treatment toxicity. The aim of this study was to explore the role of radiomics for risk stratification in this patient population to guide treatment. (2) Methods: the study population consisted of 225 patients with locally advanced HPV+ OPSCC treated with curative-intent radiation or chemoradiation therapy. Appearance of distant metastasis was used as the endpoint event. Radiomics data were extracted from the gross tumor volumes (GTVs) identified on the planning CT, with gray level being discretized using three different bin widths (8, 16, and 32). The data extracted for the groups with and without distant metastasis were subsequently balanced using three different algorithms including synthetic minority over-sampling technique (SMOTE), adaptive synthetic sampling (ADASYN), and borderline SMOTE. From these different combinations, a total of nine radiomics datasets were derived. Top features that minimized redundancy while maximizing relevance to the endpoint were selected individually and collectively for the nine radiomics datasets to build support vector machine (SVM) based predictive classifiers. Performance of the developed classifiers was evaluated by receiver operating characteristic (ROC) curve analysis. (3) Results: of the 225 locally advanced HPV+ OPSCC patients being studied, 9.3% had developed distant metastases at last follow-up. SVM classifiers built for the nine radiomics dataset using either their own respective top features or the top consensus ones were all able to differentiate the two cohorts at a level of excellence or beyond, with ROC area under curve (AUC) ranging from 0.84 to 0.95 (median = 0.90). ROC comparisons further revealed that the majority of the built classifiers did not distinguish the two cohorts significantly better than each other. (4) Conclusions: radiomics demonstrated discriminative ability in distinguishing patients with locally advanced HPV+ OPSCC who went on to develop distant metastasis after completion of definitive chemoradiation or radiation alone and may serve to risk stratify this patient population with the purpose of guiding the appropriate therapy.

Prediction of treatment outcome using MRI radiomics and machine learning in oropharyngeal cancer patients after surgical treatment

OBJECTIVES

In this study, we aimed to analyze preoperative MRI images of oropharyngeal cancer patients who underwent surgical treatment, extracted radiomics features, and constructed a disease recurrence and death prediction model using radiomics features and machine-learning techniques.

MATERIALS AND METHODS

A total of 157 patients participated in this study, and 107 stable radiomics features were selected and used for constructing a predictive model.

RESULTS

The performance of the combined model (clinical and radiomics) yielded the following results: AUC of 0.786, accuracy of 0.854, precision of 0.429, recall of 0.500, and f1 score of 0.462. The combined model showed better performance than either the clinical and radiomics only models for predicting disease recurrence. For predicting death, the combined model performance has an AUC of 0.841, accuracy of 0.771, precision of 0.308, recall of 0.667, and f1 score of 0.421. The combined model showed superior performance over the predictive model using only clinical variables. A Cox proportional hazard model using the combined variables for predicting patient death yielded a c-index value that was significantly better than that of the model including only clinical variables.

CONCLUSIONS

A predictive model using clinical variables and MRI radiomics features showed excellent performance in predicting disease recurrence and death in oropharyngeal cancer patients. In the future, a multicenter study is necessary to verify the model's performance and confirm its clinical usefulness.

Radiomics and radiogenomics in head and neck squamous cell carcinoma: Potential contribution to patient management and challenges

The application of imaging biomarkers in oncology is still in its infancy, but with the expansion of radiomics and radiogenomics a revolution is expected in this field. This may be of special interest in head and neck cancer, since it can promote precision medicine and personalization of treatment by overcoming several intrinsic obstacles in this pathology. Our goal is to provide the medical oncologist with the basis to approach these disciplines and appreciate their main uses in clinical research and clinical practice in the medium term. Aligned with this objective we analyzed the most relevant studies in the field, also highlighting novel opportunities and current challenges.

Diagnostic Utility of Radiomics in Thyroid and Head and Neck Cancers

Radiomics is an emerging field in radiology that utilizes advanced statistical data characterizing algorithms to evaluate medical imaging and objectively quantify characteristics of a given disease. Due to morphologic heterogeneity and genetic variation intrinsic to neoplasms, radiomics have the potential to provide a unique insight into the underlying tumor and tumor microenvironment. Radiomics has been gaining popularity due to potential applications in disease quantification, predictive modeling, treatment planning, and response assessment - paving way for the advancement of personalized medicine. However, producing a reliable radiomic model requires careful evaluation and construction to be translated into clinical practices that have varying software and/or medical equipment. We aim to review the diagnostic utility of radiomics in otorhinolaryngology, including both cancers of the head and neck as well as the thyroid.

A Prospectively Validated Prognostic Model for Patients with Locally Advanced Squamous Cell Carcinoma of the Head and Neck Based on Radiomics of Computed Tomography Images

BACKGROUND

Locoregionally advanced head and neck squamous cell carcinoma (HNSCC) patients have high relapse and mortality rates. Imaging-based decision support may improve outcomes by optimising personalised treatment, and support patient risk stratification. We propose a multifactorial prognostic model including radiomics features to improve risk stratification for advanced HNSCC, compared to TNM eighth edition, the gold standard.

PATIENT AND METHODS

Data of 666 retrospective- and 143 prospective-stage III-IVA/B HNSCC patients were collected. A multivariable Cox proportional-hazards model was trained to predict overall survival (OS) using diagnostic CT-based radiomics features extracted from the primary tumour. Separate analyses were performed using TNM8, tumour volume, clinical and biological variables, and combinations thereof with radiomics features. Patient risk stratification in three groups was assessed through Kaplan-Meier (KM) curves. A log-rank test was performed for significance (p-value < 0.05). The prognostic accuracy was reported through the concordance index (CI).

RESULTS

A model combining an 11-feature radiomics signature, clinical and biological variables, TNM8, and volume could significantly stratify the validation cohort into three risk groups (p < 0∙01, CI of 0.79 as validation).

CONCLUSION

A combination of radiomics features with other predictors can predict OS very accurately for advanced HNSCC patients and improves on the current gold standard of TNM8.

Intrinsic radiomic expression patterns after 20 Gy demonstrate early metabolic response of oropharyngeal cancers

PURPOSE

This study investigated the prognostic potential of intra-treatment PET radiomics data in patients undergoing definitive (chemo) radiation therapy for oropharyngeal cancer (OPC) on a prospective clinical trial. We hypothesized that the radiomic expression of OPC tumors after 20 Gy is associated with recurrence-free survival (RFS).

MATERIALS AND METHODS

Sixty-four patients undergoing definitive (chemo)radiation for OPC were prospectively enrolled on an IRB-approved study. Investigational ¹⁸ F-FDG-PET/CT images were acquired prior to treatment and 2 weeks (20 Gy) into a seven-week course of therapy. Fifty-five quantitative radiomic features were extracted from the primary tumor as potential biomarkers of early metabolic response. An unsupervised data clustering algorithm was used to partition patients into clusters based only on their radiomic expression. Clustering results were naïvely compared to residual disease and/or subsequent recurrence and used to derive Kaplan-Meier estimators of RFS. To test whether radiomic expression provides prognostic value beyond conventional clinical features associated with head and neck cancer, multivariable Cox proportional hazards modeling was used to adjust radiomic clusters for T and N stage, HPV status, and change in tumor volume.

RESULTS

While pre-treatment radiomics were not prognostic, intra-treatment radiomic expression was intrinsically associated with both residual/recurrent disease (P = 0.0256, χ 2 test) and RFS (HR = 7.53, 95% CI = 2.54-22.3; P = 0.0201). On univariate Cox analysis, radiomic cluster was associated with RFS (unadjusted HR = 2.70; 95% CI = 1.26-5.76; P = 0.0104) and maintained significance after adjustment for T, N staging, HPV status, and change in tumor volume after 20 Gy (adjusted HR = 2.69; 95% CI = 1.03-7.04; P = 0.0442). The particular radiomic characteristics associated with outcomes suggest that metabolic spatial heterogeneity after 20 Gy portends complete and durable therapeutic response. This finding is independent of baseline metabolic imaging characteristics and clinical features of head and neck cancer, thus providing prognostic advantages over existing approaches.

CONCLUSIONS

Our data illustrate the prognostic value of intra-treatment metabolic image interrogation, which may potentially guide adaptive therapy strategies for OPC patients and serve as a blueprint for other disease sites. The quality of our study was strengthened by its prospective image acquisition protocol, homogenous patient cohort, relatively long patient follow-up times, and unsupervised clustering formalism that is less prone to hyper-parameter tuning and over-fitting compared to supervised learning.

Targeting Treatment Resistance in Head and Neck Squamous Cell Carcinoma - Proof of Concept for CT Radiomics-Based Identification of Resistant Sub-Volumes

Purpose

Radiomics has already been proposed as a prognostic biomarker in head and neck cancer (HNSCC). However, its predictive power in radiotherapy has not yet been studied. Here, we investigated a local radiomics approach to distinguish between tumor sub-volumes with different levels of radiosensitivity as a possible target for radiation dose intensification.

Materials and Methods

Of 40 patients (n=28 training and n=12 validation) with biopsy confirmed locally recurrent HNSCC, pretreatment contrast-enhanced CT images were registered with follow-up PET/CT imaging allowing identification of controlled (GTVcontrol) vs non-controlled (GTVrec) tumor sub-volumes on pretreatment imaging. A bi-regional model was built using radiomic features extracted from pretreatment CT in the GTVrec and GTVcontrol to differentiate between those regions. Additionally, concept of local radiomics was implemented to perform detection task. The original tumor volume was divided into sub-volumes with no prior information on the location of recurrence. Radiomic features from those sub-volumes were then used to detect recurrent sub-volumes using multivariable logistic regression.

Results

Radiomic features extracted from non-controlled regions differed significantly from those in controlled regions (training AUC = 0.79 CI 95% 0.66 - 0.91 and validation AUC = 0.88 CI 95% 0.72 – 1.00). Local radiomics analysis allowed efficient detection of non-controlled sub-volumes both in the training AUC = 0.66 (CI 95% 0.56 – 0.75) and validation cohort 0.70 (CI 95% 0.53 – 0.86), however performance of this model was inferior to bi-regional model. Both models indicated that sub-volumes characterized by higher heterogeneity were linked to tumor recurrence.

Conclusion

Local radiomics is able to detect sub-volumes with decreased radiosensitivity, associated with location of tumor recurrence in HNSCC in the pre-treatment CT imaging. This proof of concept study, indicates that local CT radiomics can be used as predictive biomarker in radiotherapy and potential target for dose intensification.

Assessment of clinical radiosensitivity in patients with head-neck squamous cell carcinoma from pre-treatment quantitative ultrasound radiomics

To investigate the role of quantitative ultrasound (QUS) radiomics to predict treatment response in patients with head and neck squamous cell carcinoma (HNSCC) treated with radical radiotherapy (RT). Five spectral parameters, 20 texture, and 80 texture-derivative features were extracted from the index lymph node before treatment. Response was assessed initially at 3 months with complete responders labelled as early responders (ER). Patients with residual disease were followed to classify them as either late responders (LR) or patients with persistent/progressive disease (PD). Machine learning classifiers with leave-one-out cross-validation was used for the development of a binary response-prediction radiomics model. A total of 59 patients were included in the study (22 ER, 29 LR, and 8 PD). A support vector machine (SVM) classifier led to the best performance with accuracy and area under curve (AUC) of 92% and 0.91, responsively to define the response at 3 months (ER vs. LR/PD). The 2-year recurrence-free survival for predicted-ER, LR, PD using an SVM-model was 91%, 78%, and 27%, respectively (p < 0.01). Pretreatment QUS-radiomics using texture derivatives in HNSCC can predict the response to RT with an accuracy of more than 90% with a strong influence on the survival.

Clinical trial registration: clinicaltrials.gov.in identifier NCT03908684.

Deep Learning in Head and Neck Tumor Multiomics Diagnosis and Analysis: Review of the Literature

Head and neck tumors are the sixth most common neoplasms. Multiomics integrates multiple dimensions of clinical, pathologic, radiological, and biological data and has the potential for tumor diagnosis and analysis. Deep learning (DL), a type of artificial intelligence (AI), is applied in medical image analysis. Among the DL techniques, the convolution neural network (CNN) is used for image segmentation, detection, and classification and in computer-aided diagnosis. Here, we reviewed multiomics image analysis of head and neck tumors using CNN and other DL neural networks. We also evaluated its application in early tumor detection, classification, prognosis/metastasis prediction, and the signing out of the reports. Finally, we highlighted the challenges and potential of these techniques.

Prediction of post-radiotherapy locoregional progression in HPV-associated oropharyngeal squamous cell carcinoma using machine-learning analysis of baseline PET/CT radiomics

•

Radiomics quantitatively captures visually inappreciable imaging features.

•

PET/CT radiomics provides wholistic metabolic and structural tumor characterization.

•

Machine-learning algorithms can generate radiomics-based biomarkers for OPSCC.

•

PET/CT radiomics can predict post-radiotherapy locoregional progression in HPV-associated OPSCC.

•

Such biomarkers may improve patient selection for treatment de-intensification trials.

Locoregional failure remains a therapeutic challenge in oropharyngeal squamous cell carcinoma (OPSCC). We aimed to devise novel objective imaging biomarkers for prediction of locoregional progression in HPV-associated OPSCC. Following manual lesion delineation, 1037 PET and 1037 CT radiomic features were extracted from each primary tumor and metastatic cervical lymph node on baseline PET/CT scans. Applying random forest machine-learning algorithms, we generated radiomic models for censoring-aware locoregional progression prognostication (evaluated by Harrell's C-index) and risk stratification (evaluated in Kaplan-Meier analysis). A total of 190 patients were included; an optimized model yielded a median (interquartile range) C-index of 0.76 (0.66-0.81; p = 0.01) in prognostication of locoregional progression, using combined PET/CT radiomic features from primary tumors. Radiomics-based risk stratification reliably identified patients at risk for locoregional progression within 2-, 3-, 4-, and 5-year follow-up intervals, with log-rank p-values of p = 0.003, p = 0.001, p = 0.02, p = 0.006 in Kaplan-Meier analysis, respectively. Our results suggest PET/CT radiomic biomarkers can predict post-radiotherapy locoregional progression in HPV-associated OPSCC. Pending validation in large, independent cohorts, such objective biomarkers may improve patient selection for treatment de-intensification trials in this prognostically favorable OPSCC entity, and eventually facilitate personalized therapy.

Baseline MRI-Radiomics Can Predict Overall Survival in Non-Endemic EBV-Related Nasopharyngeal Carcinoma Patients

Advanced stage nasopharyngeal cancer (NPC) shows highly variable treatment outcomes, suggesting the need for independent prognostic factors. This study aims at developing a magnetic resonance imaging (MRI)-based radiomic signature as a prognostic marker for different clinical endpoints in NPC patients from non-endemic areas. A total 136 patients with advanced NPC and available MRI imaging (T1-weighted and T2-weighted) were selected. For each patient, 2144 radiomic features were extracted from the main tumor and largest lymph node. A multivariate Cox regression model was trained on a subset of features to obtain a radiomic signature for overall survival (OS), which was also applied for the prognosis of other clinical endpoints. Validation was performed using 10-fold cross-validation. The added prognostic value of the radiomic features to clinical features and volume was also evaluated. The radiomics-based signature had good prognostic power for OS and loco-regional recurrence-free survival (LRFS), with C-index of 0.68 and 0.72, respectively. In all the cases, the addition of radiomics to clinical features improved the prognostic performance. Radiomic features can provide independent prognostic information in NPC patients from non-endemic areas.

Applicability of radiomics in interstitial lung disease associated with systemic sclerosis: proof of concept

Objective

To retrospectively evaluate if texture-based radiomics features are able to detect interstitial lung disease (ILD) and to distinguish between the different disease stages in patients with systemic sclerosis (SSc) in comparison with mere visual analysis of high-resolution computed tomography (HRCT).

Methods

Sixty patients (46 females, median age 56 years) with SSc who underwent HRCT of the thorax were retrospectively analyzed. Visual analysis was performed by two radiologists for the presence of ILD features. Gender, age, and pulmonary function (GAP) stage was calculated from clinical data (gender, age, pulmonary function test). Data augmentation was performed and the balanced dataset was split into a training (70%) and a testing dataset (30%). For selecting variables that allow classification of the GAP stage, single and multiple logistic regression models were fitted and compared by using the Akaike information criterion (AIC). Diagnostic accuracy was evaluated from the area under the curve (AUC) from receiver operating characteristic (ROC) analyses, and diagnostic sensitivity and specificity were calculated.

Results

Values for some radiomics features were significantly lower (p < 0.05) and those of other radiomics features were significantly higher (p = 0.001) in patients with GAP2 compared with those in patients with GAP1. The combination of two specific radiomics features in a multivariable model resulted in the lowest AIC of 10.73 with an AUC of 0.96, 84% sensitivity, and 99% specificity. Visual assessment of fibrosis was inferior in predicting individual GAP stages (AUC 0.86; 83% sensitivity; 74% specificity).

Conclusion

The correlation of radiomics with GAP stage, but not with the visually defined features of ILD-HRCT, implies that radiomics might capture features indicating severity of SSc-ILD on HRCT, which are not recognized by visual analysis.

Key Points

• Radiomics features can predict GAP stage with a sensitivity of 84% and a specificity of almost 100%.

• Extent of fibrosis on HRCT and a combined model of different visual HRCT-ILD features perform worse in predicting GAP stage.

• The correlation of radiomics with GAP stage, but not with the visually defined features of ILD-HRCT, implies that radiomics might capture features on HRCT, which are not recognized by visual analysis.

Electronic supplementary material

The online version of this article (10.1007/s00330-020-07293-8) contains supplementary material, which is available to authorized users.

Diagnostic advances of artificial intelligence and radiomics in gastroenterology

Traditional medical imaging, including ultrasound, computed tomography, magnetic resonance imaging, or positron emission tomography, remains widely used diagnostic modalities for gastrointestinal diseases at present. These modalities are used to assess changes in morphology, attenuation, signal intensity, and enhancement characteristics. Gastrointestinal tumors, especially malignant tumors, are commonly seen in clinical practice with an increasing number of deaths each year. Because the imaging manifestations of different diseases usually overlap, accurate early diagnosis of tumor lesions, noninvasive and effective evaluation of tumor staging, and prediction of prognosis remain challenging. Fortunately, traditional medical images contain a great deal of important information that cannot be recognized by human eyes but can be extracted by artificial intelligence (AI) technology, which can quantitatively assess the heterogeneity of lesions and provide valuable information, including therapeutic effects and patient prognosis. With the development of computer technology, the combination of medical imaging and AI technology is considered to represent a promising field in medical image analysis. This new emerging field is called “radiomics”, which makes big data mining and extraction from medical imagery possible and can help clinicians make effective decisions and develop personalized treatment plans. Recently, AI and radiomics have been gradually applied to lesion detection, qualitative and quantitative diagnosis, histopathological grading and staging of tumors, therapeutic efficacy assessment, and prognosis evaluation. In this minireview, we briefly introduce the basic principles and technology of radiomics. Then, we review the research and application of AI and radiomics in gastrointestinal diseases, especially diagnostic advancements of radiomics in the differential diagnosis, treatment option, assessment of therapeutic efficacy, and prognosis evaluation of esophageal, gastric, hepatic, pancreatic, and colorectal diseases.

Comparison of patient stratification by computed tomography radiomics and hypoxia positron emission tomography in head-and-neck cancer radiotherapy

BACKGROUND AND PURPOSE

Hypoxia Positron-Emission-Tomography (PET) as well as Computed Tomography (CT) radiomics have been shown to be prognostic for radiotherapy outcome. Here, we investigate the stratification potential of CT-radiomics in head and neck cancer (HNC) patients and test if CT-radiomics is a surrogate predictor for hypoxia as identified by PET.

MATERIALS AND METHODS

Two independent cohorts of HNC patients were used for model development and validation, HN1 (n = 149) and HN2 (n = 47). The training set HN1 consisted of native planning CT data whereas for the validation cohort HN2 also hypoxia PET/CT data was acquired using [18F]-Fluoromisonidazole (FMISO). Machine learning algorithms including feature engineering and classifier selection were trained for two-year loco-regional control (LRC) to create optimal CT-radiomics signatures.Secondly, a pre-defined [18F]FMISO-PET tumour-to-muscle-ratio (TMRpeak ≥ 1.6) was used for LRC prediction. Comparison between risk groups identified by CT-radiomics or [18F]FMISO-PET was performed using area-under-the-curve (AUC) and Kaplan-Meier analysis including log-rank test.

RESULTS

The best performing CT-radiomics signature included two features with nearest-neighbour classification (AUC = 0.76 ± 0.09), whereas AUC was 0.59 for external validation. In contrast, [18F]FMISO TMRpeak reached an AUC of 0.66 in HN2. Kaplan-Meier analysis of the independent validation cohort HN2 did not confirm the prognostic value of CT-radiomics (p = 0.18), whereas for [18F]FMISO-PET significant differences were observed (p = 0.02).

CONCLUSIONS

No direct correlation of patient stratification using [18F]FMISO-PET or CT-radiomics was found in this study. Risk groups identified by CT-radiomics or hypoxia PET showed only poor overlap. Direct assessment of tumour hypoxia using PET seems to be more powerful to stratify HNC patients.

Radiomic biomarkers for head and neck squamous cell carcinoma

Tumor heterogeneity is a well-known prognostic factor in head and neck squamous cell carcinoma (HNSCC). A major limitation of tissue- and blood-derived tumor markers is the lack of spatial resolution to image tumor heterogeneity. Tissue markers derived from tumor biopsies usually represent only a small tumor subregion at a single timepoint and are therefore often not representative of the tumors' biology or the biological alterations during and after treatment. Similarly, liquid biopsies give an overall picture of the tumors' secreted factors but completely lack any spatial resolution. Radiomics has the potential to give complete three-dimensional information about the tumor. We conducted a comprehensive literature search to assess the correlation of radiomics to tumor biology and treatment outcome in HNSCC and to assess current limitations of the radiomic biomarkers. In total, 25 studies that explored the ability of radiomics to predict tumor biology and phenotype in HNSCC and 28 studies that explored radiomics to predict post-treatment events were identified. Out of these 53 studies, only three failed to show a significant correlation. The major technical challenges are currently artifacts due to metal implants, non-standardized contrast injection, and delineation uncertainties. All studies to date were retrospective and none of the above-mentioned radiomics signatures have been validated in an independent cohort using an independent software implementation, which shows that transferability due to the numerous technical challenges is currently a major limitation. However, radiomics is a very young field and these studies hopefully pave the way for clinical implementation of radiomics for HNSCC in the future.

Applications of radiomics in precision diagnosis, prognostication and treatment planning of head and neck squamous cell carcinomas

Recent advancements in computational power, machine learning, and artificial intelligence technology have enabled automated evaluation of medical images to generate quantitative diagnostic and prognostic biomarkers. Such objective biomarkers are readily available and have the potential to improve personalized treatment, precision medicine, and patient selection for clinical trials. In this article, we explore the merits of the most recent addition to the “-omics” concept for the broader field of head and neck cancer – “Radiomics”. This review discusses radiomics studies focused on (molecular) characterization, classification, prognostication and treatment guidance for head and neck squamous cell carcinomas (HNSCC). We review the underlying hypothesis, general concept and typical workflow of radiomic analysis, and elaborate on current and future challenges to be addressed before routine clinical application.