Deep learning pathological microscopic features in endemic nasopharyngeal cancer: Prognostic value and protentional role for individual induction chemotherapy

Artificial Intelligence in Head and Neck Surgery

This article explores artificial intelligence's (AI's) role in otolaryngology for head and neck cancer diagnosis and management. It highlights AI's potential in pattern recognition for early cancer detection, prognostication, and treatment planning, primarily through image analysis using clinical, endoscopic, and histopathologic images. Radiomics is also discussed at length, as well as the many ways that radiologic image analysis can be utilized, including for diagnosis, lymph node metastasis prediction, and evaluation of treatment response. The study highlights AI's promise and limitations, underlining the need for clinician-data scientist collaboration to enhance head and neck cancer care.

Computer Vision-Radiomics & Pathognomics

The role of computer vision in extracting radiographic (radiomics) and histopathologic (pathognomics) features is an extension of molecular biomarkers that have been foundational to our understanding across the spectrum of head and neck disorders. Especially within head and neck cancers, machine learning and deep learning applications have yielded advances in the characterization of tumor features, nodal features, and various outcomes. This review aims to overview the landscape of radiomic and pathognomic applications, informing future work to address gaps. Novel methodologies will be needed to potentially engineer ways of integrating multidimensional data inputs to examine disease features to guide prognosis comprehensively and ultimately clinical management.

Deep learning in cancer genomics and histopathology

Histopathology and genomic profiling are cornerstones of precision oncology and are routinely obtained for patients with cancer. Traditionally, histopathology slides are manually reviewed by highly trained pathologists. Genomic data, on the other hand, is evaluated by engineered computational pipelines. In both applications, the advent of modern artificial intelligence methods, specifically machine learning (ML) and deep learning (DL), have opened up a fundamentally new way of extracting actionable insights from raw data, which could augment and potentially replace some aspects of traditional evaluation workflows. In this review, we summarize current and emerging applications of DL in histopathology and genomics, including basic diagnostic as well as advanced prognostic tasks. Based on a growing body of evidence, we suggest that DL could be the groundwork for a new kind of workflow in oncology and cancer research. However, we also point out that DL models can have biases and other flaws that users in healthcare and research need to know about, and we propose ways to address them.

AI-Based Risk Score from Tumour-Infiltrating Lymphocyte Predicts Locoregional-Free Survival in Nasopharyngeal Carcinoma

BACKGROUND

Locoregional recurrence of nasopharyngeal carcinoma (NPC) occurs in 10% to 50% of cases following primary treatment. However, the current main prognostic markers for NPC, both stage and plasma Epstein-Barr virus DNA, are not sensitive to locoregional recurrence.

METHODS

We gathered 385 whole-slide images (WSIs) from haematoxylin and eosin (H&E)-stained NPC sections (n = 367 cases), which were collected from Sun Yat-sen University Cancer Centre. We developed a deep learning algorithm to detect tumour nuclei and lymphocyte nuclei in WSIs, followed by density-based clustering to quantify the tumour-infiltrating lymphocytes (TILs) into 12 scores. The Random Survival Forest model was then trained on the TILs to generate risk score.

RESULTS

Based on Kaplan-Meier analysis, the proposed methods were able to stratify low- and high-risk NPC cases in a validation set of locoregional recurrence with a statically significant result (p < 0.001). This finding was also found in distant metastasis-free survival (p < 0.001), progression-free survival (p < 0.001), and regional recurrence-free survival (p < 0.05). Furthermore, in both univariate analysis (HR: 1.58, CI: 1.13-2.19, p < 0.05) and multivariate analysis (HR:1.59, CI: 1.11-2.28, p < 0.05), we also found that our methods demonstrated a strong prognostic value for locoregional recurrence.

CONCLUSION

The proposed novel digital markers could potentially be utilised to assist treatment decisions in cases of NPC.

Comparison of MRI radiomics-based machine learning survival models in predicting prognosis of glioblastoma multiforme

Objective

To compare the performance of radiomics-based machine learning survival models in predicting the prognosis of glioblastoma multiforme (GBM) patients.

Methods

131 GBM patients were included in our study. The traditional Cox proportional-hazards (CoxPH) model and four machine learning models (SurvivalTree, Random survival forest (RSF), DeepSurv, DeepHit) were constructed, and the performance of the five models was evaluated using the C-index.

Results

After the screening, 1792 radiomics features were obtained. Seven radiomics features with the strongest relationship with prognosis were obtained following the application of the least absolute shrinkage and selection operator (LASSO) regression. The CoxPH model demonstrated that age (HR = 1.576, p = 0.037), Karnofsky performance status (KPS) score (HR = 1.890, p = 0.006), radiomics risk score (HR = 3.497, p = 0.001), and radiomics risk level (HR = 1.572, p = 0.043) were associated with poorer prognosis. The DeepSurv model performed the best among the five models, obtaining C-index of 0.882 and 0.732 for the training and test set, respectively. The performances of the other four models were lower: CoxPH (0.663 training set / 0.635 test set), SurvivalTree (0.702/0.655), RSF (0.735/0.667), DeepHit (0.608/0.560).

Conclusion

This study confirmed the superior performance of deep learning algorithms based on radiomics relative to the traditional method in predicting the overall survival of GBM patients; specifically, the DeepSurv model showed the best predictive ability.

Comparison of deep learning-based recurrence-free survival with random survival forest and Cox proportional hazard models in Stage-I NSCLC patients

BACKGROUND

The curative treatment for Stage I non-small cell lung cancer (NSCLC) is surgical resection. Even for Stage I patients, the probability of recurrence after curative treatment is around 20%.

METHODS

In this retrospective study, we included 268 operated Stage I NSCLC patients between January 2008 and June 2018 to analyze the prognostic factors (pathological stage, histological type, number of sampled mediastinal lymph node stations, type of resection, SUVmax of the lesion) that may affect relapse with three different methods, Cox proportional hazard (CoxPH), random survival forest (RSF), DeepSurv, and to compare the performance of these methods with Harrell's C-index. The dataset was randomly split into two sets, training and test sets.

RESULTS

In the training set, DeepSurv showed the best performance among the three models, the C-index of the training set was 0.832, followed by RSF (0.675) and CoxPH (0.672). In the test set, RSF showed the best performance among the three models, followed by DeepSurv with 0.677 and CoxPH methods with 0.625.

CONCLUSION

In conclusion, machine-learning techniques can be useful in predicting recurrence for lung cancer and guide clinicians both in choosing the adjuvant treatment options and best follow-up programs.

Application of Artificial Intelligence to the Diagnosis and Therapy of Nasopharyngeal Carcinoma

Artificial intelligence (AI) is an interdisciplinary field that encompasses a wide range of computer science disciplines, including image recognition, machine learning, human-computer interaction, robotics and so on. Recently, AI, especially deep learning algorithms, has shown excellent performance in the field of image recognition, being able to automatically perform quantitative evaluation of complex medical image features to improve diagnostic accuracy and efficiency. AI has a wider and deeper application in the medical field of diagnosis, treatment and prognosis. Nasopharyngeal carcinoma (NPC) occurs frequently in southern China and Southeast Asian countries and is the most common head and neck cancer in the region. Detecting and treating NPC early is crucial for a good prognosis. This paper describes the basic concepts of AI, including traditional machine learning and deep learning algorithms, and their clinical applications of detecting and assessing NPC lesions, facilitating treatment and predicting prognosis. The main limitations of current AI technologies are briefly described, including interpretability issues, privacy and security and the need for large amounts of annotated data. Finally, we discuss the remaining challenges and the promising future of using AI to diagnose and treat NPC.

Predicting prognosis of nasopharyngeal carcinoma based on deep learning: peritumoral region should be valued

BACKGROUND

The purpose of this study was to explore whether incorporating the peritumoral region to train deep neural networks could improve the performance of the models for predicting the prognosis of NPC.

METHODS

A total of 381 NPC patients who were divided into high- and low-risk groups according to progression-free survival were retrospectively included. Deeplab v3 and U-Net were trained to build segmentation models for the automatic segmentation of the tumor and suspicious lymph nodes. Five datasets were constructed by expanding 5, 10, 20, 40, and 60 pixels outward from the edge of the automatically segmented region. Inception-Resnet-V2, ECA-ResNet50t, EfficientNet-B3, and EfficientNet-B0 were trained with the original, segmented, and the five new constructed datasets to establish the classification models. The receiver operating characteristic curve was used to evaluate the performance of each model.

RESULTS

The Dice coefficients of Deeplab v3 and U-Net were 0.741(95%CI:0.722-0.760) and 0.737(95%CI:0.720-0.754), respectively. The average areas under the curve (aAUCs) of deep learning models for classification trained with the original and segmented images and with images expanded by 5, 10, 20, 40, and 60 pixels were 0.717 ± 0.043, 0.739 ± 0.016, 0.760 ± 0.010, 0.768 ± 0.018, 0.802 ± 0.013, 0.782 ± 0.039, and 0.753 ± 0.014, respectively. The models trained with the images expanded by 20 pixels obtained the best performance.

CONCLUSIONS

The peritumoral region NPC contains information related to prognosis, and the incorporation of this region could improve the performance of deep learning models for prognosis prediction.

A Scoping Review of the Use of Machine Learning in Health Economics and Outcomes Research: Part 2-Data From Nonwearables

OBJECTIVES

Despite the increasing interest in applying machine learning (ML) methods in health economics and outcomes research (HEOR), stakeholders face uncertainties in when and how ML can be used. We reviewed the recent applications of ML in HEOR.

METHODS

We searched PubMed for studies published between January 2020 and March 2021 and randomly chose 20% of the identified studies for the sake of manageability. Studies that were in HEOR and applied an ML technique were included. Studies related to wearable devices were excluded. We abstracted information on the ML applications, data types, and ML methods and analyzed it using descriptive statistics.

RESULTS

We retrieved 805 articles, of which 161 (20%) were randomly chosen. Ninety-two of the random sample met the eligibility criteria. We found that ML was primarily used for predicting future events (86%) rather than current events (14%). The most common response variables were clinical events or disease incidence (42%) and treatment outcomes (22%). ML was less used to predict economic outcomes such as health resource utilization (16%) or costs (3%). Although electronic medical records (35%) were frequently used for model development, claims data were used less frequently (9%). Tree-based methods (eg, random forests and boosting) were the most commonly used ML methods (31%).

CONCLUSIONS

The use of ML techniques in HEOR is growing rapidly, but there remain opportunities to apply them to predict economic outcomes, especially using claims databases, which could inform the development of cost-effectiveness models.

Development and Validation of a DeepSurv Nomogram to Predict Survival Outcomes and Guide Personalized Adjuvant Chemotherapy in Non-Small Cell Lung Cancer

Objective

To develop and validate a DeepSurv nomogram based on radiomic features extracted from computed tomography images and clinicopathological factors, to predict the overall survival and guide individualized adjuvant chemotherapy in patients with non-small cell lung cancer (NSCLC).

Patients and Methods

This retrospective study involved 976 consecutive patients with NSCLC (training cohort, n=683; validation cohort, n=293). DeepSurv was constructed based on 1,227 radiomic features, and the risk score was calculated for each patient as the output. A clinical multivariate Cox regression model was built with clinicopathological factors to determine the independent risk factors. Finally, a DeepSurv nomogram was constructed by integrating the risk score and independent clinicopathological factors. The discrimination capability, calibration, and clinical usefulness of the nomogram performance were assessed using concordance index evaluation, the Greenwood-Nam-D’Agostino test, and decision curve analysis, respectively. The treatment strategy was analyzed using a Kaplan–Meier curve and log-rank test for the high- and low-risk groups.

Results

The DeepSurv nomogram yielded a significantly better concordance index (training cohort, 0.821; validation cohort 0.768) with goodness-of-fit (P<0.05). The risk score, age, thyroid transcription factor-1, Ki-67, and disease stage were the independent risk factors for NSCLC.The Greenwood-Nam-D’Agostino test showed good calibration performance (P=0.39). Both high- and low-risk patients did not benefit from adjuvant chemotherapy, and chemotherapy in low-risk groups may lead to a poorer prognosis.

Conclusions

The DeepSurv nomogram, which is based on the risk score and independent risk factors, had good predictive performance for survival outcome. Further, it could be used to guide personalized adjuvant chemotherapy in patients with NSCLC.

A Survey on Deep Learning for Precision Oncology

Precision oncology, which ensures optimized cancer treatment tailored to the unique biology of a patient’s disease, has rapidly developed and is of great clinical importance. Deep learning has become the main method for precision oncology. This paper summarizes the recent deep-learning approaches relevant to precision oncology and reviews over 150 articles within the last six years. First, we survey the deep-learning approaches categorized by various precision oncology tasks, including the estimation of dose distribution for treatment planning, survival analysis and risk estimation after treatment, prediction of treatment response, and patient selection for treatment planning. Secondly, we provide an overview of the studies per anatomical area, including the brain, bladder, breast, bone, cervix, esophagus, gastric, head and neck, kidneys, liver, lung, pancreas, pelvis, prostate, and rectum. Finally, we highlight the challenges and discuss potential solutions for future research directions.

Deep-learning model for predicting the survival of rectal adenocarcinoma patients based on a surveillance, epidemiology, and end results analysis

Background

We collected information on patients with rectal adenocarcinoma in the United States from the Surveillance, Epidemiology, and EndResults (SEER) database. We used this information to establish a model that combined deep learning with a multilayer neural network (the DeepSurv model) for predicting the survival rate of patients with rectal adenocarcinoma.

Methods

We collected patients with rectal adenocarcinoma in the United States and older than 20 yearswho had been added to the SEER database from 2004 to 2015. We divided these patients into training and test cohortsat a ratio of 7:3. The training cohort was used to develop a seven-layer neural network based on the analysis method established by Katzman and colleagues to construct a DeepSurv prediction model. We then used the C-index and calibration plots to evaluate the prediction performance of the DeepSurv model.

Results

The 49,275 patients with rectal adenocarcinoma included in the study were randomly divided into the training cohort (70%, n = 34,492) and the test cohort (30%, n = 14,783). There were no statistically significant differences in clinical characteristics between the two cohorts (p > 0.05). We applied Cox proportional-hazards regression to the data in the training cohort, which showed that age, sex, marital status, tumor grade, surgery status, and chemotherapy status were significant factors influencing survival (p < 0.05). Using the training cohort to construct the DeepSurv model resulted in a C-index of the model of 0.824, while using the test cohort to verify the DeepSurv model yielded a C-index of 0.821. Thesevalues show that the prediction effect of the DeepSurv model for the test-cohort patients was highly consistent with the prediction resultsfor the training-cohort patients.

Conclusion

The DeepSurv prediction model of the seven-layer neural network that we have established can accurately predict the survival rateand time of rectal adenocarcinoma patients.

Application of Artificial Intelligence for Nasopharyngeal Carcinoma Management - A Systematic Review

INTRODUCTION

Nasopharyngeal carcinoma (NPC) is endemic to Eastern and South-Eastern Asia, and, in 2020, 77% of global cases were diagnosed in these regions. Apart from its distinct epidemiology, the natural behavior, treatment, and prognosis are different from other head and neck cancers. With the growing trend of artificial intelligence (AI), especially deep learning (DL), in head and neck cancer care, we sought to explore the unique clinical application and implementation direction of AI in the management of NPC.

METHODS

The search protocol was performed to collect publications using AI, machine learning (ML) and DL in NPC management from PubMed, Scopus and Embase. The articles were filtered using inclusion and exclusion criteria, and the quality of the papers was assessed. Data were extracted from the finalized articles.

RESULTS

A total of 78 articles were reviewed after removing duplicates and papers that did not meet the inclusion and exclusion criteria. After quality assessment, 60 papers were included in the current study. There were four main types of applications, which were auto-contouring, diagnosis, prognosis, and miscellaneous applications (especially on radiotherapy planning). The different forms of convolutional neural networks (CNNs) accounted for the majority of DL algorithms used, while the artificial neural network (ANN) was the most frequent ML model implemented.

CONCLUSION

There is an overall positive impact identified from AI implementation in the management of NPC. With improving AI algorithms, we envisage AI will be available as a routine application in a clinical setting soon.

The role of deep learning-based survival model in improving survival prediction of patients with glioblastoma

This retrospective study has been conducted to validate the performance of deep learning‐based survival models in glioblastoma (GBM) patients alongside the Cox proportional hazards model (CoxPH) and the random survival forest (RSF). Furthermore, the effect of hyperparameters optimization methods on improving the prediction accuracy of deep learning‐based survival models was investigated. Of the 305 cases, 260 GBM patients were included in our analysis based on the following criteria: demographic information (i.e., age, Karnofsky performance score, gender, and race), tumor characteristic (i.e., laterality and location), details of post‐surgical treatment (i.e., time to initiate concurrent chemoradiation therapy, standard treatment, and radiotherapy techniques), and last follow‐up time as well as the molecular markers (i.e., O‐6‐methylguanine methyltransferase and isocitrate dehydrogenase 1 status). Experimental results have demonstrated that age (Elderly > 65: hazard ratio [HR] = 1.63; 95% confidence interval [CI]: 1.213–2.18; p value = 0.001) and tumors located at multiple lobes ([HR] = 1.75; 95% [CI]: 1.177–2.61; p value = 0.006) were associated with poorer prognosis. In contrast, age (young < 40: [HR] = 0.57; 95% [CI]: 0.343–0.96; p value = 0.034) and type of radiotherapy (others include stereotactic and brachytherapy: [HR] = 0.5; 95%[CI]: 0.266–0.95; p value = 0.035) were significantly related to better prognosis. Furthermore, the proposed deep learning‐based survival model (concordance index [c‐index] = 0.823 configured by Bayesian hyperparameter optimization), outperformed the RSF (c‐index = 0.728), and the CoxPH model (c‐index = 0.713) in the training dataset. Our results show the ability of deep learning in learning a complex association of risk factors. Moreover, the remarkable performance of the deep‐learning‐based survival model could be promising to support decision‐making systems in personalized medicine for patients with GBM.

A Comprehensive Review on Radiomics and Deep Learning for Nasopharyngeal Carcinoma Imaging

Nasopharyngeal carcinoma (NPC) is one of the most common malignant tumours of the head and neck, and improving the efficiency of its diagnosis and treatment strategies is an important goal. With the development of the combination of artificial intelligence (AI) technology and medical imaging in recent years, an increasing number of studies have been conducted on image analysis of NPC using AI tools, especially radiomics and artificial neural network methods. In this review, we present a comprehensive overview of NPC imaging research based on radiomics and deep learning. These studies depict a promising prospect for the diagnosis and treatment of NPC. The deficiencies of the current studies and the potential of radiomics and deep learning for NPC imaging are discussed. We conclude that future research should establish a large-scale labelled dataset of NPC images and that studies focused on screening for NPC using AI are necessary.

QuPath: The global impact of an open source digital pathology system

QuPath, originally created at the Centre for Cancer Research & Cell Biology at Queen's University Belfast as part of a research programme in digital pathology (DP) funded by Invest Northern Ireland and Cancer Research UK, is arguably the most wildly used image analysis software program in the world. On the back of the explosion of DP and a need to comprehensively visualise and analyse whole slides images (WSI), QuPath was developed to address the many needs associated with tissue based image analysis; these were several fold and, predominantly, translational in nature: from the requirement to visualise images containing billions of pixels from files several GBs in size, to the demand for high-throughput reproducible analysis, which the paradigm of routine visual pathological assessment continues to struggle to deliver. Resultantly, large-scale biomarker quantification must increasingly be augmented with DP. Here we highlight the impact of the open source Quantitative Pathology & Bioimage Analysis DP system since its inception, by discussing the scope of scientific research in which QuPath has been cited, as the system of choice for researchers.

A deep-learning-based prognostic nomogram integrating microscopic digital pathology and macroscopic magnetic resonance images in nasopharyngeal carcinoma: a multi-cohort study

BACKGROUND

To explore the prognostic value of radiomics-based and digital pathology-based imaging biomarkers from macroscopic magnetic resonance imaging (MRI) and microscopic whole-slide images for patients with nasopharyngeal carcinoma (NPC).

METHODS

We recruited 220 NPC patients and divided them into training (n = 132), internal test (n = 44), and external test (n = 44) cohorts. The primary endpoint was failure-free survival (FFS). Radiomic features were extracted from pretreatment MRI and selected and integrated into a radiomic signature. The histopathological signature was extracted from whole-slide images of biopsy specimens using an end-to-end deep-learning method. Incorporating two signatures and independent clinical factors, a multi-scale nomogram was constructed. We also tested the correlation between the key imaging features and genetic alternations in an independent cohort of 16 patients (biological test cohort).

RESULTS

Both radiomic and histopathologic signatures presented significant associations with treatment failure in the three cohorts (C-index: 0.689-0.779, all p < 0.050). The multi-scale nomogram showed a consistent significant improvement for predicting treatment failure compared with the clinical model in the training (C-index: 0.817 versus 0.730, p < 0.050), internal test (C-index: 0.828 versus 0.602, p < 0.050) and external test (C-index: 0.834 versus 0.679, p < 0.050) cohorts. Furthermore, patients were stratified successfully into two groups with distinguishable prognosis (log-rank p < 0.0010) using our nomogram. We also found that two texture features were related to the genetic alternations of chromatin remodeling pathways in another independent cohort.

CONCLUSION

The multi-scale imaging features showed a complementary value in prognostic prediction and may improve individualized treatment in NPC.

Deep learning pathological microscopic features in endemic nasopharyngeal cancer: Prognostic value and protentional role for individual induction chemotherapy

BACKGROUND

To explore the prognostic value and the role for treatment decision of pathological microscopic features in patients with nasopharyngeal carcinoma (NPC) using the method of deep learning.

METHODS

The pathological microscopic features were extracted using the software QuPath (version 0.1.3. Queen's University) in the training cohort (Guangzhou training cohort, n = 843). We used the neural network DeepSurv to analyze the pathological microscopic features (DSPMF) and then classified patients into high-risk and low-risk groups through the time-dependent receiver operating characteristic (ROC). The prognosis accuracy of the pathological feature was validated in a validation cohort (n = 212). The primary endpoint was progression-free survival (PFS).

RESULTS

We found 429 pathological microscopic features in the H&E image. Patients with high-risk scores in the training cohort had shorter 5-year PFS (HR 10.03, 6.06-16.61; P < .0001). The DSPMF (C-index: 0.723) had the higher C-index than the EBV DNA (C-index: 0.612) copies and the N stage (C-index: 0.593). Furthermore, induction chemotherapy (ICT) plus concomitant chemoradiotherapy (CCRT) had better 5-year PFS to those received CCRT (P < .0001) in the high-risk group.

CONCLUSION

The DSPMF is a reliable prognostic tool for survival risk in patients with NPC and might be able to guide the treatment decision.