Machine Learning Analysis of Image Data Based on Detailed MR Image Reports for Nasopharyngeal Carcinoma Prognosis

Artificial Intelligence in Head and Neck Surgery

This article explores artificial intelligence's (AI's) role in otolaryngology for head and neck cancer diagnosis and management. It highlights AI's potential in pattern recognition for early cancer detection, prognostication, and treatment planning, primarily through image analysis using clinical, endoscopic, and histopathologic images. Radiomics is also discussed at length, as well as the many ways that radiologic image analysis can be utilized, including for diagnosis, lymph node metastasis prediction, and evaluation of treatment response. The study highlights AI's promise and limitations, underlining the need for clinician-data scientist collaboration to enhance head and neck cancer care.

Deciphering the Prognostic Efficacy of MRI Radiomics in Nasopharyngeal Carcinoma: A Comprehensive Meta-Analysis

This meta-analysis investigates the prognostic value of MRI-based radiomics in nasopharyngeal carcinoma treatment outcomes, specifically focusing on overall survival (OS) variability. The study protocol was registered with INPLASY (INPLASY202420101). Initially, a systematic review identified 15 relevant studies involving 6243 patients through a comprehensive search across PubMed, Embase, and Web of Science, adhering to PRISMA guidelines. The methodological quality was assessed using the Quality in Prognosis Studies (QUIPS) tool and the Radiomics Quality Score (RQS), highlighting a low risk of bias in most domains. Our analysis revealed a significant average concordance index (c-index) of 72% across studies, indicating the potential of radiomics in clinical prognostication. However, moderate heterogeneity was observed, particularly in OS predictions. Subgroup analyses and meta-regression identified validation methods and radiomics software as significant heterogeneity moderators. Notably, the number of features in the prognosis model correlated positively with its performance. These findings suggest radiomics' promising role in enhancing cancer treatment strategies, though the observed heterogeneity and potential biases call for cautious interpretation and standardization in future research.

Cross-site prognosis prediction for nasopharyngeal carcinoma from incomplete multi-modal data

Accurate prognosis prediction for nasopharyngeal carcinoma based on magnetic resonance (MR) images assists in the guidance of treatment intensity, thus reducing the risk of recurrence and death. To reduce repeated labor and sufficiently explore domain knowledge, aggregating labeled/annotated data from external sites enables us to train an intelligent model for a clinical site with unlabeled data. However, this task suffers from the challenges of incomplete multi-modal examination data fusion and image data heterogeneity among sites. This paper proposes a cross-site survival analysis method for prognosis prediction of nasopharyngeal carcinoma from domain adaptation viewpoint. Utilizing a Cox model as the basic framework, our method equips it with a cross-attention based multi-modal fusion regularization. This regularization model effectively fuses the multi-modal information from multi-parametric MR images and clinical features onto a domain-adaptive space, despite the absence of some modalities. To enhance the feature discrimination, we also extend the contrastive learning technique to censored data cases. Compared with the conventional approaches which directly deploy a trained survival model in a new site, our method achieves superior prognosis prediction performance in cross-site validation experiments. These results highlight the key role of cross-site adaptability of our method and support its value in clinical practice.

Comprehensive integrated analysis of MR and DCE-MR radiomics models for prognostic prediction in nasopharyngeal carcinoma

Although prognostic prediction of nasopharyngeal carcinoma (NPC) remains a pivotal research area, the role of dynamic contrast-enhanced magnetic resonance (DCE-MR) has been less explored. This study aimed to investigate the role of DCR-MR in predicting progression-free survival (PFS) in patients with NPC using magnetic resonance (MR)- and DCE-MR-based radiomic models. A total of 434 patients with two MR scanning sequences were included. The MR- and DCE-MR-based radiomics models were developed based on 289 patients with only MR scanning sequences and 145 patients with four additional pharmacokinetic parameters (volume fraction of extravascular extracellular space (ve), volume fraction of plasma space (vp), volume transfer constant (Ktrans), and reverse reflux rate constant (kep) of DCE-MR. A combined model integrating MR and DCE-MR was constructed. Utilizing methods such as correlation analysis, least absolute shrinkage and selection operator regression, and multivariate Cox proportional hazards regression, we built the radiomics models. Finally, we calculated the net reclassification index and C-index to evaluate and compare the prognostic performance of the radiomics models. Kaplan-Meier survival curve analysis was performed to investigate the model's ability to stratify risk in patients with NPC. The integration of MR and DCE-MR radiomic features significantly enhanced prognostic prediction performance compared to MR- and DCE-MR-based models, evidenced by a test set C-index of 0.808 vs 0.729 and 0.731, respectively. The combined radiomics model improved net reclassification by 22.9%-52.6% and could significantly stratify the risk levels of patients with NPC (p = 0.036). Furthermore, the MR-based radiomic feature maps achieved similar results to the DCE-MR pharmacokinetic parameters in terms of reflecting the underlying angiogenesis information in NPC. Compared to conventional MR-based radiomics models, the combined radiomics model integrating MR and DCE-MR showed promising results in delivering more accurate prognostic predictions and provided more clinical benefits in quantifying and monitoring phenotypic changes associated with NPC prognosis.

Predictive function of tumor burden-incorporated machine-learning algorithms for overall survival and their value in guiding management decisions in patients with locally advanced nasopharyngeal carcinoma

Objective

Accurate prognostic predictions and personalized decision-making on induction chemotherapy (IC) for individuals with locally advanced nasopharyngeal carcinoma (LA-NPC) remain challenging. This research examined the predictive function of tumor burden-incorporated machine-learning algorithms for overall survival (OS) and their value in guiding treatment in patients with LA-NPC.

Methods

Individuals with LA-NPC were reviewed retrospectively. Tumor burden signature-based OS prediction models were established using a nomogram and two machine-learning methods, the interpretable eXtreme Gradient Boosting (XGBoost) risk prediction model, and DeepHit time-to-event neural network. The models' prediction performances were compared using the concordance index (C-index) and the area under the curve (AUC). The patients were divided into two cohorts based on the risk predictions of the most successful model. The efficacy of IC combined with concurrent chemoradiotherapy was compared to that of chemoradiotherapy alone.

Results

The 1 221 eligible individuals, assigned to the training (n = 813) or validation (n = 408) set, showed significant respective differences in the C-indices of the XGBoost, DeepHit, and nomogram models (0.849 and 0.768, 0.811 and 0.767, 0.730 and 0.705). The training and validation sets had larger AUCs in the XGBoost and DeepHit models than the nomogram model in predicting OS (0.881 and 0.760, 0.845 and 0.776, and 0.764 and 0.729, P < 0.001). IC presented survival benefits in the XGBoost-derived high-risk but not low-risk group.

Conclusion

This research used machine-learning algorithms to create and verify a comprehensive model integrating tumor burden with clinical variables to predict OS and determine which patients will most likely gain from IC. This model could be valuable for delivering patient counseling and conducting clinical evaluations.

A Rulefit-based prognostic analysis using structured MRI report to select potential beneficiaries from induction chemotherapy in advanced nasopharyngeal carcinoma: A dual-centre study

BACKGROUND AND PURPOSE

Structured MRI report facilitate prognostic prediction for nasopharyngeal carcinoma (NPC). However, the intrinsic association among structured variables is not fully utilised. This study aimed to investigate the performance of a Rulefit-based model in feature integration behind structured MRI report and prognostic prediction in advanced NPC.

MATERIALS AND METHODS

We retrospectively enrolled 1207 patients diagnosed with non-metastatic advanced NPC from two centres, and divided into training (N = 544), internal testing (N = 367), and external testing (N = 296) cohorts. Machine learning algorithms including multivariate analysis, deep learning, Lasso, and Rulefit were used to establish corresponding prognostic models. The concordance indices (C- indices) of three clinical and six combined models with different algorithms for overall survival (OS) prediction were compared. Survival benefits of induction chemotherapy (IC) were calculated among risk groups stratified by different models. A website was established for individualised survival visualisation.

RESULTS

Incorporating structured variables into Stage model significantly improved the prognostic prediction performance. Six prognostic rules with structured variables were identified by Rulefit. OS prediction of Rules model was comparable to Lasso model in internal testing cohort (C-index: 0.720 vs. 0.713, P = 0.100) and achieved the highest C-index of 0.711 in external testing cohort, indicating better generalisability. The Rules model stratified patients into risk groups with significant 5-year OS differences in each cohort, and revealed significant survival benefits from additional IC in high-risk group.

CONCLUSION

The Rulefit-based Rules model, with the revelation of intrinsic associations behind structured variables, is promising in risk stratification and guiding individualised IC treatment for advanced NPC.

Application of Artificial Intelligence to the Diagnosis and Therapy of Nasopharyngeal Carcinoma

Artificial intelligence (AI) is an interdisciplinary field that encompasses a wide range of computer science disciplines, including image recognition, machine learning, human-computer interaction, robotics and so on. Recently, AI, especially deep learning algorithms, has shown excellent performance in the field of image recognition, being able to automatically perform quantitative evaluation of complex medical image features to improve diagnostic accuracy and efficiency. AI has a wider and deeper application in the medical field of diagnosis, treatment and prognosis. Nasopharyngeal carcinoma (NPC) occurs frequently in southern China and Southeast Asian countries and is the most common head and neck cancer in the region. Detecting and treating NPC early is crucial for a good prognosis. This paper describes the basic concepts of AI, including traditional machine learning and deep learning algorithms, and their clinical applications of detecting and assessing NPC lesions, facilitating treatment and predicting prognosis. The main limitations of current AI technologies are briefly described, including interpretability issues, privacy and security and the need for large amounts of annotated data. Finally, we discuss the remaining challenges and the promising future of using AI to diagnose and treat NPC.

Predicting prognosis of nasopharyngeal carcinoma based on deep learning: peritumoral region should be valued

BACKGROUND

The purpose of this study was to explore whether incorporating the peritumoral region to train deep neural networks could improve the performance of the models for predicting the prognosis of NPC.

METHODS

A total of 381 NPC patients who were divided into high- and low-risk groups according to progression-free survival were retrospectively included. Deeplab v3 and U-Net were trained to build segmentation models for the automatic segmentation of the tumor and suspicious lymph nodes. Five datasets were constructed by expanding 5, 10, 20, 40, and 60 pixels outward from the edge of the automatically segmented region. Inception-Resnet-V2, ECA-ResNet50t, EfficientNet-B3, and EfficientNet-B0 were trained with the original, segmented, and the five new constructed datasets to establish the classification models. The receiver operating characteristic curve was used to evaluate the performance of each model.

RESULTS

The Dice coefficients of Deeplab v3 and U-Net were 0.741(95%CI:0.722-0.760) and 0.737(95%CI:0.720-0.754), respectively. The average areas under the curve (aAUCs) of deep learning models for classification trained with the original and segmented images and with images expanded by 5, 10, 20, 40, and 60 pixels were 0.717 ± 0.043, 0.739 ± 0.016, 0.760 ± 0.010, 0.768 ± 0.018, 0.802 ± 0.013, 0.782 ± 0.039, and 0.753 ± 0.014, respectively. The models trained with the images expanded by 20 pixels obtained the best performance.

CONCLUSIONS

The peritumoral region NPC contains information related to prognosis, and the incorporation of this region could improve the performance of deep learning models for prognosis prediction.

Prognostic potential of a voxelwise invasion risk map of nasopharyngeal carcinoma based on a coordinate system of the nasopharynx

Background

Tumor invasion risk (TIR) is an important prognostic factor in nasopharyngeal carcinoma (NPC). We propose a novel prognostic analytic method for NPC based on a voxelwise analysis of TIR in a coordinate system of the nasopharynx.

Methods

A stable nasopharynx coordinate system was constructed based on anatomical landmarks to obtain an accurate TIR profile for NPC. The coordinate system was validated by image registration of the lateral pterygoid muscle (LPM). The tumors were registered to the coordinate system through shift, scale, and rotation transformations. The voxelwise TIR map for NPC was obtained by superposition of all registered and mirrored tumor regions of interest. The minimum risk (MinR) point of the tumor region was used as an independent prognostic factor for NPC. The cutoff value was calculated with density plot and validated with restricted cubic splines (RCSs), and then the patients were divided into 2 groups for overall survival (OS) analysis.

Results

The first voxelwise TIR map of NPC was obtained based on 778 patients. The OS of patients with a low TIR was 76.8% and was 92.6% for patients with a high TIR [P<0.001; hazard ratio (HR) =1/0.45; 95% CI: 0.27-0.77; adjusted P=0.004]. Thus, patients with a low TIR had a poor prognosis, whereas patients with a high TIR had a good prognosis. The MinR may be better at grading the prognosis of patients compared to the American Joint Committee on Cancer (AJCC) staging or tumor/node (T/N) classification systems.

Conclusions

The voxelwise TIR map provides a new method for the prognostic analysis of NPC. Potential clinical applications of voxelwise TIR mapping are clinical target volume (CTV) delineation and dose-painting for NPC.

Use of automated artificial intelligence to predict the need for orthodontic extractions

Objective

To develop and explore the usefulness of an artificial intelligence system for the prediction of the need for dental extractions during orthodontic treatments based on gender, model variables, and cephalometric records.

Methods

The gender, model variables, and radiographic records of 214 patients were obtained from an anonymized data bank containing 314 cases treated by two experienced orthodontists. The data were processed using an automated machine learning software (Auto-WEKA) and used to predict the need for extractions.

Results

By generating and comparing several prediction models, an accuracy of 93.9% was achieved for determining whether extraction is required or not based on the model and radiographic data. When only model variables were used, an accuracy of 87.4% was attained, whereas a 72.7% accuracy was achieved if only cephalometric information was used.

Conclusions

The use of an automated machine learning system allows the generation of orthodontic extraction prediction models. The accuracy of the optimal extraction prediction models increases with the combination of model and cephalometric data for the analytical process.

Radiomics in Nasopharyngeal Carcinoma

Nasopharyngeal carcinoma (NPC) is one of the most common head and neck malignancies, and the primary treatment methods are radiotherapy and chemotherapy. Radiotherapy alone, concurrent chemoradiotherapy, and induction chemotherapy combined with concurrent chemoradiotherapy can be used according to different grades. Treatment options and prognoses vary greatly depending on the grade of disease in the patients. Accurate grading and risk assessment are required. Recently, radiomics has combined a large amount of invisible high-dimensional information extracted from computed tomography, magnetic resonance imaging, or positron emission tomography with powerful computing capabilities of machine-learning algorithms, providing the possibility to achieve an accurate diagnosis and individualized treatment for cancer patients. As an effective tumor biomarker of NPC, the radiomic signature has been widely used in grading, differential diagnosis, prediction of prognosis, evaluation of treatment response, and early identification of therapeutic complications. The process of radiomic research includes image segmentation, feature extraction, feature selection, model establishment, and evaluation. Many open-source or commercial tools can be used to achieve these procedures. The development of machine-learning algorithms provides more possibilities for radiomics research. This review aimed to summarize the application of radiomics in NPC and introduce the basic process of radiomics research.

Automatic location scheme of anatomical landmarks in 3D head MRI based on the scale attention hourglass network

BACKGROUND AND OBJECTIVE

An anatomical landmark is biologically meaningful point in medical images and often used for medical image registration. The purpose of this study is to automatically locate anatomical landmarks from 3D medical images.

METHODS

A two-step automatic location scheme of anatomical landmarks in 3D medical image was designed in this study. In the first step, the full convolutional neural network was used for slice detection from a 3D medical image. In the second step, the scale attention hourglass network was used for landmark location in the detected slice and could overcome the difficulty of similar anatomical structures and different image parameters. This method was implemented and tested on four stable anatomical landmarks in 3D head MRI.

RESULTS

A total of 500 and 300 3D head volumes were used for training and testing, respectively. Results showed that the slice detection accuracy reached 85.7% and that the maximum location error was less than one slice. The average accuracy of the four anatomical landmarks in the detected slice reached 87.2%, and the spatial distance was 2.4 ± 2.4, which obtained better performance compared with hourglass network and feature pyramid networks.

CONCLUSIONS

This method can be useful for locating anatomical landmarks in 3D head MRI and provides technical support for medical image registration and big data analysis.

Application of Artificial Intelligence for Nasopharyngeal Carcinoma Management - A Systematic Review

INTRODUCTION

Nasopharyngeal carcinoma (NPC) is endemic to Eastern and South-Eastern Asia, and, in 2020, 77% of global cases were diagnosed in these regions. Apart from its distinct epidemiology, the natural behavior, treatment, and prognosis are different from other head and neck cancers. With the growing trend of artificial intelligence (AI), especially deep learning (DL), in head and neck cancer care, we sought to explore the unique clinical application and implementation direction of AI in the management of NPC.

METHODS

The search protocol was performed to collect publications using AI, machine learning (ML) and DL in NPC management from PubMed, Scopus and Embase. The articles were filtered using inclusion and exclusion criteria, and the quality of the papers was assessed. Data were extracted from the finalized articles.

RESULTS

A total of 78 articles were reviewed after removing duplicates and papers that did not meet the inclusion and exclusion criteria. After quality assessment, 60 papers were included in the current study. There were four main types of applications, which were auto-contouring, diagnosis, prognosis, and miscellaneous applications (especially on radiotherapy planning). The different forms of convolutional neural networks (CNNs) accounted for the majority of DL algorithms used, while the artificial neural network (ANN) was the most frequent ML model implemented.

CONCLUSION

There is an overall positive impact identified from AI implementation in the management of NPC. With improving AI algorithms, we envisage AI will be available as a routine application in a clinical setting soon.

A Comprehensive Review on Radiomics and Deep Learning for Nasopharyngeal Carcinoma Imaging

Nasopharyngeal carcinoma (NPC) is one of the most common malignant tumours of the head and neck, and improving the efficiency of its diagnosis and treatment strategies is an important goal. With the development of the combination of artificial intelligence (AI) technology and medical imaging in recent years, an increasing number of studies have been conducted on image analysis of NPC using AI tools, especially radiomics and artificial neural network methods. In this review, we present a comprehensive overview of NPC imaging research based on radiomics and deep learning. These studies depict a promising prospect for the diagnosis and treatment of NPC. The deficiencies of the current studies and the potential of radiomics and deep learning for NPC imaging are discussed. We conclude that future research should establish a large-scale labelled dataset of NPC images and that studies focused on screening for NPC using AI are necessary.

Development and external evaluation of predictions models for mortality of COVID-19 patients using machine learning method

To predict the mortality of patients with coronavirus disease 2019 (COVID-19). We collected clinical data of COVID-19 patients between January 18 and March 29 2020 in Wuhan, China . Gradient boosting decision tree (GBDT), logistic regression (LR) model, and simplified LR were built to predict the mortality of COVID-19. We also evaluated different models by computing area under curve (AUC), accuracy, positive predictive value (PPV), and negative predictive value (NPV) under fivefold cross-validation. A total of 2924 patients were included in our evaluation, with 257 (8.8%) died and 2667 (91.2%) survived during hospitalization. Upon admission, there were 21 (0.7%) mild cases, 2051 (70.1%) moderate case, 779 (26.6%) severe cases, and 73 (2.5%) critically severe cases. The GBDT model exhibited the highest fivefold AUC, which was 0.941, followed by LR (0.928) and LR-5 (0.913). The diagnostic accuracies of GBDT, LR, and LR-5 were 0.889, 0.868, and 0.887, respectively. In particular, the GBDT model demonstrated the highest sensitivity (0.899) and specificity (0.889). The NPV of all three models exceeded 97%, while their PPV values were relatively low, resulting in 0.381 for LR, 0.402 for LR-5, and 0.432 for GBDT. Regarding severe and critically severe cases, the GBDT model also performed the best with a fivefold AUC of 0.918. In the external validation test of the LR-5 model using 72 cases of COVID-19 from Brunei, leukomonocyte (%) turned to show the highest fivefold AUC (0.917), followed by urea (0.867), age (0.826), and SPO2 (0.704). The findings confirm that the mortality prediction performance of the GBDT is better than the LR models in confirmed cases of COVID-19. The performance comparison seems independent of disease severity.