The Diagnostic Value of Ultrasound-Based Deep Learning in Differentiating Parotid Gland Tumors

Deep learning-assisted diagnosis of benign and malignant parotid gland tumors based on automatic segmentation of ultrasound images: a multicenter retrospective study

Objectives

To construct deep learning-assisted diagnosis models based on automatic segmentation of ultrasound images to facilitate radiologists in differentiating benign and malignant parotid tumors.

Methods

A total of 582 patients histopathologically diagnosed with PGTs were retrospectively recruited from 4 centers, and their data were collected for analysis. The radiomics features of six deep learning models (ResNet18, Inception_v3 etc) were analyzed based on the ultrasound images that were obtained under the best automatic segmentation model (Deeplabv3, UNet++, and UNet). The performance of three physicians was compared when the optimal model was used and not. The Net Reclassification Index (NRI) and Integrated Discrimination Improvement (IDI) were utilized to evaluate the clinical benefit of the optimal model.

Results

The Deeplabv3 model performed optimally in terms of automatic segmentation. The ResNet18 deep learning model had the best prediction performance, with an area under the receiver-operating characteristic curve of 0.808 (0.694-0.923), 0.809 (0.712-0.906), and 0.812 (0.680-0.944) in the internal test set and external test sets 1 and 2, respectively. Meanwhile, the optimal model-assisted clinical and overall benefits were markedly enhanced for two out of three radiologists (in internal validation set, NRI: 0.259 and 0.213 [p = 0.002 and 0.017], IDI: 0.284 and 0.201 [p = 0.005 and 0.043], respectively; in external test set 1, NRI: 0.183 and 0.161 [p = 0.019 and 0.008], IDI: 0.205 and 0.184 [p = 0.031 and 0.045], respectively; in external test set 2, NRI: 0.297 and 0.297 [p = 0.038 and 0.047], IDI: 0.332 and 0.294 [p = 0.031 and 0.041], respectively).

Conclusions

The deep learning model constructed for automatic segmentation of ultrasound images can improve the diagnostic performance of radiologists for PGTs.

Swin MoCo: Improving parotid gland MRI segmentation using contrastive learning

BACKGROUND

Segmentation of the parotid glands and tumors by MR images is essential for treating parotid gland tumors. However, segmentation of the parotid glands is particularly challenging due to their variable shape and low contrast with surrounding structures.

PURPOSE

The lack of large and well-annotated datasets limits the development of deep learning in medical images. As an unsupervised learning method, contrastive learning has seen rapid development in recent years. It can better use unlabeled images and is hopeful to improve parotid gland segmentation.

METHODS

We propose Swin MoCo, a momentum contrastive learning network with Swin Transformer as its backbone. The ImageNet supervised model is used as the initial weights of Swin MoCo, thus improving the training effects on small medical image datasets.

RESULTS

Swin MoCo trained with transfer learning improves parotid gland segmentation to 89.78% DSC, 85.18% mIoU, 3.60 HD, and 90.08% mAcc. On the Synapse multi-organ computed tomography (CT) dataset, using Swin MoCo as the pre-trained model of Swin-Unet yields 79.66% DSC and 12.73 HD, which outperforms the best result of Swin-Unet on the Synapse dataset.

CONCLUSIONS

The above improvements require only 4 h of training on a single NVIDIA Tesla V100, which is computationally cheap. Swin MoCo provides new approaches to improve the performance of tasks on small datasets. The code is publicly available at https://github.com/Zian-Xu/Swin-MoCo.

Parotid Gland Segmentation Using Purely Transformer-Based U-Shaped Network and Multimodal MRI

Parotid gland tumors account for approximately 2% to 10% of head and neck tumors. Segmentation of parotid glands and tumors on magnetic resonance images is essential in accurately diagnosing and selecting appropriate surgical plans. However, segmentation of parotid glands is particularly challenging due to their variable shape and low contrast with surrounding structures. Recently, deep learning has developed rapidly, and Transformer-based networks have performed well on many computer vision tasks. However, Transformer-based networks have yet to be well used in parotid gland segmentation tasks. We collected a multi-center multimodal parotid gland MRI dataset and implemented parotid gland segmentation using a purely Transformer-based U-shaped segmentation network. We used both absolute and relative positional encoding to improve parotid gland segmentation and achieved multimodal information fusion without increasing the network computation. In addition, our novel training approach reduces the clinician's labeling workload by nearly half. Our method achieved good segmentation of both parotid glands and tumors. On the test set, our model achieved a Dice-Similarity Coefficient of 86.99%, Pixel Accuracy of 99.19%, Mean Intersection over Union of 81.79%, and Hausdorff Distance of 3.87. The purely Transformer-based U-shaped segmentation network we used outperforms other convolutional neural networks. In addition, our method can effectively fuse the information from multi-center multimodal MRI dataset, thus improving the parotid gland segmentation.

Performance of radiomics in the differential diagnosis of parotid tumors: a systematic review

Purpose

A systematic review and meta-analysis were conducted to evaluate the diagnostic precision of radiomics in the differential diagnosis of parotid tumors, considering the increasing utilization of radiomics in tumor diagnosis. Although some researchers have attempted to apply radiomics in this context, there is ongoing debate regarding its accuracy.

Methods

Databases of PubMed, Cochrane, EMBASE, and Web of Science up to May 29, 2024 were systematically searched. The quality of included primary studies was assessed using the Radiomics Quality Score (RQS) checklist. The meta-analysis was performed utilizing a bivariate mixed-effects model.

Results

A total of 39 primary studies were incorporated. The machine learning model relying on MRI radiomics for diagnosis malignant tumors of the parotid gland, demonstrated a sensitivity of 0.80 [95% CI: 0.74, 0.86], SROC of 0.89 [95% CI: 0.27-0.99] in the validation set. The machine learning model based on MRI radiomics for diagnosis malignant tumors of the parotid gland, exhibited a sensitivity of 0.83[95% CI: 0.76, 0.88], SROC of 0.89 [95% CI: 0.17-1.00] in the validation set. The models also demonstrated high predictive accuracy for benign lesions.

Conclusion

There is great potential for radiomics-based models to improve the accuracy of diagnosing benign and malignant tumors of the parotid gland. To further enhance this potential, future studies should consider implementing standardized radiomics-based features, adopting more robust feature selection methods, and utilizing advanced model development tools. These measures can significantly improve the diagnostic accuracy of artificial intelligence algorithms in distinguishing between benign and malignant tumors of the parotid gland.

Systematic review registration

https://www.crd.york.ac.uk/prospero/, identifier CRD42023434931.

Prediction of visceral pleural invasion of clinical stage I lung adenocarcinoma using thoracoscopic images and deep learning

PURPOSE

To develop deep learning models using thoracoscopic images to identify visceral pleural invasion (VPI) in patients with clinical stage I lung adenocarcinoma, and to verify if these models can be applied clinically.

METHODS

Two deep learning models, one based on a convolutional neural network (CNN) and the other based on a vision transformer (ViT), were applied and trained via 463 images (VPI negative: 269 images, VPI positive: 194 images) captured from surgical videos of 81 patients. Model performances were validated via an independent test dataset containing 46 images (VPI negative: 28 images, VPI positive: 18 images) from 46 test patients.

RESULTS

The areas under the receiver operating characteristic curves of the CNN-based and ViT-based models were 0.77 and 0.84 (p = 0.304), respectively. The accuracy, sensitivity, specificity, and positive and negative predictive values were 73.91, 83.33, 67.86, 62.50, and 86.36% for the CNN-based model and 78.26, 77.78, 78.57, 70.00, and 84.62% for the ViT-based model, respectively. These models' diagnostic abilities were comparable to those of board-certified thoracic surgeons and tended to be superior to those of non-board-certified thoracic surgeons.

CONCLUSION

The deep learning model systems can be utilized in clinical applications via data expansion.

Differentiation of benign and malignant parotid gland tumors based on the fusion of radiomics and deep learning features on ultrasound images

Objective

The pathological classification and imaging manifestation of parotid gland tumors are complex, while accurate preoperative identification plays a crucial role in clinical management and prognosis assessment. This study aims to construct and compare the performance of clinical models, traditional radiomics models, deep learning (DL) models, and deep learning radiomics (DLR) models based on ultrasound (US) images in differentiating between benign parotid gland tumors (BPGTs) and malignant parotid gland tumors (MPGTs).

Methods

Retrospective analysis was conducted on 526 patients with confirmed PGTs after surgery, who were randomly divided into a training set and a testing set in the ratio of 7:3. Traditional radiomics and three DL models (DenseNet121, VGG19, ResNet50) were employed to extract handcrafted radiomics (HCR) features and DL features followed by feature fusion. Seven machine learning classifiers including logistic regression (LR), support vector machine (SVM), RandomForest, ExtraTrees, XGBoost, LightGBM and multi-layer perceptron (MLP) were combined to construct predictive models. The most optimal model was integrated with clinical and US features to develop a nomogram. Receiver operating characteristic (ROC) curve was employed for assessing performance of various models while the clinical utility was assessed by decision curve analysis (DCA).

Results

The DLR model based on ExtraTrees demonstrated superior performance with AUC values of 0.943 (95% CI: 0.918-0.969) and 0.916 (95% CI: 0.861-0.971) for the training and testing set, respectively. The combined model DLR nomogram (DLRN) further enhanced the performance, resulting in AUC values of 0.960 (95% CI: 0.940- 0.979) and 0.934 (95% CI: 0.876-0.991) for the training and testing sets, respectively. DCA analysis indicated that DLRN provided greater clinical benefits compared to other models.

Conclusion

DLRN based on US images shows exceptional performance in distinguishing BPGTs and MPGTs, providing more reliable information for personalized diagnosis and treatment plans in clinical practice.

Deep learning-assisted diagnosis of benign and malignant parotid tumors based on ultrasound: a retrospective study

BACKGROUND

To develop a deep learning(DL) model utilizing ultrasound images, and evaluate its efficacy in distinguishing between benign and malignant parotid tumors (PTs), as well as its practicality in assisting clinicians with accurate diagnosis.

METHODS

A total of 2211 ultrasound images of 980 pathologically confirmed PTs (Training set: n = 721; Validation set: n = 82; Internal-test set: n = 89; External-test set: n = 88) from 907 patients were retrospectively included in this study. The optimal model was selected and the diagnostic performance evaluation is conducted by utilizing the area under curve (AUC) of the receiver-operating characteristic(ROC) based on five different DL networks constructed at varying depths. Furthermore, a comparison of different seniority radiologists was made in the presence of the optimal auxiliary diagnosis model. Additionally, the diagnostic confusion matrix of the optimal model was calculated, and an analysis and summary of misjudged cases' characteristics were conducted.

RESULTS

The Resnet18 demonstrated superior diagnostic performance, with an AUC value of 0.947, accuracy of 88.5%, sensitivity of 78.2%, and specificity of 92.7% in internal-test set, and with an AUC value of 0.925, accuracy of 89.8%, sensitivity of 83.3%, and specificity of 90.6% in external-test set. The PTs were subjectively assessed twice by six radiologists, both with and without the assisted of the model. With the assisted of the model, both junior and senior radiologists demonstrated enhanced diagnostic performance. In the internal-test set, there was an increase in AUC values by 0.062 and 0.082 for junior radiologists respectively, while senior radiologists experienced an improvement of 0.066 and 0.106 in their respective AUC values.

CONCLUSIONS

The DL model based on ultrasound images demonstrates exceptional capability in distinguishing between benign and malignant PTs, thereby assisting radiologists of varying expertise levels to achieve heightened diagnostic performance, and serve as a noninvasive imaging adjunct diagnostic method for clinical purposes.

Salivary gland pathologies: evolution in classification and association with unique genetic alterations

PURPOSE

The correct classification of salivary gland pathologies is crucial for choosing a treatment method and determining the prognosis. Better outcomes are now achievable thanks to the introduction of new therapy approaches, such as targeted therapies for malignant salivary gland tumors. To apply these in clinical routine, a clear classification of the lesions is required.

METHODS

The following review examines all changes from the first World Health Organization (WHO) Classification of salivary gland pathologies from 1972 to fifth edition from 2022. Possible developments in the diagnosis and classification of salivary gland pathology are also presented.

RESULTS

The current WHO classification is the fifth edition. With the development of new diagnostic methods, based on genetic alterations, it provides insight into the molecular basis of lesions. This has resulted in the evolution of classification, introduction of new entities and reclassification of existing ones.

CONCLUSIONS

Genetic alterations will become increasingly more significant in the identification of salivary gland pathologies in the future. These alterations will be helpful as prognostic and predictive biomarkers, and may also serve as targets for anti-cancer therapies.

Deep learning-assisted diagnosis of parotid gland tumors by using contrast-enhanced CT imaging

OBJECTIVES

Imaging interpretation of the benignancy or malignancy of parotid gland tumors (PGTs) is a critical consideration prior to surgery in view of therapeutic and prognostic values of such discrimination. This study investigates the application of a deep learning-based method for preoperative stratification of PGTs.

MATERIALS AND METHODS

Using the 3D DenseNet-121 architecture and a dataset consisting of 117 volumetric arterial-phase contrast-enhanced CT scans, we developed a binary classifier for PGT distinction and tested it. We compared the discriminative performance of the model on the test set to that of 12 junior and 12 senior head and neck clinicians. Besides, potential clinical utility of the model was evaluated by measuring changes in unassisted and model-assisted performance of junior clinicians.

RESULTS

The model finally reached the sensitivity, specificity, PPV, NPV, F1-score of 0.955 (95% CI 0.751-0.998), 0.667 (95% CI 0.241-0.940), 0.913 (95% CI 0.705-0.985), 0.800 (95% CI 0.299-0.989) and 0.933, respectively, comparable to that of practicing clinicians. Furthermore, there were statistically significant increases in junior clinicians' specificity, PPV, NPV and F1-score in differentiating benign from malignant PGTs when unassisted and model-assisted performance of junior clinicians were compared.

CONCLUSION

Our results provide evidence that deep learning-based method may offer assistance for PGT's binary distinction.

Tratamiento quirúrgico de la patología tumoral de la glándula parótida. Estudio descriptivo de 263 parotidectomías

Introducción y objetivo: Los tumores salivales representan el 3-10% de los tumores de cabeza y cuello, siendo el 75-80% de origen parotídeo y en su mayoría benignos. La parotidectomía es una técnica quirúrgica que consiste en la exéresis de la glándula parótida. Existen diversos tipos; parotidectomía superficial (PS), parotidectomía superficial parcial (PSP) y parotidectomía total (PT). En esta última, al no respetarse el nervio facial (NF), las complicaciones son más frecuentes. Nuestro objetivo es analizar el resultado (tasa de recidiva y complicaciones) de la parotidectomía como técnica quirúrgica empleada en el manejo de la patología parotídea, así como evaluar qué prueba complementaria es la más eficaz en el diagnostico prequirúrgico de la patología parotídea tumoral. Material y método: Se realiza un estudio retrospectivo incluyendo 263 pacientes tratados mediante PS o PT entre enero de 2004 y diciembre de 2020 en el Hospital Universitario de Fuenlabrada. Se registraron datos demográficos, tiempo de evolución de la lesión, pruebas complementarias, protocolo quirúrgico y complicaciones postoperatorias. Se analiza principalmente la correlación positiva entre las pruebas realizadas prequirúrgicas (PAAF, ecografía, TC y RMN), con el diagnóstico definitivo anatomopatológico obtenido tras examinar la pieza quirúrgica. También se describe la tasa de paresia y parálisis facial y otras complicaciones habidas. Resultados: Se incluyeron 263 pacientes tratados mediante parotidectomía. El tiempo de evolución medio de las lesiones parotídeas fue de 15 meses (DE 19.88). La sensibilidad de la PAAF en nuestro estudio fue de 68.7%. Se realizó ecografía en un 44.10% de los pacientes, TC en un 77.94% y RMN en un 15.20%, mostrando una sensibilidad de 18.05%, 31.21% y 45%, respectivamente. La cirugía más frecuente fue la PS (43.3%, 114/263), seguida por la PSP (41.1%, 108/263) y, por último, la menos habitual fue la PT (15.58%, 41/263). Los tumores benignos fueron más frecuentes (84.79%, 223/263), siendo el adenoma pleomorfo el más frecuente, 45.73% (102/223). Dentro del grupo de tumores malignos (15.20%, 40/263), el más habitual fue el carcinoma mucoepidermoide (17.5%, 7/40) y las metástasis (17.5%, 7/40). La paresia facial, según la escala de House-Brackmann, fue leve (grado I y II) y transitoria en la mayoría de los casos, apareciendo en un 31.55%. Tras un periodo medio de seguimiento de 6 años no se han encontrado recidivas post parotidectomía por ningún tipo tumoral en nuestro estudio. Conclusión: En nuestra muestra, los tumores benignos representaron la gran mayoría de la patología parotídea. Dentro de este grupo, el adenoma pleomorfo fue el más frecuente. La PAAF fue la prueba complementaria con mejor correlación con el diagnostico anatomopatológico definitivo, seguida por la RMN. La paresia facial leve (grados I y II) y transitoria fue la complicación postquirúrgica mas habitual.

Using deep learning to distinguish malignant from benign parotid tumors on plain computed tomography images

Objectives

Evaluating the diagnostic efficiency of deep-learning models to distinguish malignant from benign parotid tumors on plain computed tomography (CT) images.

Materials and methods

The CT images of 283 patients with parotid tumors were enrolled and analyzed retrospectively. Of them, 150 were benign and 133 were malignant according to pathology results. A total of 917 regions of interest of parotid tumors were cropped (456 benign and 461 malignant). Three deep-learning networks (ResNet50, VGG16_bn, and DenseNet169) were used for diagnosis (approximately 3:1 for training and testing). The diagnostic efficiencies (accuracy, sensitivity, specificity, and area under the curve [AUC]) of three networks were calculated and compared based on the 917 images. To simulate the process of human diagnosis, a voting model was developed at the end of the networks and the 283 tumors were classified as benign or malignant. Meanwhile, 917 tumor images were classified by two radiologists (A and B) and original CT images were classified by radiologist B. The diagnostic efficiencies of the three deep-learning network models (after voting) and the two radiologists were calculated.

Results

For the 917 CT images, ResNet50 presented high accuracy and sensitivity for diagnosing malignant parotid tumors; the accuracy, sensitivity, specificity, and AUC were 90.8%, 91.3%, 90.4%, and 0.96, respectively. For the 283 tumors, the accuracy, sensitivity, and specificity of ResNet50 (after voting) were 92.3%, 93.5% and 91.2%, respectively.

Conclusion

ResNet50 presented high sensitivity in distinguishing malignant from benign parotid tumors on plain CT images; this made it a promising auxiliary diagnostic method to screen malignant parotid tumors.