Automatic segmentation of uterine endometrial cancer on multi-sequence MRI using a convolutional neural network

Recent trends in AI applications for pelvic MRI: a comprehensive review

Magnetic resonance imaging (MRI) is an essential tool for evaluating pelvic disorders affecting the prostate, bladder, uterus, ovaries, and/or rectum. Since the diagnostic pathway of pelvic MRI can involve various complex procedures depending on the affected organ, the Reporting and Data System (RADS) is used to standardize image acquisition and interpretation. Artificial intelligence (AI), which encompasses machine learning and deep learning algorithms, has been integrated into both pelvic MRI and the RADS, particularly for prostate MRI. This review outlines recent developments in the use of AI in various stages of the pelvic MRI diagnostic pathway, including image acquisition, image reconstruction, organ and lesion segmentation, lesion detection and classification, and risk stratification, with special emphasis on recent trends in multi-center studies, which can help to improve the generalizability of AI.

A deep learning framework for predicting endometrial cancer from cytopathologic images with different staining styles

Endometrial cancer screening is crucial for clinical treatment. Currently, cytopathologists analyze cytopathology images is considered a popular screening method, but manual diagnosis is time-consuming and laborious. Deep learning can provide objective guidance efficiency. But endometrial cytopathology images often come from different medical centers with different staining styles. It decreases the generalization ability of deep learning models in cytopathology images analysis, leading to poor performance. This study presents a robust automated screening framework for endometrial cancer that can be applied to cytopathology images with different staining styles, and provide an objective diagnostic reference for cytopathologists, thus contributing to clinical treatment. We collected and built the XJTU-EC dataset, the first cytopathology dataset that includes segmentation and classification labels. And we propose an efficient two-stage framework for adapting different staining style images, and screening endometrial cancer at the cellular level. Specifically, in the first stage, a novel CM-UNet is utilized to segment cell clumps, with a channel attention (CA) module and a multi-level semantic supervision (MSS) module. It can ignore staining variance and focus on extracting semantic information for segmentation. In the second stage, we propose a robust and effective classification algorithm based on contrastive learning, ECRNet. By momentum-based updating and adding labeled memory banks, it can reduce most of the false negative results. On the XJTU-EC dataset, CM-UNet achieves an excellent segmentation performance, and ECRNet obtains an accuracy of 98.50%, a precision of 99.32% and a sensitivity of 97.67% on the test set, which outperforms other competitive classical models. Our method robustly predicts endometrial cancer on cytopathologic images with different staining styles, which will further advance research in endometrial cancer screening and provide early diagnosis for patients. The code will be available on GitHub.

Evaluating the quality of radiomics-based studies for endometrial cancer using RQS and METRICS tools

OBJECTIVE

To assess the methodological quality of radiomics-based models in endometrial cancer using the radiomics quality score (RQS) and METhodological radiomICs score (METRICS).

METHODS

We systematically reviewed studies published by October 30th, 2023. Inclusion criteria were original radiomics studies on endometrial cancer using CT, MRI, PET, or ultrasound. Articles underwent a quality assessment by novice and expert radiologists using RQS and METRICS. The inter-rater reliability for RQS and METRICS among radiologists with varying expertise was determined. Subgroup analyses were performed to assess whether scores varied according to study topic, imaging technique, publication year, and journal quartile.

RESULTS

Sixty-eight studies were analysed, with a median RQS of 11 (IQR, 9-14) and METRICS score of 67.6% (IQR, 58.8-76.0); two different articles reached maximum RQS of 19 and METRICS of 90.7%, respectively. Most studies utilised MRI (82.3%) and machine learning methods (88.2%). Characterisation and recurrence risk stratification were the most explored outcomes, featured in 35.3% and 19.1% of articles, respectively. High inter-rater reliability was observed for both RQS (ICC: 0.897; 95% CI: 0.821, 0.946) and METRICS (ICC: 0.959; 95% CI: 0.928, 0.979). Methodological limitations such as lack of external validation suggest areas for improvement. At subgroup analyses, no statistically significant difference was noted.

CONCLUSIONS

Whilst using RQS, the quality of endometrial cancer radiomics research was apparently unsatisfactory, METRICS depicts a good overall quality. Our study highlights the need for strict compliance with quality metrics. Adhering to these quality measures can increase the consistency of radiomics towards clinical application in the pre-operative management of endometrial cancer.

CLINICAL RELEVANCE STATEMENT

Both the RQS and METRICS can function as instrumental tools for identifying different methodological deficiencies in endometrial cancer radiomics research. However, METRICS also reflected a focus on the practical applicability and clarity of documentation.

KEY POINTS

The topic of radiomics currently lacks standardisation, limiting clinical implementation. METRICS scores were generally higher than the RQS, reflecting differences in the development process and methodological content. A positive trend in METRICS score may suggest growing attention to methodological aspects in radiomics research.

Clinical Utility of Diffusion-Weighted Imaging in Gynecological Imaging: Revisited

ABSTRACT

Diffusion-weighted imaging (DWI) is an increasingly valuable sequence in daily clinical practice, providing both functional and morphological information. The use of DWI can help quantify diffusion using the apparent diffusion coefficient, which reflects the physiological features of the tissue and tumor microcirculation. This knowledge is crucial for understanding and interpreting gynecological imaging. This article reviews the clinical utility of DWI for gynecological imaging, highlighting its ability to aid in the detection of endometrial and cervical cancers, as well as tumor extension and metastasis. In addition, DWI can easily detect the solid components of ovarian cancer (including dissemination), assist in the diagnosis of adnexal torsion, and potentially show bone marrow status. Apparent diffusion coefficient measurement is useful for differentiating between endometrial lesions, uterine leiomyomas, and sarcomas, and may provide important information for predicting the prognosis of gynecological cancers.

Artificial Intelligence and Radiomics for Endometrial Cancer MRI: Exploring the Whats, Whys and Hows

Endometrial cancer (EC) is intricately linked to obesity and diabetes, which are widespread risk factors. Medical imaging, especially magnetic resonance imaging (MRI), plays a major role in EC assessment, particularly for disease staging. However, the diagnostic performance of MRI exhibits variability in the detection of clinically relevant prognostic factors (e.g., deep myometrial invasion and metastatic lymph nodes assessment). To address these challenges and enhance the value of MRI, radiomics and artificial intelligence (AI) algorithms emerge as promising tools with a potential to impact EC risk assessment, treatment planning, and prognosis prediction. These advanced post-processing techniques allow us to quantitatively analyse medical images, providing novel insights into cancer characteristics beyond conventional qualitative image evaluation. However, despite the growing interest and research efforts, the integration of radiomics and AI to EC management is still far from clinical practice and represents a possible perspective rather than an actual reality. This review focuses on the state of radiomics and AI in EC MRI, emphasizing risk stratification and prognostic factor prediction, aiming to illuminate potential advancements and address existing challenges in the field.

Preoperative Imaging Evaluation of Endometrial Cancer in FIGO 2023

The staging of endometrial cancer is based on the International Federation of Gynecology and Obstetrics (FIGO) staging system according to the examination of surgical specimens, and has revised in 2023, 14 years after its last revision in 2009. Molecular and histological classification has incorporated to new FIGO system reflecting the biological behavior and prognosis of endometrial cancer. Nonetheless, the basic role of imaging modalities including ultrasound, computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography, as a preoperative assessment of the tumor extension and also the evaluation points in CT and MRI imaging are not changed, other than several point of local tumor extension. In the field of radiology, it has also undergone remarkable advancement through the rapid progress of computational technology. The application of deep learning reconstruction techniques contributes the benefits of shorter acquisition time or higher quality. Radiomics, which extract various quantitative features from the images, is also expected to have the potential for the quantitative prediction of risk factors such as histological types and lymphovascular space invasion, which is newly included in the new FIGO system. This article reviews the preoperative imaging diagnosis in new FIGO system and recent advances in imaging analysis and their clinical contributions in endometrial cancer. EVIDENCE LEVEL: 4 TECHNICAL EFFICACY: Stage 3.

Multi-parametric MRI-based radiomics for preoperative prediction of multiple biological characteristics in endometrial cancer

Purpose

To develop and validate multi-parametric MRI (MP-MRI)-based radiomics models for the prediction of biological characteristics in endometrial cancer (EC).

Methods

A total of 292 patients with EC were divided into LVSI (n = 208), DMI (n = 292), MSI (n = 95), and Her-2 (n = 198) subsets. Total 2316 radiomics features were extracted from MP-MRI (T2WI, DWI, and ADC) images, and clinical factors (age, FIGO stage, differentiation degree, pathological type, menopausal state, and irregular vaginal bleeding) were included. Intra-class correlation coefficient (ICC), spearman's rank correlation test, univariate logistic regression, and least absolute shrinkage and selection operator (LASSO) were used to select radiomics features; univariate and multivariate logistic regression were used to identify clinical independent risk factors. Five classifiers were applied (logistic regression, random forest, decision tree, K-nearest neighbor, and Bayes) to construct radiomics models for predicting biological characteristics. The clinical model was built based on the clinical independent risk factors. The combined model incorporating the radiomics score (radscore) and the clinical independent risk factors was constructed. The model was evaluated by ROC curve, calibration curve (H-L test), and decision curve analysis (DCA).

Results

In the training cohort, the RF radiomics model performed best among the five classifiers for the three subsets (MSI, LVSI, and DMI) according to AUC values (AUCMSI: 0.844; AUCLVSI: 0.952; AUCDMI: 0.840) except for Her-2 subset (Decision tree: AUC=0.714), and the combined model had higher AUC than the clinical model in each subset (MSI: AUCcombined =0.907, AUCclinical =0.755; LVSI: AUCcombined =0.959, AUCclinical =0.835; DMI: AUCcombined = 0.883, AUCclinical =0.796; Her-2: AUCcombined =0.812, AUCclinical =0.717; all P<0.05). Nevertheless, in the validation cohort, significant differences between the two models (combined vs. clinical model) were found only in the DMI and LVSI subsets (DMI: AUCcombined =0.803, AUCclinical =0.698; LVSI: AUCcombined =0.926, AUCclinical =0.796; all P<0.05).

Conclusion

The radiomics analysis based on MP-MRI and clinical independent risk factors can potentially predict multiple biological features of EC, including DMI, LVSI, MSI, and Her-2, and provide valuable guidance for clinical decision-making.

Weakly supervised segmentation of uterus by scribble labeling on endometrial cancer MR images

Uterine segmentation of endometrial cancer MR images can be a valuable diagnostic tool for gynecologists. However, uterine segmentation based on deep learning relies on artificial pixel-level annotation, which is time-consuming, laborious and subjective. To reduce the dependence on pixel-level annotation, a method of weakly supervised uterine segmentation on endometrial cancer MRI slices is proposed, which only requires scribble label and is enhanced by pseudo-label technology, exponential geodesic distance loss and input disturbance strategy. Specifically, the limitations caused by the shortage of supervision are addressed by dynamically mixing the two outputs of the dual branch network to generate pseudo-labels, expanding supervision information and promoting mutual supervision training. On the other hand, considering the large difference of grayscale intensity between the uterus and surrounding tissues, the exponential geodesic distance loss is introduced to enhance the ability of the network to capture the edge of the uterus. Input disturbance strategies are incorporated to adapt to the flexible and variable characteristics of the uterus and further improve the segmentation performance of the network. The proposed method is evaluated on MRI images from 135 cases of endometrial cancer. Compared with other four weakly supervised segmentation methods, the performance of the proposed method is the best, whose mean DI, HD95, Recall, Precision, ADP are 92.8%, 11.632, 92.7%, 93.6%, 6.5% and increasing by 2.1%, 9.144, 0.6%, 2.4%, 2.9% respectively. The experimental results demonstrate that the proposed method is more effective than other weakly supervised methods and achieves similar performance as those fully supervised.

Advances in Radiomics Research for Endometrial Cancer: A Comprehensive Review

Endometrial cancer (EC) is a common gynecologic malignancy, with a rising trend in related mortality rates. The assessment based on imaging examinations contributes to the preoperative staging and surgical management of EC. However, conventional imaging diagnosis has limitations such as low accuracy and subjectivity. Radiomics, utilizing advanced feature analysis from medical images, extracts more information, ultimately establishing associations between imaging features and disease phenotypes. In recent years, radiomic studies on EC have emerged, employing radiomic features combined with clinical characteristics to model and predict histopathological features, protein expression, and clinical prognosis. This article elaborates on the application of radiomics in EC research and discusses its implications.

Developing and Evaluating Deep Learning Algorithms for Object Detection: Key Points for Achieving Superior Model Performance

In recent years, artificial intelligence, especially object detection-based deep learning in computer vision, has made significant advancements, driven by the development of computing power and the widespread use of graphic processor units. Object detection-based deep learning techniques have been applied in various fields, including the medical imaging domain, where remarkable achievements have been reported in disease detection. However, the application of deep learning does not always guarantee satisfactory performance, and researchers have been employing trial-and-error to identify the factors contributing to performance degradation and enhance their models. Moreover, due to the black-box problem, the intermediate processes of a deep learning network cannot be comprehended by humans; as a result, identifying problems in a deep learning model that exhibits poor performance can be challenging. This article highlights potential issues that may cause performance degradation at each deep learning step in the medical imaging domain and discusses factors that must be considered to improve the performance of deep learning models. Researchers who wish to begin deep learning research can reduce the required amount of trial-and-error by understanding the issues discussed in this study.

Automated Detection of Endometrial Polyps from Hysteroscopic Videos Using Deep Learning

Endometrial polyps are common gynecological lesions. The standard treatment for this condition is hysteroscopic polypectomy. However, this procedure may be accompanied by misdetection of endometrial polyps. To improve the diagnostic accuracy and reduce the risk of misdetection, a deep learning model based on YOLOX is proposed to detect endometrial polyps in real time. Group normalization is employed to improve its performance with large hysteroscopic images. In addition, we propose a video adjacent-frame association algorithm to address the problem of unstable polyp detection. Our proposed model was trained on a dataset of 11,839 images from 323 cases provided by a hospital and was tested on two datasets of 431 cases from two hospitals. The results show that the lesion-based sensitivity of the model reached 100% and 92.0% for the two test sets, compared with 95.83% and 77.33%, respectively, for the original YOLOX model. This demonstrates that the improved model may be used effectively as a diagnostic tool during clinical hysteroscopic procedures to reduce the risk of missing endometrial polyps.

Dual deterministic model based on deep neural network for the classification of pneumonia

Pneumonia is a disease caused by the virus (flu, respiratory Syncytial Virus) or bacteria. It can be fatal if not diagnosed and treated at an early stage. Chest X-rays have been widely utilized to diagnose such abnormalities with high exactitude and are primarily responsible for the augment real-world diagnosis process. Poor availability of authentic data and yardstick-based approaches and studies complicates the comparison process and identifying the safest recognition method. In this paper, a Dual Deterministic Model (DD-M) is proposed based on a Deep Neural network that would identify Pneumonia from chest X-ray and distinguish the cause in case of either viral or bacterial infection at an efficiency equivalent of an active radiologist. To accomplish the automated task of the proposed algorithm, an automatic computer-aided system is necessary. The proposed algorithm incorporates deep learning techniques to understand radiographic imaging better. The results were evaluated after implementing the proposed algorithm where; it reveals various aspects of the chest infected with Pneumonia compared to the healthy individual with approximately 97.45% accuracy and distinguishes between the viral and bacterial infection with the efficiency of 88.41%. The proposed algorithm with an improved image dataset will help the doctors diagnose.

Generalizable transfer learning of automated tumor segmentation from cervical cancers toward a universal model for uterine malignancies in diffusion-weighted MRI

PURPOSE

To investigate the generalizability of transfer learning (TL) of automated tumor segmentation from cervical cancers toward a universal model for cervical and uterine malignancies in diffusion-weighted magnetic resonance imaging (DWI).

METHODS

In this retrospective multicenter study, we analyzed pelvic DWI data from 169 and 320 patients with cervical and uterine malignancies and divided them into the training (144 and 256) and testing (25 and 64) datasets, respectively. A pretrained model was established using DeepLab V3 + from the cervical cancer dataset, followed by TL experiments adjusting the training data sizes and fine-tuning layers. The model performance was evaluated using the dice similarity coefficient (DSC).

RESULTS

In predicting tumor segmentation for all cervical and uterine malignancies, TL models improved the DSCs from the pretrained cervical model (DSC 0.43) when adding 5, 13, 26, and 51 uterine cases for training (DSC improved from 0.57, 0.62, 0.68, 0.70, p < 0.001). Following the crossover at adding 128 cases (DSC 0.71), the model trained by combining data from adding all the 256 patients exhibited the highest DSCs for the combined cervical and uterine datasets (DSC 0.81) and cervical only dataset (DSC 0.91).

CONCLUSIONS

TL may improve the generalizability of automated tumor segmentation of DWI from a specific cancer type toward multiple types of uterine malignancies especially in limited case numbers.

Automatic segmentation of bladder cancer on MRI using a convolutional neural network and reproducibility of radiomics features: a two-center study

This study aimed to develop a versatile automatic segmentation model of bladder cancer (BC) on MRI using a convolutional neural network and investigate the robustness of radiomics features automatically extracted from apparent diffusion coefficient (ADC) maps. This two-center retrospective study used multi-vendor MR units and included 170 patients with BC, of whom 140 were assigned to training datasets for the modified U-net model with five-fold cross-validation and 30 to test datasets for assessment of segmentation performance and reproducibility of automatically extracted radiomics features. For model input data, diffusion-weighted images with b = 0 and 1000 s/mm², ADC maps, and multi-sequence images (b0-b1000-ADC maps) were used. Segmentation accuracy was compared between ours and existing models. The reproducibility of radiomics features on ADC maps was evaluated using intraclass correlation coefficient. The model with multi-sequence images achieved the highest Dice similarity coefficient (DSC) with five-fold cross-validation (mean DSC = 0.83 and 0.79 for the training and validation datasets, respectively). The median (interquartile range) DSC of the test dataset model was 0.81 (0.70-0.88). Radiomics features extracted from manually and automatically segmented BC exhibited good reproducibility. Thus, our U-net model performed highly accurate segmentation of BC, and radiomics features extracted from the automatic segmentation results exhibited high reproducibility.

Preoperative Tumor Texture Analysis on MRI for High-Risk Disease Prediction in Endometrial Cancer: A Hypothesis-Generating Study

OBJECTIVE

To develop and validate magnetic resonance (MR) imaging-based radiomics models for high-risk endometrial cancer (EC) prediction preoperatively, to be able to estimate deep myometrial invasion (DMI) and lymphovascular space invasion (LVSI), and to discriminate between low-risk and other categories of risk as proposed by ESGO/ESTRO/ESP (European Society of Gynaecological Oncology-European Society for Radiotherapy & Oncology and European Society of Pathology) guidelines.

METHODS

This retrospective study included 96 women with EC who underwent 1.5-T MR imaging before surgical staging between April 2009 and May 2019 in two referral centers divided into training (T = 73) and validation cohorts (V = 23). Radiomics features were extracted using the MODDICOM library with manual delineation of whole-tumor volume on MR images (axial T2-weighted). Diagnostic performances of radiomic models were evaluated by area under the receiver operating characteristic (ROC) curve in training (AUCT) and validation (AUCV) cohorts by using a subset of the most relevant texture features tested individually in univariate analysis using Wilcoxon-Mann-Whitney.

RESULTS

A total of 228 radiomics features were extracted and ultimately limited to 38 for DMI, 29 for LVSI, and 15 for risk-classes prediction for logistic radiomic modeling. Whole-tumor radiomic models yielded an AUCT/AUCV of 0.85/0.68 in DMI estimation, 0.92/0.81 in LVSI prediction, and 0.84/0.76 for differentiating low-risk vs other risk classes (intermediate/high-intermediate/high).

CONCLUSION

MRI-based radiomics has great potential in developing advanced prognostication in EC.

Fully Automatic Whole-Volume Tumor Segmentation in Cervical Cancer

Simple Summary

Uterine cervical cancer (CC) is a leading cause of cancer-related deaths in women worldwide. Pelvic magnetic resonance imaging (MRI) allows the assessment of local tumor extent and guides the choice of primary treatment. MRI tumor segmentation enables whole-volume radiomic tumor profiling, which is potentially useful for prognostication and individualization of therapy in CC. Manual tumor segmentation is, however, labor intensive and thus not part of routine clinical workflow. In the current work, we trained a deep learning (DL) algorithm to automatically segment the primary tumor in CC patients. Although the achieved segmentation performance of the trained DL algorithm is slightly lower than that for human experts, it is still relatively good. This study suggests that automated MRI primary tumor segmentations by DL algorithms without any human interaction is possible in patients with CC.

Abstract

Uterine cervical cancer (CC) is the most common gynecologic malignancy worldwide. Whole-volume radiomic profiling from pelvic MRI may yield prognostic markers for tailoring treatment in CC. However, radiomic profiling relies on manual tumor segmentation which is unfeasible in the clinic. We present a fully automatic method for the 3D segmentation of primary CC lesions using state-of-the-art deep learning (DL) techniques. In 131 CC patients, the primary tumor was manually segmented on T2-weighted MRI by two radiologists (R1, R2). Patients were separated into a train/validation (n = 105) and a test- (n = 26) cohort. The segmentation performance of the DL algorithm compared with R1/R2 was assessed with Dice coefficients (DSCs) and Hausdorff distances (HDs) in the test cohort. The trained DL network retrieved whole-volume tumor segmentations yielding median DSCs of 0.60 and 0.58 for DL compared with R1 (DL-R1) and R2 (DL-R2), respectively, whereas DSC for R1-R2 was 0.78. Agreement for primary tumor volumes was excellent between raters (R1-R2: intraclass correlation coefficient (ICC) = 0.93), but lower for the DL algorithm and the raters (DL-R1: ICC = 0.43; DL-R2: ICC = 0.44). The developed DL algorithm enables the automated estimation of tumor size and primary CC tumor segmentation. However, segmentation agreement between raters is better than that between DL algorithm and raters.

The stability of oncologic MRI radiomic features and the potential role of deep learning: a review

The use of MRI radiomic models for the diagnosis, prognosis and treatment response prediction of tumors has been increasingly reported in literature. However, its widespread adoption in clinics is hampered by issues related to features stability. In the MRI radiomic workflow, the main factors that affect radiomic features computation can be found in the image acquisition and reconstruction phase, in the image pre-processing steps, and in the segmentation of the region of interest on which radiomic indices are extracted. Deep Neural Networks (DNNs), having shown their potentiality in the medical image processing and analysis field, can be seen as an attractive strategy to partially overcome the issues related to radiomic stability and mitigate their impact. In fact, DNN approaches can be prospectively integrated in the MRI radiomic workflow to improve image quality, obtain accurate and reproducible segmentations and generate standardized images. In this review, DNN methods that can be included in the image processing steps of the radiomic workflow are described and discussed, in the light of a detailed analysis of the literature in the context of MRI radiomic reliability.

The Effects of Automatic Segmentations on Preoperative Lymph Node Status Prediction Models With Ultrasound Radiomics for Patients With Early Stage Cervical Cancer

Introduction: The purpose of this study is to investigate the effects of automatic segmentation algorithms on the performance of ultrasound (US) radiomics models in predicting the status of lymph node metastasis (LNM) for patients with early stage cervical cancer preoperatively. Methods: US images of 148 cervical cancer patients were collected and manually contoured by two senior radiologists. The four deep learning-based automatic segmentation models, namely U-net, context encoder network (CE-net), Resnet, and attention U-net were constructed to segment the tumor volumes automatically. Radiomics features were extracted and selected from manual and automatically segmented regions of interest (ROIs) to predict the LNM of these cervical cancer patients preoperatively. The reliability and reproducibility of radiomics features and the performances of prediction models were evaluated. Results: A total of 449 radiomics features were extracted from manual and automatic segmented ROIs with Pyradiomics. Features with an intraclass coefficient (ICC) > 0.9 were all 257 (57.2%) from manual and automatic segmented contours. The area under the curve (AUCs) of validation models with radiomics features extracted from manual, attention U-net, CE-net, Resnet, and U-net were 0.692, 0.755, 0.696, 0.689, and 0.710, respectively. Attention U-net showed best performance in the LNM prediction model with a lowest discrepancy between training and validation. The AUCs of models with automatic segmentation features from attention U-net, CE-net, Resnet, and U-net were 9.11%, 0.58%, -0.44%, and 2.61% higher than AUC of model with manual contoured features, respectively. Conclusion: The reliability and reproducibility of radiomics features, as well as the performance of radiomics models, were affected by manual segmentation and automatic segmentations.