Differentiation Between Lipomas and Atypical Lipomatous Tumors of the Extremities Using Radiomics

Effects of Interobserver Segmentation Variability and Intensity Discretization on MRI-Based Radiomic Feature Reproducibility of Lipoma and Atypical Lipomatous Tumor

Segmentation and image intensity discretization impact on radiomics workflow. The aim of this study is to investigate the influence of interobserver segmentation variability and intensity discretization methods on the reproducibility of MRI-based radiomic features in lipoma and atypical lipomatous tumor (ALT). Thirty patients with lipoma or ALT were retrospectively included. Three readers independently performed manual contour-focused segmentation on T1-weighted and T2-weighted sequences, including the whole tumor volume. Additionally, a marginal erosion was applied to segmentations to evaluate its influence on feature reproducibility. After image pre-processing, with included intensity discretization employing both fixed bin number and width approaches, 1106 radiomic features were extracted from each sequence. Intraclass correlation coefficient (ICC) 95% confidence interval lower bound ≥ 0.75 defined feature stability. In contour-focused vs. margin shrinkage segmentation, the rates of stable features extracted from T1-weighted and T2-weighted images ranged from 92.68 to 95.21% vs. 90.69 to 95.66% after fixed bin number discretization and from 95.75 to 97.65% vs. 95.39 to 96.47% after fixed bin width discretization, respectively, with no difference between the two segmentation approaches (p ≥ 0.175). Higher stable feature rates and higher feature ICC values were found when implementing discretization with fixed bin width compared to fixed bin number, regardless of the segmentation approach (p < 0.001). In conclusion, MRI radiomic features of lipoma and ALT are reproducible regardless of the segmentation approach and intensity discretization method, although a certain degree of interobserver variability highlights the need for a preliminary reliability analysis in future studies.

Radiomics in Diagnosis, Grading, and Treatment Response Assessment of Soft Tissue Sarcomas: A Systematic Review and Meta-analysis

RATIONALE AND OBJECTIVES

To evaluate radiomics in soft tissue sarcomas (STSs) for diagnostic accuracy, grading, and treatment response assessment, with a focus on clinical relevance.

METHODS

In this diagnostic accuracy study, radiomics was applied using multiple MRI sequences and AI classifiers, with histopathological diagnosis as the reference standard. Statistical analysis involved meta-analysis, random-effects model, and Deeks' funnel plot asymmetry test.

RESULTS

Among 579 unique titles and abstracts, 24 articles were included in the systematic review, with 21 used for meta-analysis. Radiomics demonstrated a pooled sensitivity of 84% (95% CI: 80-87) and specificity of 63% (95% CI: 56-70), AUC of 0.93 for diagnosis, sensitivity of 84% (95% CI: 82-87) and specificity of 73% (95% CI: 68-77), AUC of 0.91 for grading, and sensitivity of 83% (95% CI: 67-94) and specificity of 67% (95% CI: 59-74), AUC of 0.87 for treatment response assessment.

CONCLUSION

Radiomics exhibits potential for accurate diagnosis, grading, and treatment response assessment in STSs, emphasizing the need for standardization and prospective trials.

CLINICAL RELEVANCE STATEMENT

Radiomics offers precise tools for STS diagnosis, grading, and treatment response assessment, with implications for optimizing patient care and treatment strategies in this complex malignancy.

Diagnostic Performance of Radiomics and Deep Learning to Identify Benign and Malignant Soft Tissue Tumors: A Systematic Review and Meta-analysis

RATIONALE AND OBJECTIVES

To systematically evaluate the application value of radiomics and deep learning (DL) in the differential diagnosis of benign and malignant soft tissue tumors (STTs).

MATERIALS AND METHODS

A systematic review was conducted on studies published up to December 11, 2023, that utilized radiomics and DL methods for the diagnosis of STTs. The methodological quality and risk of bias were evaluated using the Radiomics Quality Score (RQS) 2.0 system and Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool, respectively. A bivariate random-effects model was used to calculate the summarized sensitivity and specificity. To identify factors contributing to heterogeneity, meta-regression and subgroup analyses were performed to assess the following covariates: diagnostic modality, region/volume of interest, imaging examination, study design, and pathology type. The asymmetry of Deeks' funnel plot was used to assess publication bias.

RESULTS

A total of 21 studies involving 3866 patients were included, with 13 studies using independent test/validation sets included in the quantitative statistical analysis. The average RQS was 21.31, with substantial or near-perfect inter-rater agreement. The combined sensitivity and specificity were 0.84 (95% CI: 0.76-0.89) and 0.88 (95% CI: 0.69-0.96), respectively. Meta-regression and subgroup analyses showed that study design and the region/volume of interest were significant factors affecting study heterogeneity (P < 0.05). No publication bias was observed.

CONCLUSION

Radiomics and DL can accurately distinguish between benign and malignant STTs. Future research should concentrate on enhancing the rigor of study designs, conducting multicenter prospective validations, amplifying the interpretability of DL models, and integrating multimodal data to elevate the diagnostic accuracy and clinical utility of soft tissue tumor assessments.

CT and MRI radiomics of bone and soft-tissue sarcomas: an updated systematic review of reproducibility and validation strategies

OBJECTIVE

To systematically review radiomic feature reproducibility and model validation strategies in recent studies dealing with CT and MRI radiomics of bone and soft-tissue sarcomas, thus updating a previous version of this review which included studies published up to 2020.

METHODS

A literature search was conducted on EMBASE and PubMed databases for papers published between January 2021 and March 2023. Data regarding radiomic feature reproducibility and model validation strategies were extracted and analyzed.

RESULTS

Out of 201 identified papers, 55 were included. They dealt with radiomics of bone (n = 23) or soft-tissue (n = 32) tumors. Thirty-two (out of 54 employing manual or semiautomatic segmentation, 59%) studies included a feature reproducibility analysis. Reproducibility was assessed based on intra/interobserver segmentation variability in 30 (55%) and geometrical transformations of the region of interest in 2 (4%) studies. At least one machine learning validation technique was used for model development in 34 (62%) papers, and K-fold cross-validation was employed most frequently. A clinical validation of the model was reported in 38 (69%) papers. It was performed using a separate dataset from the primary institution (internal test) in 22 (40%), an independent dataset from another institution (external test) in 14 (25%) and both in 2 (4%) studies.

CONCLUSIONS

Compared to papers published up to 2020, a clear improvement was noted with almost double publications reporting methodological aspects related to reproducibility and validation. Larger multicenter investigations including external clinical validation and the publication of databases in open-access repositories could further improve methodology and bring radiomics from a research area to the clinical stage.

CRITICAL RELEVANCE STATEMENT

An improvement in feature reproducibility and model validation strategies has been shown in this updated systematic review on radiomics of bone and soft-tissue sarcomas, highlighting efforts to enhance methodology and bring radiomics from a research area to the clinical stage.

KEY POINTS

• 2021-2023 radiomic studies on CT and MRI of musculoskeletal sarcomas were reviewed. • Feature reproducibility was assessed in more than half (59%) of the studies. • Model clinical validation was performed in 69% of the studies. • Internal (44%) and/or external (29%) test datasets were employed for clinical validation.

Radiomics and artificial intelligence for soft-tissue sarcomas: Current status and perspectives

This article proposes a summary of the current status of the research regarding the use of radiomics and artificial intelligence to improve the radiological assessment of patients with soft tissue sarcomas (STS), a heterogeneous group of rare and ubiquitous mesenchymal malignancies. After a first part explaining the principle of radiomics approaches, from raw image post-processing to extraction of radiomics features mined with unsupervised and supervised machine-learning algorithms, and the current research involving deep learning algorithms in STS, especially convolutional neural networks, this review details their main research developments since the formalisation of 'radiomics' in oncologic imaging in 2010. This review focuses on CT and MRI and does not involve ultrasonography. Radiomics and deep radiomics have been successfully applied to develop predictive models to discriminate between benign soft-tissue tumors and STS, to predict the histologic grade (i.e., the most important prognostic marker of STS), the response to neoadjuvant chemotherapy and/or radiotherapy, and the patients' survivals and probability for presenting distant metastases. The main findings, limitations and expectations are discussed for each of these outcomes. Overall, after a first decade of publications emphasizing the potential of radiomics through retrospective proof-of-concept studies, almost all positive but with heterogeneous and often non-replicable methods, radiomics is now at a turning point in order to provide robust demonstrations of its clinical impact through open-science, independent databases, and application of good and standardized practices in radiomics such as those provided by the Image Biomarker Standardization Initiative, without forgetting innovative research paths involving other '-omics' data to better understand the relationships between imaging of STS, gene-expression profiles and tumor microenvironment.

Increasing differential diagnosis between lipoma and liposarcoma through radiomics: a narrative review

Soft tissue sarcomas (STSs) are rare, heterogeneous, and very often asymptomatic diseases. Their diagnosis is fundamental, as is the identification of the degree of malignancy, which may be high, medium, or low. The Italian Medical Oncology Association and European Society of Medical Oncology (ESMO) guidelines recommend magnetic resonance imaging (MRI) because the clinical examination is typically ineffective. The diagnosis of these rare diseases with artificial intelligence (AI) techniques presents reduced datasets and therefore less robust methods. However, the combination of AI techniques with radiomics may be a new angle in diagnosing rare diseases such as STSs. Results obtained are promising within the literature, not only for the performance but also for the explicability of the data. In fact, one can make tumor classification, site localization, and prediction of the risk of developing metastasis. Thanks to the synergy between computer scientists and radiologists, linking numerical features to radiological evidence with excellent performance could be a new step forward for the diagnosis of rare diseases.

MRI radiomics-based machine learning for classification of deep-seated lipoma and atypical lipomatous tumor of the extremities

PURPOSE

To determine diagnostic performance of MRI radiomics-based machine learning for classification of deep-seated lipoma and atypical lipomatous tumor (ALT) of the extremities.

MATERIAL AND METHODS

This retrospective study was performed at three tertiary sarcoma centers and included 150 patients with surgically treated and histology-proven lesions. The training-validation cohort consisted of 114 patients from centers 1 and 2 (n = 64 lipoma, n = 50 ALT). The external test cohort consisted of 36 patients from center 3 (n = 24 lipoma, n = 12 ALT). 3D segmentation was manually performed on T1- and T2-weighted MRI. After extraction and selection of radiomic features, three machine learning classifiers were trained and validated using nested fivefold cross-validation. The best-performing classifier according to previous analysis was evaluated and compared to an experienced musculoskeletal radiologist in the external test cohort.

RESULTS

Eight features passed feature selection and were incorporated into the machine learning models. After training and validation (74% ROC-AUC), the best-performing classifier (Random Forest) showed 92% sensitivity and 33% specificity in the external test cohort with no statistical difference compared to the radiologist (p = 0.474).

CONCLUSION

MRI radiomics-based machine learning may classify deep-seated lipoma and ALT of the extremities with high sensitivity and negative predictive value, thus potentially serving as a non-invasive screening tool to reduce unnecessary referral to tertiary tumor centers.

AI-Based Automated Lipomatous Tumor Segmentation in MR Images: Ensemble Solution to Heterogeneous Data

Deep learning (DL) has been proposed to automate image segmentation and provide accuracy, consistency, and efficiency. Accurate segmentation of lipomatous tumors (LTs) is critical for correct tumor radiomics analysis and localization. The major challenge of this task is data heterogeneity, including tumor morphological characteristics and multicenter scanning protocols. To mitigate the issue, we aimed to develop a DL-based Super Learner (SL) ensemble framework with different data correction and normalization methods. Pathologically proven LTs on pre-operative T1-weighted/proton-density MR images of 185 patients were manually segmented. The LTs were categorized by tumor locations as distal upper limb (DUL), distal lower limb (DLL), proximal upper limb (PUL), proximal lower limb (PLL), or Trunk (T) and grouped by 80%/9%/11% for training, validation and testing. Six configurations of correction/normalization were applied to data for fivefold-cross-validation trainings, resulting in 30 base learners (BLs). A SL was obtained from the BLs by optimizing SL weights. The performance was evaluated by dice-similarity-coefficient (DSC), sensitivity, specificity, and Hausdorff distance (HD95). For predictions of the BLs, the average DSC, sensitivity, and specificity from the testing data were 0.72 [Formula: see text] 0.16, 0.73 [Formula: see text] 0.168, and 0.99 [Formula: see text] 0.012, respectively, while for SL predictions were 0.80 [Formula: see text] 0.184, 0.78 [Formula: see text] 0.193, and 1.00 [Formula: see text] 0.010. The average HD95 of the BLs were 11.5 (DUL), 23.2 (DLL), 25.9 (PUL), 32.1 (PLL), and 47.9 (T) mm, whereas of SL were 1.7, 8.4, 15.9, 2.2, and 36.6 mm, respectively. The proposed method could improve the segmentation accuracy and mitigate the performance instability and data heterogeneity aiding the differential diagnosis of LTs in real clinical situations.

Tumor-to-bone distance and radiomic features on MRI distinguish intramuscular lipomas from well-differentiated liposarcomas

Background

To develop a machine learning model based on tumor-to-bone distance and radiomic features derived from preoperative MRI images to distinguish intramuscular (IM) lipomas and atypical lipomatous tumors/well-differentiated liposarcomas (ALTs/WDLSs) and compared with radiologists.

Methods

The study included patients with IM lipomas and ALTs/WDLSs diagnosed between 2010 and 2022, and with MRI scans (sequence/field strength: T1-weighted (T1W) imaging at 1.5 or 3.0 Tesla MRI). Manual segmentation of tumors based on the three-dimensional T1W images was performed by two observers to appraise the intra- and interobserver variability. After radiomic features and tumor-to-bone distance were extracted, it was used to train a machine learning model to distinguish IM lipomas and ALTs/WDLSs. Both feature selection and classification steps were performed using Least Absolute Shrinkage and Selection Operator logistic regression. The performance of the classification model was assessed using a tenfold cross-validation strategy and subsequently evaluated using the receiver operating characteristic curve (ROC) analysis. The classification agreement of two experienced musculoskeletal (MSK) radiologists was assessed using the kappa statistics. The diagnosis accuracy of each radiologist was evaluated using the final pathological results as the gold standard. Additionally, we compared the performance of the model and two radiologists in terms of the area under the receiver operator characteristic curves (AUCs) using the Delong’s test.

Results

There were 68 tumors (38 IM lipomas and 30 ALTs/WDLSs). The AUC of the machine learning model was 0.88 [95% CI 0.72–1] (sensitivity, 91.6%; specificity, 85.7%; and accuracy, 89.0%). For Radiologist 1, the AUC was 0.94 [95% CI 0.87–1] (sensitivity, 97.4%; specificity, 90.9%; and accuracy, 95.0%), and as to Radiologist 2, the AUC was 0.91 [95% CI 0.83–0.99] (sensitivity, 100%; specificity, 81.8%; and accuracy, 93.3%). The classification agreement of the radiologists was 0.89 of kappa value (95% CI 0.76–1). Although the AUC of the model was lower than of two experienced MSK radiologists, there was no statistically significant difference between the model and two radiologists (all P > 0.05).

Conclusions

The novel machine learning model based on tumor-to-bone distance and radiomic features is a noninvasive procedure that has the potential for distinguishing IM lipomas from ALTs/WDLSs. The predictive features that suggested malignancy were size, shape, depth, texture, histogram, and tumor-to-bone distance.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13018-023-03718-4.

Robustness of Radiomic Features: Two-Dimensional versus Three-Dimensional MRI-Based Feature Reproducibility in Lipomatous Soft-Tissue Tumors

This retrospective study aimed to compare the intra- and inter-observer manual-segmentation variability in the feature reproducibility between two-dimensional (2D) and three-dimensional (3D) magnetic-resonance imaging (MRI)-based radiomic features. The study included patients with lipomatous soft-tissue tumors that were diagnosed with histopathology and underwent MRI scans. Tumor segmentation based on the 2D and 3D MRI images was performed by two observers to assess the intra- and inter-observer variability. In both the 2D and the 3D segmentations, the radiomic features were extracted from the normalized images. Regarding the stability of the features, the intraclass correlation coefficient (ICC) was used to evaluate the intra- and inter-observer segmentation variability. Features with ICC > 0.75 were considered reproducible. The degree of feature robustness was classified as low, moderate, or high. Additionally, we compared the efficacy of 2D and 3D contour-focused segmentation in terms of the effects of the stable feature rate, sensitivity, specificity, and diagnostic accuracy of machine learning on the reproducible features. In total, 93 and 107 features were extracted from the 2D and 3D images, respectively. Only 35 features from the 2D images and 63 features from the 3D images were reproducible. The stable feature rate for the 3D segmentation was more significant than for the 2D segmentation (58.9% vs. 37.6%, p = 0.002). The majority of the features for the 3D segmentation had moderate-to-high robustness, while 40.9% of the features for the 2D segmentation had low robustness. The diagnostic accuracy of the machine-learning model for the 2D segmentation was close to that for the 3D segmentation (88% vs. 90%). In both the 2D and the 3D segmentation, the specificity values were equal to 100%. However, the sensitivity for the 2D segmentation was lower than for the 3D segmentation (75% vs. 83%). For the 2D + 3D radiomic features, the model achieved a diagnostic accuracy of 87% (sensitivity, 100%, and specificity, 80%). Both 2D and 3D MRI-based radiomic features of lipomatous soft-tissue tumors are reproducible. With a higher stable feature rate, 3D contour-focused segmentation should be selected for the feature-extraction process.

Radiomics-based approaches outperform visual analysis for differentiating lipoma from atypical lipomatous tumors: a review

BACKGROUND

Differentiating atypical lipomatous tumors (ALTs) and well-differentiated liposarcomas (WDLs) from benign lipomatous lesions is important for guiding clinical management, though conventional visual analysis of these lesions is challenging due to overlap of imaging features. Radiomics-based approaches may serve as a promising alternative and/or supplementary diagnostic approach to conventional imaging.

PURPOSE

The purpose of this study is to review the practice of radiomics-based imaging and systematically evaluate the literature available for studies evaluating radiomics applied to differentiating ALTs/WDLs from benign lipomas.

REVIEW

A background review of the radiomic workflow is provided, outlining the steps of image acquisition, segmentation, feature extraction, and model development. Subsequently, a systematic review of MEDLINE, EMBASE, Scopus, the Cochrane Library, and the grey literature was performed from inception to June 2022 to identify size studies using radiomics for differentiating ALTs/WDLs from benign lipomas. Radiomic models were shown to outperform conventional analysis in all but one model with a sensitivity ranging from 68 to 100% and a specificity ranging from 84 to 100%. However, current approaches rely on user input and no studies used a fully automated method for segmentation, contributing to interobserver variability and decreasing time efficiency.

CONCLUSION

Radiomic models may show improved performance for differentiating ALTs/WDLs from benign lipomas compared to conventional analysis. However, considerable variability between radiomic approaches exists and future studies evaluating a standardized radiomic model with a multi-institutional study design and preferably fully automated segmentation software are needed before clinical application can be more broadly considered.