Machine and deep learning methods for radiomics

A pretreatment multiparametric MRI-based radiomics-clinical machine learning model for predicting radiation-induced temporal lobe injury in patients with nasopharyngeal carcinoma

BACKGROUND

To establish and validate a machine learning model using pretreatment multiparametric magnetic resonance imaging-based radiomics data with clinical data to predict radiation-induced temporal lobe injury (RTLI) in patients with nasopharyngeal carcinoma (NPC) after intensity-modulated radiotherapy (IMRT).

METHODS

Data from 230 patients with NPC who received IMRT (130 with RTLI and 130 without) were randomly divided into the training (n = 161) and validation cohort (n = 69) with a ratio of 7:3. Radiomics features were extracted from pretreatment apparent diffusion coefficient (ADC) map, T2-weighted imaging (T2WI), and CE-T1-weighted imaging (CE-T1WI). T-test, spearman rank correlation, and least absolute shrinkage and selection operator (LASSO) algorithm were employed to identify significant radiomics features. Clinical features were selected with univariate and multivariate analyses. Radiomics and clinical models were constructed using multiple machine learning classifiers, and a clinical-radiomics nomogram that combined clinical with radiomics features was developed. Receiver operating characteristic (ROC) curves, calibration curves, and decision curve analysis (DCA) were drawn to compare and verify the predictive performances of the clinical model, radiomics model, and clinical-radiomics nomogram.

RESULTS

A total of 5064 radiomics features were extracted, from which 52 radiomics features were selected to construct the radiomics signature. The AUC of the radiomics signature based on multiparametric MRI was 0.980 in the training cohort and 0.969 in the validation cohort, outperforming the radiomics signature only based on T2WI and CE-T1WI (p < 0.05), which highlighted the significance of the DWI sequence in the prediction of temporal lobe injury. The area under the curve (AUC) of the clinical model was 0.895 in the training cohort and 0.905 in the validation cohort. The nomogram, which integrated radiomics and clinical features, demonstrated an impressive AUC value of 0.984 in the validation set; however, no statistically significant difference was observed compared to the radiomics model. The calibration curve and decision curve analysis of the nomogram demonstrated excellent predictive performance and clinical feasibility.

CONCLUSIONS

The clinical-radiomics nomogram, integrating clinical features with radiomics features derived from pretreatment multiparametric MRI, exhibits compelling predictive performance for RTLI in patients diagnosed with NPC.

Glioma Tumor Grading Using Radiomics on Conventional MRI: A Comparative Study of WHO 2021 and WHO 2016 Classification of Central Nervous Tumors

BACKGROUND

Glioma grading transformed in World Health Organization (WHO) 2021 CNS tumor classification, integrating molecular markers. However, the impact of this change on radiomics-based machine learning (ML) classifiers remains unexplored.

PURPOSE

To assess the performance of ML in classifying glioma tumor grades based on various WHO criteria.

STUDY TYPE

Retrospective.

SUBJECTS

A neuropathologist regraded gliomas of 237 patients into WHO 2016 and 2021 from 2007 criteria.

FIELD STRENGTH/SEQUENCE

Multicentric 0.5 to 3 Tesla; pre- and post-contrast T1-weighted, T2-weighted, and fluid-attenuated inversion recovery.

ASSESSMENT

Radiomic features were selected using random forest-recursive feature elimination. The synthetic minority over-sampling technique (SMOTE) was implemented for data augmentation. Stratified 10-fold cross-validation with and without SMOTE was used to evaluate 11 classifiers for 3-grade (2, 3, and 4; WHO 2016 and 2021) and 2-grade (low and high grade; WHO 2007 and 2021) classification. Additionally, we developed the models on data randomly divided into training and test sets (mixed-data analysis), or data divided based on the centers (independent-data analysis).

STATISTICAL TESTS

We assessed ML classifiers using sensitivity, specificity, accuracy, and the area under the receiver operating characteristic curve (AUC). Top performances were compared with a t-test and categorical data with the chi-square test using a significance level of P < 0.05.

RESULTS

In the mixed-data analysis, Stacking Classifier without SMOTE achieved the highest accuracy (0.86) and AUC (0.92) in 3-grade WHO 2021 grouping. The results of WHO 2021 were significantly better than WHO 2016 (P-value<0.0001). In the 2-grade analysis, ML achieved 1.00 in all metrics. In the independent-data analysis, ML classifiers showed strong discrimination between grade 2 and 4, despite lower performance metrics than the mixed analysis.

DATA CONCLUSION

ML algorithms performed better in glioma tumor grading based on WHO 2021 criteria. Nonetheless, the clinical use of ML classifiers needs further investigation.

LEVEL OF EVIDENCE

3 TECHNICAL EFFICACY: Stage 2.

Differential diagnostic value of radiomics models in benign versus malignant vertebral compression fractures: A systematic review and meta-analysis

PURPOSE

Early diagnosis of benign and malignant vertebral compression fractures by analyzing imaging data is crucial to guide treatment and assess prognosis, and the development of radiomics made it an alternative option to biopsy examination. This systematic review and meta-analysis was conducted with the purpose of quantifying the diagnostic efficacy of radiomics models in distinguishing between benign and malignant vertebral compression fractures.

METHODS

Searching on PubMed, Embase, Web of Science and Cochrane Library was conducted to identify eligible studies published before September 23, 2023. After evaluating for methodological quality and risk of bias using the Radiomics Quality Score (RQS) and the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2), we selected studies providing confusion matrix results to be included in random-effects meta-analysis.

RESULTS

A total of sixteen articles, involving 1,519 vertebrae with pathological-diagnosed tumor infiltration, were included in our meta-analysis. The combined sensitivity and specificity of the top-performing models were 0.92 (95 % CI: 0.87-0.96) and 0.93 (95 % CI: 0.88-0.96), respectively. Their AUC was 0.97 (95 % CI: 0.96-0.99). By contrast, radiologists' combined sensitivity was 0.90 (95 %CI: 0.75-0.97) and specificity was 0.92 (95 %CI: 0.67-0.98). The AUC was 0.96 (95 %CI: 0.94-0.97). Subsequent subgroup analysis and sensitivity test suggested that part of the heterogeneity might be explained by differences in imaging modality, segmentation, deep learning and cross-validation.

CONCLUSION

We found remarkable diagnosis potential in correctly distinguishing vertebral compression fractures in complex clinical contexts. However, the published radiomics models still have a great heterogeneity, and more large-scale clinical trials are essential to validate their generalizability.

Clinical Applications of Radiomics and Deep Learning in Breast and Lung cancer: a Narrative Literature Review on Current Evidence and Future Perspectives

Radiomics, analysing quantitative features from medical imaging, has rapidly become an emerging field in translational oncology. Radiomics has been investigated in several neoplastic malignancies as it might allow for a non-invasive tumour characterization and for the identification of predictive and prognostic biomarkers. Over the last few years, evidence has been accumulating regarding potential clinical applications of machine learning in many crucial moments of cancer patients' history. However, the incorporation of radiomics in clinical decision-making process is still limited by low data reproducibility and study variability. Moreover, the need for prospective validations and standardizations is emerging. In this narrative review, we summarize current evidence regarding radiomic applications in high-incidence cancers (breast and lung) for screening, diagnosis, staging, treatment choice, response, and clinical outcome evaluation. We also discuss pro and cons of the radiomic approach, suggesting possible solutions to critical issues which might invalidate radiomics studies and propose future perspectives.

Visualization of Pulpal Structures by SWIR in Endodontic Access Preparation

Endodontic access preparation is one of the initial steps in root canal treatments and can be hindered by the obliteration of pulp canals and formation of tertiary dentin. Until now, methods for direct intraoperative visualization of the 3-dimensional anatomy of teeth have been missing. Here, we evaluate the use of shortwave infrared radiation (SWIR) for navigation during stepwise access preparation. Nine teeth (3 anteriors, 3 premolars, and 3 molars) were explanted en bloc with intact periodontium including alveolar bone and mucosa from the upper or lower jaw of human body donors. Analysis was performed at baseline as well as at preparation depths of 5 mm, 7 mm, and 9 mm, respectively. For reflection, SWIR was used at a wavelength of 1,550 nm from the occlusal direction, whereas for transillumination, SWIR was passed through each sample at the marginal gingiva from the buccal as well as oral side at a wavelength of 1,300 nm. Pulpal structures could be identified as darker areas approximately 2 mm before reaching the pulp chamber using SWIR transillumination, although they were indistinguishable under normal circumstances. Furcation areas in molars appeared with higher intensity than areas with canals. The location of pulpal structures was confirmed by superimposition of segmented micro-computed tomography (µCT) images. By radiomic analysis, significant differences between pulpal and parapulpal areas could be detected in image features. With hierarchical cluster analysis, both segments could be confirmed and associated with specific clusters. The local thickness of µCTs was calculated and correlated with SWIR transillumination images, by which a linear dependency of thickness and intensity could be demonstrated. Lastly, by in silico simulations of light propagation, dentin tubules were shown to be a crucial factor for understanding the visibility of the pulp. In conclusion, SWIR transillumination may allow direct clinical live navigation during endodontic access preparation.

Artificial Intelligence-Driven Radiomics in Head and Neck Cancer: Current Status and Future Prospects

BACKGROUND

Radiomics is a rapidly growing field used to leverage medical radiological images by extracting quantitative features. These are supposed to characterize a patient's phenotype, and when combined with artificial intelligence techniques, to improve the accuracy of diagnostic models and clinical outcome prediction.

OBJECTIVES

This review aims at examining the application areas of artificial intelligence-based radiomics (AI-based radiomics) for the management of head and neck cancer (HNC). It further explores the workflow of AI-based radiomics for personalized and precision oncology in HNC. Finally, it examines the current challenges of AI-based radiomics in daily clinical oncology and offers possible solutions to these challenges.

METHODS

Comprehensive electronic databases (PubMed, Medline via Ovid, Scopus, Web of Science, CINAHL, and Cochrane Library) were searched following the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) guidelines. The quality of included studies and their risk of biases were evaluated using the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD)and Prediction Model Risk of Bias Assessment Tool (PROBAST).

RESULTS

Out of the 659 search hits retrieved, 45 fulfilled the inclusion criteria. Our review revealed that the application of AI-based radiomics model as an ancillary tool for improved decision-making in HNC management includes radiomics-based cancer diagnosis and radiomics-based cancer prognosis. The radiomics-based cancer diagnosis includes tumor staging, tumor grading, and classification of malignant and benign tumors. Similarly, radiomics-based cancer prognosis includes prediction for treatment response, recurrence, metastasis, and survival. In addition, the challenges in the implementation of these models for clinical evaluations include data imbalance, feature engineering (extraction and selection), model generalizability, multi-modal fusion, and model interpretability.

CONCLUSION

Considering the highly subjective and interobserver variability that is peculiar to the interpretation of medical images by expert clinicians, AI-based radiomics seeks to offer potentially useful quantitative information, which is not visible to the human eye or unintentionally often remain ignored during clinical imaging practice. By enabling the extraction of this type of information, AI-based radiomics has the potential to revolutionize HNC oncology, providing a platform for more personalized, higher quality, and cost-effective care for HNC patients.

Deep Learning Radiomics Analysis of CT Imaging for Differentiating Between Crohn's Disease and Intestinal Tuberculosis

This study aimed to develop and evaluate a CT-based deep learning radiomics model for differentiating between Crohn's disease (CD) and intestinal tuberculosis (ITB). A total of 330 patients with pathologically confirmed as CD or ITB from the First Affiliated Hospital of Zhengzhou University were divided into the validation dataset one (CD: 167; ITB: 57) and validation dataset two (CD: 78; ITB: 28). Based on the validation dataset one, the synthetic minority oversampling technique (SMOTE) was adopted to create balanced dataset as training data for feature selection and model construction. The handcrafted and deep learning (DL) radiomics features were extracted from the arterial and venous phases images, respectively. The interobserver consistency analysis, Spearman's correlation, univariate analysis, and the least absolute shrinkage and selection operator (LASSO) regression were used to select features. Based on extracted multi-phase radiomics features, six logistic regression models were finally constructed. The diagnostic performances of different models were compared using ROC analysis and Delong test. The arterial-venous combined deep learning radiomics model for differentiating between CD and ITB showed a high prediction quality with AUCs of 0.885, 0.877, and 0.800 in SMOTE dataset, validation dataset one, and validation dataset two, respectively. Moreover, the deep learning radiomics model outperformed the handcrafted radiomics model in same phase images. In validation dataset one, the Delong test results indicated that there was a significant difference in the AUC of the arterial models (p = 0.037), while not in venous and arterial-venous combined models (p = 0.398 and p = 0.265) as comparing deep learning radiomics models and handcrafted radiomics models. In our study, the arterial-venous combined model based on deep learning radiomics analysis exhibited good performance in differentiating between CD and ITB.

Radiomics as a tool for prognostic prediction in transarterial chemoembolization for hepatocellular carcinoma: a systematic review and meta-analysis

INTRODUCTION

Transarterial chemoembolization (TACE) is one of the predominant locoregional therapeutic modalities for addressing hepatocellular carcinoma (HCC). However, achieving precise prognostic predictions and effective patient selection remains a challenging pursuit. The primary objective of this systematic review and meta-analysis is to evaluate the efficacy of radiomics in forecasting the prognosis associated with TACE treatment.

METHODS

A comprehensive exploration of pertinent original studies was undertaken, encompassing databases of PubMed, Web of Science and Embase. The studies' quality was meticulously evaluated employing the quality assessment of diagnostic accuracy studies 2 (QUADAS-2), the radiomics quality score (RQS) and the METhodological RadiomICs Score (METRICS). Pooled statistics, along with 95% confidence intervals (95% CI), were computed for sensitivity, specificity, positive likelihood ratio (PLR), and negative likelihood ratio (NLR). Additionally, a summary receiver operating characteristic curve (sROC) was generated. To discern potential sources of heterogeneity, meta-regression and subgroup analyses were performed.

RESULTS

The systematic review incorporated 29 studies, comprising a total of 5483 patients, with 14 studies involving 2691 patients qualifying for inclusion in the meta-analysis. The assessed studies exhibited commendable quality with regard to bias risk, with mean RQS of 12.90 ± 5.13 (35.82% ± 14.25%) and mean METRICS of 62.98% ± 14.58%. The pooled sensitivity was 0.83 (95% CI: 0.78-0.87), specificity was 0.86 (95% CI: 0.79-0.92), PLR was 6.13 (95% CI: 3.79-9.90), and NLR was 0.20 (95% CI: 0.15-0.27). The area under the sROC was 0.90 (95% CI: 0.87-0.93). Significant heterogeneity within all the included studies was observed, while meta-regression and subgroup analyses revealed homogeneous and promising findings in subgroups where principal methodological variables such as modeling algorithms, imaging modalities, and imaging phases were specified.

CONCLUSION

Radiomics models have exhibited robust predictive capabilities concerning prognosis subsequent to TACE, thereby presenting promising prospects for clinical translation.

Deep learning model based on contrast-enhanced ultrasound for predicting vessels encapsulating tumor clusters in hepatocellular carcinoma

OBJECTIVES

To establish and validate a non-invasive deep learning (DL) model based on contrast-enhanced ultrasound (CEUS) to predict vessels encapsulating tumor clusters (VETC) patterns in hepatocellular carcinoma (HCC).

MATERIALS AND METHODS

This retrospective study included consecutive HCC patients with preoperative CEUS images and available tissue specimens. Patients were randomly allocated into the training and test cohorts. CEUS images were analyzed using the ResNet-18 convolutional neural network for the development and validation of the VETC predictive model. The predictive value for postoperative early recurrence (ER) of the proposed model was further evaluated.

RESULTS

A total of 242 patients were enrolled finally, including 195 in the training cohort (54.6 ± 11.2 years, 178 males) and 47 in the test cohort (55.1 ± 10.6 years, 40 males). The DL model (DL signature) achieved favorable performance in both the training cohort (area under the receiver operating characteristics curve [AUC]: 0.92, 95% confidence interval [CI]: 0.88-0.96) and test cohort (AUC: 0.90, 95% CI: 0.82-0.99). The stratified analysis demonstrated good discrimination of DL signature regardless of tumor size. Moreover, the DL signature was found independently correlated with postoperative ER (hazard ratio [HR]: 1.99, 95% CI: 1.29-3.06, p = 0.002). C-indexes of 0.70 and 0.73 were achieved when the DL signature was used to predict ER independently and combined with clinical features.

CONCLUSION

The proposed DL signature provides a non-invasive and practical method for VETC-HCC prediction, and contributes to the identification of patients with high risk of postoperative ER.

CLINICAL RELEVANCE STATEMENT

This DL model based on contrast-enhanced US displayed an important role in non-invasive diagnosis and prognostication for patients with VETC-HCC, which was helpful in individualized management.

KEY POINTS

Preoperative biopsy to determine VETC status in HCC patients is limited. The contrast-enhanced DL model provides a non-invasive tool for the prediction of VETC-HCC. The proposed deep-learning signature assisted in identifying patients with a high risk of postoperative ER.

Enhancing prognostic prediction in hepatocellular carcinoma post-TACE: a machine learning approach integrating radiomics and clinical features

Objective

This study aimed to investigate the use of radiomics features and clinical information by four machine learning algorithms for predicting the prognosis of patients with hepatocellular carcinoma (HCC) who have been treated with transarterial chemoembolization (TACE).

Methods

A total of 105 patients with HCC treated with TACE from 2002 to 2012 were enrolled retrospectively and randomly divided into two cohorts for training (n = 74) and validation (n = 31) according to a ratio of 7:3. The Spearman rank, random forest, and univariate Cox regression were used to select the optimal radiomics features. Univariate Cox regression was used to select clinical features. Four machine learning algorithms were used to develop the models: random survival forest, eXtreme gradient boosting (XGBoost), gradient boosting, and the Cox proportional hazard regression model. The area under the curve (AUC) and C-index were devoted to assessing the performance of the models in predicting HCC prognosis.

Results

A total of 1,834 radiomics features were extracted from the computed tomography images of each patient. The clinical risk factors for HCC prognosis were age at diagnosis, TNM stage, and metastasis, which were analyzed using univariate Cox regression. In various models, the efficacy of the combined models generally surpassed that of the radiomics and clinical models. Among four machine learning algorithms, XGBoost exhibited the best performance in combined models, achieving an AUC of 0.979 in the training set and 0.750 in the testing set, demonstrating its strong prognostic prediction capability.

Conclusion

The superior performance of the XGBoost-based combined model underscores its potential as a powerful tool for enhancing the precision of prognostic assessments for patients with HCC.

Bibliometric analysis of the application of deep learning in cancer from 2015 to 2023

BACKGROUND

Recently, the application of deep learning (DL) has made great progress in various fields, especially in cancer research. However, to date, the bibliometric analysis of the application of DL in cancer is scarce. Therefore, this study aimed to explore the research status and hotspots of the application of DL in cancer.

METHODS

We retrieved all articles on the application of DL in cancer from the Web of Science database Core Collection database. Biblioshiny, VOSviewer and CiteSpace were used to perform the bibliometric analysis through analyzing the numbers, citations, countries, institutions, authors, journals, references, and keywords.

RESULTS

We found 6,016 original articles on the application of DL in cancer. The number of annual publications and total citations were uptrend in general. China published the greatest number of articles, USA had the highest total citations, and Saudi Arabia had the highest centrality. Chinese Academy of Sciences was the most productive institution. Tian, Jie published the greatest number of articles, while He Kaiming was the most co-cited author. IEEE Access was the most popular journal. The analysis of references and keywords showed that DL was mainly used for the prediction, detection, classification and diagnosis of breast cancer, lung cancer, and skin cancer.

CONCLUSIONS

Overall, the number of articles on the application of DL in cancer is gradually increasing. In the future, further expanding and improving the application scope and accuracy of DL applications, and integrating DL with protein prediction, genomics and cancer research may be the research trends.

Brain metastasis magnetic resonance imaging-based deep learning for predicting epidermal growth factor receptor (EGFR) mutation and subtypes in metastatic non-small cell lung cancer

Background

The preoperative identification of epidermal growth factor receptor (EGFR) mutations and subtypes based on magnetic resonance imaging (MRI) of brain metastases (BM) is necessary to facilitate individualized therapy. This study aimed to develop a deep learning model to preoperatively detect EGFR mutations and identify the location of EGFR mutations in patients with non-small cell lung cancer (NSCLC) and BM.

Methods

We included 160 and 72 patients who underwent contrast-enhanced T1-weighted (T1w-CE) and T2-weighted (T2W) MRI at Liaoning Cancer Hospital and Institute (center 1) and Shengjing Hospital of China Medical University (center 2) to form a training cohort and an external validation cohort, respectively. A multiscale feature fusion network (MSF-Net) was developed by adaptively integrating features based on different stages of residual network (ResNet) 50 and by introducing channel and spatial attention modules. The external validation set from center 2 was used to assess the performance of MSF-Net and to compare it with that of handcrafted radiomics features. Receiver operating characteristic (ROC) curves, accuracy, precision, recall, and F1-score were used to evaluate the effectiveness of the models. Gradient-weighted class activation mapping (Grad-CAM) was used to demonstrate the attention of the MSF-Net model.

Results

The developed MSF-Net generated a better diagnostic performance than did the handcrafted radiomics in terms of the microaveraged area under the curve (AUC) (MSF-Net: 0.91; radiomics: 0.80) and macroaveraged AUC (MSF-Net: 0.90; radiomics: 0.81) for predicting EGFR mutations and subtypes.

Conclusions

This study provides an end-to-end and noninvasive imaging tool for the preoperative prediction of EGFR mutation status and subtypes based on BM, which may be helpful for facilitating individualized clinical treatment plans.

Radiomics and Deep Features: Robust Classification of Brain Hemorrhages and Reproducibility Analysis Using a 3D Autoencoder Neural Network

This study evaluates the reproducibility of machine learning models that integrate radiomics and deep features (features extracted from a 3D autoencoder neural network) to classify various brain hemorrhages effectively. Using a dataset of 720 patients, we extracted 215 radiomics features (RFs) and 15,680 deep features (DFs) from CT brain images. With rigorous screening based on Intraclass Correlation Coefficient thresholds (>0.75), we identified 135 RFs and 1054 DFs for analysis. Feature selection techniques such as Boruta, Recursive Feature Elimination (RFE), XGBoost, and ExtraTreesClassifier were utilized alongside 11 classifiers, including AdaBoost, CatBoost, Decision Trees, LightGBM, Logistic Regression, Naive Bayes, Neural Networks, Random Forest, Support Vector Machines (SVM), and k-Nearest Neighbors (k-NN). Evaluation metrics included Area Under the Curve (AUC), Accuracy (ACC), Sensitivity (SEN), and F1-score. The model evaluation involved hyperparameter optimization, a 70:30 train-test split, and bootstrapping, further validated with the Wilcoxon signed-rank test and q-values. Notably, DFs showed higher accuracy. In the case of RFs, the Boruta + SVM combination emerged as the optimal model for AUC, ACC, and SEN, while XGBoost + Random Forest excelled in F1-score. Specifically, RFs achieved AUC, ACC, SEN, and F1-scores of 0.89, 0.85, 0.82, and 0.80, respectively. Among DFs, the ExtraTreesClassifier + Naive Bayes combination demonstrated remarkable performance, attaining an AUC of 0.96, ACC of 0.93, SEN of 0.92, and an F1-score of 0.92. Distinguished models in the RF category included SVM with Boruta, Logistic Regression with XGBoost, SVM with ExtraTreesClassifier, CatBoost with XGBoost, and Random Forest with XGBoost, each yielding significant q-values of 42. In the DFs realm, ExtraTreesClassifier + Naive Bayes, ExtraTreesClassifier + Random Forest, and Boruta + k-NN exhibited robustness, with 43, 43, and 41 significant q-values, respectively. This investigation underscores the potential of synergizing DFs with machine learning models to serve as valuable screening tools, thereby enhancing the interpretation of head CT scans for patients with brain hemorrhages.

Identifying radiogenomic associations of breast cancer based on DCE-MRI by using Siamese Neural Network with manufacturer bias normalization

BACKGROUND AND PURPOSE

The immunohistochemical test (IHC) for Human Epidermal Growth Factor Receptor 2 (HER2) and hormone receptors (HR) provides prognostic information and guides treatment for patients with invasive breast cancer. The objective of this paper is to establish a non-invasive system for identifying HER2 and HR in breast cancer using dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI).

METHODS

In light of the absence of high-performance algorithms and external validation in previously published methods, this study utilizes 3D deep features and radiomics features to represent the information of the Region of Interest (ROI). A Siamese Neural Network was employed as the classifier, with 3D deep features and radiomics features serving as the network input. To neutralize manufacturer bias, a batch effect normalization method, ComBat, was introduced. To enhance the reliability of the study, two datasets, Predict Your Therapeutic Response with Imaging and moLecular Analysis (I-SPY 1) and I-SPY 2, were incorporated. I-SPY 2 was utilized for model training and validation, while I-SPY 1 was exclusively employed for external validation. Additionally, a breast tumor segmentation network was trained to improve radiomic feature extraction.

RESULTS

The results indicate that our approach achieved an average Area Under the Curve (AUC) of 0.632, with a Standard Error of the Mean (SEM) of 0.042 for HER2 prediction in the I-SPY 2 dataset. For HR prediction, our method attained an AUC of 0.635 (SEM 0.041), surpassing other published methods in the AUC metric. Moreover, the proposed method yielded competitive results in other metrics. In external validation using the I-SPY 1 dataset, our approach achieved an AUC of 0.567 (SEM 0.032) for HR prediction and 0.563 (SEM 0.033) for HER2 prediction.

CONCLUSION

This study proposes a non-invasive system for identifying HER2 and HR in breast cancer. Although the results do not conclusively demonstrate superiority in both tasks, they indicate that the proposed method achieved good performance and is a competitive classifier compared to other reference methods. Ablation studies demonstrate that both radiomics features and deep features for the Siamese Neural Network are beneficial for the model. The introduced manufacturer bias normalization method has been shown to enhance the method's performance. Furthermore, the external validation of the method enhances the reliability of this research. Source code, pre-trained segmentation network, Radiomics and deep features, data for statistical analysis, and Supporting Information of this article are online at: https://github.com/FORRESTHUACHEN/Siamese_Neural_Network_based_Brest_cancer_Radiogenomic.

Associations between Radiomics and Genomics in Non-Small Cell Lung Cancer Utilizing Computed Tomography and Next-Generation Sequencing: An Exploratory Study

BACKGROUND

Radiomics, an evolving paradigm in medical imaging, involves the quantitative analysis of tumor features and demonstrates promise in predicting treatment responses and outcomes. This study aims to investigate the predictive capacity of radiomics for genetic alterations in non-small cell lung cancer (NSCLC).

METHODS

This exploratory, observational study integrated radiomic perspectives using computed tomography (CT) and genomic perspectives through next-generation sequencing (NGS) applied to liquid biopsies. Associations between radiomic features and genetic mutations were established using the Area Under the Receiver Operating Characteristic curve (AUC-ROC). Machine learning techniques, including Support Vector Machine (SVM) classification, aim to predict genetic mutations based on radiomic features. The prognostic impact of selected gene variants was assessed using Kaplan-Meier curves and Log-rank tests.

RESULTS

Sixty-six patients underwent screening, with fifty-seven being comprehensively characterized radiomically and genomically. Predominantly males (68.4%), adenocarcinoma was the prevalent histological type (73.7%). Disease staging is distributed across I/II (38.6%), III (31.6%), and IV (29.8%). Significant correlations were identified with mutations of ROS1 p.Thr145Pro (shape_Sphericity), ROS1 p.Arg167Gln (glszm_ZoneEntropy, firstorder_TotalEnergy), ROS1 p.Asp2213Asn (glszm_GrayLevelVariance, firstorder_RootMeanSquared), and ALK p.Asp1529Glu (glcm_Imc1). Patients with the ROS1 p.Thr145Pro variant demonstrated markedly shorter median survival compared to the wild-type group (9.7 months vs. not reached, p = 0.0143; HR: 5.35; 95% CI: 1.39-20.48).

CONCLUSIONS

The exploration of the intersection between radiomics and cancer genetics in NSCLC is not only feasible but also holds the potential to improve genetic predictions and enhance prognostic accuracy.

Automatic grading of knee osteoarthritis with a plain radiograph radiomics model: combining anteroposterior and lateral images

OBJECTIVES

To establish a radiomics-based automatic grading model for knee osteoarthritis (OA) and evaluate the influence of different body positions on the model's effectiveness.

MATERIALS AND METHODS

Plain radiographs of a total of 473 pairs of knee joints from 473 patients (May 2020 to July 2021) were retrospectively analyzed. Each knee joint included anteroposterior (AP) and lateral (LAT) images which were randomly assigned to the training cohort and the testing cohort at a ratio of 7:3. First, an assessment of knee OA severity was done by two independent radiologists with Kallgren-Lawrence grading scale. Then, another two radiologists independently delineated the region of interest for radiomic feature extraction and selection. The radiomic classification features were dimensionally reduced and a machine model was conducted using logistic regression (LR). Finally, the classification efficiency of the model was evaluated using receiver operating characteristic curves and the area under the curve (AUC).

RESULTS

The AUC (macro/micro) of the model using a combination of AP and LAT (AP&LAT) images were 0.772/0.778, 0.818/0.799, and 0.864/0.879, respectively. The radiomic features from the combined images achieved better classification performance than the individual position image (p < 0.05). The overall accuracy of the radiomic model with AP&LAT images was 0.727 compared to 0.712 and 0.417 for radiologists with 4 years and 2 years of musculoskeletal diagnostic experience.

CONCLUSIONS

A radiomic model constructed by combining the AP&LAT images of the knee joint can better grade knee OA and assist clinicians in accurate diagnosis and treatment.

CRITICAL RELEVANCE STATEMENT

A radiomic model based on plain radiographs accurately grades knee OA severity. By utilizing the LR classifier and combining AP&LAT images, it improves accuracy and consistency in grading, aiding clinical decision-making, and treatment planning.

KEY POINTS

Radiomic model performed more accurately in K/L grading of knee OA than junior radiologists. Radiomic features from the combined images achieved better classification performance than the individual position image. A radiomic model can improve the grading of knee OA and assist in diagnosis and treatment.

Development and Validation of Prognostic Models Using Radiomic Features from Pre-Treatment Positron Emission Tomography (PET) Images in Head and Neck Squamous Cell Carcinoma (HNSCC) Patients

High-dimensional radiomics features derived from pre-treatment positron emission tomography (PET) images offer prognostic insights for patients with head and neck squamous cell carcinoma (HNSCC). Using 124 PET radiomics features and clinical variables (age, sex, stage of cancer, site of cancer) from a cohort of 232 patients, we evaluated four survival models-penalized Cox model, random forest, gradient boosted model and support vector machine-to predict all-cause mortality (ACM), locoregional recurrence/residual disease (LR) and distant metastasis (DM) probability during 36, 24 and 24 months of follow-up, respectively. We developed models with five-fold cross-validation, selected the best-performing model for each outcome based on the concordance index (C-statistic) and the integrated Brier score (IBS) and validated them in an independent cohort of 102 patients. The penalized Cox model demonstrated better performance for ACM (C-statistic = 0.70, IBS = 0.12) and DM (C-statistic = 0.70, IBS = 0.08) while the random forest model displayed better performance for LR (C-statistic = 0.76, IBS = 0.07). We conclude that the ML-based prognostic model can aid clinicians in quantifying prognosis and determining effective treatment strategies, thereby improving favorable outcomes in HNSCC patients.

A Review of Machine Learning Approaches for Brain Positron Emission Tomography Data Analysis

Positron emission tomography (PET) imaging has moved forward the development of medical diagnostics and research across various domains, including cardiology, neurology, infection detection, and oncology. The integration of machine learning (ML) algorithms into PET data analysis has further enhanced their capabilities of including disease diagnosis and classification, image segmentation, and quantitative analysis. ML algorithms empower researchers and clinicians to extract valuable insights from complex big PET datasets, which enabling automated pattern recognition, predictive health outcome modeling, and more efficient data analysis. This review explains the basic knowledge of PET imaging, statistical methods for PET image analysis, and challenges of PET data analysis. We also discussed the improvement of analysis capabilities by combining PET data with machine learning algorithms and the application of this combination in various aspects of PET image research. This review also highlights current trends and future directions in PET imaging, emphasizing the driving and critical role of machine learning and big PET image data analytics in improving diagnostic accuracy and personalized medical approaches. Integration between PET imaging will shape the future of medical diagnosis and research.

Imaging Genomics and Multiomics: A Guide for Beginners Starting Radiomics-Based Research

Radiomics uses advanced mathematical analysis of pixel-level information from radiologic images to extract existing information in traditional imaging algorithms. It is intended to find imaging biomarkers related to the genomics of tumors or disease patterns that improve medical care by advanced detection of tumor response patterns in tumors and to assess prognosis. Radiomics expands the paradigm of medical imaging to help with diagnosis, management of diseases and prognostication, leveraging image features by extracting information that can be used as imaging biomarkers to predict prognosis and response to treatment. Radiogenomics is an emerging area in radiomics that investigates the association between imaging characteristics and gene expression profiles. There are an increasing number of research publications using different radiomics approaches without a clear consensus on which method works best. We aim to describe the workflow of radiomics along with a guide of what to expect when starting a radiomics-based research project.

A systematic review of brain metastases from lung cancer using magnetic resonance neuroimaging: Clinical and technical aspects

INTRODUCTION

Brain metastases (BMs) are common in lung cancer (LC) and are associated with poor prognosis. Magnetic resonance imaging (MRI) plays a vital role in the detection, diagnosis and management of BMs. This review summarises recent advances in MRI techniques for BMs from LC.

METHODS

This systematic review was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. A comprehensive literature search was conducted in three electronic databases: PubMed, Scopus and the Web of Science. The search was limited to studies published between January 2000 and March 2023. The quality of the included studies was evaluated using appropriate tools for different study designs. A narrative synthesis was carried out to describe the key findings of the included studies.

RESULTS

Sixty-five studies were included. Standard MRI sequences such as T1-weighted (T1w), T2-weighted (T2w) and fluid-attenuated inversion recovery (FLAIR) were commonly used. Advanced techniques included perfusion-weighted imaging (PWI), diffusion-weighted imaging (DWI) and radiomics analysis. DWI and PWI parameters could distinguish tumour recurrence from radiation necrosis. Radiomics models predicted genetic mutations and the risk of BMs. Diagnostic accuracy was improved with deep learning (DL) approaches. Prognostic factors such as performance status and concurrent chemotherapy impacted survival.

CONCLUSION

Advanced MRI techniques and specialised MRI methods have emerging roles in managing BMs from LC. PWI and DWI improve diagnostic accuracy in treated BMs. Radiomics and DL facilitate personalised prognosis and treatment. Magnetic resonance imaging plays a key role in the continuum of care for BMs of patients with LC, from screening to treatment monitoring.

Explainable Precision Medicine in Breast MRI: A Combined Radiomics and Deep Learning Approach for the Classification of Contrast Agent Uptake

In DCE-MRI, the degree of contrast uptake in normal fibroglandular tissue, i.e., background parenchymal enhancement (BPE), is a crucial biomarker linked to breast cancer risk and treatment outcome. In accordance with the Breast Imaging Reporting & Data System (BI-RADS), it should be visually classified into four classes. The susceptibility of such an assessment to inter-reader variability highlights the urgent need for a standardized classification algorithm. In this retrospective study, the first post-contrast subtraction images for 27 healthy female subjects were included. The BPE was classified slice-wise by two expert radiologists. The extraction of radiomic features from segmented BPE was followed by dataset splitting and dimensionality reduction. The latent representations were then utilized as inputs to a deep neural network classifying BPE into BI-RADS classes. The network's predictions were elucidated at the radiomic feature level with Shapley values. The deep neural network achieved a BPE classification accuracy of 84 ± 2% (p-value < 0.00001). Most of the misclassifications involved adjacent classes. Different radiomic features were decisive for the prediction of each BPE class underlying the complexity of the decision boundaries. A highly precise and explainable pipeline for BPE classification was achieved without user- or algorithm-dependent radiomic feature selection.

A dosiomics model for prediction of radiation-induced acute skin toxicity in breast cancer patients: machine learning-based study for a closed bore linac

BACKGROUND

Radiation induced acute skin toxicity (AST) is considered as a common side effect of breast radiation therapy. The goal of this study was to design dosiomics-based machine learning (ML) models for prediction of AST, to enable creating optimized treatment plans for high-risk individuals.

METHODS

Dosiomics features extracted using Pyradiomics tool (v3.0.1), along with treatment plan-derived dose volume histograms (DVHs), and patient-specific treatment-related (PTR) data of breast cancer patients were used for modeling. Clinical scoring was done using the Common Terminology Criteria for Adverse Events (CTCAE) V4.0 criteria for skin-specific symptoms. The 52 breast cancer patients were grouped into AST 2 + (CTCAE ≥ 2) and AST 2 - (CTCAE < 2) toxicity grades to facilitate AST modeling. They were randomly divided into training (70%) and testing (30%) cohorts. Multiple prediction models were assessed through multivariate analysis, incorporating different combinations of feature groups (dosiomics, DVH, and PTR) individually and collectively. In total, seven unique combinations, along with seven classification algorithms, were considered after feature selection. The performance of each model was evaluated on the test group using the area under the receiver operating characteristic curve (AUC) and f1-score. Accuracy, precision, and recall of each model were also studied. Statistical analysis involved features differences between AST 2 - and AST 2 + groups and cutoff value calculations.

RESULTS

Results showed that 44% of the patients developed AST 2 + after Tomotherapy. The dosiomics (DOS) model, developed using dosiomics features, exhibited a noteworthy improvement in AUC (up to 0.78), when spatial information is preserved in the dose distribution, compared to DVH features (up to 0.71). Furthermore, a baseline ML model created using only PTR features for comparison with DOS models showed the significance of dosiomics in early AST prediction. By employing the Extra Tree (ET) classifiers, the DOS + DVH + PTR model achieved a statistically significant improved performance in terms of AUC (0.83; 95% CI 0.71-0.90), accuracy (0.70), precision (0.74) and sensitivity (0.72) compared to other models.

CONCLUSIONS

This study confirmed the benefit of dosiomics-based ML in the prediction of AST. However, the combination of dosiomics, DVH, and PTR yields significant improvement in AST prediction. The results of this study provide the opportunity for timely interventions to prevent the occurrence of radiation induced AST.

The use of deep learning in interventional radiotherapy (brachytherapy): A review with a focus on open source and open data

Deep learning advanced to one of the most important technologies in almost all medical fields. Especially in areas, related to medical imaging it plays a big role. However, in interventional radiotherapy (brachytherapy) deep learning is still in an early phase. In this review, first, we investigated and scrutinised the role of deep learning in all processes of interventional radiotherapy and directly related fields. Additionally, we summarised the most recent developments. For better understanding, we provide explanations of key terms and approaches to solving common deep learning problems. To reproduce results of deep learning algorithms both source code and training data must be available. Therefore, a second focus of this work is on the analysis of the availability of open source, open data and open models. In our analysis, we were able to show that deep learning plays already a major role in some areas of interventional radiotherapy, but is still hardly present in others. Nevertheless, its impact is increasing with the years, partly self-propelled but also influenced by closely related fields. Open source, data and models are growing in number but are still scarce and unevenly distributed among different research groups. The reluctance in publishing code, data and models limits reproducibility and restricts evaluation to mono-institutional datasets. The conclusion of our analysis is that deep learning can positively change the workflow of interventional radiotherapy but there is still room for improvements when it comes to reproducible results and standardised evaluation methods.

Ultrasound deep learning radiomics and clinical machine learning models to predict low nuclear grade, ER, PR, and HER2 receptor status in pure ductal carcinoma in situ

Background

Low nuclear grade ductal carcinoma in situ (DCIS) patients can adopt proactive management strategies to avoid unnecessary surgical resection. Different personalized treatment modalities may be selected based on the expression status of molecular markers, which is also predictive of different outcomes and risks of recurrence. DCIS ultrasound findings are mostly non mass lesions, making it difficult to determine boundaries. Currently, studies have shown that models based on deep learning radiomics (DLR) have advantages in automatic recognition of tumor contours. Machine learning models based on clinical imaging features can explain the importance of imaging features.

Methods

The available ultrasound data of 349 patients with pure DCIS confirmed by surgical pathology [54 low nuclear grade, 175 positive estrogen receptor (ER+), 163 positive progesterone receptor (PR+), and 81 positive human epidermal growth factor receptor 2 (HER2+)] were collected. Radiologists extracted ultrasonographic features of DCIS lesions based on the 5th Edition of Breast Imaging Reporting and Data System (BI-RADS). Patient age and BI-RADS characteristics were used to construct clinical machine learning (CML) models. The RadImageNet pretrained network was used for extracting radiomics features and as an input for DLR modeling. For training and validation datasets, 80% and 20% of the data, respectively, were used. Logistic regression (LR), support vector machine (SVM), random forest (RF), and eXtreme Gradient Boosting (XGBoost) algorithms were performed and compared for the final classification modeling. Each task used the area under the receiver operating characteristic curve (AUC) to evaluate the effectiveness of DLR and CML models.

Results

In the training dataset, low nuclear grade, ER+, PR+, and HER2+ DCIS lesions accounted for 19.20%, 65.12%, 61.21%, and 30.19%, respectively; the validation set, they consisted of 19.30%, 62.50%, 57.14%, and 30.91%, respectively. In the DLR models we developed, the best AUC values for identifying features were 0.633 for identifying low nuclear grade, completed by the XGBoost Classifier of ResNet50; 0.618 for identifying ER, completed by the RF Classifier of InceptionV3; 0.755 for identifying PR, completed by the XGBoost Classifier of InceptionV3; and 0.713 for identifying HER2, completed by the LR Classifier of ResNet50. The CML models had better performance than DLR in predicting low nuclear grade, ER+, PR+, and HER2+ DCIS lesions. The best AUC values by classification were as follows: for low nuclear grade by RF classification, AUC: 0.719; for ER+ by XGBoost classification, AUC: 0.761; for PR+ by XGBoost classification, AUC: 0.780; and for HER2+ by RF classification, AUC: 0.723.

Conclusions

Based on small-scale datasets, our study showed that the DLR models developed using RadImageNet pretrained network and CML models may help predict low nuclear grade, ER+, PR+, and HER2+ DCIS lesions so that patients benefit from hierarchical and personalized treatment.

Machine Learning in Diagnosis and Prognosis of Lung Cancer by PET-CT

As a disease with high morbidity and high mortality, lung cancer has seriously harmed people's health. Therefore, early diagnosis and treatment are more important. PET/CT is usually used to obtain the early diagnosis, staging, and curative effect evaluation of tumors, especially lung cancer, due to the heterogeneity of tumors and the differences in artificial image interpretation and other reasons, it also fails to entirely reflect the real situation of tumors. Artificial intelligence (AI) has been applied to all aspects of life. Machine learning (ML) is one of the important ways to realize AI. With the help of the ML method used by PET/CT imaging technology, there are many studies in the diagnosis and treatment of lung cancer. This article summarizes the application progress of ML based on PET/CT in lung cancer, in order to better serve the clinical. In this study, we searched PubMed using machine learning, lung cancer, and PET/CT as keywords to find relevant articles in the past 5 years or more. We found that PET/CT-based ML approaches have achieved significant results in the detection, delineation, classification of pathology, molecular subtyping, staging, and response assessment with survival and prognosis of lung cancer, which can provide clinicians a powerful tool to support and assist in critical daily clinical decisions. However, ML has some shortcomings such as slightly poor repeatability and reliability.

Predicting histologic grades for pancreatic neuroendocrine tumors by radiologic image-based artificial intelligence: a systematic review and meta-analysis

Background

Accurate detection of the histological grade of pancreatic neuroendocrine tumors (PNETs) is important for patients' prognoses and treatment. Here, we investigated the performance of radiological image-based artificial intelligence (AI) models in predicting histological grades using meta-analysis.

Method

A systematic literature search was performed for studies published before September 2023. Study characteristics and diagnostic measures were extracted. Estimates were pooled using random-effects meta-analysis. Evaluation of risk of bias was performed by the QUADAS-2 tool.

Results

A total of 26 studies were included, 20 of which met the meta-analysis criteria. We found that the AI-based models had high area under the curve (AUC) values and showed moderate predictive value. The pooled distinguishing abilities between different grades of PNETs were 0.89 [0.84-0.90]. By performing subgroup analysis, we found that the radiomics feature-only models had a predictive value of 0.90 [0.87-0.92] with I2 = 89.91%, while the pooled AUC value of the combined group was 0.81 [0.77-0.84] with I2 = 41.54%. The validation group had a pooled AUC of 0.84 [0.81-0.87] without heterogenicity, whereas the validation-free group had high heterogenicity (I2 = 91.65%, P=0.000). The machine learning group had a pooled AUC of 0.83 [0.80-0.86] with I2 = 82.28%.

Conclusion

AI can be considered as a potential tool to detect histological PNETs grades. Sample diversity, lack of external validation, imaging modalities, inconsistent radiomics feature extraction across platforms, different modeling algorithms and software choices were sources of heterogeneity. Standardized imaging, transparent statistical methodologies for feature selection and model development are still needed in the future to achieve the transformation of radiomics results into clinical applications.

Systematic Review Registration

https://www.crd.york.ac.uk/prospero/, identifier CRD42022341852.

Radiomics analysis of intratumoral and different peritumoral regions from multiparametric MRI for evaluating HER2 status of breast cancer: A comparative study

Purpose

To investigate the potential of radiomics signatures (RSs) from intratumoral and peritumoral regions on multiparametric magnetic resonance imaging (MRI) to noninvasively evaluate HER2 status in breast cancer.

Method

In this retrospective study, 992 patients with pathologically confirmed breast cancers who underwent preoperative MRI were enrolled. The breast cancer lesions were segmented manually, and the intratumor region of interest (ROIIntra) was dilated by 2, 4, 6 and 8 mm (ROIPeri2mm, ROIPeri4mm, ROIPeri6mm, and ROIPeri8mm, respectively). Quantitative radiomics features were extracted from dynamic contrast-enhanced T1-weighted imaging (DCE-T1), fat-saturated T2-weighted imaging (T2) and diffusion-weighted imaging (DWI). A three-step procedure was performed for feature selection, and RSs were constructed using a support vector machine (SVM) to predict HER2 status.

Result

The best single-area RSs for predicting HER2 status were DCE_Peri4mm-RS, T2_Peri4mm-RS, and DWI_Peri4mm-RS, yielding areas under the curve (AUCs) of 0.716 (95% confidence interval (CI), 0.648-0.778), 0.706 (95% CI, 0.637-0.768), and 0.719 (95% CI, 0.651-0.780), respectively, in the test set. The optimal RSs combining intratumoral and peritumoral regions for evaluating HER2 status were DCE-T1_Intra + DCE_Peri4mm-RS, T2_Intra + T2_Peri6mm-RS and DWI_Intra + DWI_Peri4mm-RS, with AUCs of 0.752 (95% CI, 0.686-0.810), 0.754 (95% CI, 0.688-0.812) and 0.725 (95% CI, 0.657-0.786), respectively, in the test set. Combining three sequences in the ROIIntra, ROIPeri2mm, ROIPeri4mm, ROIPeri6mm and ROIPeri8mm areas, the optimal RS was DCE-T1_Peri4mm + T2_Peri4mm + DWI_Peri4mm-RS, achieving an AUC of 0.795 (95% CI, 0.733-0.849) in the test set.

Conclusion

This study systematically explored the influence of the intratumoral region, different peritumoral sizes and their combination in radiomics analysis for predicting HER2 status in breast cancer based on multiparametric MRI and found the optimal RS.

Dose-Incorporated Deep Ensemble Learning for Improving Brain Metastasis Stereotactic Radiosurgery Outcome Prediction

PURPOSE

To develop a novel deep ensemble learning model for accurate prediction of brain metastasis (BM) local control outcomes after stereotactic radiosurgery (SRS).

METHODS AND MATERIALS

A total of 114 brain metastases (BMs) from 82 patients were evaluated, including 26 BMs that developed biopsy-confirmed local failure post-SRS. The SRS spatial dose distribution (Dmap) of each BM was registered to the planning contrast-enhanced T1 (T1-CE) magnetic resonance imaging (MRI). Axial slices of the Dmap, T1-CE, and planning target volume (PTV) segmentation (PTVseg) intersecting the BM center were extracted within a fixed field of view determined by the 60% isodose volume in Dmap. A spherical projection was implemented to transform planar image content onto a spherical surface using multiple projection centers, and the resultant T1-CE/Dmap/PTVseg projections were stacked as a 3-channel variable. Four Visual Geometry Group (VGG-19) deep encoders were used in an ensemble design, with each submodel using a different spherical projection formula as input for BM outcome prediction. In each submodel, clinical features after positional encoding were fused with VGG-19 deep features to generate logit results. The ensemble's outcome was synthesized from the 4 submodel results via logistic regression. In total, 10 model versions with random validation sample assignments were trained to study model robustness. Performance was compared with (1) a single VGG-19 encoder, (2) an ensemble with a T1-CE MRI as the sole image input after projections, and (3) an ensemble with the same image input design without clinical feature inclusion.

RESULTS

The ensemble model achieved an excellent area under the receiver operating characteristic curve (AUCROC: 0.89 ± 0.02) with high sensitivity (0.82 ± 0.05), specificity (0.84 ± 0.11), and accuracy (0.84 ± 0.08) results. This outperformed the MRI-only VGG-19 encoder (sensitivity: 0.35 ± 0.01, AUCROC: 0.64 ± 0.08), the MRI-only deep ensemble (sensitivity: 0.60 ± 0.09, AUCROC: 0.68 ± 0.06), and the 3-channel ensemble without clinical feature fusion (sensitivity: 0.78 ± 0.08, AUCROC: 0.84 ± 0.03).

CONCLUSIONS

Facilitated by the spherical image projection method, a deep ensemble model incorporating Dmap and clinical variables demonstrated excellent performance in predicting BM post-SRS local failure. Our novel approach could improve other radiation therapy outcome models and warrants further evaluation.

Noninvasive Assessment of HER2 Expression Status in Gastric Cancer Using 18F-FDG Positron Emission Tomography/Computed Tomography-Based Radiomics: A Pilot Study

Purpose: Immunohistochemistry (IHC) is the main method to detect human epidermal growth factor receptor 2 (HER2) expression levels. However, IHC is invasive and cannot reflect HER2 expression status in real time. The aim of this study was to construct and verify three types of radiomics models based on 18F-fuorodeoxyglucose (18F-FDG) positron emission tomography/computed tomography (PET/CT) imaging and to evaluate the predictive ability of these radiomics models for the expression status of HER2 in patients with gastric cancer (GC). Patients and Methods: A total of 118 patients with GC were enrolled in this study. 18F-FDG PET/CT imaging was performed prior to surgery. The LIFEx software package was applied to extract PET and CT radiomics features. The minimum absolute contraction and selection operator (least absolute shrinkage and selection operator [LASSO]) algorithm was used to select the best radiomics features. Three machine learning methods, logistic regression (LR), support vector machine (SVM), and random forest (RF) models, were constructed and verified. The Synthetic Minority Oversampling Technique (SMOTE) was applied to address data imbalance. Results: In the training and test sets, the area under the curve (AUC) values of the LR, SVM, and RF models were 0.809, 0.761, 0.861 and 0.628, 0.993, 0.717, respectively, and the Brier scores were 0.118, 0.214, and 0.143, respectively. Among the three models, the LR and RF models exhibited extremely good prediction performance. The AUC values of the three models significantly improved after SMOTE balanced the data. Conclusions: 18F-FDG PET/CT-based radiomics models, especially LR and RF models, demonstrate good performance in predicting HER2 expression status in patients with GC and can be used to preselect patients who may benefit from HER2-targeted therapy.

Artificial-Intelligence-Enhanced Analysis of In Vivo Confocal Microscopy in Corneal Diseases: A Review

Artificial intelligence (AI) has seen significant progress in medical diagnostics, particularly in image and video analysis. This review focuses on the application of AI in analyzing in vivo confocal microscopy (IVCM) images for corneal diseases. The cornea, as an exposed and delicate part of the body, necessitates the precise diagnoses of various conditions. Convolutional neural networks (CNNs), a key component of deep learning, are a powerful tool for image data analysis. This review highlights AI applications in diagnosing keratitis, dry eye disease, and diabetic corneal neuropathy. It discusses the potential of AI in detecting infectious agents, analyzing corneal nerve morphology, and identifying the subtle changes in nerve fiber characteristics in diabetic corneal neuropathy. However, challenges still remain, including limited datasets, overfitting, low-quality images, and unrepresentative training datasets. This review explores augmentation techniques and the importance of feature engineering to address these challenges. Despite the progress made, challenges are still present, such as the "black-box" nature of AI models and the need for explainable AI (XAI). Expanding datasets, fostering collaborative efforts, and developing user-friendly AI tools are crucial for enhancing the acceptance and integration of AI into clinical practice.

The Influence of Additional Treatments on the Survival of Patients Undergoing Transarterial Radioembolization (TARE)

The aim of this study was to present our preliminary experience with transarterial radioembolization (TARE) using Yttrium-90 (90Y), compare the cancer-specific survival (CSS) of patients with hepatocellular carcinoma (HCC) and colorectal cancer (CRC) liver metastases undergoing TARE, and investigate the influence of additional treatments on CSS. Our database was interrogated to retrieve patients who had undergone TARE using Yttrium-90 (90Y) glass or resin microspheres. Kaplan-Meier curves and the log-rank test were employed to conduct survival analysis for the different groups (p < 0.05). Thirty-nine patients were retrieved (sex: 27 M, 12 F; mean age: 63.59 ± 15.66 years): twenty-three with hepatocellular carcinoma (HCC) and sixteen with CRC liver metastasis. Globally, the patients with HCC demonstrated a significantly longer CSS than those with CRC liver metastasis (22.64 ± 2.7 vs. 7.21 ± 1.65 months; p = 0.014). Among the patients with CRC liver metastasis, those receiving TARE and additional concomitant treatments (n = 10) demonstrated a longer CSS than the CRC patients receiving only TARE (9.97 ± 2.21 vs. 2.59 ± 0.24 months; p = 0.06). In the HCC group, there was a trend of a longer CSS in patients (n = 8) receiving TARE and additional treatments (27.89 ± 3.1 vs. 17.69 ± 3.14 months; p = 0.15). Patients with HCC seem to achieve a longer survival after TARE compared to patients with CRC liver metastases. In patients with CRC liver metastases, the combination of TARE and additional concomitant treatments may improve survival.

Development and validation of a deep learning model for predicting postoperative survival of patients with gastric cancer

BACKGROUND

Deep learning (DL), a specialized form of machine learning (ML), is valuable for forecasting survival in various diseases. Its clinical applicability in real-world patients with gastric cancer (GC) has yet to be extensively validated.

METHODS

A combined cohort of 11,414 GC patients from the Surveillance, Epidemiology and End Results (SEER) database and 2,846 patients from a Chinese dataset were utilized. The internal validation of different algorithms, including DL model, traditional ML models, and American Joint Committee on Cancer (AJCC) stage model, was conducted by training and testing sets on the SEER database, followed by external validation on the Chinese dataset. The performance of the algorithms was assessed using the area under the receiver operating characteristic curve, decision curve, and calibration curve.

RESULTS

DL model demonstrated superior performance in terms of the area under the curve (AUC) at 1, 3, and, 5 years post-surgery across both datasets, surpassing other ML models and AJCC stage model, with AUCs of 0.77, 0.80, and 0.82 in the SEER dataset and 0.77, 0.76, and 0.75 in the Chinese dataset, respectively. Furthermore, decision curve analysis revealed that the DL model yielded greater net gains at 3 years than other ML models and AJCC stage model, and calibration plots at 3 years indicated a favorable level of consistency between the ML and actual observations during external validation.

CONCLUSIONS

DL-based model was established to accurately predict the survival rate of postoperative patients with GC.

Segmentation of Variants of Nuclei on Whole Slide Images by Using Radiomic Features

The histopathological segmentation of nuclear types is a challenging task because nuclei exhibit distinct morphologies, textures, and staining characteristics. Accurate segmentation is critical because it affects the diagnostic workflow for patient assessment. In this study, a framework was proposed for segmenting various types of nuclei from different organs of the body. The proposed framework improved the segmentation performance for each nuclear type using radiomics. First, we used distinct radiomic features to extract and analyze quantitative information about each type of nucleus and subsequently trained various classifiers based on the best input sub-features of each radiomic feature selected by a LASSO operator. Second, we inputted the outputs of the best classifier to various segmentation models to learn the variants of nuclei. Using the MoNuSAC2020 dataset, we achieved state-of-the-art segmentation performance for each category of nuclei type despite the complexity, overlapping, and obscure regions. The generalized adaptability of the proposed framework was verified by the consistent performance obtained in whole slide images of different organs of the body and radiomic features.

Study on diagnosing thyroid nodules of ACR TI-RADS 4-5 with multimodal ultrasound radiomics technology

BACKGROUND

Explore the feasibility of using the multimodal ultrasound (US) radiomics technology to diagnose American College of Radiology (ACR) Thyroid Imaging Reporting and Data System (TI-RADS) 4-5 thyroid nodules.

METHOD

This study prospectively collected the clinical characteristics, conventional, and US elastography images of 100 patients diagnosed with ACR TI-RADS 4-5 nodules from May 2022 to 2023. Independent risk factors for malignant thyroid nodules were extracted and screened using methods such as the least absolute shrinkage and selection operator (LASSO) logistic regression (LR) model, and a multimodal US radiomics combined diagnostic model was established. Using a multifactorial LR analysis and a Rad-score rating, the predictive performance was validated and evaluated, and the final threshold range was determined to assess the clinical net benefit of the model.

RESULTS

In the training set, the US radiomics combined predictive model area under curve (AUC = 0.928) had higher diagnostic performance compared with clinical characteristics (AUC = 0.779), conventional US (AUC = 0.794), and US elastography model (AUC = 0.852). In the validation set, the multimodal US radiomics combined diagnostic model (AUC = 0.829) also had higher diagnostic performance compared with clinical characteristics (AUC = 0.799), conventional US (AUC = 0.802), and US elastography model (AUC = 0.718).

CONCLUSION

Multi-modal US radiomics technology can effectively diagnose thyroid nodules of ACR TI-RADS 4-5, and the combination of radiomics signature and conventional US features can further improve the diagnostic performance.

MRI-Based Radiomics Methods for Predicting Ki-67 Expression in Breast Cancer: A Systematic Review and Meta-analysis

RATIONALE AND OBJECTIVES

The purpose of this systematic review and meta-analysis was to assess the quality and diagnostic accuracy of MRI-based radiomics for predicting Ki-67 expression in breast cancer.

MATERIALS AND METHODS

A systematic literature search was performed to find relevant studies published in different databases, including PubMed, Web of Science, and Embase up until March 10, 2023. All papers were independently evaluated for eligibility by two reviewers. Studies that matched research questions and provided sufficient data for quantitative synthesis were included in the systematic review and meta-analysis, respectively. The quality of the articles was assessed using Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) and Radiomics Quality Score (RQS) tools. The predictive value of MRI-based radiomics for Ki-67 antigen in patients with breast cancer was assessed using pooled sensitivity (SEN), specificity, and area under the curve (AUC). Meta-regression was performed to explore the cause of heterogeneity. Different covariates were used for subgroup analysis.

RESULTS

31 studies were included in the systematic review; among them, 21 reported sufficient data for meta-analysis. 20 training cohorts and five validation cohorts were pooled separately. The pooled sensitivity, specificity, and AUC of MRI-based radiomics for predicting Ki-67 expression in training cohorts were 0.80 [95% CI, 0.73-0.86], 0.82 [95% CI, 0.78-0.86], and 0.88 [95%CI, 0.85-0.91], respectively. The corresponding values for validation cohorts were 0.81 [95% CI, 0.72-0.87], 0.73 [95% CI, 0.62-0.82], and 0.84 [95%CI, 0.80-0.87], respectively. Based on QUADAS-2, some risks of bias were detected for reference standard and flow and timing domains. However, the quality of the included article was acceptable. The mean RQS score of the included articles was close to 6, corresponding to 16.6% of the maximum possible score. Significant heterogeneity was observed in pooled sensitivity and specificity of training cohorts (I2 > 75%). We found that using deep learning radiomic methods, magnetic field strength (3 T vs. 1.5 T), scanner manufacturer, region of interest structure (2D vs. 3D), route of tissue sampling, Ki-67 cut-off, logistic regression for model construction, and LASSO for feature reduction as well as PyRadiomics software for feature extraction had a great impact on heterogeneity according to our joint model analysis. Diagnostic performance in studies that used deep learning-based radiomics and multiple MRI sequences (e.g., DWI+DCE) was slightly higher. In addition, radiomic features derived from DWI sequences performed better than contrast-enhanced sequences in terms of specificity and sensitivity. No publication bias was found based on Deeks' funnel plot. Sensitivity analysis showed that eliminating every study one by one does not impact overall results.

CONCLUSION

This meta-analysis showed that MRI-based radiomics has a good diagnostic accuracy in differentiating breast cancer patients with high Ki-67 expression from low-expressing groups. However, the sensitivity and specificity of these methods still do not surpass 90%, restricting them from being used as a supplement to current pathological assessments (e.g., biopsy or surgery) to predict Ki-67 expression accurately.

Interobserver delineation variability of computed tomography-based radiomic features of the parotid gland

PURPOSE

To assess the interobserver delineation variability of radiomic features of the parotid gland from computed tomography (CT) images and evaluate the correlation of these features for head and neck cancer (HNC) radiotherapy patients.

MATERIALS AND METHODS

Contrast-enhanced CT images of 20 HNC patients were utilized. The parotid glands were delineated by treating radiation oncologists (ROs), a selected RO and AccuContour auto-segmentation software. Dice similarity coefficients (DSCs) between each pair of observers were calculated. A total of 107 radiomic features were extracted, whose robustness to interobserver delineation was assessed using the intraclass correlation coefficient (ICC). Pearson correlation coefficients (r) were calculated to determine the relationship between the features. The influence of excluding unrobust features from normal tissue complication probability (NTCP) modeling was investigated for severe oral mucositis (grade ≥3).

RESULTS

The average DSC was 0.84 (95% confidence interval, 0.83-0.86). Most of the shape features demonstrated robustness (ICC ≥0.75), while the first-order and texture features were influenced by delineation variability. Among the three observers investigated, 42 features were sufficiently robust, out of which 36 features exhibited weak correlation (|r|<0.8). No significant difference in the robustness level was found when comparing manual segmentation by a single RO or automated segmentation with the actual clinical contour data made by treating ROs. Excluding unrobust features from the NTCP model for severe oral mucositis did not deteriorate the model performance.

CONCLUSION

Interobserver delineation variability had substantial impact on radiomic features of the parotid gland. Both manual and automated segmentation methods contributed similarly to this variation.

Artificial intelligence applications in prostate cancer

Artificial intelligence (AI) applications have enabled remarkable advancements in healthcare delivery. These AI tools are often aimed to improve accuracy and efficiency of histopathology assessment and diagnostic imaging interpretation, risk stratification (i.e., prognostication), and prediction of therapeutic benefit for personalized treatment recommendations. To date, multiple AI algorithms have been explored for prostate cancer to address automation of clinical workflow, integration of data from multiple domains in the decision-making process, and the generation of diagnostic, prognostic, and predictive biomarkers. While many studies remain within the pre-clinical space or lack validation, the last few years have witnessed the emergence of robust AI-based biomarkers validated on thousands of patients, and the prospective deployment of clinically-integrated workflows for automated radiation therapy design. To advance the field forward, multi-institutional and multi-disciplinary collaborations are needed in order to prospectively implement interoperable and accountable AI technology routinely in clinic.

Predictive modeling algorithms for liver metastasis in colorectal cancer: A systematic review of the current literature

This study aims to assess the quality and performance of predictive models for colorectal cancer liver metastasis (CRCLM). A systematic review was performed to identify relevant studies from various databases. Studies that described or validated predictive models for CRCLM were included. The methodological quality of the predictive models was assessed. Model performance was evaluated by the reported area under the receiver operating characteristic curve (AUC). Of the 117 articles screened, seven studies comprising 14 predictive models were included. The distribution of included predictive models was as follows: radiomics (n = 3), logistic regression (n = 3), Cox regression (n = 2), nomogram (n = 3), support vector machine (SVM, n = 2), random forest (n = 2), and convolutional neural network (CNN, n = 2). Age, sex, carcinoembryonic antigen, and tumor staging (T and N stage) were the most frequently used clinicopathological predictors for CRCLM. The mean AUCs ranged from 0.697 to 0.870, with 86% of the models demonstrating clear discriminative ability (AUC > 0.70). A hybrid approach combining clinical and radiomic features with SVM provided the best performance, achieving an AUC of 0.870. The overall risk of bias was identified as high in 71% of the included studies. This review highlights the potential of predictive modeling to accurately predict the occurrence of CRCLM. Integrating clinicopathological and radiomic features with machine learning algorithms demonstrates superior predictive capabilities.

Deep learning-based radiomics model from pretreatment ADC to predict biochemical recurrence in advanced prostate cancer

Purpose

To develop deep-learning radiomics model for predicting biochemical recurrence (BCR) of advanced prostate cancer (PCa) based on pretreatment apparent diffusion coefficient (ADC) maps.

Methods

Data were collected retrospectively from 131 patients diagnosed with advanced PCa, randomly divided into training (n = 93) and test (n = 38) datasets. Pre-treatment ADC images were segmented using a pre-trained artificial intelligence (AI) model to identify suspicious PCa areas. Three models were constructed, including a clinical model, a conventional radiomics model and a deep-radiomics model. The receiver operating characteristic (ROC), precision-recall (PR) curve and decision curve analysis (DCA) were used to assess predictive performance in test dataset. The net reclassification index (NRI) and integrated discrimination improvement (IDI) were employed to compare the performance enhancement of the deep-radiomics model in relation to the other two models.

Results

The deep-radiomics model exhibited a significantly higher area under the curve (AUC) of ROC than the other two (P = 0.033, 0.026), as well as PR curve (AUC difference 0.420, 0.432). The DCA curve demonstrated superior performance for the deep-radiomics model across all risk thresholds than the other two. Taking the clinical model as reference, the NRI and IDI was 0.508 and 0.679 for the deep-radiomics model with significant difference. Compared with the conventional radiomics model, the NRI and IDI was 0.149 and 0.164 for the deep-radiomics model without significant difference.

Conclusion

The deep-radiomics model exhibits promising potential in predicting BCR in advanced PCa, compared to both the clinical model and the conventional radiomics model.

Machine Learning-Based Breast Tumor Ultrasound Radiomics for Pre-operative Prediction of Axillary Sentinel Lymph Node Metastasis Burden in Early-Stage Invasive Breast Cancer

OBJECTIVE

The aim of the work described here was to assess the application of ultrasound (US) radiomics with machine learning (ML) classifiers to the prediction of axillary sentinel lymph node metastasis (SLNM) burden in early-stage invasive breast cancer (IBC).

METHODS

In this study, 278 early-stage IBC patients with at least one SLNM (195 in the training set and 83 in the test set) were studied at our institution. Pathologic SLNM burden was used as the reference standard. The US radiomics features of breast tumors were extracted by using 3D-Slicer and PyRadiomics software. Four ML classifiers-linear discriminant analysis (LDA), support vector machine (SVM), random forest (RF) and decision tree (DT)-were used to construct radiomics models for the prediction of SLNM burden. The combined clinicopathologic-radiomics models were also assessed with respect to sensitivity, specificity, accuracy and areas under the curve (AUCs).

RESULTS

Among the US radiomics models, the SVM classifier achieved better predictive performance with an AUC of 0.920 compared with RF (AUC = 0.874), LDA (AUC = 0.835) and DT (AUC = 0.800) in the test set. The clinicopathologic model had low efficacy, with AUCs of 0.678 and 0.710 in the training and test sets, respectively. The combined clinicopathologic (C) factors and SVM classifier (C + SVM) model improved the predictive ability with an AUC of 0.934, sensitivity of 86.7%, specificity of 89.9% and accuracy of 91.0% in the test set.

CONCLUSION

ML-based US radiomics analysis, as a novel and promising predictive tool, is conducive to a precise clinical treatment strategy.

Non-invasive prediction of the chronic degree of lupus nephropathy based on ultrasound radiomics

OBJECTIVE

Through machine learning (ML) analysis of the radiomics features of ultrasound extracted from patients with lupus nephritis (LN), this attempt was made to non-invasively predict the chronicity index (CI)of LN.

METHODS

A retrospective collection of 136 patients with LN who had renal biopsy was retrospectively collected, and the patients were randomly divided into training set and validation set according to 7:3. Radiomics features are extracted from ultrasound images, independent factors are obtained by using LASSO dimensionality reduction, and then seven ML models were used to establish predictive models. At the same time, a clinical model and an US model were established. The diagnostic efficacy of the model is evaluated by analysis of the receiver operating characteristics (ROC) curve, accuracy, specificity, and sensitivity. The performance of the seven machine learning models was compared with each other and with clinical and US models.

RESULTS

A total of 1314 radiomics features are extracted from ultrasound images, and 5 features are finally screened out by LASSO for model construction, and the average ROC of the seven ML is 0.683, among which the Xgboost model performed the best, and the AUC in the test set is 0.826 (95% CI: 0.681-0.936). For the same test set, the AUC of clinical model constructed based on eGFR is 0.560 (95% CI: 0.357-0.761), and the AUC of US model constructed based on Ultrasound parameters is 0.679 (95% CI: 0.489-0.853). The Xgboost model is significantly more efficient than the clinical and US models.

CONCLUSION

ML model based on ultrasound radiomics features can accurately predict the chronic degree of LN, which can provide a valuable reference for clinicians in the treatment strategy of LN patients.

Deep learning and machine learning predictive models for neurological function after interventional embolization of intracranial aneurysms

Objective

The objective of this study is to develop a model to predicts the postoperative Hunt-Hess grade in patients with intracranial aneurysms by integrating radiomics and deep learning technologies, using preoperative CTA imaging data. Thereby assisting clinical decision-making and improving the assessment and prognosis of postoperative neurological function.

Methods

This retrospective study encompassed 101 patients who underwent aneurysm embolization surgery. 851 radiomic features were extracted from CTA images. 512 deep learning features are extracted from last layer of ResNet50 deep convolutional neural network model. The feature screening process pipeline encompassed intraclass correlation coefficient analysis, principal component analysis, U test, spearman correlation analysis, minimum redundancy maximum relevance algorithm and Lasso regression, to identify features most correlated with postoperative Hunt-Hess grading. In the model construction phase, three distinct models were constructed: radiomics feature-based model (RSM), deep learning feature-based model (DLM), and deep learning-radiomics feature fusion model (DLRSCM). The study also calculated the radiomics score and combined it with clinical data to construct a Nomogram for predictive modeling. DLM, RSM and DLRSCM model was constructed by 9 base algorithms and 1 ensemble learning algorithm - Stacking ensemble model. Model performance was evaluated based on the area under the Receiver Operating Characteristic (ROC) curve (AUC), Matthews Correlation Coefficient (MCC), calibration curves, and decision curves analysis.

Results

5 significant radiomic feature and 4 significant deep learning features were obtained through the feature selection process. These features were utilized for model construction. Bootstrap resampling method was used for internal validation of the models. In terms of model evaluation, the DLM model, the stacking ensemble algorithm results achieved an AUC of 0.959 and MCC of 0.815. In the RSM model, the stacking ensemble model AUC was 0.935 and MCC was 0.793. The stacking ensemble model in DLRSCM outperformed others, with an AUC of 0.968 and MCC of 0.820. Results indicated that the ANN performed optimally among all base models, while the stacked ensemble learning model exhibited the highest predictive performance.

Conclusion

This study demonstrates that the combination of radiomics and deep learning is an effective approach to predict the postoperative Hunt-Hess grade in patients with intracranial aneurysms. This holds significant value in the early identification of postoperative neurological complications and in enhancing clinical decision-making.

Diagnostic Accuracy of Deep Learning for the Prediction of Osteoporosis Using Plain X-rays: A Systematic Review and Meta-Analysis

(1) Background: This meta-analysis assessed the diagnostic accuracy of deep learning model-based osteoporosis prediction using plain X-ray images. (2) Methods: We searched PubMed, Web of Science, SCOPUS, and Google Scholar from no set beginning date to 28 February 2023, for eligible studies that applied deep learning methods for diagnosing osteoporosis using X-ray images. The quality of studies was assessed using the Quality Assessment of Diagnostic Accuracy Studies-2 criteria. The area under the receiver operating characteristic curve (AUROC) was used to quantify the predictive performance. Subgroup, meta-regression, and sensitivity analyses were performed to identify the potential sources of study heterogeneity. (3) Results: Six studies were included; the pooled AUROC, sensitivity, and specificity were 0.88 (95% confidence interval [CI] 0.85-0.91), 0.81 (95% CI 0.78-0.84), and 0.87 (95% CI 0.81-0.92), respectively, indicating good performance. Moderate heterogeneity was observed. Mega-regression and subgroup analyses were not performed due to the limited number of studies included. (4) Conclusion: Deep learning methods effectively extract bone density information from plain radiographs, highlighting their potential for opportunistic screening. Nevertheless, additional prospective multicenter studies involving diverse patient populations are required to confirm the applicability of this novel technique.

An Informative Review of Radiomics Studies on Cancer Imaging: The Main Findings, Challenges and Limitations of the Methodologies

The aim of this informative review was to investigate the application of radiomics in cancer imaging and to summarize the results of recent studies to support oncological imaging with particular attention to breast cancer, rectal cancer and primitive and secondary liver cancer. This review also aims to provide the main findings, challenges and limitations of the current methodologies. Clinical studies published in the last four years (2019-2022) were included in this review. Among the 19 studies analyzed, none assessed the differences between scanners and vendor-dependent characteristics, collected images of individuals at additional points in time, performed calibration statistics, represented a prospective study performed and registered in a study database, conducted a cost-effectiveness analysis, reported on the cost-effectiveness of the clinical application, or performed multivariable analysis with also non-radiomics features. Seven studies reached a high radiomic quality score (RQS), and seventeen earned additional points by using validation steps considering two datasets from two distinct institutes and open science and data domains (radiomics features calculated on a set of representative ROIs are open source). The potential of radiomics is increasingly establishing itself, even if there are still several aspects to be evaluated before the passage of radiomics into routine clinical practice. There are several challenges, including the need for standardization across all stages of the workflow and the potential for cross-site validation using real-world heterogeneous datasets. Moreover, multiple centers and prospective radiomics studies with more samples that add inter-scanner differences and vendor-dependent characteristics will be needed in the future, as well as the collecting of images of individuals at additional time points, the reporting of calibration statistics and the performing of prospective studies registered in a study database.

Predicting quetiapine dose in patients with depression using machine learning techniques based on real-world evidence

BACKGROUND

Being one of the most widespread, pervasive, and troublesome illnesses in the world, depression causes dysfunction in various spheres of individual and social life. Regrettably, despite obtaining evidence-based antidepressant medication, up to 70% of people are going to continue to experience troublesome symptoms. Quetiapine, as one of the most commonly prescribed antipsychotic medication worldwide, has been reported as an effective augmentation strategy to antidepressants. The right quetiapine dose and personalized quetiapine treatment are frequently challenging for clinicians. This study aimed to identify important influencing variables for quetiapine dose by maximizing the use of data from real world, and develop a predictive model of quetiapine dose through machine learning techniques to support selections for treatment regimens.

METHODS

The study comprised 308 depressed patients who were medicated with quetiapine and hospitalized in the First Hospital of Hebei Medical University, from November 1, 2019, to August 31, 2022. To identify the important variables influencing the dose of quetiapine, a univariate analysis was applied. The prediction abilities of nine machine learning models (XGBoost, LightGBM, RF, GBDT, SVM, LR, ANN, DT) were compared. Algorithm with the optimal model performance was chosen to develop the prediction model.

RESULTS

Four predictors were selected from 38 variables by the univariate analysis (p < 0.05), including quetiapine TDM value, age, mean corpuscular hemoglobin concentration, and total bile acid. Ultimately, the XGBoost algorithm was used to create a prediction model for quetiapine dose that had the greatest predictive performance (accuracy = 0.69) out of nine models. In the testing cohort (62 cases), a total of 43 cases were correctly predicted of the quetiapine dose regimen. In dose subgroup analysis, AUROC for patients with daily dose of 100 mg, 200 mg, 300 mg and 400 mg were 0.99, 0.75, 0.93 and 0.86, respectively.

CONCLUSIONS

In this work, machine learning techniques are used for the first time to estimate the dose of quetiapine for patients with depression, which is valuable for the clinical drug recommendations.

Empowering breast cancer diagnosis and radiology practice: advances in artificial intelligence for contrast-enhanced mammography

Artificial intelligence (AI) applications in breast imaging span a wide range of tasks including decision support, risk assessment, patient management, quality assessment, treatment response assessment and image enhancement. However, their integration into the clinical workflow has been slow due to the lack of a consensus on data quality, benchmarked robust implementation, and consensus-based guidelines to ensure standardization and generalization. Contrast-enhanced mammography (CEM) has improved sensitivity and specificity compared to current standards of breast cancer diagnostic imaging i.e., mammography (MG) and/or conventional ultrasound (US), with comparable accuracy to MRI (current diagnostic imaging benchmark), but at a much lower cost and higher throughput. This makes CEM an excellent tool for widespread breast lesion characterization for all women, including underserved and minority women. Underlining the critical need for early detection and accurate diagnosis of breast cancer, this review examines the limitations of conventional approaches and reveals how AI can help overcome them. The Methodical approaches, such as image processing, feature extraction, quantitative analysis, lesion classification, lesion segmentation, integration with clinical data, early detection, and screening support have been carefully analysed in recent studies addressing breast cancer detection and diagnosis. Recent guidelines described by Checklist for Artificial Intelligence in Medical Imaging (CLAIM) to establish a robust framework for rigorous evaluation and surveying has inspired the current review criteria.

Trends and Hotspots in Global Radiomics Research: A Bibliometric Analysis

Objectives: The purpose of this research is to summarize the structure of radiomics-based knowledge and to explore potential trends and priorities by using bibliometric analysis. Methods: Select radiomics-related publications from 2012 to October 2022 from the Science Core Collection Web site. Use VOSviewer (version 1.6.18), CiteSpace (version 6.1.3), Tableau (version 2022), Microsoft Excel and Rstudio's free online platforms (http://bibliometric.com) for co-writing, co-citing, and co-occurrence analysis of countries, institutions, authors, references, and keywords in the field. The visual analysis is also carried out on it. Results: The study included 6428 articles. Since 2012, there has been an increase in research papers based on radiomics. Judging by publications, China has made the largest contribution in this area. We identify the most productive institutions and authors as Fudan University and Tianjie. The top three magazines with the most publications are《FRONTIERS IN ONCOLOGY》, 《EUROPEAN RADIOLOGY》, and 《CANCERS》. According to the results of reference and keyword analysis, "deep learning, nomogram, ultrasound, f-18-fdg, machine learning, covid-19, radiogenomics" has been determined as the main research direction in the future. Conclusion: Radiomics is in a phase of vigorous development with broad prospects. Cross-border cooperation between countries and institutions should be strengthened in the future. It can be predicted that the development of deep learning-based models and multimodal fusion models will be the focus of future research. Advances in knowledge: This study explores the current state of research and hot spots in the field of radiomics from multiple perspectives, comprehensively, and objectively reflecting the evolving trends in imaging-related research and providing a reference for future research.

k-strip: A novel segmentation algorithm in k-space for the application of skull stripping

BACKGROUND AND OBJECTIVE

We present a novel deep learning-based skull stripping algorithm for magnetic resonance imaging (MRI) that works directly in the information rich complex valued k-space.

METHODS

Using four datasets from different institutions with a total of around 200,000 MRI slices, we show that our network can perform skull-stripping on the raw data of MRIs while preserving the phase information which no other skull stripping algorithm is able to work with. For two of the datasets, skull stripping performed by HD-BET (Brain Extraction Tool) in the image domain is used as the ground truth, whereas the third and fourth dataset comes with per-hand annotated brain segmentations.

RESULTS

All four datasets were very similar to the ground truth (DICE scores of 92 %-99 % and Hausdorff distances of under 5.5 pixel). Results on slices above the eye-region reach DICE scores of up to 99 %, whereas the accuracy drops in regions around the eyes and below, with partially blurred output. The output of k-Strip often has smoothed edges at the demarcation to the skull. Binary masks are created with an appropriate threshold.

CONCLUSION

With this proof-of-concept study, we were able to show the feasibility of working in the k-space frequency domain, preserving phase information, with consistent results. Besides preserving valuable information for further diagnostics, this approach makes an immediate anonymization of patient data possible, already before being transformed into the image domain. Future research should be dedicated to discovering additional ways the k-space can be used for innovative image analysis and further workflows.

State of the art: radiomics and radiomics-related artificial intelligence on the road to clinical translation

Radiomics and artificial intelligence carry the promise of increased precision in oncologic imaging assessments due to the ability of harnessing thousands of occult digital imaging features embedded in conventional medical imaging data. While powerful, these technologies suffer from a number of sources of variability that currently impede clinical translation. In order to overcome this impediment, there is a need to control for these sources of variability through harmonization of imaging data acquisition across institutions, construction of standardized imaging protocols that maximize the acquisition of these features, harmonization of post-processing techniques, and big data resources to properly power studies for hypothesis testing. For this to be accomplished, it will be critical to have multidisciplinary and multi-institutional collaboration.