Radiomics in nuclear medicine: robustness, reproducibility, standardization, and how to avoid data analysis traps and replication crisis

Extensions of open science for applied behavior analysis: Preregistration for single-case experimental designs

Open science practices are designed to enhance the utility, integrity, and credibility of scientific research. This article highlights how preregistration in open science practice can be leveraged to enhance the rigor and transparency of single-case experimental designs within an applied behavior analysis framework. We provide an overview of the benefits of preregistration including increased transparency, reduced risk of researcher bias, and improved replicability, and we review the specific contexts under which these practices most benefit the proposed framework. We discuss potential concerns with and unique considerations for preregistering experiments that use single-case designs, with practical guidance for researchers who are seeking to preregister their studies. We present a checklist as a tool for researchers in applied behavior analysis to use for preregistration and provide recommendations for our field to strengthen the contingencies for open science practices that include preregistration.

Self-reported checklists and quality scoring tools in radiomics: a meta-research

OBJECTIVE

To evaluate the use of reporting checklists and quality scoring tools for self-reporting purposes in radiomics literature.

METHODS

Literature search was conducted in PubMed (date, April 23, 2023). The radiomics literature was sampled at random after a sample size calculation with a priori power analysis. A systematic assessment for self-reporting, including the use of documentation such as completed checklists or quality scoring tools, was conducted in original research papers. These eligible papers underwent independent evaluation by a panel of nine readers, with three readers assigned to each paper. Automatic annotation was used to assist in this process. Then, a detailed item-by-item confirmation analysis was carried out on papers with checklist documentation, with independent evaluation of two readers.

RESULTS

The sample size calculation yielded 117 papers. Most of the included papers were retrospective (94%; 110/117), single-center (68%; 80/117), based on their private data (89%; 104/117), and lacked external validation (79%; 93/117). Only seven papers (6%) had at least one self-reported document (Radiomics Quality Score (RQS), Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD), or Checklist for Artificial Intelligence in Medical Imaging (CLAIM)), with a statistically significant binomial test (p < 0.001). Median rate of confirmed items for all three documents was 81% (interquartile range, 6). For quality scoring tools, documented scores were higher than suggested scores, with a mean difference of - 7.2 (standard deviation, 6.8).

CONCLUSION

Radiomic publications often lack self-reported checklists or quality scoring tools. Even when such documents are provided, it is essential to be cautious, as the accuracy of the reported items or scores may be questionable.

CLINICAL RELEVANCE STATEMENT

Current state of radiomic literature reveals a notable absence of self-reporting with documentation and inaccurate reporting practices. This critical observation may serve as a catalyst for motivating the radiomics community to adopt and utilize such tools appropriately, thereby fostering rigor, transparency, and reproducibility of their research, moving the field forward.

KEY POINTS

• In radiomics literature, there has been a notable absence of self-reporting with documentation. • Even if such documents are provided, it is critical to exercise caution because the accuracy of the reported items or scores may be questionable. • Radiomics community needs to be motivated to adopt and appropriately utilize the reporting checklists and quality scoring tools.

MRI-based deep learning and radiomics for prediction of occult cervical lymph node metastasis and prognosis in early-stage oral and oropharyngeal squamous cell carcinoma: a diagnostic study

INTRODUCTION

The incidence of occult cervical lymph node metastases (OCLNM) is reported to be 20-30% in early-stage oral cancer and oropharyngeal cancer. There is a lack of an accurate diagnostic method to predict occult lymph node metastasis and to help surgeons make precise treatment decisions.

AIM

To construct and evaluate a preoperative diagnostic method to predict OCLNM in early-stage oral and oropharyngeal squamous cell carcinoma (OC and OP SCC) based on deep learning features (DLFs) and radiomics features.

METHODS

A total of 319 patients diagnosed with early-stage OC or OP SCC were retrospectively enrolled and divided into training, test and external validation sets. Traditional radiomics features and DLFs were extracted from their MRI images. The least absolute shrinkage and selection operator (LASSO) analysis was employed to identify the most valuable features. Prediction models for OCLNM were developed using radiomics features and DLFs. The effectiveness of the models and their clinical applicability were evaluated using the area under the curve (AUC), decision curve analysis (DCA), and survival analysis.

RESULTS

Seventeen prediction models were constructed. The Resnet50 deep learning (DL) model based on the combination of radiomics and DL features achieves the optimal performance, with AUC values of 0.928 (95% CI: 0.881-0.975), 0.878 (95% CI: 0.766-0.990), 0.796 (95% CI: 0.666-0.927), and 0.834 (95% CI: 0.721-0.947) in the training, test, external validation set1, and external validation set2, respectively. Moreover, the Resnet50 model has great prediction value of prognosis in patients with early-stage OC and OP SCC.

CONCLUSION

The proposed MRI-based Resnet50 DL model demonstrated high capability in diagnosis of OCLNM and prognosis prediction in the early-stage OC and OP SCC. The Resnet50 model could help refine the clinical diagnosis and treatment of the early-stage OC and OP SCC.

Robustness of radiomics among photon-counting detector CT and dual-energy CT systems: a texture phantom study

OBJECTIVES

To evaluate the robustness of radiomics features among photon-counting detector CT (PCD-CT) and dual-energy CT (DECT) systems.

METHODS

A texture phantom consisting of twenty-eight materials was scanned with one PCD-CT and four DECT systems (dual-source, rapid kV-switching, dual-layer, and sequential scanning) at three dose levels twice. Thirty sets of virtual monochromatic images at 70 keV were reconstructed. Regions of interest were delineated for each material with a rigid registration. Ninety-three radiomics were extracted per PyRadiomics. The test-retest repeatability between repeated scans was assessed by Bland-Altman analysis. The intra-system reproducibility between dose levels, and inter-system reproducibility within the same dose level, were evaluated by intraclass correlation coefficient (ICC) and concordance correlation coefficient (CCC). Inter-system variability among five scanners was assessed by coefficient of variation (CV) and quartile coefficient of dispersion (QCD).

RESULTS

The test-retest repeatability analysis presented that 97.1% of features were repeatable between scan-rescans. The mean ± standard deviation ICC and CCC were 0.945 ± 0.079 and 0.945 ± 0.079 for intra-system reproducibility, respectively, and 86.0% and 85.7% of features were with ICC > 0.90 and CCC > 0.90, respectively, between different dose levels. The mean ± standard deviation ICC and CCC were 0.157 ± 0.174 and 0.157 ± 0.174 for inter-system reproducibility, respectively, and none of the features were with ICC > 0.90 or CCC > 0.90 within the same dose level. The inter-system variability suggested that 6.5% and 12.8% of features were with CV < 10% and QCD < 10%, respectively, among five CT systems.

CONCLUSION

The radiomics features were non-reproducible with significant variability in values among different CT techniques.

CLINICAL RELEVANCE STATEMENT

Radiomics features are non-reproducible with significant variability in values among photon-counting detector CT and dual-energy CT systems, necessitating careful attention to improve the cross-system generalizability of radiomic features before implementation of radiomics analysis in clinical routine.

KEY POINTS

CT radiomics stability should be guaranteed before the implementation in the clinical routine. Radiomics robustness was on a low level among photon-counting detectors and dual-energy CT techniques. Limited inter-system robustness of radiomic features may impact the generalizability of models.

Radiolabeling of bionanomaterials with technetium 99m: current state and future prospects

Radiolabeling of bionanomaterials with technetium-99m (99mTc) has become a promising approach in combining the benefits of nanotechnology and nuclear medicine for diagnostic and therapeutic purposes. This review is intended to provide a comprehensive overview of the state-of-the-art of radiolabeling of bionanomaterials with 99mTc, highlighting the synthesis methods, labeling mechanisms, biological evaluation, physicochemical characterization and clinical applications of 99mTc-labeled bionanomaterials. Various types of nanomaterials are considered in the review, including lipid- and protein-based nanosystems, dendrimers and polymeric nanomaterials. Moreover, the review assesses the challenges presented by this emerging field, such as stability of the radiolabel, potential toxicity of the nanomaterials and regulatory aspects. Finally, promising future perspectives and areas of research development in 99mTc-labeled bionanomaterials are discussed.

The effect of harmonization on the variability of PET radiomic features extracted using various segmentation methods

PURPOSE

This study aimed to examine the robustness of positron emission tomography (PET) radiomic features extracted via different segmentation methods before and after ComBat harmonization in patients with non-small cell lung cancer (NSCLC).

METHODS

We included 120 patients (positive recurrence = 46 and negative recurrence = 74) referred for PET scanning as a routine part of their care. All patients had a biopsy-proven NSCLC. Nine segmentation methods were applied to each image, including manual delineation, K-means (KM), watershed, fuzzy-C-mean, region-growing, local active contour (LAC), and iterative thresholding (IT) with 40, 45, and 50% thresholds. Diverse image discretizations, both without a filter and with different wavelet decompositions, were applied to PET images. Overall, 6741 radiomic features were extracted from each image (749 radiomic features from each segmented area). Non-parametric empirical Bayes (NPEB) ComBat harmonization was used to harmonize the features. Linear Support Vector Classifier (LinearSVC) with L1 regularization For feature selection and Support Vector Machine classifier (SVM) with fivefold nested cross-validation was performed using StratifiedKFold with 'n_splits' set to 5 to predict recurrence in NSCLC patients and assess the impact of ComBat harmonization on the outcome.

RESULTS

From 749 extracted radiomic features, 206 (27%) and 389 (51%) features showed excellent reliability (ICC ≥ 0.90) against segmentation method variation before and after NPEB ComBat harmonization, respectively. Among all, 39 features demonstrated poor reliability, which declined to 10 after ComBat harmonization. The 64 fixed bin widths (without any filter) and wavelets (LLL)-based radiomic features set achieved the best performance in terms of robustness against diverse segmentation techniques before and after ComBat harmonization. The first-order and GLRLM and also first-order and NGTDM feature families showed the largest number of robust features before and after ComBat harmonization, respectively. In terms of predicting recurrence in NSCLC, our findings indicate that using ComBat harmonization can significantly enhance machine learning outcomes, particularly improving the accuracy of watershed segmentation, which initially had fewer reliable features than manual contouring. Following the application of ComBat harmonization, the majority of cases saw substantial increase in sensitivity and specificity.

CONCLUSION

Radiomic features are vulnerable to different segmentation methods. ComBat harmonization might be considered a solution to overcome the poor reliability of radiomic features.

Baseline [18F]FDG PET/CT and MRI first-order breast tumor features do not improve pathological complete response prediction to neoadjuvant chemotherapy

PURPOSE

To verify the ability of pretreatment [18F]FDG PET/CT and T1-weighed dynamic contrast-enhanced MRI to predict pathological complete response (pCR) after neoadjuvant chemotherapy (NAC) in breast cancer (BC) patients.

METHODS

This retrospective study includes patients with BC of no special type submitted to baseline [18F]FDG PET/CT, NAC and surgery. [18F]FDG PET-based features reflecting intensity and heterogeneity of tracer uptake were extracted from the primary BC and suspicious axillary lymph nodes (ALN), for comparative analysis related to NAC response (pCR vs. non-pCR). Multivariate logistic regression was performed for response prediction combining the breast tumor-extracted PET-based features and clinicopathological features. A subanalysis was performed in a patients' subsample by adding breast tumor-extracted first-order MRI-based features to the multivariate logistic regression.

RESULTS

A total of 170 tumors from 168 patients were included. pCR was observed in 60/170 tumors (20/107 luminal B-like, 25/45 triple-negative and 15/18 HER2-enriched surrogate molecular subtypes). Higher intensity and higher heterogeneity of [18F]FDG uptake in the primary BC were associated with NAC response in HER2-negative tumors (immunohistochemistry score 0, 1 + or 2 + non-amplified by in situ hybridization). Also, higher intensity of tracer uptake was observed in ALN in the pCR group among HER2-negative tumors. No [18F]FDG PET-based features were associated with pCR in the other subgroup analyses. A subsample of 103 tumors was also submitted to extraction of MRI-based features. When combined with clinicopathological features, neither [18F]FDG PET nor MRI-based features had additional value for pCR prediction. The only significant predictors were estrogen receptor status, HER2 expression and grade.

CONCLUSION

Pretreatment [18F]FDG PET-based features from primary BC and ALN are not associated with response to NAC, except in HER2-negative tumors. As compared with pathological features, no breast tumor-extracted PET or MRI-based feature improved response prediction.

Multivariate testing and effect size measures for batch effect evaluation in radiomic features

While precision medicine applications of radiomics analysis are promising, differences in image acquisition can cause "batch effects" that reduce reproducibility and affect downstream predictive analyses. Harmonization methods such as ComBat have been developed to correct these effects, but evaluation methods for quantifying batch effects are inconsistent. In this study, we propose the use of the multivariate statistical test PERMANOVA and the Robust Effect Size Index (RESI) to better quantify and characterize batch effects in radiomics data. We evaluate these methods in both simulated and real radiomics features extracted from full-field digital mammography (FFDM) data. PERMANOVA demonstrated higher power than standard univariate statistical testing, and RESI was able to interpretably quantify the effect size of site at extremely large sample sizes. These methods show promise as more powerful and interpretable methods for the detection and quantification of batch effects in radiomics studies.

Gastro-Esophageal Cancer: Can Radiomic Parameters from Baseline 18F-FDG-PET/CT Predict the Development of Distant Metastatic Disease?

We aimed to determine if clinical parameters and radiomics combined with sarcopenia status derived from baseline 18F-FDG-PET/CT could predict developing metastatic disease and overall survival (OS) in gastroesophageal cancer (GEC). Patients referred for primary staging who underwent 18F-FDG-PET/CT from 2008 to 2019 were evaluated retrospectively. Overall, 243 GEC patients (mean age = 64) were enrolled. Clinical, histopathology, and sarcopenia data were obtained, and primary tumor radiomics features were extracted. For classification (early-stage vs. advanced disease), the association of the studied parameters was evaluated. Various clinical and radiomics models were developed and assessed. Accuracy and area under the curve (AUC) were calculated. For OS prediction, univariable and multivariable Cox analyses were performed. The best model included PET/CT radiomics features, clinical data, and sarcopenia score (accuracy = 80%; AUC = 88%). For OS prediction, various clinical, CT, and PET features entered the multivariable analysis. Three clinical factors (advanced disease, age ≥ 70 and ECOG ≥ 2), along with one CT-derived and one PET-derived radiomics feature, retained their significance. Overall, 18F-FDG PET/CT radiomics seems to have a potential added value in identifying GEC patients with advanced disease and may enhance the performance of baseline clinical parameters. These features may also have a prognostic value for OS, improving the decision-making for GEC patients.

Does consensus contour improve robustness and accuracy in 18F-FDG PET radiomic features?

PURPOSE

The purpose of our study is to validate the robustness and accuracy of consensus contour in 2-deoxy-2-[18 F]fluoro-D-glucose (18 F-FDG) PET radiomic features.

METHODS

225 nasopharyngeal carcinoma (NPC) and 13 extended cardio-torso (XCAT) simulated data were enrolled. All segmentation were performed with four segmentation methods under two different initial masks, respectively. Consensus contour (ConSeg) was then developed using the majority vote rule. 107 radiomic features were extracted by Pyradiomics based on segmentation and the intraclass correlation coefficient (ICC) was calculated for each feature between masks or among segmentation, respectively. In XCAT ICC between segmentation and simulated ground truth were also calculated to access the accuracy.

RESULTS

ICC varied with the dataset, segmentation method, initial mask and feature type. ConSeg presented higher ICC for radiomic features in robustness tests and similar ICC in accuracy tests, compared with the average of four segmentation results. Higher ICC were also generally observed in irregular initial masks compared with rectangular masks in both robustness and accuracy tests. Furthermore, 19 features (17.76%) had ICC ≥ 0.75 in both robustness and accuracy tests for any of the segmentation methods or initial masks. The dataset was observed to have a large impact on the correlation relationships between radiomic features, but not the segmentation method or initial mask.

CONCLUSIONS

The consensus contour combined with irregular initial mask could improve the robustness and accuracy in radiomic analysis to some extent. The correlation relationships between radiomic features and feature clusters largely depended on the dataset, but not segmentation method or initial mask.

Radiomics workflow definition & challenges - German priority program 2177 consensus statement on clinically applied radiomics

OBJECTIVES

Achieving a consensus on a definition for different aspects of radiomics workflows to support their translation into clinical usage. Furthermore, to assess the perspective of experts on important challenges for a successful clinical workflow implementation.

MATERIALS AND METHODS

The consensus was achieved by a multi-stage process. Stage 1 comprised a definition screening, a retrospective analysis with semantic mapping of terms found in 22 workflow definitions, and the compilation of an initial baseline definition. Stages 2 and 3 consisted of a Delphi process with over 45 experts hailing from sites participating in the German Research Foundation (DFG) Priority Program 2177. Stage 2 aimed to achieve a broad consensus for a definition proposal, while stage 3 identified the importance of translational challenges.

RESULTS

Workflow definitions from 22 publications (published 2012-2020) were analyzed. Sixty-nine definition terms were extracted, mapped, and semantic ambiguities (e.g., homonymous and synonymous terms) were identified and resolved. The consensus definition was developed via a Delphi process. The final definition comprising seven phases and 37 aspects reached a high overall consensus (> 89% of experts "agree" or "strongly agree"). Two aspects reached no strong consensus. In addition, the Delphi process identified and characterized from the participating experts' perspective the ten most important challenges in radiomics workflows.

CONCLUSION

To overcome semantic inconsistencies between existing definitions and offer a well-defined, broad, referenceable terminology, a consensus workflow definition for radiomics-based setups and a terms mapping to existing literature was compiled. Moreover, the most relevant challenges towards clinical application were characterized.

CRITICAL RELEVANCE STATEMENT

Lack of standardization represents one major obstacle to successful clinical translation of radiomics. Here, we report a consensus workflow definition on different aspects of radiomics studies and highlight important challenges to advance the clinical adoption of radiomics.

KEY POINTS

Published radiomics workflow terminologies are inconsistent, hindering standardization and translation. A consensus radiomics workflow definition proposal with high agreement was developed. Publicly available result resources for further exploitation by the scientific community.

Validated machine learning tools to distinguish immune checkpoint inhibitor, radiotherapy, COVID-19 and other infective pneumonitis

BACKGROUND

Pneumonitis is a well-described, potentially disabling, or fatal adverse effect associated with both immune checkpoint inhibitors (ICI) and thoracic radiotherapy. Accurate differentiation between checkpoint inhibitor pneumonitis (CIP) radiation pneumonitis (RP), and infective pneumonitis (IP) is crucial for swift, appropriate, and tailored management to achieve optimal patient outcomes. However, correct diagnosis is often challenging, owing to overlapping clinical presentations and radiological patterns.

METHODS

In this multi-centre study of 455 patients, we used machine learning with radiomic features extracted from chest CT imaging to develop and validate five models to distinguish CIP and RP from COVID-19, non-COVID-19 infective pneumonitis, and each other. Model performance was compared to that of two radiologists.

RESULTS

Models to distinguish RP from COVID-19, CIP from COVID-19 and CIP from non-COVID-19 IP out-performed radiologists (test set AUCs of 0.92 vs 0.8 and 0.8; 0.68 vs 0.43 and 0.4; 0.71 vs 0.55 and 0.63 respectively). Models to distinguish RP from non-COVID-19 IP and CIP from RP were not superior to radiologists but demonstrated modest performance, with test set AUCs of 0.81 and 0.8 respectively. The CIP vs RP model performed less well on patients with prior exposure to both ICI and radiotherapy (AUC 0.54), though the radiologists also had difficulty distinguishing this test cohort (AUC values 0.6 and 0.6).

CONCLUSION

Our results demonstrate the potential utility of such tools as a second or concurrent reader to support oncologists, radiologists, and chest physicians in cases of diagnostic uncertainty. Further research is required for patients with exposure to both ICI and thoracic radiotherapy.

Applying oversampling before cross-validation will lead to high bias in radiomics

Class imbalance is often unavoidable for radiomic data collected from clinical routine. It can create problems during classifier training since the majority class could dominate the minority class. Consequently, resampling methods like oversampling or undersampling are applied to the data to class-balance the data. However, the resampling must not be applied upfront to all data because it would lead to data leakage and, therefore, to erroneous results. This study aims to measure the extent of this bias. Five-fold cross-validation with 30 repeats was performed using a set of 15 radiomic datasets to train predictive models. The training involved two scenarios: first, the models were trained correctly by applying the resampling methods during the cross-validation. Second, the models were trained incorrectly by performing the resampling on all the data before cross-validation. The bias was defined empirically as the difference between the best-performing models in both scenarios in terms of area under the receiver operating characteristic curve (AUC), sensitivity, specificity, balanced accuracy, and the Brier score. In addition, a simulation study was performed on a randomly generated dataset for verification. The results demonstrated that incorrectly applying the oversampling methods to all data resulted in a large positive bias (up to 0.34 in AUC, 0.33 in sensitivity, 0.31 in specificity, and 0.37 in balanced accuracy). The bias depended on the data balance, and approximately an increase of 0.10 in the AUC was observed for each increase in imbalance. The models also showed a bias in calibration measured using the Brier score, which differed by up to -0.18 between the correctly and incorrectly trained models. The undersampling methods were not affected significantly by bias. These results emphasize that any resampling method should be applied correctly only to the training data to avoid data leakage and, subsequently, biased model performance and calibration.

Impact of 18F-FDG PET Intensity Normalization on Radiomic Features of Oropharyngeal Squamous Cell Carcinomas and Machine Learning-Generated Biomarkers

We aimed to investigate the effects of 18F-FDG PET voxel intensity normalization on radiomic features of oropharyngeal squamous cell carcinoma (OPSCC) and machine learning-generated radiomic biomarkers. Methods: We extracted 1,037 18F-FDG PET radiomic features quantifying the shape, intensity, and texture of 430 OPSCC primary tumors. The reproducibility of individual features across 3 intensity-normalized images (body-weight SUV, reference tissue activity ratio to lentiform nucleus of brain and cerebellum) and the raw PET data was assessed using an intraclass correlation coefficient (ICC). We investigated the effects of intensity normalization on the features' utility in predicting the human papillomavirus (HPV) status of OPSCCs in univariate logistic regression, receiver-operating-characteristic analysis, and extreme-gradient-boosting (XGBoost) machine-learning classifiers. Results: Of 1,037 features, a high (ICC ≥ 0.90), medium (0.90 > ICC ≥ 0.75), and low (ICC < 0.75) degree of reproducibility across normalization methods was attained in 356 (34.3%), 608 (58.6%), and 73 (7%) features, respectively. In univariate analysis, features from the PET normalized to the lentiform nucleus had the strongest association with HPV status, with 865 of 1,037 (83.4%) significant features after multiple testing corrections and a median area under the receiver-operating-characteristic curve (AUC) of 0.65 (interquartile range, 0.62-0.68). Similar tendencies were observed in XGBoost models, with the lentiform nucleus-normalized model achieving the numerically highest average AUC of 0.72 (SD, 0.07) in the cross validation within the training cohort. The model generalized well to the validation cohorts, attaining an AUC of 0.73 (95% CI, 0.60-0.85) in independent validation and 0.76 (95% CI, 0.58-0.95) in external validation. The AUCs of the XGBoost models were not significantly different. Conclusion: Only one third of the features demonstrated a high degree of reproducibility across intensity-normalization techniques, making uniform normalization a prerequisite for interindividual comparability of radiomic markers. The choice of normalization technique may affect the radiomic features' predictive value with respect to HPV. Our results show trends that normalization to the lentiform nucleus may improve model performance, although more evidence is needed to draw a firm conclusion.

Predicting postoperative rehemorrhage in hypertensive intracerebral hemorrhage using noncontrast CT radiomics and clinical data with an interpretable machine learning approach

In hypertensive intracerebral hemorrhage (HICH) patients, while emergency surgeries effectively reduce intracranial pressure and hematoma volume, their significant risk of causing postoperative rehemorrhage necessitates early detection and management to improve patient prognosis. This study sought to develop and validate machine learning (ML) models leveraging clinical data and noncontrast CT radiomics to pinpoint patients at risk of postoperative rehemorrhage, equipping clinicians with an early detection tool for prompt intervention. The study conducted a retrospective analysis on 609 HICH patients, dividing them into training and external verification cohorts. These patients were categorized into groups with and without postoperative rehemorrhage. Radiomics features from noncontrast CT images were extracted, standardized, and employed to create several ML models. These models underwent internal validation using both radiomics and clinical data, with the best model's feature significance assessed via the Shapley additive explanations (SHAP) method, then externally validated. In the study of 609 patients, postoperative rehemorrhage rates were similar in the training (18.8%, 80/426) and external verification (17.5%, 32/183) cohorts. Six significant noncontrast CT radiomics features were identified, with the support vector machine (SVM) model outperforming others in both internal and external validations. SHAP analysis highlighted five critical predictors of postoperative rehemorrhage risk, encompassing three radiomics features from noncontrast CT and two clinical data indicators. This study highlights the effectiveness of an SVM model combining radiomics features from noncontrast CT and clinical parameters in predicting postoperative rehemorrhage among HICH patients. This approach enables timely and effective interventions, thereby improving patient outcomes.

Delta Radiomic Features Predict Resection Margin Status and Overall Survival in Neoadjuvant-Treated Pancreatic Cancer Patients

BACKGROUND

Neoadjuvant therapy (NAT) emerged as the standard of care for patients with pancreatic ductal adenocarcinoma (PDAC) who undergo surgery; however, surgery is morbid, and tools to predict resection margin status (RMS) and prognosis in the preoperative setting are needed. Radiomic models, specifically delta radiomic features (DRFs), may provide insight into treatment dynamics to improve preoperative predictions.

METHODS

We retrospectively collected clinical, pathological, and surgical data (patients with resectable, borderline, locally advanced, and metastatic disease), and pre/post-NAT contrast-enhanced computed tomography (CT) scans from PDAC patients at the University of Texas Southwestern Medical Center (UTSW; discovery) and Humanitas Hospital (validation cohort). Gross tumor volume was contoured from CT scans, and 257 radiomics features were extracted. DRFs were calculated by direct subtraction of pre/post-NAT radiomic features. Cox proportional models and binary prediction models, including/excluding clinical variables, were constructed to predict overall survival (OS), disease-free survival (DFS), and RMS.

RESULTS

The discovery and validation cohorts comprised 58 and 31 patients, respectively. Both cohorts had similar clinical characteristics, apart from differences in NAT (FOLFIRINOX vs. gemcitabine/nab-paclitaxel; p < 0.05) and type of surgery resections (pancreatoduodenectomy, distal or total pancreatectomy; p < 0.05). The model that combined clinical variables (pre-NAT carbohydrate antigen (CA) 19-9, the change in CA19-9 after NAT (∆CA19-9), and resectability status) and DRFs outperformed the clinical feature-based models and other radiomics feature-based models in predicting OS (UTSW: 0.73; Humanitas: 0.66), DFS (UTSW: 0.75; Humanitas: 0.64), and RMS (UTSW 0.73; Humanitas: 0.69).

CONCLUSIONS

Our externally validated, predictive/prognostic delta-radiomics models, which incorporate clinical variables, show promise in predicting the risk of predicting RMS in NAT-treated PDAC patients and their OS or DFS.

Artificial intelligence in neuro-oncology: advances and challenges in brain tumor diagnosis, prognosis, and precision treatment

This review delves into the most recent advancements in applying artificial intelligence (AI) within neuro-oncology, specifically emphasizing work on gliomas, a class of brain tumors that represent a significant global health issue. AI has brought transformative innovations to brain tumor management, utilizing imaging, histopathological, and genomic tools for efficient detection, categorization, outcome prediction, and treatment planning. Assessing its influence across all facets of malignant brain tumor management- diagnosis, prognosis, and therapy- AI models outperform human evaluations in terms of accuracy and specificity. Their ability to discern molecular aspects from imaging may reduce reliance on invasive diagnostics and may accelerate the time to molecular diagnoses. The review covers AI techniques, from classical machine learning to deep learning, highlighting current applications and challenges. Promising directions for future research include multimodal data integration, generative AI, large medical language models, precise tumor delineation and characterization, and addressing racial and gender disparities. Adaptive personalized treatment strategies are also emphasized for optimizing clinical outcomes. Ethical, legal, and social implications are discussed, advocating for transparency and fairness in AI integration for neuro-oncology and providing a holistic understanding of its transformative impact on patient care.

Segmentation of Variants of Nuclei on Whole Slide Images by Using Radiomic Features

The histopathological segmentation of nuclear types is a challenging task because nuclei exhibit distinct morphologies, textures, and staining characteristics. Accurate segmentation is critical because it affects the diagnostic workflow for patient assessment. In this study, a framework was proposed for segmenting various types of nuclei from different organs of the body. The proposed framework improved the segmentation performance for each nuclear type using radiomics. First, we used distinct radiomic features to extract and analyze quantitative information about each type of nucleus and subsequently trained various classifiers based on the best input sub-features of each radiomic feature selected by a LASSO operator. Second, we inputted the outputs of the best classifier to various segmentation models to learn the variants of nuclei. Using the MoNuSAC2020 dataset, we achieved state-of-the-art segmentation performance for each category of nuclei type despite the complexity, overlapping, and obscure regions. The generalized adaptability of the proposed framework was verified by the consistent performance obtained in whole slide images of different organs of the body and radiomic features.

Prediction of Gleason score in prostate cancer patients based on radiomic features of transrectal ultrasound images

OBJECTIVES

The aim of this study was to develop a model for predicting the Gleason score of patients with prostate cancer based on ultrasound images.

METHODS

Transrectal ultrasound images of 838 prostate cancer patients from The Cancer Imaging Archive database were included in this cross-section study. Data were randomly divided into the training set and testing set (ratio 7:3). A total of 103 radiomic features were extracted from the ultrasound image. Lasso regression was used to select radiomic features. Random forest and broad learning system (BLS) methods were utilized to develop the model. The area under the curve (AUC) was calculated to evaluate the model performance.

RESULTS

After the screening, 10 radiomic features were selected. The AUC and accuracy of the radiomic feature variables random forest model in the testing set were 0.727 (95% CI, 0.694-0.760) and 0.646 (95% CI, 0.620-0.673), respectively. When PSA and radiomic feature variables were included in the random forest model, the AUC and accuracy of the model were 0.770 (95% CI, 0.740-0.800) and 0.713 (95% CI, 0.688-0.738), respectively. While the BLS method was utilized to construct the model, the AUC and accuracy of the model were 0.726 (95% CI, 0.693-0.759) and 0.698 (95% CI, 0.673-0.723), respectively. In predictions for different Gleason grades, the highest AUC of 0.847 (95% CI, 0.749-0.945) was found to predict Gleason grade 5 (Gleason score ≥9).

CONCLUSIONS

A model based on transrectal ultrasound image features showed a good ability to predict Gleason scores in prostate cancer patients.

ADVANCES IN KNOWLEDGE

This study used ultrasound-based radiomics to predict the Gleason score of patients with prostate cancer.

Impacts of Adaptive Statistical Iterative Reconstruction-V and Deep Learning Image Reconstruction Algorithms on Robustness of CT Radiomics Features: Opportunity for Minimizing Radiomics Variability Among Scans of Different Dose Levels

This study aims to investigate the influence of adaptive statistical iterative reconstruction-V (ASIR-V) and deep learning image reconstruction (DLIR) on CT radiomics feature robustness. A standardized phantom was scanned under single-energy CT (SECT) and dual-energy CT (DECT) modes at standard and low (20 and 10 mGy) dose levels. Images of SECT 120 kVp and corresponding DECT 120 kVp-like virtual monochromatic images were generated with filtered back-projection (FBP), ASIR-V at 40% (AV-40) and 100% (AV-100) blending levels, and DLIR algorithm at low (DLIR-L), medium (DLIR-M), and high (DLIR-H) strength levels. Ninety-four features were extracted via Pyradiomics. Reproducibility of features was calculated between standard and low dose levels, between reconstruction algorithms in reference to FBP images, and within scan mode, using intraclass correlation coefficient (ICC) and concordance correlation coefficient (CCC). The average percentage of features with ICC > 0.90 and CCC > 0.90 between the two dose levels was 21.28% and 20.75% in AV-40 images, and 39.90% and 35.11% in AV-100 images, respectively, and increased from 15.43 to 45.22% and from 15.43 to 44.15% with an increasing strength level of DLIR. The average percentage of features with ICC > 0.90 and CCC > 0.90 in reference to FBP images was 26.07% and 25.80% in AV-40 images, and 18.88% and 18.62% in AV-100 images, respectively, and decreased from 27.93 to 17.82% and from 27.66 to 17.29% with an increasing strength level of DLIR. DLIR and ASIR-V algorithms showed low reproducibility in reference to FBP images, while the high-strength DLIR algorithm provides an opportunity for minimizing radiomics variability due to dose reduction.

Classification of Pulmonary Nodules in 2-[18F]FDG PET/CT Images with a 3D Convolutional Neural Network

Purpose

2-[18F]FDG PET/CT plays an important role in the management of pulmonary nodules. Convolutional neural networks (CNNs) automatically learn features from images and have the potential to improve the discrimination between malignant and benign pulmonary nodules. The purpose of this study was to develop and validate a CNN model for classification of pulmonary nodules from 2-[18F]FDG PET images.

Methods

One hundred thirteen participants were retrospectively selected. One nodule per participant. The 2-[18F]FDG PET images were preprocessed and annotated with the reference standard. The deep learning experiment entailed random data splitting in five sets. A test set was held out for evaluation of the final model. Four-fold cross-validation was performed from the remaining sets for training and evaluating a set of candidate models and for selecting the final model. Models of three types of 3D CNNs architectures were trained from random weight initialization (Stacked 3D CNN, VGG-like and Inception-v2-like models) both in original and augmented datasets. Transfer learning, from ImageNet with ResNet-50, was also used.

Results

The final model (Stacked 3D CNN model) obtained an area under the ROC curve of 0.8385 (95% CI: 0.6455-1.0000) in the test set. The model had a sensibility of 80.00%, a specificity of 69.23% and an accuracy of 73.91%, in the test set, for an optimised decision threshold that assigns a higher cost to false negatives.

Conclusion

A 3D CNN model was effective at distinguishing benign from malignant pulmonary nodules in 2-[18F]FDG PET images.

Supplementary Information

The online version contains supplementary material available at 10.1007/s13139-023-00821-6.

METhodological RadiomICs Score (METRICS): a quality scoring tool for radiomics research endorsed by EuSoMII

PURPOSE

To propose a new quality scoring tool, METhodological RadiomICs Score (METRICS), to assess and improve research quality of radiomics studies.

METHODS

We conducted an online modified Delphi study with a group of international experts. It was performed in three consecutive stages: Stage#1, item preparation; Stage#2, panel discussion among EuSoMII Auditing Group members to identify the items to be voted; and Stage#3, four rounds of the modified Delphi exercise by panelists to determine the items eligible for the METRICS and their weights. The consensus threshold was 75%. Based on the median ranks derived from expert panel opinion and their rank-sum based conversion to importance scores, the category and item weights were calculated.

RESULT

In total, 59 panelists from 19 countries participated in selection and ranking of the items and categories. Final METRICS tool included 30 items within 9 categories. According to their weights, the categories were in descending order of importance: study design, imaging data, image processing and feature extraction, metrics and comparison, testing, feature processing, preparation for modeling, segmentation, and open science. A web application and a repository were developed to streamline the calculation of the METRICS score and to collect feedback from the radiomics community.

CONCLUSION

In this work, we developed a scoring tool for assessing the methodological quality of the radiomics research, with a large international panel and a modified Delphi protocol. With its conditional format to cover methodological variations, it provides a well-constructed framework for the key methodological concepts to assess the quality of radiomic research papers.

CRITICAL RELEVANCE STATEMENT

A quality assessment tool, METhodological RadiomICs Score (METRICS), is made available by a large group of international domain experts, with transparent methodology, aiming at evaluating and improving research quality in radiomics and machine learning.

KEY POINTS

• A methodological scoring tool, METRICS, was developed for assessing the quality of radiomics research, with a large international expert panel and a modified Delphi protocol. • The proposed scoring tool presents expert opinion-based importance weights of categories and items with a transparent methodology for the first time. • METRICS accounts for varying use cases, from handcrafted radiomics to entirely deep learning-based pipelines. • A web application has been developed to help with the calculation of the METRICS score ( https://metricsscore.github.io/metrics/METRICS.html ) and a repository created to collect feedback from the radiomics community ( https://github.com/metricsscore/metrics ).

A Critical Analysis of the Robustness of Radiomics to Variations in Segmentation Methods in 18F-PSMA-1007 PET Images of Patients Affected by Prostate Cancer

BACKGROUND

Radiomics shows promising results in supporting the clinical decision process, and much effort has been put into its standardization, thus leading to the Imaging Biomarker Standardization Initiative (IBSI), that established how radiomics features should be computed. However, radiomics still lacks standardization and many factors, such as segmentation methods, limit study reproducibility and robustness.

AIM

We investigated the impact that three different segmentation methods (manual, thresholding and region growing) have on radiomics features extracted from 18F-PSMA-1007 Positron Emission Tomography (PET) images of 78 patients (43 Low Risk, 35 High Risk). Segmentation was repeated for each patient, thus leading to three datasets of segmentations. Then, feature extraction was performed for each dataset, and 1781 features (107 original, 930 Laplacian of Gaussian (LoG) features, 744 wavelet features) were extracted. Feature robustness and reproducibility were assessed through the intra class correlation coefficient (ICC) to measure agreement between the three segmentation methods. To assess the impact that the three methods had on machine learning models, feature selection was performed through a hybrid descriptive-inferential method, and selected features were given as input to three classifiers, K-Nearest Neighbors (KNN), Support Vector Machines (SVM), Linear Discriminant Analysis (LDA), Random Forest (RF), AdaBoost and Neural Networks (NN), whose performance in discriminating between low-risk and high-risk patients have been validated through 30 times repeated five-fold cross validation.

CONCLUSIONS

Our study showed that segmentation methods influence radiomics features and that Shape features were the least reproducible (average ICC: 0.27), while GLCM features the most reproducible. Moreover, feature reproducibility changed depending on segmentation type, resulting in 51.18% of LoG features exhibiting excellent reproducibility (range average ICC: 0.68-0.87) and 47.85% of wavelet features exhibiting poor reproducibility that varied between wavelet sub-bands (range average ICC: 0.34-0.80) and resulted in the LLL band showing the highest average ICC (0.80). Finally, model performance showed that region growing led to the highest accuracy (74.49%), improved sensitivity (84.38%) and AUC (79.20%) in contrast with manual segmentation.

Clinico-biological-radiomics (CBR) based machine learning for improving the diagnostic accuracy of FDG-PET false-positive lymph nodes in lung cancer

BACKGROUND

The main problem of positron emission tomography/computed tomography (PET/CT) for lymph node (LN) staging is the high false positive rate (FPR). Thus, we aimed to explore a clinico-biological-radiomics (CBR) model via machine learning (ML) to reduce FPR and improve the accuracy for predicting the hypermetabolic mediastinal-hilar LNs status in lung cancer than conventional PET/CT.

METHODS

A total of 260 lung cancer patients with hypermetabolic mediastinal-hilar LNs (SUVmax ≥ 2.5) were retrospectively reviewed. Patients were treated with surgery with systematic LN resection and pathologically divided into the LN negative (LN-) and positive (LN +) groups, and randomly assigned into the training (n = 182) and test (n = 78) sets. Preoperative CBR dataset containing 1738 multi-scale features was constructed for all patients. Prediction models for hypermetabolic LNs status were developed using the features selected by the supervised ML algorithms, and evaluated using the classical diagnostic indicators. Then, a nomogram was developed based on the model with the highest area under the curve (AUC) and the lowest FPR, and validated by the calibration plots.

RESULTS

In total, 109 LN- and 151 LN + patients were enrolled in this study. 6 independent prediction models were developed to differentiate LN- from LN + patients using the selected features from clinico-biological-image dataset, radiomics dataset, and their combined CBR dataset, respectively. The DeLong test showed that the CBR Model containing all-scale features held the highest predictive efficiency and the lowest FPR among all of established models (p < 0.05) in both the training and test sets (AUCs of 0.90 and 0.89, FPRs of 12.82% and 6.45%, respectively) (p < 0.05). The quantitative nomogram based on CBR Model was validated to have a good consistency with actual observations.

CONCLUSION

This study presents an integrated CBR nomogram that can further reduce the FPR and improve the accuracy of hypermetabolic mediastinal-hilar LNs evaluation than conventional PET/CT in lung cancer, thereby greatly reducing the risk of overestimation and assisting for precision treatment.

Impact of respiratory motion on 18 F-FDG PET radiomics stability: Clinical evaluation with a digital PET scanner

PURPOSE

18 F-FDG PET quantitative features are susceptible to respiratory motion. However, studies using clinical patient data to explore the impact of respiratory motion on 18 F-FDG PET radiomic features are limited. In this study, we investigated the impact of respiratory motion on radiomics stability with clinical 18 F-FDG PET images using a data-driven gating (DDG) algorithm on the digital PET scanner.

MATERIALS AND METHODS

A total of 101 patients who underwent oncological 18 F-FDG PET scans were retrospectively included. A DDG algorithm combined with a motion compensation technique was used to extract the PET images with respiratory motion correction. 18 F-FDG-avid lesions from the thorax to the upper abdomen were analyzed on the non-DDG and DDG PET images. The lesions were segmented with a 40% threshold of the maximum standardized uptake. A total of 725 radiomic features were computed from the segmented lesions, including first-order, shape, texture, and wavelet features. The intraclass correlation coefficient (ICC) and coefficient of variation (COV) were calculated to evaluate feature stability. An ICC above 0.9 and a COV below 5% were considered high stability.

RESULTS

In total, 168 lesions with and without respiratory motion correction were analyzed. Our results indicated that most 18 F-FDG PET radiomic features are sensitive to respiratory motion. Overall, only 27 out of 725 (3.72%) radiomic features were identified as highly stable, including one from the first-order features (entropy), one from the shape features (sphericity), four from the gray-level co-occurrence matrix features (normalized and unnormalized inverse difference moment, joint entropy, and sum entropy), one from the gray-level run-length matrix features (run entropy), and 20 from the wavelet filter-based features.

CONCLUSION

Respiratory motion has a significant impact on 18 F-FDG PET radiomics stability. The highly stable features identified in our study may serve as potential candidates for further applications, such as machine learning modeling.

Enhancing Interoperability and Harmonisation of Nuclear Medicine Image Data and Associated Clinical Data

Nuclear imaging techniques such as positron emission tomography (PET) and single photon emission computed tomography (SPECT) in combination with computed tomography (CT) are established imaging modalities in clinical practice, particularly for oncological problems. Due to a multitude of manufacturers, different measurement protocols, local demographic or clinical workflow variations as well as various available reconstruction and analysis software, very heterogeneous datasets are generated. This review article examines the current state of interoperability and harmonisation of image data and related clinical data in the field of nuclear medicine. Various approaches and standards to improve data compatibility and integration are discussed. These include, for example, structured clinical history, standardisation of image acquisition and reconstruction as well as standardised preparation of image data for evaluation. Approaches to improve data acquisition, storage and analysis will be presented. Furthermore, approaches are presented to prepare the datasets in such a way that they become usable for projects applying artificial intelligence (AI) (machine learning, deep learning, etc.). This review article concludes with an outlook on future developments and trends related to AI in nuclear medicine, including a brief research of commercial solutions.

Nuclear medicine radiomics in digestive system tumors: Concept, applications, challenges, and future perspectives

Radiomics aims to develop novel biomarkers and provide relevant deeper subvisual information about pathology, immunophenotype, and tumor microenvironment. It uses automated or semiautomated quantitative analysis of high-dimensional images to improve characterization, diagnosis, and prognosis. Recent years have seen a rapid increase in radiomics applications in nuclear medicine, leading to some promising research results in digestive system oncology, which have been driven by big data analysis and the development of artificial intelligence. Although radiomics advances one step further toward the non-invasive precision medical analysis, it is still a step away from clinical application and faces many challenges. This review article summarizes the available literature on digestive system tumors regarding radiomics in nuclear medicine. First, we describe the workflow and steps involved in radiomics analysis. Subsequently, we discuss the progress in clinical application regarding the utilization of radiomics for distinguishing between various diseases and evaluating their prognosis, and demonstrate how radiomics advances this field. Finally, we offer our viewpoint on how the field can progress by addressing the challenges facing clinical implementation.

Clinical Applications of Radiomics in Nuclear Medicine

Radiomics is an emerging field of artificial intelligence that focuses on the extraction and analysis of quantitative features such as intensity, shape, texture and spatial relationships from medical images. These features, often imperceptible to the human eye, can reveal complex patterns and biological insights. They can also be combined with clinical data to create predictive models using machine learning to improve disease characterization in nuclear medicine. This review article examines the current state of radiomics in nuclear medicine and shows its potential to improve patient care. Selected clinical applications for diseases such as cancer, neurodegenerative diseases, cardiovascular problems and thyroid diseases are examined. The article concludes with a brief classification in terms of future perspectives and strategies for linking research findings to clinical practice.

Computed Tomography-derived intratumoral and peritumoral radiomics in predicting EGFR mutation in lung adenocarcinoma

OBJECTIVE

To investigate the value of Computed Tomography (CT) radiomics derived from different peritumoral volumes of interest (VOIs) in predicting epidermal growth factor receptor (EGFR) mutation status in lung adenocarcinoma patients.

MATERIALS AND METHODS

A retrospective cohort of 779 patients who had pathologically confirmed lung adenocarcinoma were enrolled. 640 patients were randomly divided into a training set, a validation set, and an internal testing set (3:1:1), and the remaining 139 patients were defined as an external testing set. The intratumoral VOI (VOI_I) was manually delineated on the thin-slice CT images, and seven peritumoral VOIs (VOI_P) were automatically generated with 1, 2, 3, 4, 5, 10, and 15 mm expansion along the VOI_I. 1454 radiomic features were extracted from each VOI. The t-test, the least absolute shrinkage and selection operator (LASSO), and the minimum redundancy maximum relevance (mRMR) algorithm were used for feature selection, followed by the construction of radiomics models (VOI_I model, VOI_P model and combined model). The performance of the models were evaluated by the area under the curve (AUC).

RESULTS

399 patients were classified as EGFR mutant (EGFR+), while 380 were wild-type (EGFR-). In the training and validation sets, internal and external testing sets, VOI4 (intratumoral and peritumoral 4 mm) model achieved the best predictive performance, with AUCs of 0.877, 0.727, and 0.701, respectively, outperforming the VOI_I model (AUCs of 0.728, 0.698, and 0.653, respectively).

CONCLUSIONS

Radiomics extracted from peritumoral region can add extra value in predicting EGFR mutation status of lung adenocarcinoma patients, with the optimal peritumoral range of 4 mm.

Development and multicenter validation of a multiparametric imaging model to predict treatment response in rectal cancer

OBJECTIVES

To develop and validate a multiparametric model to predict neoadjuvant treatment response in rectal cancer at baseline using a heterogeneous multicenter MRI dataset.

METHODS

Baseline staging MRIs (T2W (T2-weighted)-MRI, diffusion-weighted imaging (DWI) / apparent diffusion coefficient (ADC)) of 509 patients (9 centres) treated with neoadjuvant chemoradiotherapy (CRT) were collected. Response was defined as (1) complete versus incomplete response, or (2) good (Mandard tumor regression grade (TRG) 1-2) versus poor response (TRG3-5). Prediction models were developed using combinations of the following variable groups: (1) Non-imaging: age/sex/tumor-location/tumor-morphology/CRT-surgery interval (2) Basic staging: cT-stage/cN-stage/mesorectal fascia involvement, derived from (2a) original staging reports, or (2b) expert re-evaluation (3) Advanced staging: variables from 2b combined with cTN-substaging/invasion depth/extramural vascular invasion/tumor length (4) Quantitative imaging: tumour volume + first-order histogram features (from T2W-MRI and DWI/ADC) Models were developed with data from 6 centers (n = 412) using logistic regression with the Least Absolute Shrinkage and Selector Operator (LASSO) feature selection, internally validated using repeated (n = 100) random hold-out validation, and externally validated using data from 3 centers (n = 97).

RESULTS

After external validation, the best model (including non-imaging and advanced staging variables) achieved an area under the curve of 0.60 (95%CI=0.48-0.72) to predict complete response and 0.65 (95%CI=0.53-0.76) to predict a good response. Quantitative variables did not improve model performance. Basic staging variables consistently achieved lower performance compared to advanced staging variables.

CONCLUSIONS

Overall model performance was moderate. Best results were obtained using advanced staging variables, highlighting the importance of good-quality staging according to current guidelines. Quantitative imaging features had no added value (in this heterogeneous dataset).

CLINICAL RELEVANCE STATEMENT

Predicting tumour response at baseline could aid in tailoring neoadjuvant therapies for rectal cancer. This study shows that image-based prediction models are promising, though are negatively affected by variations in staging quality and MRI acquisition, urging the need for harmonization.

KEY POINTS

This multicenter study combining clinical information and features derived from MRI rendered disappointing performance to predict response to neoadjuvant treatment in rectal cancer. Best results were obtained with the combination of clinical baseline information and state-of-the-art image-based staging variables, highlighting the importance of good quality staging according to current guidelines and staging templates. No added value was found for quantitative imaging features in this multicenter retrospective study. This is likely related to acquisition variations, which is a major problem for feature reproducibility and thus model generalizability.

Optimization and validation of 18F-DCFPyL PET radiomics-based machine learning models in intermediate- to high-risk primary prostate cancer

INTRODUCTION

Radiomics extracted from prostate-specific membrane antigen (PSMA)-PET modeled with machine learning (ML) may be used for prediction of disease risk. However, validation of previously proposed approaches is lacking. We aimed to optimize and validate ML models based on 18F-DCFPyL-PET radiomics for the prediction of lymph-node involvement (LNI), extracapsular extension (ECE), and postoperative Gleason score (GS) in primary prostate cancer (PCa) patients.

METHODS

Patients with intermediate- to high-risk PCa who underwent 18F-DCFPyL-PET/CT before radical prostatectomy with pelvic lymph-node dissection were evaluated. The training dataset included 72 patients, the internal validation dataset 24 patients, and the external validation dataset 27 patients. PSMA-avid intra-prostatic lesions were delineated semi-automatically on PET and 480 radiomics features were extracted. Conventional PET-metrics were derived for comparative analysis. Segmentation, preprocessing, and ML methods were optimized in repeated 5-fold cross-validation (CV) on the training dataset. The trained models were tested on the combined validation dataset. Combat harmonization was applied to external radiomics data. Model performance was assessed using the receiver-operating-characteristics curve (AUC).

RESULTS

The CV-AUCs in the training dataset were 0.88, 0.79 and 0.84 for LNI, ECE, and GS, respectively. In the combined validation dataset, the ML models could significantly predict GS with an AUC of 0.78 (p<0.05). However, validation AUCs for LNI and ECE prediction were not significant (0.57 and 0.63, respectively). Conventional PET metrics-based models had comparable AUCs for LNI (0.59, p>0.05) and ECE (0.66, p>0.05), but a lower AUC for GS (0.73, p<0.05). In general, Combat harmonization improved external validation AUCs (-0.03 to +0.18).

CONCLUSION

In internal and external validation, 18F-DCFPyL-PET radiomics-based ML models predicted high postoperative GS but not LNI or ECE in intermediate- to high-risk PCa. Therefore, the clinical benefit seems to be limited. These results underline the need for external and/or multicenter validation of PET radiomics-based ML model analyses to assess their generalizability.

Multimodality radiomics analysis based on [18F]FDG PET/CT imaging and multisequence MRI: application to nasopharyngeal carcinoma prognosis

OBJECTIVES

To determine whether radiomics models developed from 2-deoxy-2-[18F]fluoro-D-glucose ([18F]FDG) PET/CT combined with multisequence MRI could contribute to predicting the progression-free survival (PFS) of nasopharyngeal carcinoma (NPC) patients.

METHODS

One hundred thirty-two NPC patients who underwent both PET/CT and MRI scanning were retrospectively enrolled (88 vs. 44 for training vs. testing). For each modality/sequence (i.e., PET, CT, T1, T1C, and T2), 1906 radiomics features were extracted from the primary tumor volume. Univariate Cox model and correlation analysis were used for feature selection. A multivariate Cox model was used to establish radiomics signature. Prognostic performances of 5 individual modality models and 12 multimodality models (3 integrations × 4 fusion strategies) were assessed by the concordance index (C-index) and log-rank test. A clinical-radiomics nomogram was built to explore the clinical utilities of radiomics signature, which was evaluated by discrimination, calibration curve, and decision curve analysis (DCA).

RESULTS

The radiomics signatures of individual modalities showed limited prognostic efficacy with a C-index of 0.539-0.664 in the testing cohort. Different fusion strategies exhibited a slight difference in predictive performance. The PET/CT and MRI integrated model achieved the best performance with a C-index of 0.745 (95% CI, 0.619-0.865) in the testing cohort (log-rank test, p < 0.05). Clinical-radiomics nomogram further improved the prognosis, which also showed satisfactory discrimination, calibration, and net benefit.

CONCLUSIONS

Multimodality radiomics analysis by combining PET/CT with multisequence MRI could potentially improve the efficacy of PFS prediction for NPC patients.

KEY POINTS

• Individual modality radiomics models showed limited performance in prognosis evaluation for NPC patients. • Combined PET, CT and multisequence MRI radiomics signature could improve the prognostic efficacy. • Multilevel fusion strategies exhibit comparable performance but feature-level fusion deserves more attention.

A nomogram for distinguishing benign and malignant parotid gland tumors using clinical data and preoperative blood markers: development and validation

PURPOSE

This study aimed to construct and validate a nomogram that incorporated clinical data and preoperative blood markers to differentiate BPGTs from MPGTs more efficiently and at low cost.

METHODS

We retrospectively analyzed patients who underwent parotidectomy and histopathological diagnosis at the First Affiliated Hospital of Guangxi Medical University from January 2013 to June 2022. Subjects were randomly divided into training and validation sets with a 7:3 ratio. In the training set, the least absolute shrinkage and selection operator (LASSO) regression analysis was performed to select the most relevant features from 19 variables and built a nomogram using logistic regression. We evaluated the model's performance using receiver-operating characteristic (ROC) curves, calibration curves, clinical decision curve analysis (DCA), and clinical impact curve analysis (CICA).

RESULTS

The final sample consisted of 644 patients, of whom 108 (16.77%) had MPGTs. The nomogram included four features: current smoking status, pain/tenderness, peripheral facial paralysis, and lymphocyte-to-monocyte ratio (LMR). The optimal cut-off value for the nomogram was 0.17. The areas under the ROC curves (AUCs) of the nomogram were 0.748 (95% confidence interval [CI] = 0.689-0.807) and 0.754 (95% CI = 0.636-0.872) in the training and validation sets, respectively. The nomogram also showed good calibration, high accuracy, moderate sensitivity, and acceptable specificity in both sets. The DCA and CICA demonstrated that the nomogram had significant net benefits for a wide range of threshold probabilities (0.06-0.88 for the training set; 0.06-0.57 and 0.73-0.95 for the validation set).

CONCLUSION

The nomogram based on clinical characteristics and preoperative blood markers was a reliable tool for discriminating BPGTs from MPGTs preoperatively.

Development of a radiomic-clinical nomogram for prediction of survival in patients with diffuse large B-cell lymphoma treated with chimeric antigen receptor T cells

BACKGROUND

In our current work, an 18F-FDG PET/CT radiomics-based model was developed to assess the progression-free survival (PFS) and overall survival (OS) of patients with relapsed or refractory (R/R) diffuse large B-cell lymphoma (DLBCL) who received chimeric antigen receptor (CAR)-T cell therapy.

METHODS

A total of 61 DLBCL cases receiving 18F-FDG PET/CT before CAR-T cell infusion were included in the current analysis, and these patients were randomly assigned to a training cohort (n = 42) and a validation cohort (n = 19). Radiomic features from PET and CT images were obtained using LIFEx software, and radiomics signatures (R-signatures) were then constructed by choosing the optimal parameters according to their PFS and OS. Subsequently, the radiomics model and clinical model were constructed and validated.

RESULTS

The radiomics model that integrated R-signatures and clinical risk factors showed superior prognostic performance compared with the clinical models in terms of both PFS (C-index: 0.710 vs. 0.716; AUC: 0.776 vs. 0.712) and OS (C-index: 0.780 vs. 0.762; AUC: 0.828 vs. 0.728). For validation, the C-index of the two approaches was 0.640 vs. 0.619 and 0.676 vs. 0.699 for predicting PFS and OS, respectively. Moreover, the AUC was 0.886 vs. 0.635 and 0.778 vs. 0.705, respectively. The calibration curves indicated good agreement, and the decision curve analysis suggested that the net benefit of radiomics models was higher than that of clinical models.

CONCLUSIONS

PET/CT-derived R-signature could be a potential prognostic biomarker for R/R DLBCL patients undergoing CAR-T cell therapy. Moreover, the risk stratification could be further enhanced when the PET/CT-derived R-signature was combined with clinical factors.

Role of radiomic analysis of [18F]fluoromethylcholine PET/CT in predicting biochemical recurrence in a cohort of intermediate and high risk prostate cancer patients at initial staging

AIM

To study the feasibility of radiomic analysis of baseline [18F]fluoromethylcholine positron emission tomography/computed tomography (PET/CT) for the prediction of biochemical recurrence (BCR) in a cohort of intermediate and high-risk prostate cancer (PCa) patients.

MATERIAL AND METHODS

Seventy-four patients were prospectively collected. We analyzed three prostate gland (PG) segmentations (i.e., PGwhole: whole PG; PG41%: prostate having standardized uptake value - SUV > 0.41*SUVmax; PG2.5: prostate having SUV > 2.5) together with three SUV discretization steps (i.e., 0.2, 0.4, and 0.6). For each segmentation/discretization step, we trained a logistic regression model to predict BCR using radiomic and/or clinical features.

RESULTS

The median baseline prostate-specific antigen was 11 ng/mL, the Gleason score was > 7 for 54% of patients, and the clinical stage was T1/T2 for 89% and T3 for 9% of patients. The baseline clinical model achieved an area under the receiver operating characteristic curve (AUC) of 0.73. Performances improved when clinical data were combined with radiomic features, in particular for PG2.5 and 0.4 discretization, for which the median test AUC was 0.78.

CONCLUSION

Radiomics reinforces clinical parameters in predicting BCR in intermediate and high-risk PCa patients. These first data strongly encourage further investigations on the use of radiomic analysis to identify patients at risk of BCR.

CLINICAL RELEVANCE STATEMENT

The application of AI combined with radiomic analysis of [18F]fluoromethylcholine PET/CT images has proven to be a promising tool to stratify patients with intermediate or high-risk PCa in order to predict biochemical recurrence and tailor the best treatment options.

KEY POINTS

• Stratification of patients with intermediate and high-risk prostate cancer at risk of biochemical recurrence before initial treatment would help determine the optimal curative strategy. • Artificial intelligence combined with radiomic analysis of [18F]fluorocholine PET/CT images allows prediction of biochemical recurrence, especially when radiomic features are complemented with patients' clinical information (highest median AUC of 0.78). • Radiomics reinforces the information of conventional clinical parameters (i.e., Gleason score and initial prostate-specific antigen level) in predicting biochemical recurrence.

Head and neck cancer treatment outcome prediction: a comparison between machine learning with conventional radiomics features and deep learning radiomics

Background

Radiomics can provide in-depth characterization of cancers for treatment outcome prediction. Conventional radiomics rely on extraction of image features within a pre-defined image region of interest (ROI) which are typically fed to a classification algorithm for prediction of a clinical endpoint. Deep learning radiomics allows for a simpler workflow where images can be used directly as input to a convolutional neural network (CNN) with or without a pre-defined ROI.

Purpose

The purpose of this study was to evaluate (i) conventional radiomics and (ii) deep learning radiomics for predicting overall survival (OS) and disease-free survival (DFS) for patients with head and neck squamous cell carcinoma (HNSCC) using pre-treatment 18F-fluorodeoxuglucose positron emission tomography (FDG PET) and computed tomography (CT) images.

Materials and methods

FDG PET/CT images and clinical data of patients with HNSCC treated with radio(chemo)therapy at Oslo University Hospital (OUS; n = 139) and Maastricht University Medical Center (MAASTRO; n = 99) were collected retrospectively. OUS data was used for model training and initial evaluation. MAASTRO data was used for external testing to assess cross-institutional generalizability. Models trained on clinical and/or conventional radiomics features, with or without feature selection, were compared to CNNs trained on PET/CT images without or with the gross tumor volume (GTV) included. Model performance was measured using accuracy, area under the receiver operating characteristic curve (AUC), Matthew's correlation coefficient (MCC), and the F1 score calculated for both classes separately.

Results

CNNs trained directly on images achieved the highest performance on external data for both endpoints. Adding both clinical and radiomics features to these image-based models increased performance further. Conventional radiomics including clinical data could achieve competitive performance. However, feature selection on clinical and radiomics data lead to overfitting and poor cross-institutional generalizability. CNNs without tumor and node contours achieved close to on-par performance with CNNs including contours.

Conclusion

High performance and cross-institutional generalizability can be achieved by combining clinical data, radiomics features and medical images together with deep learning models. However, deep learning models trained on images without contours can achieve competitive performance and could see potential use as an initial screening tool for high-risk patients.

Predictive value of radiomics-based machine learning for the disease-free survival in breast cancer: a systematic review and meta-analysis

Purpose

This study summarized the previously-published studies regarding the use of radiomics-based predictive models for the identification of breast cancer-associated prognostic factors, which can help clinical decision-making and follow-up strategy.

Materials and methods

This study has been pre-registered on PROSPERO. PubMed, Embase, Cochrane Library, and Web of Science were searched, from inception to April 23, 2022, for studies that used radiomics for prognostic prediction of breast cancer patients. Then the search was updated on July 18, 2023. Quality assessment was conducted using the Radiomics Quality Score, and meta-analysis was performed using R software.

Results

A total of 975 articles were retrieved, and 13 studies were included, involving 5014 participants and 35 prognostic models. Among the models, 20 models were radiomics-based and the other 15 were based on clinical or pathological information. The primary outcome was Disease-free Survival (DFS). The retrieved studies were screened using LASSO, and Cox Regression was applied for modeling. The mean RQS was 18. The c-index of radiomics-based models for DFS prediction was 0.763 (95%CI 0.718-0.810) in the training set and 0.702 (95%CI 0.637-0.774) in the validation set. The c-index of combination models was 0.807 (95%CI0.736-0.885) in the training set and 0.840 (95%CI 0.794-0.888) in the validation set. There was no significant change in the c-index of DFS at 1, 2, 3, and over 5 years of follow-up.

Conclusion

This study has proved that radiomics-based prognostic models are of great predictive performance for the prognosis of breast cancer patients. combination model shows significantly enhanced predictive performance.

Systematic review registration

https://www.crd.york.ac.uk/PROSPERO/, identifier CRD42022332392.

Artificial intelligence CT radiomics to predict early recurrence of intrahepatic cholangiocarcinoma: a multicenter study

OBJECTIVES

In this multicenter study, we sought to develop and validate a preoperative model for predicting early recurrence (ER) risk after curative resection of intrahepatic cholangiocarcinoma (ICC) through artificial intelligence (AI)-based CT radiomics approach.

MATERIALS AND METHODS

A total of 311 patients (Derivation: 160; Internal and two external validations: 36, 74 and 61) from 8 medical centers who underwent curative resection were collected retrospectively. In derivation cohort, radiomics and clinical-radiomics models for ER prediction were constructed by LightGBM (a machine learning algorithm). A clinical model was also developed for comparison. Model performance was validated in internal and two external cohorts by ROC. In addition, we investigated the interpretability of the LightGBM model.

RESULTS

The combined clinical-radiomics model that included 15 radiomic features and 3 clinical features (CA19-9 > 1000 U/ml, vascular invasion and tumor margin), resulting in the area under the curves (AUCs) of 0.974 (95% CI 0.946-1.000) in the derivation cohort, and 0.871-0.882 (95% CI 0.672-0.962) in the internal and external validation cohorts, respectively, which are higher than the AJCC 8th TNM staging system (AUCs: 0.686-0.717, p all < 0.05). Especially, the sensitivity of this machine learning model could reach 94.6% on average for all the cohorts.

CONCLUSIONS

This AI-driven combined radiomics model may provide as a useful tool to preoperatively predict ER and improve therapeutic management of ICC patients.

REliability of consensus-based segMentatIoN in raDiomic feature reproducibility (REMIND): A word of caution

OBJECTIVE

To evaluate the reliability of consensus-based segmentation in terms of reproducibility of radiomic features.

METHODS

In this retrospective study, three tumor data sets were investigated: breast cancer (n = 30), renal cell carcinoma (n = 30), and pituitary macroadenoma (n = 30). MRI was utilized for breast and pituitary data sets, while CT was used for renal data set. 12 readers participated in the segmentation process. Consensus segmentation was created by making corrections on a previous region or volume of interest. Four experiments were designed to evaluate the reproducibility of radiomic features. Reliability was assessed with intraclass correlation coefficient (ICC) with two cut-off values: 0.75 and 0.9.

RESULTS

Considering the lower bound of the 95% confidence interval and the ICC threshold of 0.90, at least 61% of the radiomic features were not reproducible in the inter-consensus analysis. In the susceptibility experiment, at least half (54%) became non-reproducible when the first reader is replaced with a different reader. In the intra-consensus analysis, at least about one-third (32%) were non-reproducible when the same second reader segmented the image over the same first reader two weeks later. Compared to inter-reader analysis based on independent single readers, the inter-consensus analysis did not statistically significantly improve the rates of reproducible features in all data sets and analyses.

CONCLUSIONS

Despite the positive connotation of the word "consensus", it is essential to REMIND that consensus-based segmentation has significant reproducibility issues. Therefore, the usage of consensus-based segmentation alone should be avoided unless a reliability analysis is performed, even if it is not practical in clinical settings.

Applications of Artificial Intelligence and Radiomics in Molecular Hybrid Imaging and Theragnostics for Neuro-Endocrine Neoplasms (NENs)

Nuclear medicine has acquired a crucial role in the management of patients with neuroendocrine neoplasms (NENs) by improving the accuracy of diagnosis and staging as well as their risk stratification and personalized therapies, including radioligand therapies (RLT). Artificial intelligence (AI) and radiomics can enable physicians to further improve the overall efficiency and accuracy of the use of these tools in both diagnostic and therapeutic settings by improving the prediction of the tumor grade, differential diagnosis from other malignancies, assessment of tumor behavior and aggressiveness, and prediction of treatment response. This systematic review aims to describe the state-of-the-art AI and radiomics applications in the molecular imaging of NENs.

Radiomic signatures based on pretreatment 18F-FDG PET/CT, combined with clinicopathological characteristics, as early prognostic biomarkers among patients with invasive breast cancer

Purpose

The aim of this study was to investigate the predictive role of fluorine-18 fluorodeoxyglucose positron emission tomography/computed tomography (18F-FDG PET/CT) in the prognostic risk stratification of patients with invasive breast cancer (IBC). To achieve this, we developed a clinicopathologic-radiomic-based model (C-R model) and established a nomogram that could be utilized in clinical practice.

Methods

We retrospectively enrolled a total of 91 patients who underwent preoperative 18F-FDG PET/CT and randomly divided them into training (n=63) and testing cohorts (n=28). Radiomic signatures (RSs) were identified using the least absolute shrinkage and selection operator (LASSO) regression algorithm and used to compute the radiomic score (Rad-score). Patients were assigned to high- and low-risk groups based on the optimal cut-off value of the receiver operating characteristic (ROC) curve analysis for both Rad-score and clinicopathological risk factors. Univariate and multivariate Cox regression analyses were performed to determine the association between these variables and progression-free survival (PFS) or overall survival (OS). We then plotted a nomogram integrating all these factors to validate the predictive performance of survival status.

Results

The Rad-score, age, clinical M stage, and minimum standardized uptake value (SUVmin) were identified as independent prognostic factors for predicting PFS, while only Rad-score, age, and clinical M stage were found to be prognostic factors for OS in the training cohort. In the testing cohort, the C-R model showed superior performance compared to single clinical or radiomic models. The concordance index (C-index) values for the C-R model, clinical model, and radiomic model were 0.816, 0.772, and 0.647 for predicting PFS, and 0.882, 0.824, and 0.754 for OS, respectively. Furthermore, decision curve analysis (DCA) and calibration curves demonstrated that the C-R model had a good ability for both clinical net benefit and application.

Conclusion

The combination of clinicopathological risks and baseline PET/CT-derived Rad-score could be used to evaluate the prognosis in patients with IBC. The predictive nomogram based on the C-R model further enhanced individualized estimation and allowed for more accurate prediction of patient outcomes.

Assessment of androgen receptor expression in breast cancer patients using 18 F-FDG PET/CT radiomics and clinicopathological characteristics

OBJECTIVE

In the present study, we mainly aimed to predict the expression of androgen receptor (AR) in breast cancer (BC) patients by combing radiomic features and clinicopathological factors in a non-invasive machine learning way.

MATERIALS AND METHODS

A total of 48 BC patients, who were initially diagnosed by ¹⁸F-FDG PET/CT, were retrospectively enrolled in this study. LIFEx software was used to extract radiomic features based on PET and CT data. The most useful predictive features were selected by the LASSO (least absolute shrinkage and selection operator) regression and t-test. Radiomic signatures and clinicopathologic characteristics were incorporated to develop a prediction model using multivariable logistic regression analysis. The receiver operating characteristic (ROC) curve, Hosmer-Lemeshow (H-L) test, and decision curve analysis (DCA) were conducted to assess the predictive efficiency of the model.

RESULTS

In the univariate analysis, the metabolic tumor volume (MTV) was significantly correlated with the expression of AR in BC patients (p < 0.05). However, there only existed feeble correlations between estrogen receptor (ER), progesterone receptor (PR), and AR status (p = 0.127, p = 0.061, respectively). Based on the binary logistic regression method, MTV, SHAPE_Sphericity_CT (CT Sphericity from SHAPE), and GLCM_Contrast_CT (CT Contrast from grey-level co-occurrence matrix) were included in the prediction model for AR expression. Among them, GLCM_Contrast_CT was an independent predictor of AR status (OR = 9.00, p = 0.018). The area under the curve (AUC) of ROC in this model was 0.832. The p-value of the H-L test was beyond 0.05.

CONCLUSIONS

A prediction model combining radiomic features and clinicopathological characteristics could be a promising approach to predict the expression of AR and noninvasively screen the BC patients who could benefit from anti-AR regimens.

Prediction model based on radiomics and clinical features for preoperative lymphovascular invasion in gastric cancer patients

Background: We explored whether a model based on contrast-enhanced computed tomography radiomics features and clinicopathological factors can evaluate preoperative lymphovascular invasion (LVI) in patients with gastric cancer (GC) with Lauren classification. Methods: Based on clinical and radiomic characteristics, we established three models: Clinical + Arterial phase_Radcore, Clinical + Venous phase_Radcore and a combined model. The relationship between Lauren classification and LVI was analyzed using a histogram. Results: We retrospectively analyzed 495 patients with GC. The areas under the curve of the combined model were 0.8629 and 0.8343 in the training and testing datasets, respectively. The combined model showed a superior performance to the other models. Conclusion: CECT-based radiomics models can effectively predict preoperative LVI in GC patients with Lauren classification.

Additional Value of PET and CT Image-Based Features in the Detection of Occult Lymph Node Metastases in Lung Cancer: A Systematic Review of the Literature

Lung cancer represents the second most common malignancy worldwide and lymph node (LN) involvement serves as a crucial prognostic factor for tailoring treatment approaches. Invasive methods, such as mediastinoscopy and endobronchial ultrasound-guided transbronchial needle aspiration (EBUS-TBNA), are employed for preoperative LN staging. Among the preoperative non-invasive diagnostic methods, computed tomography (CT) and, recently, positron emission tomography (PET)/CT with fluorine-18-fludeoxyglucose ([¹⁸F]FDG) are routinely recommended by several guidelines; however, they can both miss pathologically proven LN metastases, with an incidence up to 26% for patients staged with [¹⁸F]FDG PET/CT. These undetected metastases, known as occult LN metastases (OLMs), are usually cases of micro-metastasis or small LN metastasis (shortest radius below 10 mm). Hence, it is crucial to find novel approaches to increase their discovery rate. Radiomics is an emerging field that seeks to uncover and quantify the concealed information present in biomedical images by utilising machine or deep learning approaches. The extracted features can be integrated into predictive models, as numerous reports have emphasised their usefulness in the staging of lung cancer. However, there is a paucity of studies examining the detection of OLMs using quantitative features derived from images. Hence, the objective of this review was to investigate the potential application of PET- and/or CT-derived quantitative radiomic features for the identification of OLMs.

A systematic review of radiomics in giant cell tumor of bone (GCTB): the potential of analysis on individual radiomics feature for identifying genuine promising imaging biomarkers

PURPOSE

To systematically assess the quality of radiomics research in giant cell tumor of bone (GCTB) and to test the feasibility of analysis at the level of radiomics feature.

METHODS

We searched PubMed, Embase, Web of Science, China National Knowledge Infrastructure, and Wanfang Data to identify articles of GCTB radiomics until 31 July 2022. The studies were assessed by radiomics quality score (RQS), transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD) statement, checklist for artificial intelligence in medical imaging (CLAIM), and modified quality assessment of diagnostic accuracy studies (QUADAS-2) tool. The radiomic features selected for model development were documented.

RESULTS

Nine articles were included. The average of the ideal percentage of RQS, the TRIPOD adherence rate and the CLAIM adherence rate were 26%, 56%, and 57%, respectively. The risk of bias and applicability concerns were mainly related to the index test. The shortness in external validation and open science were repeatedly emphasized. In GCTB radiomics models, the gray level co-occurrence matrix features (40%), first order features (28%), and gray-level run-length matrix features (18%) were most selected features out of all reported features. However, none of the individual feature has appeared repeatably in multiple studies. It is not possible to meta-analyze radiomics features at present.

CONCLUSION

The quality of GCTB radiomics studies is suboptimal. The reporting of individual radiomics feature data is encouraged. The analysis at the level of radiomics feature has potential to generate more practicable evidence for translating radiomics into clinical application.

Robustness of radiomics features of virtual unenhanced and virtual monoenergetic images in dual-energy CT among different imaging platforms and potential role of CT number variability

OBJECTIVES

To evaluate robustness of dual-energy CT (DECT) radiomics features of virtual unenhanced (VUE) image and virtual monoenergetic image (VMI) among different imaging platforms.

METHODS

A phantom with sixteen clinical-relevant densities was scanned on ten DECT platforms with comparable scan parameters. Ninety-four radiomic features were extracted via Pyradiomics from VUE images and VMIs at energy level of 70 keV (VMI_70keV). Test-retest repeatability was assessed by Bland-Altman analysis. Inter-platform reproducibility of VUE images and VMI_70keV was evaluated by coefficient of variation (CV) and quartile coefficient of dispersion (QCD) among platforms, and by intraclass correlation coefficient (ICC) and concordance correlation coefficient (CCC) between platform pairs. The correlation between variability of CT number radiomics reproducibility was estimated.

RESULTS

92.02% and 92.87% of features were repeatable between scan-rescans for VUE images and VMI_70keV, respectively. Among platforms, 11.30% and 28.39% features of VUE images, and 15.16% and 28.99% features of VMI_70keV were with CV < 10% and QCD < 10%. The average percentages of radiomics features with ICC > 0.90 and CCC > 0.90 between platform pairs were 10.00% and 9.86% in VUE images and 11.23% and 11.23% in VMI_70keV. The CT number inter-platform reproducibility using CV and QCD showed negative correlations with percentage of the first-order radiomics features with CV < 10% and QCD < 10%, in both VUE images and VMI_70keV (r² 0.3870-0.6178, all p < 0.001).

CONCLUSIONS

The majority of DECT radiomics features were non-reproducible. The differences in CT number were considered as an indicator of inter-platform DECT radiomics variation. Critical relevance statement: The majority of radiomics features extracted from the VUE images and the VMI70keV were non-reproducible among platforms, while synchronizing energy levels of VMI to reduce the CT number value variability may be a potential way to mitigate radiomics instability.

CheckList for EvaluAtion of Radiomics research (CLEAR): a step-by-step reporting guideline for authors and reviewers endorsed by ESR and EuSoMII

Even though radiomics can hold great potential for supporting clinical decision-making, its current use is mostly limited to academic research, without applications in routine clinical practice. The workflow of radiomics is complex due to several methodological steps and nuances, which often leads to inadequate reporting and evaluation, and poor reproducibility. Available reporting guidelines and checklists for artificial intelligence and predictive modeling include relevant good practices, but they are not tailored to radiomic research. There is a clear need for a complete radiomics checklist for study planning, manuscript writing, and evaluation during the review process to facilitate the repeatability and reproducibility of studies. We here present a documentation standard for radiomic research that can guide authors and reviewers. Our motivation is to improve the quality and reliability and, in turn, the reproducibility of radiomic research. We name the checklist CLEAR (CheckList for EvaluAtion of Radiomics research), to convey the idea of being more transparent. With its 58 items, the CLEAR checklist should be considered a standardization tool providing the minimum requirements for presenting clinical radiomics research. In addition to a dynamic online version of the checklist, a public repository has also been set up to allow the radiomics community to comment on the checklist items and adapt the checklist for future versions. Prepared and revised by an international group of experts using a modified Delphi method, we hope the CLEAR checklist will serve well as a single and complete scientific documentation tool for authors and reviewers to improve the radiomics literature.

Lack of repeatability of radiomic features derived from PET scans: Results from a 18 F-DCFPyL test-retest cohort

OBJECTIVES

PET-based radiomic metrics are increasingly utilized as predictive image biomarkers. However, the repeatability of radiomic features on PET has not been assessed in a test-retest setting. The prostate-specific membrane antigen-targeted compound ¹⁸ F-DCFPyL is a high-affinity, high-contrast PET agent that we utilized in a test-retest cohort of men with metastatic prostate cancer (PC).

METHODS

Data of 21 patients enrolled in a prospective clinical trial with histologically proven PC underwent two ¹⁸ F-DCFPyL PET scans within 7 days, using identical acquisition and reconstruction parameters. Sites of disease were segmented and a set of 29 different radiomic parameters were assessed on both scans. We determined repeatability of quantification by using Pearson's correlations, within-subject coefficient of variation (wCOV), and Bland-Altman analysis.

RESULTS

In total, 230 lesions (177 bone, 38 lymph nodes, 15 others) were assessed on both scans. For all investigated radiomic features, a broad range of inter-scan correlation was found (r, 0.07-0.95), with acceptable reproducibility for entropy and homogeneity (wCOV, 16.0% and 12.7%, respectively). On Bland-Altman analysis, no systematic increase or decrease between the scans was observed for either parameter (±1.96 SD: 1.07/-1.30, 0.23/-0.18, respectively). The remaining 27 tested radiomic metrics, however, achieved unacceptable high wCOV (≥21.7%).

CONCLUSION

Many common radiomic features derived from a test-retest PET study had poor repeatability. Only Entropy and homogeneity achieved good repeatability, supporting the notion that those image biomarkers may be incorporated in future clinical trials. Those radiomic features based on high frequency aspects of images appear to lack the repeatability on PET to justify further study.