Towards reproducible radiomics research: introduction of a database for radiomics studies

Overlooked and underpowered: a meta-research addressing sample size in radiomics prediction models for binary outcomes

OBJECTIVES

To investigate how studies determine the sample size when developing radiomics prediction models for binary outcomes, and whether the sample size meets the estimates obtained by using established criteria.

METHODS

We identified radiomics studies that were published from 01 January 2023 to 31 December 2023 in seven leading peer-reviewed radiological journals. We reviewed the sample size justification methods, and actual sample size used. We calculated and compared the actual sample size used to the estimates obtained by using three established criteria proposed by Riley et al. We investigated which characteristics factors were associated with the sufficient sample size that meets the estimates obtained by using established criteria proposed by Riley et al. RESULTS: We included 116 studies. Eleven out of one hundred sixteen studies justified the sample size, in which 6/11 performed a priori sample size calculation. The median (first and third quartile, Q1, Q3) of the total sample size is 223 (130, 463), and those of sample size for training are 150 (90, 288). The median (Q1, Q3) difference between total sample size and minimum sample size according to established criteria are -100 (-216, 183), and those differences between total sample size and a more restrictive approach based on established criteria are -268 (-427, -157). The presence of external testing and the specialty of the topic were associated with sufficient sample size.

CONCLUSION

Radiomics studies are often designed without sample size justification, whose sample size may be too small to avoid overfitting. Sample size justification is encouraged when developing a radiomics model.

KEY POINTS

Question Sample size justification is critical to help minimize overfitting in developing a radiomics model, but is overlooked and underpowered in radiomics research. Findings Few of the radiomics models justified, calculated, or reported their sample size, and most of them did not meet the recent formal sample size criteria. Clinical relevance Radiomics models are often designed without sample size justification. Consequently, many models are too small to avoid overfitting. It should be encouraged to justify, perform, and report the considerations on sample size when developing radiomics models.

Prostate cancer MRI methodological radiomics score: a EuSoMII radiomics auditing group initiative

OBJECTIVES

To evaluate the quality of radiomics research in prostate MRI for the evaluation of prostate cancer (PCa) through the assessment of METhodological RadiomICs (METRICS) score, a new scoring tool recently introduced with the goal of fostering further improvement in radiomics and machine learning methodology.

MATERIALS AND METHODS

A literature search was conducted from July 1st, 2019, to November 30th, 2023, to identify original investigations assessing MRI-based radiomics in the setting of PCa. Seven readers with varying expertise underwent a quality assessment using METRICS. Subgroup analyses were performed to assess whether the quality score varied according to papers' categories (diagnosis, staging, prognosis, technical) and quality ratings among these latter.

RESULTS

From a total of 1106 records, 185 manuscripts were available. Overall, the average METRICS total score was 52% ± 16%. ANOVA and chi-square tests revealed no statistically significant differences between subgroups. Items with the lowest positive scores were adherence to guidelines/checklists (4.9%), handling of confounding factors (14.1%), external testing (15.1%), and the availability of data (15.7%), code (4.3%), and models (1.6%). Conversely, most studies clearly defined patient selection criteria (86.5%), employed a high-quality reference standard (89.2%), and utilized a well-described (85.9%) and clinically applicable (87%) imaging protocol as a radiomics data source.

CONCLUSION

The quality of MRI-based radiomics research for PCa in recent studies demonstrated good homogeneity and overall moderate quality.

KEY POINTS

Question To evaluate the quality of MRI-based radiomics research for PCa, assessed through the METRICS score. Findings The average METRICS total score was 52%, reflecting moderate quality in MRI-based radiomics research for PCa, with no statistically significant differences between subgroups. Clinical relevance Enhancing the quality of radiomics research can improve diagnostic accuracy for PCa, leading to better patient outcomes and more informed clinical decision-making.

Repeatability of radiomic features in myocardial T1 and T2 mapping

PURPOSE

To investigate the test-retest repeatability of radiomic features in myocardial native T1 and T2 mapping.

METHODS

In this prospective study, 50 healthy volunteers (29 women and 21 men, mean age 39.4 ± 13.7 years) underwent two identical cardiac magnetic resonance imaging (MRI) examinations at 1.5 T. The protocol included native T1 and T2 mapping in both short-axis and long-axis orientation. For T1 mapping, we investigated standard (1.9 × 1.9 mm) and high (1.4 × 1.4 mm) spatial resolution. After manual segmentation of the left ventricular myocardium, 100 radiomic features from seven feature classes were extracted and analyzed. Test-retest repeatability of radiomic features was assessed using the intraclass correlation coefficient (ICC) and classified as poor (ICC < 0.50), moderate (0.50-0.75), good (0.75-0.90), and excellent (> 0.90).

RESULTS

For T1 maps acquired in short-axis orientation at standard resolution, repeatability was excellent for 6 features, good for 29 features, moderate for 19 features, and poor for 46 features. We identified 15 features from 6 classes which showed good to excellent reproducibility for T1 mapping in all resolutions and all orientations. For short-axis T2 maps, repeatability was excellent for 6 features, good for 25 features, moderate for 23 features, and poor for 46 features. 12 features from 5 classes were found to have good to excellent repeatability in T2 mapping independent of slice orientation.

CONCLUSION

We have identified a subset of features with good to excellent repeatability independent of slice orientation and spatial resolution. We recommend using these features for further radiomics research in myocardial T1 and T2 mapping.

KEY POINTS

Question The study addresses the need for reliable radiomic features for quantitative analysis of the myocardium to ensure diagnostic consistency in cardiac MRI. Findings We have identified a subset of radiomic features demonstrating good to excellent repeatability in native T1 and T2 mapping independent of slice orientation and resolution. Clinical relevanceRadiomic features have been proposed as diagnostic and prognostic biomarkers in various heart diseases. By identifying a subset of particularly reproducible radiomic features our study serves to inform the selection of radiomic features in future research and clinical applications.

Replication study of PD-L1 status prediction in NSCLC using PET/CT radiomics

This study investigates the predictive capability of radiomics in determining programmed cell death ligand 1 (PD-L1) expression (>=1%) status in non-small cell lung cancer (NSCLC) patients using a newly collected [18F]FDG PET/CT dataset. We aimed to replicate and validate the radiomics-based machine learning (ML) model proposed by Zhao et al. [1] predicting PD-L1 status from PET/CT-imaging. An independent cohort of 254 NSCLC patients underwent [18F]FDG PET/CT imaging, with primary tumor segmentation conducted using lung tissue window (LTW) and more conservative soft tissue window (STW) methods. Radiomics models ("Rad-score" and "complex model") and a clinical-stage model from Zhao et al. were evaluated via 10-fold cross-validation and AUC analysis, alongside a benchmark-study comparing different ML-model pipelines. Clinicopathological data were collected from medical records. On our data, the Rad-score model yielded mean AUCs of 0.593 (STW) and 0.573 (LTW), below Zhao et al.'s 0.761. The complex model achieved mean AUCs of 0.505 (STW) and 0.519 (LTW), lower than Zhao et al.'s 0.769. The clinical model showed a mean AUC of 0.555, below Zhao et al.'s 0.64. All models performed significantly lower than Zhao et al.'s findings. Our benchmark study on four ML pipelines revealed consistently low performance across all configurations. Our study failed to replicate original findings, suggesting poor model performance and questioning predictive value of radiomics features in classifying PD-L1 expression from PET/CT imaging. These results highlight challenges in replicating radiomics-based ML models and stress the need for rigorous validation.

Robustness of radiomics among photon-counting detector CT and dual-energy CT systems: a texture phantom study

OBJECTIVES

To evaluate the robustness of radiomics features among photon-counting detector CT (PCD-CT) and dual-energy CT (DECT) systems.

METHODS

A texture phantom consisting of twenty-eight materials was scanned with one PCD-CT and four DECT systems (dual-source, rapid kV-switching, dual-layer, and sequential scanning) at three dose levels twice. Thirty sets of virtual monochromatic images at 70 keV were reconstructed. Regions of interest were delineated for each material with a rigid registration. Ninety-three radiomics were extracted per PyRadiomics. The test-retest repeatability between repeated scans was assessed by Bland-Altman analysis. The intra-system reproducibility between dose levels, and inter-system reproducibility within the same dose level, were evaluated by intraclass correlation coefficient (ICC) and concordance correlation coefficient (CCC). Inter-system variability among five scanners was assessed by coefficient of variation (CV) and quartile coefficient of dispersion (QCD).

RESULTS

The test-retest repeatability analysis presented that 97.1% of features were repeatable between scan-rescans. The mean ± standard deviation ICC and CCC were 0.945 ± 0.079 and 0.945 ± 0.079 for intra-system reproducibility, respectively, and 86.0% and 85.7% of features were with ICC > 0.90 and CCC > 0.90, respectively, between different dose levels. The mean ± standard deviation ICC and CCC were 0.157 ± 0.174 and 0.157 ± 0.174 for inter-system reproducibility, respectively, and none of the features were with ICC > 0.90 or CCC > 0.90 within the same dose level. The inter-system variability suggested that 6.5% and 12.8% of features were with CV < 10% and QCD < 10%, respectively, among five CT systems.

CONCLUSION

The radiomics features were non-reproducible with significant variability in values among different CT techniques.

CLINICAL RELEVANCE STATEMENT

Radiomics features are non-reproducible with significant variability in values among photon-counting detector CT and dual-energy CT systems, necessitating careful attention to improve the cross-system generalizability of radiomic features before implementation of radiomics analysis in clinical routine.

KEY POINTS

CT radiomics stability should be guaranteed before the implementation in the clinical routine. Radiomics robustness was on a low level among photon-counting detectors and dual-energy CT techniques. Limited inter-system robustness of radiomic features may impact the generalizability of models.

Robustness of radiomics within photon-counting detector CT: impact of acquisition and reconstruction factors

OBJECTIVES

To assess the impact of acquisition and reconstruction factors on the robustness of radiomics within photon-counting detector CT (PCD-CT).

METHODS

A phantom with twenty-eight texture materials was scanned with different acquisition and reconstruction factors including reposition, scan mode (standard vs high-pitch), tube voltage (120 kVp vs 140 kVp), slice thickness (1.0 mm vs 0.4 mm), radiation dose level (0.5 mGy, 1.0 mGy, 3.0 mGy, 5.0 mGy, vs 10.0 mGy), quantum iterative reconstruction level (0/4, 2/4, vs 4/4), and reconstruction kernel (Qr40, Qr44, vs Qr48). Thirteen sets of virtual monochromatic images at 70-keV were reconstructed. The regions of interest were drawn with rigid registrations. Ninety-three radiomics features were extracted from each material. The reproducibility of radiomics features was evaluated using the intraclass correlation coefficient (ICC) and concordance correlation coefficient (CCC). The variability of radiomics features was assessed by coefficient of variation (CV) and quartile coefficient of dispersion (QCD).

RESULTS

The percentage of features with ICC > 0.90 and CCC > 0.90 were high when repositioned (88.2% and 88.2%) and tube voltage was changed (87.1% and 87.1%), but none of the features with ICC > 0.90 and CCC > 0.90 when high-pitch scan and different slice thickness were used. The percentage of features with CV < 10% and QCD < 10% were high when repositioned (47.3% and 68.8%) and tube voltage was changed (64.2% and 71.0%), but that with CV < 10% and QCD < 10% were low between standard and high-pitch scans (16.1% and 26.9%) and slice thickness (19.4% and 29.0%).

CONCLUSIONS

The PCD-CT radiomics was robust to tube voltage, radiation dose, reconstruction strength level, and kernel, but brittle to high-pitch scan and slice thickness.

KEY POINTS

Question The stability of radiomics features against acquisition and reconstruction factors within PCD-CT should be fully determined before academic research and clinical application. Findings The radiomics features are robust against tube voltage, radiation dose, reconstruction strength level, and kernel within PCD-CT but brittle to high-pitch scan and slice thickness. Clinical relevance The high-pitch scan and slice thickness that influence voxel size should be set with careful attention within PCD-CT, to allow a higher robustness of radiomics features before the implementation of radiomics analysis in clinical routine.

The current and upcoming era of radiomics in phaeochromocytoma and paraganglioma

The topic of the diagnosis of phaeochromocytomas remains highly relevant because of advances in laboratory diagnostics, genetics, and therapeutic options and also the development of imaging methods. Computed tomography still represents an essential tool in clinical practice, especially in incidentally discovered adrenal masses; it allows morphological evaluation, including size, shape, necrosis, and unenhanced attenuation. More advanced post-processing tools to analyse digital images, such as texture analysis and radiomics, are currently being studied. Radiomic features utilise digital image pixels to calculate parameters and relations undetectable by the human eye. On the other hand, the amount of radiomic data requires massive computer capacity. Radiomics, together with machine learning and artificial intelligence in general, has the potential to improve not only the differential diagnosis but also the prediction of complications and therapy outcomes of phaeochromocytomas in the future. Currently, the potential of radiomics and machine learning does not match expectations and awaits its fulfilment.

Radiomics in radiology: What the radiologist needs to know about technical aspects and clinical impact

Radiomics represents the science of extracting and analyzing a multitude of quantitative features from medical imaging, revealing the quantitative potential of radiologic images. This scientific review aims to provide radiologists with a comprehensive understanding of radiomics, emphasizing its principles, applications, challenges, limits, and prospects. The limitations of standardization in current scientific production are analyzed, along with possible solutions proposed by some of the referenced papers. As the continuous evolution of medical imaging is ongoing, radiologists must be aware of new perspectives to play a central role in patient management.

Decoding Radiomics: A Step-by-Step Guide to Machine Learning Workflow in Hand-Crafted and Deep Learning Radiomics Studies

Although radiomics research has experienced rapid growth in recent years, with numerous studies dedicated to the automated extraction of diagnostic and prognostic information from various imaging modalities, such as CT, PET, and MRI, only a small fraction of these findings has successfully transitioned into clinical practice. This gap is primarily due to the significant methodological challenges involved in radiomics research, which emphasize the need for a rigorous evaluation of study quality. While many technical aspects may lie outside the expertise of most radiologists, having a foundational knowledge is essential for evaluating the quality of radiomics workflows and contributing, together with data scientists, to the development of models with a real-world clinical impact. This review is designed for the new generation of radiologists, who may not have specialized training in machine learning or radiomics, but will inevitably play a role in this evolving field. The paper has two primary objectives: first, to provide a clear, systematic guide to radiomics study pipeline, including study design, image preprocessing, feature selection, model training and validation, and performance evaluation. Furthermore, given the critical importance of evaluating the robustness of radiomics studies, this review offers a step-by-step guide to the application of the METhodological RadiomICs Score (METRICS, 2024)-a newly proposed tool for assessing the quality of radiomics studies. This roadmap aims to support researchers and reviewers alike, regardless of their machine learning expertise, in utilizing this tool for effective study evaluation.

radMLBench: A dataset collection for benchmarking in radiomics

BACKGROUND

New machine learning methods and techniques are frequently introduced in radiomics, but they are often tested on a single dataset, which makes it challenging to assess their true benefit. Currently, there is a lack of a larger, publicly accessible dataset collection on which such assessments could be performed. In this study, a collection of radiomics datasets with binary outcomes in tabular form was curated to allow benchmarking of machine learning methods and techniques.

METHODS

A variety of journals and online sources were searched to identify tabular radiomics data with binary outcomes, which were then compiled into a homogeneous data collection that is easily accessible via Python. To illustrate the utility of the dataset collection, it was applied to investigate whether feature decorrelation prior to feature selection could improve predictive performance in a radiomics pipeline.

RESULTS

A total of 50 radiomic datasets were collected, with sample sizes ranging from 51 to 969 and 101 to 11165 features. Using this data, it was observed that decorrelating features did not yield any significant improvement on average.

CONCLUSIONS

A large collection of datasets, easily accessible via Python, suitable for benchmarking and evaluating new machine learning techniques and methods was curated. Its utility was exemplified by demonstrating that feature decorrelation prior to feature selection does not, on average, lead to significant performance gains and could be omitted, thereby increasing the robustness and reliability of the radiomics pipeline.

Machine learning based classification of spontaneous intracranial hemorrhages using radiomics features

PURPOSE

To assess the efficacy of radiomics features extracted from non-contrast computed tomography (NCCT) scans in differentiating multiple etiologies of spontaneous intracerebral hemorrhage (ICH).

METHODS

CT images and clinical data from 141 ICH patients from 2010 to 2022 were collected. The cohort comprised primary (n = 57), tumorous (n = 46), and vascular malformation-related ICH (n = 38). Radiomics features were extracted from the initial brain NCCT scans and identified potential features using mutual information. A hierarchical classification with AdaBoost classifiers was employed to classify the multiple etiologies of ICH. Age of the patient and ICH's location were examined alongside radiomics features. The accuracy, area under the curve (AUC), sensitivity, and specificity were used to evaluate classification performance.

RESULTS

The proposed method achieved an accuracy of 0.79. For identifying primary ICH, the model achieved a sensitivity of 0.86 and specificity of 0.87. Meanwhile, the sensitivity and specificity for identifying tumoral causes were 0.78 and 0.93, respectively. For vascular malformation, the model reached a sensitivity and specificity of 0.72 and 0.89, respectively. The AUCs for primary, tumorous, and vascular malformation were 0.86, 0.85, and 0.82, respectively. The findings further highlight the importance of texture-based variables in ICH classification. The age and location of the ICH can enhance the classification performance.

CONCLUSION

The use of a machine learning model with radiomics features has the potential in classifying the three types of non-traumatic ICH. It may help the radiologist decide on an appropriate further examination plan to arrive at a correct diagnosis.

Post-radiotherapy stage III/IV non-small cell lung cancer radiomics research: a systematic review and comparison of CLEAR and RQS frameworks

BACKGROUND

Lung cancer, the second most common cancer, presents persistently dismal prognoses. Radiomics, a promising field, aims to provide novel imaging biomarkers to improve outcomes. However, clinical translation faces reproducibility challenges, despite efforts to address them with quality scoring tools.

OBJECTIVE

This study had two objectives: 1) identify radiomics biomarkers in post-radiotherapy stage III/IV nonsmall cell lung cancer (NSCLC) patients, 2) evaluate research quality using the CLEAR (CheckList_for_EvaluAtion_of_Radiomics_research), RQS (Radiomics_Quality_Score) frameworks, and formulate an amalgamated CLEAR-RQS tool to enhance scientific rigor.

MATERIALS AND METHODS

A systematic literature review (Jun-Aug 2023, MEDLINE/PubMed/SCOPUS) was conducted concerning stage III/IV NSCLC, radiotherapy, and radiomic features (RF). Extracted data included study design particulars, such as sample size, radiotherapy/CT technique, selected RFs, and endpoints. CLEAR and RQS were merged into a CLEAR-RQS checklist. Three readers appraised articles utilizing CLEAR, RQS, and CLEAR-RQS metrics.

RESULTS

Out of 871 articles, 11 met the inclusion/exclusion criteria. The Median cohort size was 91 (range: 10-337) with 9 studies being single-center. No common RF were identified. The merged CLEAR-RQS checklist comprised 61 items. Most unreported items were within CLEAR's "methods" and "open-source," and within RQS's "phantom-calibration," "registry-enrolled prospective-trial-design," and "cost-effective-analysis" sections. No study scored above 50% on RQS. Median CLEAR scores were 55.74% (32.33/58 points), and for RQS, 17.59% (6.3/36 points). CLEAR-RQS article ranking fell between CLEAR and RQS and aligned with CLEAR.

CONCLUSION

Radiomics research in post-radiotherapy stage III/IV NSCLC exhibits variability and frequently low-quality reporting. The formulated CLEAR-RQS checklist may facilitate education and holds promise for enhancing radiomics research quality.

CLINICAL RELEVANCE STATEMENT

Current radiomics research in the field of stage III/IV postradiotherapy NSCLC is heterogenous, lacking reproducibility, with no identified imaging biomarker. Radiomics research quality assessment tools may enhance scientific rigor and thereby facilitate radiomics translation into clinical practice.

KEY POINTS

There is heterogenous and low radiomics research quality in postradiotherapy stage III/IV nonsmall cell lung cancer. Barriers to reproducibility are small cohort size, nonvalidated studies, missing technical parameters, and lack of data, code, and model sharing. CLEAR (CheckList_for_EvaluAtion_of_Radiomics_research), RQS (Radiomics_Quality_Score), and the amalgamated CLEAR-RQS tool are useful frameworks for assessing radiomics research quality and may provide a valuable resource for educational purposes in the field of radiomics.

Diagnostic accuracy of CT and PET/CT radiomics in predicting lymph node metastasis in non-small cell lung cancer

OBJECTIVES

This study evaluates the accuracy of radiomics in predicting lymph node metastasis in non-small cell lung cancer, which is crucial for patient management and prognosis.

METHODS

Adhering to PRISMA and AMSTAR guidelines, we systematically reviewed literature from March 2012 to December 2023 using databases including PubMed, Web of Science, and Embase. Radiomics studies utilizing computed tomography (CT) and positron emission tomography (PET)/CT imaging were included. The quality of studies was appraised with QUADAS-2 and RQS tools, and the TRIPOD checklist assessed model transparency. Sensitivity, specificity, and AUC values were synthesized to determine diagnostic performance, with subgroup and sensitivity analyses probing heterogeneity and a Fagan plot evaluating clinical applicability.

RESULTS

Our analysis incorporated 42 cohorts from 22 studies. CT-based radiomics demonstrated a sensitivity of 0.84 (95% CI: 0.79-0.88, p < 0.01) and specificity of 0.82 (95% CI: 0.75-0.87, p < 0.01), with an AUC of 0.90 (95% CI: 0.87-0.92), indicating no publication bias (p-value = 0.54 > 0.05). PET/CT radiomics showed a sensitivity of 0.82 (95% CI: 0.76-0.86, p < 0.01) and specificity of 0.86 (95% CI: 0.81-0.90, p < 0.01), with an AUC of 0.90 (95% CI: 0.87-0.93), with a slight publication bias (p-value = 0.03 < 0.05). Despite high clinical utility, subgroup analysis did not clarify heterogeneity sources, suggesting influences from possible factors like lymph node location and small subgroup sizes.

CONCLUSIONS

Radiomics models show accuracy in predicting lung cancer lymph node metastasis, yet further validation with larger, multi-center studies is necessary.

CLINICAL RELEVANCE STATEMENT

Radiomics models using CT and PET/CT imaging may improve the prediction of lung cancer lymph node metastasis, aiding personalized treatment strategies.

RESEARCH REGISTRATION UNIQUE IDENTIFYING NUMBER (UIN)

International Prospective Register of Systematic Reviews (PROSPERO), CRD42023494701. This study has been registered on the PROSPERO platform with a registration date of 18 December 2023. https://www.crd.york.ac.uk/prospero/ KEY POINTS: The study explores radiomics for lung cancer lymph node metastasis detection, impacting surgery and prognosis. Radiomics improves the accuracy of lymph node metastasis prediction in lung cancer. Radiomics can aid in the prediction of lymph node metastasis in lung cancer and personalized treatment.

Self-reported checklists and quality scoring tools in radiomics: a meta-research

OBJECTIVE

To evaluate the use of reporting checklists and quality scoring tools for self-reporting purposes in radiomics literature.

METHODS

Literature search was conducted in PubMed (date, April 23, 2023). The radiomics literature was sampled at random after a sample size calculation with a priori power analysis. A systematic assessment for self-reporting, including the use of documentation such as completed checklists or quality scoring tools, was conducted in original research papers. These eligible papers underwent independent evaluation by a panel of nine readers, with three readers assigned to each paper. Automatic annotation was used to assist in this process. Then, a detailed item-by-item confirmation analysis was carried out on papers with checklist documentation, with independent evaluation of two readers.

RESULTS

The sample size calculation yielded 117 papers. Most of the included papers were retrospective (94%; 110/117), single-center (68%; 80/117), based on their private data (89%; 104/117), and lacked external validation (79%; 93/117). Only seven papers (6%) had at least one self-reported document (Radiomics Quality Score (RQS), Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD), or Checklist for Artificial Intelligence in Medical Imaging (CLAIM)), with a statistically significant binomial test (p < 0.001). Median rate of confirmed items for all three documents was 81% (interquartile range, 6). For quality scoring tools, documented scores were higher than suggested scores, with a mean difference of - 7.2 (standard deviation, 6.8).

CONCLUSION

Radiomic publications often lack self-reported checklists or quality scoring tools. Even when such documents are provided, it is essential to be cautious, as the accuracy of the reported items or scores may be questionable.

CLINICAL RELEVANCE STATEMENT

Current state of radiomic literature reveals a notable absence of self-reporting with documentation and inaccurate reporting practices. This critical observation may serve as a catalyst for motivating the radiomics community to adopt and utilize such tools appropriately, thereby fostering rigor, transparency, and reproducibility of their research, moving the field forward.

KEY POINTS

• In radiomics literature, there has been a notable absence of self-reporting with documentation. • Even if such documents are provided, it is critical to exercise caution because the accuracy of the reported items or scores may be questionable. • Radiomics community needs to be motivated to adopt and appropriately utilize the reporting checklists and quality scoring tools.

Perfect Match: Radiomics and Artificial Intelligence in Cardiac Imaging

Cardiovascular diseases remain a significant health burden, with imaging modalities like echocardiography, cardiac computed tomography, and cardiac magnetic resonance imaging playing a crucial role in diagnosis and prognosis. However, the inherent heterogeneity of these diseases poses challenges, necessitating advanced analytical methods like radiomics and artificial intelligence. Radiomics extracts quantitative features from medical images, capturing intricate patterns and subtle variations that may elude visual inspection. Artificial intelligence techniques, including deep learning, can analyze these features to generate knowledge, define novel imaging biomarkers, and support diagnostic decision-making and outcome prediction. Radiomics and artificial intelligence thus hold promise for significantly enhancing diagnostic and prognostic capabilities in cardiac imaging, paving the way for more personalized and effective patient care. This review explores the synergies between radiomics and artificial intelligence in cardiac imaging, following the radiomics workflow and introducing concepts from both domains. Potential clinical applications, challenges, and limitations are discussed, along with solutions to overcome them.

CT Cadaveric dataset for Radiomics features stability assessment in lumbar vertebrae

Radiomics features (RFs) studies have showed limitations in the reproducibility of RFs in different acquisition settings. To date, reproducibility studies using CT images mainly rely on phantoms, due to the harness of patient exposure to X-rays. The provided CadAIver dataset has the aims of evaluating how CT scanner parameters effect radiomics features on cadaveric donor. The dataset comprises 112 unique CT acquisitions of a cadaveric truck acquired on 3 different CT scanners varying KV, mA, field-of-view, and reconstruction kernel settings. Technical validation of the CadAIver dataset comprises a comprehensive univariate and multivariate GLM approach to assess stability of each RFs extracted from lumbar vertebrae. The complete dataset is publicly available to be applied for future research in the RFs field, and could foster the creation of a collaborative open CT image database to increase the sample size, the range of available scanners, and the available body districts.

The effect of data resampling methods in radiomics

Radiomic datasets can be class-imbalanced, for instance, when the prevalence of diseases varies notably, meaning that the number of positive samples is much smaller than that of negative samples. In these cases, the majority class may dominate the model's training and thus negatively affect the model's predictive performance, leading to bias. Therefore, resampling methods are often utilized to class-balance the data. However, several resampling methods exist, and neither their relative predictive performance nor their impact on feature selection has been systematically analyzed. In this study, we aimed to measure the impact of nine resampling methods on radiomic models utilizing a set of fifteen publicly available datasets regarding their predictive performance. Furthermore, we evaluated the agreement and similarity of the set of selected features. Our results show that applying resampling methods did not improve the predictive performance on average. On specific datasets, slight improvements in predictive performance (+ 0.015 in AUC) could be seen. A considerable disagreement on the set of selected features was seen (only 28.7% of features agreed), which strongly impedes feature interpretability. However, selected features are similar when considering their correlation (82.9% of features correlated on average).

Artificial Intelligence and Radiomics for Endometrial Cancer MRI: Exploring the Whats, Whys and Hows

Endometrial cancer (EC) is intricately linked to obesity and diabetes, which are widespread risk factors. Medical imaging, especially magnetic resonance imaging (MRI), plays a major role in EC assessment, particularly for disease staging. However, the diagnostic performance of MRI exhibits variability in the detection of clinically relevant prognostic factors (e.g., deep myometrial invasion and metastatic lymph nodes assessment). To address these challenges and enhance the value of MRI, radiomics and artificial intelligence (AI) algorithms emerge as promising tools with a potential to impact EC risk assessment, treatment planning, and prognosis prediction. These advanced post-processing techniques allow us to quantitatively analyse medical images, providing novel insights into cancer characteristics beyond conventional qualitative image evaluation. However, despite the growing interest and research efforts, the integration of radiomics and AI to EC management is still far from clinical practice and represents a possible perspective rather than an actual reality. This review focuses on the state of radiomics and AI in EC MRI, emphasizing risk stratification and prognostic factor prediction, aiming to illuminate potential advancements and address existing challenges in the field.