A decade of radiomics research: are images really data or just patterns in the noise?

Cardiovascular Magnetic Resonance Radiomics to Identify Components of the Extracellular Matrix in Dilated Cardiomyopathy

BACKGROUND

Current cardiovascular magnetic resonance sequences cannot discriminate between different myocardial extracellular space (ECSs), including collagen, noncollagen, and inflammation. We sought to investigate whether cardiovascular magnetic resonance radiomics analysis can distinguish between noncollagen and inflammation from collagen in dilated cardiomyopathy.

METHODS

We identified data from 132 patients with dilated cardiomyopathy scheduled for an invasive septal biopsy who underwent cardiovascular magnetic resonance at 3 T. Cardiovascular magnetic resonance imaging protocol included native and postcontrast T1 mapping and late gadolinium enhancement (LGE). Radiomic features were computed from the midseptal myocardium, near the biopsy region, on native T1, extracellular volume (ECV) map, and LGE images. Principal component analysis was used to reduce the number of radiomic features to 5 principal radiomics. Moreover, a correlation analysis was conducted to identify radiomic features exhibiting a strong correlation (r>0.9) with the 5 principal radiomics. Biopsy samples were used to quantify ECS, myocardial fibrosis, and inflammation.

RESULTS

Four histopathological phenotypes were identified: low collagen (n=20), noncollagenous ECS expansion (n=49), mild to moderate collagenous ECS expansion (n=42), and severe collagenous ECS expansion (n=21). Noncollagenous expansion was associated with the highest risk of myocardial inflammation (65%). Although native T1 and ECV provided high diagnostic performance in differentiating severe fibrosis (C statistic, 0.90 and 0.90, respectively), their performance in differentiating between noncollagen and mild to moderate collagenous expansion decreased (C statistic: 0.59 and 0.55, respectively). Integration of ECV principal radiomics provided better discrimination and reclassification between noncollagen and mild to moderate collagen (C statistic, 0.79; net reclassification index, 0.83 [95% CI, 0.45-1.22]; P<0.001). There was a similar trend in the addition of native T1 principal radiomics (C statistic, 0.75; net reclassification index, 0.93 [95% CI, 0.56-1.29]; P<0.001) and LGE principal radiomics (C statistic, 0.74; net reclassification index, 0.59 [95% CI, 0.19-0.98]; P=0.004). Five radiomic features per sequence were identified with correlation analysis. They showed a similar improvement in performance for differentiating between noncollagen and mild to moderate collagen (native T1, ECV, LGE C statistic, 0.75, 0.77, and 0.71, respectively). These improvements remained significant when confined to a single radiomic feature (native T1, ECV, LGE C statistic, 0.71, 0.70, and 0.64, respectively).

CONCLUSIONS

Radiomic features extracted from native T1, ECV, and LGE provide incremental information that improves our capability to discriminate noncollagenous expansion from mild to moderate collagen and could be useful for detecting subtle chronic inflammation in patients with dilated cardiomyopathy.

Radiomics for the identification of extraprostatic extension with prostate MRI: a systematic review and meta-analysis

OBJECTIVES

Extraprostatic extension (EPE) of prostate cancer (PCa) is predicted using clinical nomograms. Incorporating MRI could represent a leap forward, although poor sensitivity and standardization represent unsolved issues. MRI radiomics has been proposed for EPE prediction. The aim of the study was to systematically review the literature and perform a meta-analysis of MRI-based radiomics approaches for EPE prediction.

MATERIALS AND METHODS

Multiple databases were systematically searched for radiomics studies on EPE detection up to June 2022. Methodological quality was appraised according to Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool and radiomics quality score (RQS). The area under the receiver operating characteristic curves (AUC) was pooled to estimate predictive accuracy. A random-effects model estimated overall effect size. Statistical heterogeneity was assessed with I2 value. Publication bias was evaluated with a funnel plot. Subgroup analyses were performed to explore heterogeneity.

RESULTS

Thirteen studies were included, showing limitations in study design and methodological quality (median RQS 10/36), with high statistical heterogeneity. Pooled AUC for EPE identification was 0.80. In subgroup analysis, test-set and cross-validation-based studies had pooled AUC of 0.85 and 0.89 respectively. Pooled AUC was 0.72 for deep learning (DL)-based and 0.82 for handcrafted radiomics studies and 0.79 and 0.83 for studies with multiple and single scanner data, respectively. Finally, models with the best predictive performance obtained using radiomics features showed pooled AUC of 0.82, while those including clinical data of 0.76.

CONCLUSION

MRI radiomics-powered models to identify EPE in PCa showed a promising predictive performance overall. However, methodologically robust, clinically driven research evaluating their diagnostic and therapeutic impact is still needed.

CLINICAL RELEVANCE STATEMENT

Radiomics might improve the management of prostate cancer patients increasing the value of MRI in the assessment of extraprostatic extension. However, it is imperative that forthcoming research prioritizes confirmation studies and a stronger clinical orientation to solidify these advancements.

KEY POINTS

• MRI radiomics deserves attention as a tool to overcome the limitations of MRI in prostate cancer local staging. • Pooled AUC was 0.80 for the 13 included studies, with high heterogeneity (84.7%, p < .001), methodological issues, and poor clinical orientation. • Methodologically robust radiomics research needs to focus on increasing MRI sensitivity and bringing added value to clinical nomograms at patient level.

Differentiating inflammatory and malignant pulmonary lesions on 3T lung MRI with radiomics of apparent diffusion coefficient maps and T2w derived radiomic feature maps

Background

Differentiating inflammatory from malignant lung lesions continues to be challenging in clinical routine, frequently requiring invasive methods like biopsy. Therefore, we aimed to investigate if inflammatory and malignant pulmonary lesions could be distinguished noninvasively using radiomics of apparent diffusion coefficient (ADC) maps and radiomic feature maps calculated from T2-weighted (T2w) 3 Tesla (3T) magnetic resonance imaging (MRI) of the lung.

Methods

Fifty-four patients with an unclear pulmonary lesion on computed tomography (CT) were prospectively included and examined by 3T MRI with T2w and diffusion-weighted sequences (b values of 50 and 800). ADC maps were calculated automatically. All patients underwent biopsy or bronchoalveolar lavage (BAL). Sixteen patients were excluded (e.g., motion artifacts), leaving 19 patients each with malignant and inflammatory pulmonary lesions. Target lesions were defined by biopsy or as the largest lesion (BAL-based pathogen detection), and two readers placed volumes of interest (VOIs) around the lesions on T2w images and ADC maps. One hundred and seven features were conventionally extracted from the ADC maps using PyRadiomics. T2w images were converted to 107 parametric feature maps per patient using a PyRadiomics-based, pretested software tool developed by our group. VOIs were copied from T2w images to T2 maps for feature quantification. Features were tested for significant differences using the Mann-Whitney U-test. Diagnostic performance was assessed using receiver operating characteristic (ROC) analysis and interreader agreement by intraclass correlation coefficients (ICCs).

Results

Fifty-eight features derived from ADC maps differed significantly between malignant and inflammatory pulmonary lesions, with areas under the curve (AUCs) >0.90 for 5 and >0.80 for 27 features, compared with 67 features from T2 maps (5 features with AUCs >0.80). ICCs were excellent throughout.

Conclusions

ADC and T2 maps differentiate inflammatory and malignant pulmonary lesions with outstanding (ADC) and excellent (T2w derived feature maps) diagnostic performance. MRI could thus guide the further diagnostic workup and a timely initiation of the appropriate therapy.

Reproducibility of radiomics quality score: an intra- and inter-rater reliability study

OBJECTIVES

To investigate the intra- and inter-rater reliability of the total radiomics quality score (RQS) and the reproducibility of individual RQS items' score in a large multireader study.

METHODS

Nine raters with different backgrounds were randomly assigned to three groups based on their proficiency with RQS utilization: Groups 1 and 2 represented the inter-rater reliability groups with or without prior training in RQS, respectively; group 3 represented the intra-rater reliability group. Thirty-three original research papers on radiomics were evaluated by raters of groups 1 and 2. Of the 33 papers, 17 were evaluated twice with an interval of 1 month by raters of group 3. Intraclass coefficient (ICC) for continuous variables, and Fleiss' and Cohen's kappa (k) statistics for categorical variables were used.

RESULTS

The inter-rater reliability was poor to moderate for total RQS (ICC 0.30-055, p < 0.001) and very low to good for item's reproducibility (k - 0.12 to 0.75) within groups 1 and 2 for both inexperienced and experienced raters. The intra-rater reliability for total RQS was moderate for the less experienced rater (ICC 0.522, p = 0.009), whereas experienced raters showed excellent intra-rater reliability (ICC 0.91-0.99, p < 0.001) between the first and second read. Intra-rater reliability on RQS items' score reproducibility was higher and most of the items had moderate to good intra-rater reliability (k - 0.40 to 1).

CONCLUSIONS

Reproducibility of the total RQS and the score of individual RQS items is low. There is a need for a robust and reproducible assessment method to assess the quality of radiomics research.

CLINICAL RELEVANCE STATEMENT

There is a need for reproducible scoring systems to improve quality of radiomics research and consecutively close the translational gap between research and clinical implementation.

KEY POINTS

• Radiomics quality score has been widely used for the evaluation of radiomics studies. • Although the intra-rater reliability was moderate to excellent, intra- and inter-rater reliability of total score and point-by-point scores were low with radiomics quality score. • A robust, easy-to-use scoring system is needed for the evaluation of radiomics research.

Identification of impactful imaging biomarker: Clinical applications for breast and prostate carcinoma

BACKGROUND

 Imaging biomarkers are quantitative parameters from imaging modalities, which are collected noninvasively, allow conclusions about physiological and pathophysiological processes, and may consist of single (monoparametric) or multiple parameters (bi- or multiparametric).

METHOD

 This review aims to present the state of the art for the quantification of multimodal and multiparametric imaging biomarkers. Here, the use of biomarkers using artificial intelligence will be addressed and the clinical application of imaging biomarkers in breast and prostate cancers will be explained. For the preparation of the review article, an extensive literature search was performed based on Pubmed, Web of Science and Google Scholar. The results were evaluated and discussed for consistency and generality.

RESULTS AND CONCLUSION

 Different imaging biomarkers (multiparametric) are quantified based on the use of complementary imaging modalities (multimodal) from radiology, nuclear medicine, or hybrid imaging. From these techniques, parameters are determined at the morphological (e. g., size), functional (e. g., vascularization or diffusion), metabolic (e. g., glucose metabolism), or molecular (e. g., expression of prostate specific membrane antigen, PSMA) level. The integration and weighting of imaging biomarkers are increasingly being performed with artificial intelligence, using machine learning algorithms. In this way, the clinical application of imaging biomarkers is increasing, as illustrated by the diagnosis of breast and prostate cancers.

KEY POINTS

· Imaging biomarkers are quantitative parameters to detect physiological and pathophysiological processes.. · Imaging biomarkers from multimodality and multiparametric imaging are integrated using artificial intelligence algorithms.. · Quantitative imaging parameters are a fundamental component of diagnostics for all tumor entities, such as for mammary and prostate carcinomas..

CITATION FORMAT

· Bäuerle T, Dietzel M, Pinker K et al. Identification of impactful imaging biomarker: Clinical applications for breast and prostate carcinoma. Fortschr Röntgenstr 2024; 196: 354 - 362.

Robustness of radiomic features in healthy abdominal parenchyma of patients with repeated examinations on dual-layer dual-energy CT

OBJECTIVES

Robustness of radiomic features in physiological tissue is an important prerequisite for quantitative analysis of tumor biology and response assessment. In contrast to previous studies which focused on different tumors with mostly short scan-re-scan intervals, this study aimed to evaluate the robustness of radiomic features in cancer-free patients and over a clinically encountered inter-scan interval.

MATERIALS AND METHODS

Patients without visible tumor burden who underwent at least two portal-venous phase dual energy CT examinations of the abdomen between May 2016 and January 2020 were included, while macroscopic tumor burden was excluded based upon follow-up imaging for all patients (≥3 months). Further, patients were excluded if no follow-up imaging was available, or if the CT protocol showed deviations between repeated examinations. Circular regions of interest were placed and proofread by two board-certified radiologists (4 years and 5 years experience) within the liver (segments 3 and 6), the psoas muscle (left and right), the pancreatic head, and the spleen to obtain radiomic features from normal-appearing organ parenchyma using PyRadiomics. Radiomic feature robustness was tested using the concordance correlation coefficient with a threshold of 0.75 considered indicative for deeming a feature robust.

RESULTS

In total, 160 patients with 480 repeated abdominal CT examinations (range: 2-4 per patient) were retrospectively included in this single-center, IRB-approved study. Considering all organs and feature categories, only 4.58 % (25/546) of all features were robust with the highest rate being found in the first order feature category (20.37 %, 22/108). Other feature categories (grey level co-occurrence matrix, grey level dependence matrix, grey level run length matrix, grey level size zone matrix, and neighborhood gray-tone difference matrix) yielded an overall low percentage of robust features (range: 0.00 %-1.19 %). A subgroup analysis revealed the reconstructed field of view and the X-ray tube current as determinants of feature robustness (significant differences in subgroups for all organs, p < 0.001) as well as the size of the region of interest (no significant difference for the pancreatic head with p = 0.135, significant difference with p < 0.001 for all other organs).

CONCLUSION

Radiomic feature robustness obtained from cancer-free subjects with repeated examinations using a consistent protocol and CT scanner was limited, with first order features yielding the highest proportion of robust features.

A Radiomic "Warning Sign" of Progression on Brain MRI in Individuals with MS

BACKGROUND AND PURPOSE

MS is a chronic progressive, idiopathic, demyelinating disorder whose diagnosis is contingent on the interpretation of MR imaging. New MR imaging lesions are an early biomarker of disease progression. We aimed to evaluate a machine learning model based on radiomics features in predicting progression on MR imaging of the brain in individuals with MS.

MATERIALS AND METHODS

This retrospective cohort study with external validation on open-access data obtained full ethics approval. Longitudinal MR imaging data for patients with MS were collected and processed for machine learning. Radiomics features were extracted at the future location of a new lesion in the patients' prior MR imaging ("prelesion"). Additionally, "control" samples were obtained from the normal-appearing white matter for each participant. Machine learning models for binary classification were trained and tested and then evaluated the external data of the model.

RESULTS

The total number of participants was 167. Of the 147 in the training/test set, 102 were women and 45 were men. The average age was 42 (range, 21-74 years). The best-performing radiomics-based model was XGBoost, with accuracy, precision, recall, and F1-score of 0.91, 0.91, 0.91, and 0.91 on the test set, and 0.74, 0.74, 0.74, and 0.70 on the external validation set. The 5 most important radiomics features to the XGBoost model were associated with the overall heterogeneity and low gray-level emphasis of the segmented regions. Probability maps were produced to illustrate potential future clinical applications.

CONCLUSIONS

Our machine learning model based on radiomics features successfully differentiated prelesions from normal-appearing white matter. This outcome suggests that radiomics features from normal-appearing white matter could serve as an imaging biomarker for progression of MS on MR imaging.

METhodological RadiomICs Score (METRICS): a quality scoring tool for radiomics research endorsed by EuSoMII

PURPOSE

To propose a new quality scoring tool, METhodological RadiomICs Score (METRICS), to assess and improve research quality of radiomics studies.

METHODS

We conducted an online modified Delphi study with a group of international experts. It was performed in three consecutive stages: Stage#1, item preparation; Stage#2, panel discussion among EuSoMII Auditing Group members to identify the items to be voted; and Stage#3, four rounds of the modified Delphi exercise by panelists to determine the items eligible for the METRICS and their weights. The consensus threshold was 75%. Based on the median ranks derived from expert panel opinion and their rank-sum based conversion to importance scores, the category and item weights were calculated.

RESULT

In total, 59 panelists from 19 countries participated in selection and ranking of the items and categories. Final METRICS tool included 30 items within 9 categories. According to their weights, the categories were in descending order of importance: study design, imaging data, image processing and feature extraction, metrics and comparison, testing, feature processing, preparation for modeling, segmentation, and open science. A web application and a repository were developed to streamline the calculation of the METRICS score and to collect feedback from the radiomics community.

CONCLUSION

In this work, we developed a scoring tool for assessing the methodological quality of the radiomics research, with a large international panel and a modified Delphi protocol. With its conditional format to cover methodological variations, it provides a well-constructed framework for the key methodological concepts to assess the quality of radiomic research papers.

CRITICAL RELEVANCE STATEMENT

A quality assessment tool, METhodological RadiomICs Score (METRICS), is made available by a large group of international domain experts, with transparent methodology, aiming at evaluating and improving research quality in radiomics and machine learning.

KEY POINTS

• A methodological scoring tool, METRICS, was developed for assessing the quality of radiomics research, with a large international expert panel and a modified Delphi protocol. • The proposed scoring tool presents expert opinion-based importance weights of categories and items with a transparent methodology for the first time. • METRICS accounts for varying use cases, from handcrafted radiomics to entirely deep learning-based pipelines. • A web application has been developed to help with the calculation of the METRICS score ( https://metricsscore.github.io/metrics/METRICS.html ) and a repository created to collect feedback from the radiomics community ( https://github.com/metricsscore/metrics ).

Towards reproducible radiomics research: introduction of a database for radiomics studies

OBJECTIVES

To investigate the model-, code-, and data-sharing practices in the current radiomics research landscape and to introduce a radiomics research database.

METHODS

A total of 1254 articles published between January 1, 2021, and December 31, 2022, in leading radiology journals (European Radiology, European Journal of Radiology, Radiology, Radiology: Artificial Intelligence, Radiology: Cardiothoracic Imaging, Radiology: Imaging Cancer) were retrospectively screened, and 257 original research articles were included in this study. The categorical variables were compared using Fisher's exact tests or chi-square test and numerical variables using Student's t test with relation to the year of publication.

RESULTS

Half of the articles (128 of 257) shared the model by either including the final model formula or reporting the coefficients of selected radiomics features. A total of 73 (28%) models were validated on an external independent dataset. Only 16 (6%) articles shared the data or used publicly available open datasets. Similarly, only 20 (7%) of the articles shared the code. A total of 7 (3%) articles both shared code and data. All collected data in this study is presented in a radiomics research database (RadBase) and could be accessed at https://github.com/EuSoMII/RadBase .

CONCLUSION

According to the results of this study, the majority of published radiomics models were not technically reproducible since they shared neither model nor code and data. There is still room for improvement in carrying out reproducible and open research in the field of radiomics.

CLINICAL RELEVANCE STATEMENT

To date, the reproducibility of radiomics research and open science practices within the radiomics research community are still very low. Ensuring reproducible radiomics research with model-, code-, and data-sharing practices will facilitate faster clinical translation.

KEY POINTS

• There is a discrepancy between the number of published radiomics papers and the clinical implementation of these published radiomics models. • The main obstacle to clinical implementation is the lack of model-, code-, and data-sharing practices. • In order to translate radiomics research into clinical practice, the radiomics research community should adopt open science practices.

Radiogenomics: Contemporary Applications in the Management of Rectal Cancer

Radiogenomics, a sub-domain of radiomics, refers to the prediction of underlying tumour biology using non-invasive imaging markers. This novel technology intends to reduce the high costs, workload and invasiveness associated with traditional genetic testing via the development of 'imaging biomarkers' that have the potential to serve as an alternative 'liquid-biopsy' in the determination of tumour biological characteristics. Radiogenomics also harnesses the potential to unlock aspects of tumour biology which are not possible to assess by conventional biopsy-based methods, such as full tumour burden, intra-/inter-lesion heterogeneity and the possibility of providing the information of tumour biology longitudinally. Several studies have shown the feasibility of developing a radiogenomic-based signature to predict treatment outcomes and tumour characteristics; however, many lack prospective, external validation. We performed a systematic review of the current literature surrounding the use of radiogenomics in rectal cancer to predict underlying tumour biology.

Artificial Intelligence in Oncological Hybrid Imaging

BACKGROUND

 Artificial intelligence (AI) applications have become increasingly relevant across a broad spectrum of settings in medical imaging. Due to the large amount of imaging data that is generated in oncological hybrid imaging, AI applications are desirable for lesion detection and characterization in primary staging, therapy monitoring, and recurrence detection. Given the rapid developments in machine learning (ML) and deep learning (DL) methods, the role of AI will have significant impact on the imaging workflow and will eventually improve clinical decision making and outcomes.

METHODS AND RESULTS

 The first part of this narrative review discusses current research with an introduction to artificial intelligence in oncological hybrid imaging and key concepts in data science. The second part reviews relevant examples with a focus on applications in oncology as well as discussion of challenges and current limitations.

CONCLUSION

 AI applications have the potential to leverage the diagnostic data stream with high efficiency and depth to facilitate automated lesion detection, characterization, and therapy monitoring to ultimately improve quality and efficiency throughout the medical imaging workflow. The goal is to generate reproducible, structured, quantitative diagnostic data for evidence-based therapy guidance in oncology. However, significant challenges remain regarding application development, benchmarking, and clinical implementation.

KEY POINTS

  · Hybrid imaging generates a large amount of multimodality medical imaging data with high complexity and depth.. · Advanced tools are required to enable fast and cost-efficient processing along the whole radiology value chain.. · AI applications promise to facilitate the assessment of oncological disease in hybrid imaging with high quality and efficiency for lesion detection, characterization, and response assessment. The goal is to generate reproducible, structured, quantitative diagnostic data for evidence-based oncological therapy guidance.. · Selected applications in three oncological entities (lung, prostate, and neuroendocrine tumors) demonstrate how AI algorithms may impact imaging-based tasks in hybrid imaging and potentially guide clinical decision making..

Transforming radiology to support population health

This commentary highlights key areas in which diagnostic radiological services in Singapore will need to evolve in order to address the needs of Healthier SG and population health. Policymakers should focus on “doing the right thing” by improving access to radiological expertise and services to support community and primary care and “doing the thing right” by establishing robust frameworks to support value-based care.

The role of parametric feature maps to correct different volume of interest sizes: an in vivo liver MRI study

BACKGROUND

Different volume of interest (VOI) sizes influence radiomic features. This study examined if translating images into feature maps before feature sampling could compensate for these effects in liver magnetic resonance imaging (MRI).

METHODS

T1- and T2-weighted sequences from three different scanners (two 3-T scanners, one 1.5-T scanner) of 66 patients with normal abdominal MRI were included retrospectively. Three differently sized VOIs (10, 20, and 30 mm in diameter) were drawn in the liver parenchyma (right lobe), excluding adjacent structures. Ninety-three features were extracted conventionally using PyRadiomics. All images were also converted to 93 parametric feature maps using a pretested software. Agreement between the three VOI sizes was assessed with overall concordance correlation coefficients (OCCCs), while OCCCs > 0.85 were rated reproducible. OCCCs were calculated twice: for the VOI sizes of 10, 20, and 30 mm and for those of 20 and 30 mm.

RESULTS

When extracted from original images, only 4 out of the 93 features were reproducible across all VOI sizes in T1- and T2-weighted images. When the smallest VOI was excluded, 5 features (T1-weighted) and 7 features (T2-weighted) were reproducible. Extraction from parametric maps increased the number of reproducible features to 9 (T1- and T2-weighted) across all VOIs. Excluding the 10-mm VOI, reproducibility improved to 16 (T1-weighted) and 55 features (T2-weighted). The stability of all other features also increased in feature maps.

CONCLUSIONS

Translating images into parametric maps before feature extraction improves reproducibility across different VOI sizes in normal liver MRI.

RELEVANCE STATEMENT

The size of the segmented VOI influences the feature quantity of radiomics, while software-based conversion of images into parametric feature maps before feature sampling improves reproducibility across different VOI sizes in MRI of normal liver tissue.

KEY POINTS

• Parametric feature maps can compensate for different VOI sizes. • The effect seems dependent on the VOI sizes and the MRI sequence. • Feature maps can visualize features throughout the entire image stack.

MRI-based nomograms and radiomics in presurgical prediction of extraprostatic extension in prostate cancer: a systematic review

PURPOSE

Prediction of extraprostatic extension (EPE) is essential for accurate surgical planning in prostate cancer (PCa). Radiomics based on magnetic resonance imaging (MRI) has shown potential to predict EPE. We aimed to evaluate studies proposing MRI-based nomograms and radiomics for EPE prediction and assess the quality of current radiomics literature.

METHODS

We used PubMed, EMBASE, and SCOPUS databases to find related articles using synonyms for MRI radiomics and nomograms to predict EPE. Two co-authors scored the quality of radiomics literature using the Radiomics Quality Score (RQS). Inter-rater agreement was measured using the intraclass correlation coefficient (ICC) from total RQS scores. We analyzed the characteristic s of the studies and used ANOVAs to associate the area under the curve (AUC) to sample size, clinical and imaging variables, and RQS scores.

RESULTS

We identified 33 studies-22 nomograms and 11 radiomics analyses. The mean AUC for nomogram articles was 0.783, and no significant associations were found between AUC and sample size, clinical variables, or number of imaging variables. For radiomics articles, there were significant associations between number of lesions and AUC (p < 0.013). The average RQS total score was 15.91/36 (44%). Through the radiomics operation, segmentation of region-of-interest, selection of features, and model building resulted in a broader range of results. The qualities the studies lacked most were phantom tests for scanner variabilities, temporal variability, external validation datasets, prospective designs, cost-effectiveness analysis, and open science.

CONCLUSION

Utilizing MRI-based radiomics to predict EPE in PCa patients demonstrates promising outcomes. However, quality improvement and standardization of radiomics workflow are needed.

An overview of meta-analyses on radiomics: more evidence is needed to support clinical translation

OBJECTIVE

To conduct an overview of meta-analyses of radiomics studies assessing their study quality and evidence level.

METHODS

A systematical search was updated via peer-reviewed electronic databases, preprint servers, and systematic review protocol registers until 15 November 2022. Systematic reviews with meta-analysis of primary radiomics studies were included. Their reporting transparency, methodological quality, and risk of bias were assessed by PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) 2020 checklist, AMSTAR-2 (A MeaSurement Tool to Assess systematic Reviews, version 2) tool, and ROBIS (Risk Of Bias In Systematic reviews) tool, respectively. The evidence level supporting the radiomics for clinical use was rated.

RESULTS

We identified 44 systematic reviews with meta-analyses on radiomics research. The mean ± standard deviation of PRISMA adherence rate was 65 ± 9%. The AMSTAR-2 tool rated 5 and 39 systematic reviews as low and critically low confidence, respectively. The ROBIS assessment resulted low, unclear and high risk in 5, 11, and 28 systematic reviews, respectively. We reperformed 53 meta-analyses in 38 included systematic reviews. There were 3, 7, and 43 meta-analyses rated as convincing, highly suggestive, and weak levels of evidence, respectively. The convincing level of evidence was rated in (1) T2-FLAIR radiomics for IDH-mutant vs IDH-wide type differentiation in low-grade glioma, (2) CT radiomics for COVID-19 vs other viral pneumonia differentiation, and (3) MRI radiomics for high-grade glioma vs brain metastasis differentiation.

CONCLUSIONS

The systematic reviews on radiomics were with suboptimal quality. A limited number of radiomics approaches were supported by convincing level of evidence.

CLINICAL RELEVANCE STATEMENT

The evidence supporting the clinical application of radiomics are insufficient, calling for researches translating radiomics from an academic tool to a practicable adjunct towards clinical deployment.

Radiomics Analysis for Multiple Myeloma: A Systematic Review with Radiomics Quality Scoring

Multiple myeloma (MM) is one of the most common hematological malignancies affecting the bone marrow. Radiomics analysis has been employed in the literature in an attempt to evaluate the bone marrow of MM patients. This manuscript aimed to systematically review radiomics research on MM while employing a radiomics quality score (RQS) to accurately assess research quality in the field. A systematic search was performed on Web of Science, PubMed, and Scopus. The selected manuscripts were evaluated (data extraction and RQS scoring) by three independent readers (R1, R2, and R3) with experience in radiomics analysis. A total of 23 studies with 2682 patients were included, and the median RQS was 10 for R1 (IQR 5.5-12) and R3 (IQR 8.3-12) and 11 (IQR 7.5-12.5) for R2. RQS was not significantly correlated with any of the assessed bibliometric data (impact factor, quartile, year of publication, and imaging modality) (p > 0.05). Our results demonstrated the low quality of published radiomics research in MM, similarly to other fields of radiomics research, highlighting the need to tighten publication standards.

Radiomics in colorectal cancer patients

The main therapeutic options for colorectal cancer are surgical resection and adjuvant chemotherapy in non-metastatic disease. However, the evaluation of the overall adjuvant chemotherapy benefit in patients with a high risk of recurrence is challenging. Radiological images can represent a source of data that can be analyzed by using automated computer-based techniques, working on numerical information coded within Digital Imaging and Communications in Medicine files: This image numerical analysis has been named "radiomics". Radiomics allows the extraction of quantitative features from radiological images, mainly invisible to the naked eye, that can be further analyzed by artificial intelligence algorithms. Radiomics is expanding in oncology to either understand tumor biology or for the development of imaging biomarkers for diagnosis, staging, and prognosis, prediction of treatment response and diseases monitoring and surveillance. Several efforts have been made to develop radiomics signatures for colorectal cancer patient using computed tomography (CT) images with different aims: The preoperative prediction of lymph node metastasis, detecting BRAF and RAS gene mutations. Moreover, the use of delta-radiomics allows the analysis of variations of the radiomics parameters extracted from CT scans performed at different timepoints. Most published studies concerning radiomics and magnetic resonance imaging (MRI) mainly focused on the response of advanced tumors that underwent neoadjuvant therapy. Nodes status is the main determinant of adjuvant chemotherapy. Therefore, several radiomics model based on MRI, especially on T2-weighted images and ADC maps, for the preoperative prediction of nodes metastasis in rectal cancer has been developed. Current studies mostly focused on the applications of radiomics in positron emission tomography/CT for the prediction of survival after curative surgical resection and assessment of response following neoadjuvant chemoradiotherapy. Since colorectal liver metastases develop in about 25% of patients with colorectal carcinoma, the main diagnostic tasks of radiomics should be the detection of synchronous and metachronous lesions. Radiomics could be an additional tool in clinical setting, especially in identifying patients with high-risk disease. Nevertheless, radiomics has numerous shortcomings that make daily use extremely difficult. Further studies are needed to assess performance of radiomics in stratifying patients with high-risk disease.

Radiomics and Radiogenomics in Pelvic Oncology: Current Applications and Future Directions

Radiomics refers to the conversion of medical imaging into high-throughput, quantifiable data in order to analyse disease patterns, guide prognosis and aid decision making. Radiogenomics is an extension of radiomics that combines conventional radiomics techniques with molecular analysis in the form of genomic and transcriptomic data, serving as an alternative to costly, labour-intensive genetic testing. Data on radiomics and radiogenomics in the field of pelvic oncology remain novel concepts in the literature. We aim to perform an up-to-date analysis of current applications of radiomics and radiogenomics in the field of pelvic oncology, particularly focusing on the prediction of survival, recurrence and treatment response. Several studies have applied these concepts to colorectal, urological, gynaecological and sarcomatous diseases, with individual efficacy yet poor reproducibility. This article highlights the current applications of radiomics and radiogenomics in pelvic oncology, as well as the current limitations and future directions. Despite a rapid increase in publications investigating the use of radiomics and radiogenomics in pelvic oncology, the current evidence is limited by poor reproducibility and small datasets. In the era of personalised medicine, this novel field of research has significant potential, particularly for predicting prognosis and guiding therapeutic decisions. Future research may provide fundamental data on how we treat this cohort of patients, with the aim of reducing the exposure of high-risk patients to highly morbid procedures.

CheckList for EvaluAtion of Radiomics research (CLEAR): a step-by-step reporting guideline for authors and reviewers endorsed by ESR and EuSoMII

Even though radiomics can hold great potential for supporting clinical decision-making, its current use is mostly limited to academic research, without applications in routine clinical practice. The workflow of radiomics is complex due to several methodological steps and nuances, which often leads to inadequate reporting and evaluation, and poor reproducibility. Available reporting guidelines and checklists for artificial intelligence and predictive modeling include relevant good practices, but they are not tailored to radiomic research. There is a clear need for a complete radiomics checklist for study planning, manuscript writing, and evaluation during the review process to facilitate the repeatability and reproducibility of studies. We here present a documentation standard for radiomic research that can guide authors and reviewers. Our motivation is to improve the quality and reliability and, in turn, the reproducibility of radiomic research. We name the checklist CLEAR (CheckList for EvaluAtion of Radiomics research), to convey the idea of being more transparent. With its 58 items, the CLEAR checklist should be considered a standardization tool providing the minimum requirements for presenting clinical radiomics research. In addition to a dynamic online version of the checklist, a public repository has also been set up to allow the radiomics community to comment on the checklist items and adapt the checklist for future versions. Prepared and revised by an international group of experts using a modified Delphi method, we hope the CLEAR checklist will serve well as a single and complete scientific documentation tool for authors and reviewers to improve the radiomics literature.

A pilot study of MRI radiomics for high-risk prostate cancer stratification in 1.5 T MR-guided radiotherapy

PURPOSE

To investigate the potential value of MRI radiomics obtained from a 1.5 T MRI-guided linear accelerator (MR-LINAC) for D'Amico high-risk prostate cancer (PC) classification in MR-guided radiotherapy (MRgRT).

METHODS

One hundred seventy-six consecutive PC patients underwent 1.5 T MRgRT treatment were retrospectively enrolled. Each patient received one or two pretreatment T₂ -weighted MRI scans on a 1.5 T MR-LINAC. The endpoint was to differentiate high-risk from low/intermediate-risk PC based on D'Amico criteria using MRI-radiomics. Totally 1023 features were extracted from clinical target volume (CTV) and planning target volume (PTV). Intraclass correlation coefficient of scan-rescan repeatability, feature correlation, and recursive feature elimination were used for feature dimension reduction. Least absolute shrinkage and selection operator regression was employed for model construction. Receiver operating characteristic area under the curve (AUC) analysis was used for model performance assessment in both training and testing data.

RESULTS

One hundred and eleven patients fulfilled all criteria were finally included: 76 for training and 35 for testing. The constructed MRI-radiomics models extracted from CTV and PTV achieved the AUC of 0.812 and 0.867 in the training data, without significant difference (P = 0.083). The model performances remained in the testing. The sensitivity, specificity, and accuracy were 85.71%, 64.29%, and 77.14% for the PTV-based model; and 71.43%, 71.43%, and 71.43% for the CTV-based model. The corresponding AUCs were 0.718 and 0.750 (P = 0.091) for CTV- and PTV-based models.

CONCLUSION

MRI-radiomics obtained from a 1.5 T MR-LINAC showed promising results in D'Amico high-risk PC stratification, potentially helpful for the future PC MRgRT. Prospective studies with larger sample sizes and external validation are warranted for further verification.

A first look into radiomics application in testicular imaging: A systematic review

The aim of this systematic review was to evaluate the state of the art of radiomics in testicular imaging by assessing the quality of radiomic workflow using the Radiomics Quality Score (RQS) and the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2). A systematic literature search was performed to find potentially relevant articles on the applications of radiomics in testicular imaging, and 6 final articles were extracted. The mean RQS was 11,33 ± 3,88 resulting in a percentage of 31,48% ± 10,78%. Regarding QUADAS-2 criteria, no relevant biases were found in the included papers in the patient selection, index test, reference standard criteria and flow-and-timing domain. In conclusion, despite the publication of promising studies, radiomic research on testicular imaging is in its very beginning and still hindered by methodological limitations, and the potential applications of radiomics for this field are still largely unexplored.

NEgatiVE results in Radiomics research (NEVER): A meta-research study of publication bias in leading radiology journals

PURPOSE

The purpose of this study was to conduct a meta-research of radiomics-related articles for the publication of negative results, with a focus on the leading clinical radiology journals due to their purportedly high editorial standards.

METHODS

A literature search was performed in PubMed to identify original research studies on radiomics (last search date: August 16th, 2022). The search was restricted to studies published in Q1 clinical radiology journals indexed by Scopus and Web of Science. Following an a priori power analysis based on our null hypothesis, a random sampling of the published literature was conducted. Besides the six baseline study characteristics, a total of three items about publication bias were evaluated. Agreement between raters was analyzed. Disagreements were resolved through consensus. Statistical synthesis of the qualitative evaluations was presented.

RESULTS

Following a priori power analysis, we included a random sample of 149 publications in this study. Most of the publications were retrospective (95%; 142/149), based on private data (91%; 136/149), centered on a single institution (75%; 111/149), and lacked external validation (81%; 121/149). Slightly fewer than half (44%; 66/149) made no comparison to non-radiomic approaches. Overall, only one study (1%; 1/149) reported negative results for radiomics, yielding a statistically significant binomial test (p < 0.0001).

CONCLUSION

The top clinical radiology journals almost never publish negative results, having a strong bias toward publishing positive results. Almost half of the publications did not even compare their approach with a non-radiomic method.

Systematic review of the radiomics quality score applications: an EuSoMII Radiomics Auditing Group Initiative

OBJECTIVE

The main aim of the present systematic review was a comprehensive overview of the Radiomics Quality Score (RQS)-based systematic reviews to highlight common issues and challenges of radiomics research application and evaluate the relationship between RQS and review features.

METHODS

The literature search was performed on multiple medical literature archives according to PRISMA guidelines for systematic reviews that reported radiomic quality assessment through the RQS. Reported scores were converted to a 0-100% scale. The Mann-Whitney and Kruskal-Wallis tests were used to compare RQS scores and review features.

RESULTS

The literature research yielded 345 articles, from which 44 systematic reviews were finally included in the analysis. Overall, the median of RQS was 21.00% (IQR = 11.50). No significant differences of RQS were observed in subgroup analyses according to targets (oncological/not oncological target, neuroradiology/body imaging focus and one imaging technique/more than one imaging technique, characterization/prognosis/detection/other).

CONCLUSIONS

Our review did not reveal a significant difference of quality of radiomic articles reported in systematic reviews, divided in different subgroups. Furthermore, low overall methodological quality of radiomics research was found independent of specific application domains. While the RQS can serve as a reference tool to improve future study designs, future research should also be aimed at improving its reliability and developing new tools to meet an ever-evolving research space.

KEY POINTS

• Radiomics is a promising high-throughput method that may generate novel imaging biomarkers to improve clinical decision-making process, but it is an inherently complex analysis and often lacks reproducibility and generalizability. • The Radiomics Quality Score serves a necessary role as the de facto reference tool for assessing radiomics studies. • External auditing of radiomics studies, in addition to the standard peer-review process, is valuable to highlight common limitations and provide insights to improve future study designs and practical applicability of the radiomics models.

Influence of Image Processing on Radiomic Features From Magnetic Resonance Imaging

OBJECTIVE

Before implementing radiomics in routine clinical practice, comprehensive knowledge about the repeatability and reproducibility of radiomic features is required. The aim of this study was to systematically investigate the influence of image processing parameters on radiomic features from magnetic resonance imaging (MRI) in terms of feature values as well as test-retest repeatability.

MATERIALS AND METHODS

Utilizing a phantom consisting of 4 onions, 4 limes, 4 kiwifruits, and 4 apples, we acquired a test-retest dataset featuring 3 of the most commonly used MRI sequences on a 3 T scanner, namely, a T1-weighted, a T2-weighted, and a fluid-attenuated inversion recovery sequence, each at high and low resolution. After semiautomatic image segmentation, image processing with systematic variation of image processing parameters was performed, including spatial resampling, intensity discretization, and intensity rescaling. For each respective image processing setting, a total of 45 radiomic features were extracted, corresponding to the following 7 matrices/feature classes: conventional indices, histogram matrix, shape matrix, gray-level zone length matrix, gray-level run length matrix, neighboring gray-level dependence matrix, and gray-level cooccurrence matrix. Systematic differences of individual features between different resampling steps were assessed using 1-way analysis of variance with Tukey-type post hoc comparisons to adjust for multiple testing. Test-retest repeatability of radiomic features was measured using the concordance correlation coefficient, dynamic range, and intraclass correlation coefficient.

RESULTS

Image processing influenced radiological feature values. Regardless of the acquired sequence and feature class, significant differences ( P < 0.05) in feature values were found when the size of the resampled voxels was too large, that is, bigger than 3 mm. Almost all higher-order features depended strongly on intensity discretization. The effects of intensity rescaling were negligible except for some features derived from T1-weighted sequences. For all sequences, the percentage of repeatable features (concordance correlation coefficient and dynamic range ≥ 0.9) varied considerably depending on the image processing settings. The optimal image processing setting to achieve the highest percentage of stable features varied per sequence. Irrespective of image processing, the fluid-attenuated inversion recovery sequence in high-resolution overall yielded the highest number of stable features in comparison with the other sequences (89% vs 64%-78% for the respective optimal image processing settings). Across all sequences, the most repeatable features were generally obtained for a spatial resampling close to the originally acquired voxel size and an intensity discretization to at least 32 bins.

CONCLUSION

Variation of image processing parameters has a significant impact on the values of radiomic features as well as their repeatability. Furthermore, the optimal image processing parameters differ for each MRI sequence. Therefore, it is recommended that these processing parameters be determined in corresponding test-retest scans before clinical application. Extensive repeatability, reproducibility, and validation studies as well as standardization are required before quantitative image analysis and radiomics can be reliably translated into routine clinical care.

Systematic review with radiomics quality score of cholangiocarcinoma: an EuSoMII Radiomics Auditing Group Initiative

OBJECTIVES

To systematically review current research applications of radiomics in patients with cholangiocarcinoma and to assess the quality of CT and MRI radiomics studies.

METHODS

A systematic search was conducted on PubMed/Medline, Web of Science, and Scopus databases to identify original studies assessing radiomics of cholangiocarcinoma on CT and/or MRI. Three readers with different experience levels independently assessed quality of the studies using the radiomics quality score (RQS). Subgroup analyses were performed according to journal type, year of publication, quartile and impact factor (from the Journal Citation Report database), type of cholangiocarcinoma, imaging modality, and number of patients.

RESULTS

A total of 38 original studies including 6242 patients (median 134 patients) were selected. The median RQS was 9 (corresponding to 25.0% of the total RQS; IQR 1-13) for reader 1, 8 (22.2%, IQR 3-12) for reader 2, and 10 (27.8%; IQR 5-14) for reader 3. The inter-reader agreement was good with an ICC of 0.75 (95% CI 0.62-0.85) for the total RQS. All studies were retrospective and none of them had phantom assessment, imaging at multiple time points, nor performed cost-effectiveness analysis. The RQS was significantly higher in studies published in journals with impact factor > 4 (median 11 vs. 4, p = 0.048 for reader 1) and including more than 100 patients (median 11.5 vs. 0.5, p < 0.001 for reader 1).

CONCLUSIONS

Quality of radiomics studies on cholangiocarcinoma is insufficient based on the radiomics quality score. Future research should consider prospective studies with a standardized methodology, validation in multi-institutional external cohorts, and open science data.

Artificial Intelligence in Oncological Hybrid Imaging

BACKGROUND

Artificial intelligence (AI) applications have become increasingly relevant across a broad spectrum of settings in medical imaging. Due to the large amount of imaging data that is generated in oncological hybrid imaging, AI applications are desirable for lesion detection and characterization in primary staging, therapy monitoring, and recurrence detection. Given the rapid developments in machine learning (ML) and deep learning (DL) methods, the role of AI will have significant impact on the imaging workflow and will eventually improve clinical decision making and outcomes.

METHODS AND RESULTS

The first part of this narrative review discusses current research with an introduction to artificial intelligence in oncological hybrid imaging and key concepts in data science. The second part reviews relevant examples with a focus on applications in oncology as well as discussion of challenges and current limitations.

CONCLUSION

AI applications have the potential to leverage the diagnostic data stream with high efficiency and depth to facilitate automated lesion detection, characterization, and therapy monitoring to ultimately improve quality and efficiency throughout the medical imaging workflow. The goal is to generate reproducible, structured, quantitative diagnostic data for evidence-based therapy guidance in oncology. However, significant challenges remain regarding application development, benchmarking, and clinical implementation.

KEY POINTS

· Hybrid imaging generates a large amount of multimodality medical imaging data with high complexity and depth.. · Advanced tools are required to enable fast and cost-efficient processing along the whole radiology value chain.. · AI applications promise to facilitate the assessment of oncological disease in hybrid imaging with high quality and efficiency for lesion detection, characterization, and response assessment. The goal is to generate reproducible, structured, quantitative diagnostic data for evidence-based oncological therapy guidance.. · Selected applications in three oncological entities (lung, prostate, and neuroendocrine tumors) demonstrate how AI algorithms may impact imaging-based tasks in hybrid imaging and potentially guide clinical decision making..

CITATION FORMAT

· Feuerecker B, Heimer M, Geyer T et al. Artificial Intelligence in Oncological Hybrid Imaging. Fortschr Röntgenstr 2023; 195: 105 - 114.

Must-have Qualities of Clinical Research on Artificial Intelligence and Machine Learning

In the field of computer science, known as artificial intelligence, algorithms imitate reasoning tasks that are typically performed by humans. The techniques that allow machines to learn and get better at tasks such as recognition and prediction, which form the basis of clinical practice, are referred to as machine learning, which is a subfield of artificial intelligence. The number of artificial intelligence-and machine learnings-related publications in clinical journals has grown exponentially, driven by recent developments in computation and the accessibility of simple tools. However, clinicians are often not included in data science teams, which may limit the clinical relevance, explanability, workflow compatibility, and quality improvement of artificial intelligence solutions. Thus, this results in the language barrier between clinicians and artificial intelligence developers. Healthcare practitioners sometimes lack a basic understanding of artificial intelligence research because the approach is difficult for non-specialists to understand. Furthermore, many editors and reviewers of medical publications might not be familiar with the fundamental ideas behind these technologies, which may prevent journals from publishing high-quality artificial intelligence studies or, worse still, could allow for the publication of low-quality works. In this review, we aim to improve readers’ artificial intelligence literacy and critical thinking. As a result, we concentrated on what we consider the 10 most important qualities of artificial intelligence research: valid scientific purpose, high-quality data set, robust reference standard, robust input, no information leakage, optimal bias-variance tradeoff, proper model evaluation, proven clinical utility, transparent reporting, and open science. Before designing a study, one should have defined a sound scientific purpose. Then, it should be backed by a high-quality data set, robust input, and a solid reference standard. The artificial intelligence development pipeline should prevent information leakage. For the models, optimal bias-variance tradeoff should be achieved, and generalizability assessment must be adequately performed. The clinical value of the final models must also be established. After the study, thought should be given to transparency in publishing the process and results as well as open science for sharing data, code, and models. We hope this work may improve the artificial intelligence literacy and mindset of the readers.

The True Value of Quantitative Imaging for Adrenal Mass Characterization: Reality or Possibility?

The widespread use of cross-sectional imaging modalities, such as computed tomography (CT) and magnetic resonance imaging (MRI), in the evaluation of abdominal disorders has significantly increased the number of incidentally detected adrenal abnormalities, particularly adrenal masses [...].

A methodological framework for AI-assisted diagnosis of active aortitis using radiomic analysis of FDG PET-CT images: Initial analysis

BACKGROUND

The aim of this study was to explore the feasibility of assisted diagnosis of active (peri-)aortitis using radiomic imaging biomarkers derived from [18F]-Fluorodeoxyglucose Positron Emission Tomography-Computed Tomography (FDG PET-CT) images.

METHODS

The aorta was manually segmented on FDG PET-CT in 50 patients with aortitis and 25 controls. Radiomic features (RF) (n = 107), including SUV (Standardized Uptake Value) metrics, were extracted from the segmented data and harmonized using the ComBat technique. Individual RFs and groups of RFs (i.e., signatures) were used as input in Machine Learning classifiers. The diagnostic utility of these classifiers was evaluated with area under the receiver operating characteristic curve (AUC) and accuracy using the clinical diagnosis as the ground truth.

RESULTS

Several RFs had high accuracy, 84% to 86%, and AUC scores 0.83 to 0.97 when used individually. Radiomic signatures performed similarly, AUC 0.80 to 1.00.

CONCLUSION

A methodological framework for a radiomic-based approach to support diagnosis of aortitis was outlined. Selected RFs, individually or in combination, showed similar performance to the current standard of qualitative assessment in terms of AUC for identifying active aortitis. This framework could support development of a clinical decision-making tool for a more objective and standardized assessment of aortitis.

Computed Tomographic Radiomics in Differentiating Histologic Subtypes of Epithelial Ovarian Carcinoma

IMPORTANCE

Epithelial ovarian carcinoma is heterogeneous and classified according to the World Health Organization Tumour Classification, which is based on histologic features and molecular alterations. Preoperative prediction of the histologic subtypes could aid in clinical management and disease prognostication.

OBJECTIVE

To assess the value of radiomics based on contrast-enhanced computed tomography (CT) in differentiating histologic subtypes of epithelial ovarian carcinoma in multicenter data sets.

DESIGN, SETTING, AND PARTICIPANTS

In this diagnostic study, 665 patients with histologically confirmed epithelial ovarian carcinoma were retrospectively recruited from 4 centers (Hong Kong, Guangdong Province of China, and Seoul, South Korea) between January 1, 2012, and February 28, 2022. The patients were randomly divided into a training cohort (n = 532) and a testing cohort (n = 133) with a ratio of 8:2. This process was repeated 100 times. Tumor segmentation was manually delineated on each section of contrast-enhanced CT images to encompass the entire tumor. The Mann-Whitney U test and voted least absolute shrinkage and selection operator were performed for feature reduction and selection. Selected features were used to build the logistic regression model for differentiating high-grade serous carcinoma and non-high-grade serous carcinoma.

EXPOSURES

Contrast-enhanced CT-based radiomics.

MAIN OUTCOMES AND MEASURES

Intraobserver and interobserver reproducibility of tumor segmentation were measured by Dice similarity coefficients. The diagnostic efficiency of the model was assessed by receiver operating characteristic curve and area under the curve.

RESULTS

In this study, 665 female patients (mean [SD] age, 53.6 [10.9] years) with epithelial ovarian carcinoma were enrolled and analyzed. The Dice similarity coefficients of intraobserver and interobserver were all greater than 0.80. Twenty radiomic features were selected for modeling. The areas under the curve of the logistic regression model in differentiating high-grade serous carcinoma and non-high-grade serous carcinoma were 0.837 (95% CI, 0.835-0.838) for the training cohort and 0.836 (95% CI, 0.833-0.840) for the testing cohort.

CONCLUSIONS AND RELEVANCE

In this diagnostic study, radiomic features extracted from contrast-enhanced CT were useful in the classification of histologic subtypes in epithelial ovarian carcinoma. Intraobserver and interobserver reproducibility of tumor segmentation was excellent. The proposed logistic regression model offered excellent discriminative ability among histologic subtypes.

Radiology artificial intelligence: a systematic review and evaluation of methods (RAISE)

OBJECTIVE

There has been a large amount of research in the field of artificial intelligence (AI) as applied to clinical radiology. However, these studies vary in design and quality and systematic reviews of the entire field are lacking.This systematic review aimed to identify all papers that used deep learning in radiology to survey the literature and to evaluate their methods. We aimed to identify the key questions being addressed in the literature and to identify the most effective methods employed.

METHODS

We followed the PRISMA guidelines and performed a systematic review of studies of AI in radiology published from 2015 to 2019. Our published protocol was prospectively registered.

RESULTS

Our search yielded 11,083 results. Seven hundred sixty-seven full texts were reviewed, and 535 articles were included. Ninety-eight percent were retrospective cohort studies. The median number of patients included was 460. Most studies involved MRI (37%). Neuroradiology was the most common subspecialty. Eighty-eight percent used supervised learning. The majority of studies undertook a segmentation task (39%). Performance comparison was with a state-of-the-art model in 37%. The most used established architecture was UNet (14%). The median performance for the most utilised evaluation metrics was Dice of 0.89 (range .49-.99), AUC of 0.903 (range 1.00-0.61) and Accuracy of 89.4 (range 70.2-100). Of the 77 studies that externally validated their results and allowed for direct comparison, performance on average decreased by 6% at external validation (range increase of 4% to decrease 44%).

CONCLUSION

This systematic review has surveyed the major advances in AI as applied to clinical radiology.

KEY POINTS

• While there are many papers reporting expert-level results by using deep learning in radiology, most apply only a narrow range of techniques to a narrow selection of use cases. • The literature is dominated by retrospective cohort studies with limited external validation with high potential for bias. • The recent advent of AI extensions to systematic reporting guidelines and prospective trial registration along with a focus on external validation and explanations show potential for translation of the hype surrounding AI from code to clinic.

Radiomics can differentiate high-grade glioma from brain metastasis: a systematic review and meta-analysis

OBJECTIVE

(1) To evaluate the diagnostic performance of radiomics in differentiating high-grade glioma from brain metastasis and how to improve the model. (2) To assess the methodological quality of radiomics studies and explore ways of embracing the clinical application of radiomics.

METHODS

Studies using radiomics to differentiate high-grade glioma from brain metastasis published by 26 July 2021 were systematically reviewed. Methodological quality and risk of bias were assessed using the Radiomics Quality Score (RQS) system and Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool, respectively. Pooled sensitivity and specificity of the radiomics model were also calculated.

RESULTS

Seventeen studies combining 1,717 patients were included in the systematic review, of which 10 studies without data leakage suspicion were employed for the quantitative statistical analysis. The average RQS was 5.13 (14.25% of total), with substantial or almost perfect inter-rater agreements. The inclusion of clinical features in the radiomics model was only reported in one study, as was the case for publicly available algorithm code. The pooled sensitivity and specificity were 84% (95% CI, 80-88%) and 84% (95% CI, 81-87%), respectively. The performances of feature extraction from the volume of interest (VOI) or (semi) automatic segmentation in the radiomics models were superior to those of protocols employing region of interest (ROI) or manual segmentation.

CONCLUSION

Radiomics can accurately differentiate high-grade glioma from brain metastasis. The adoption of standardized workflow to avoid potential data leakage as well as the integration of clinical features and radiomics are advised to consider in future studies.

KEY POINTS

• The pooled sensitivity and specificity of radiomics for differentiating high-grade gliomas from brain metastasis were 84% and 84%, respectively. • Avoiding potential data leakage by adopting an intensive and standardized workflow is essential to improve the quality and generalizability of the radiomics model. • The application of radiomics in combination with clinical features in differentiating high-grade gliomas from brain metastasis needs further validation.

FDG PET and CT radiomics in diagnosis and prognosis of non-small-cell lung cancer

BACKGROUND

18F-FDG PET and CT radiomics has been the object of a wide research for over 20 years but its contribution to clinical practice remains not yet well established. We have investigated its impact versus that of only histo-clinical data, for the routine management of non-small-cell lung cancer (NSCLC).

METHODS

Our patients were retrospectively considered. They all had a FDG PET-CT and immuno-histo-chemistry (IHC) to assess PD-L1 expression at the beginning of the disease. A prognosis univariate and multivariate Cox survival analyses was performed for overall survival (OS) and progression free survival (PFS) prediction, including a training/testing procedure. Two sets of 47 PET and 47 CT radiomics features (RFs) were extracted. Difference between RFs according to PD-L1 expression, the histology status and the stage level were tested using suited non parametric statistical tests and the receiver operating characteristics (ROC) curve and the area under curve (AUC).

RESULTS

From 2017 to 2019, 212 NSCLC patients treated in our institution were included. The main conventional prognostic variables were stage and gender with a low added prognostic value in the models including PET and CT RFs. Neither PET nor CT RFs were significant to separate the different levels of PD-L1 expression. Several RFs differ between adenocarcinoma (ADC) and squamous cell carcinoma (SCC) tumours and a large number of PET and CT RFs are significantly linked to patient stage.

CONCLUSIONS

In our population, PET and CT RFs show their intrinsic power to predict survival but do not significantly improve OS and PFS prediction in the different multivariate models, in comparison to conventional data. It would seem necessary to carry out one's own survival analysis before determining a radiomics signature.

Ultrasound-based radiomics analysis for differentiating benign and malignant breast lesions: From static images to CEUS video analysis

Background

Continuous contrast-enhanced ultrasound (CEUS) video is a challenging direction for radiomics research. We aimed to evaluate machine learning (ML) approaches with radiomics combined with the XGBoost model and a convolutional neural network (CNN) for discriminating between benign and malignant lesions in CEUS videos with a duration of more than 1 min.

Methods

We gathered breast CEUS videos of 109 benign and 81 malignant tumors from two centers. Radiomics combined with the XGBoost model and a CNN was used to classify the breast lesions on the CEUS videos. The lesions were manually segmented by one radiologist. Radiomics combined with the XGBoost model was conducted with a variety of data sampling methods. The CNN used pretrained 3D residual network (ResNet) models with 18, 34, 50, and 101 layers. The machine interpretations were compared with prospective interpretations by two radiologists. Breast biopsies or pathological examinations were used as the reference standard. Areas under the receiver operating curves (AUCs) were used to compare the diagnostic performance of the models.

Results

The CNN model achieved the best AUC of 0.84 on the test cohort with the 3D-ResNet-50 model. The radiomics model obtained AUCs between 0.65 and 0.75. Radiologists 1 and 2 had AUCs of 0.75 and 0.70, respectively.

Conclusions

The 3D-ResNet-50 model was superior to the radiomics combined with the XGBoost model in classifying enhanced lesions as benign or malignant on CEUS videos. The CNN model was superior to the radiologists, and the radiomics model performance was close to the performance of the radiologists.

Enhancing the stability of CT radiomics across different volume of interest sizes using parametric feature maps: a phantom study

BACKGROUND

In radiomics studies, differences in the volume of interest (VOI) are often inevitable and may confound the extracted features. We aimed to correct this confounding effect of VOI variability by applying parametric maps with a fixed voxel size.

METHODS

Ten scans of a cup filled with sodium chloride solution were scanned using a multislice computed tomography (CT) unit. Sphere-shaped VOIs with different diameters (4, 8, or 16 mm) were drawn centrally into the phantom. A total of 93 features were extracted conventionally from the original images using PyRadiomics. Using a self-designed and pretested software tool, parametric maps for the same 93 features with a fixed voxel size of 4 mm3 were created. To retrieve the feature values from the maps, VOIs were copied from the original images to preserve the position. Differences in feature quantities between the VOI sizes were tested with the Mann-Whitney U-test and agreement with overall concordance correlation coefficients (OCCC).

RESULTS

Fifty-five conventionally extracted features were significantly different between the VOI sizes, and none of the features showed excellent agreement in terms of OCCCs. When read from the parametric maps, only 8 features showed significant differences, and 3 features showed an excellent OCCC (≥ 0.85). The OCCCs for 89 features substantially increased using the parametric maps.

CONCLUSIONS

This phantom study shows that converting CT images into parametric maps resolves the confounding effect of VOI variability and increases feature reproducibility across VOI sizes.

Utility of pre-treatment FDG PET/CT-derived machine learning models for outcome prediction in classical Hodgkin lymphoma

Objectives

Relapse occurs in ~20% of patients with classical Hodgkin lymphoma (cHL) despite treatment adaption based on 2-deoxy-2-[¹⁸F]fluoro-d-glucose positron emission tomography/computed tomography response. The objective was to evaluate pre-treatment FDG PET/CT–derived machine learning (ML) models for predicting outcome in patients with cHL.

Methods

All cHL patients undergoing pre-treatment PET/CT at our institution between 2008 and 2018 were retrospectively identified. A 1.5 × mean liver standardised uptake value (SUV) and a fixed 4.0 SUV threshold were used to segment PET/CT data. Feature extraction was performed using PyRadiomics with ComBat harmonisation. Training (80%) and test (20%) cohorts stratified around 2-year event-free survival (EFS), age, sex, ethnicity and disease stage were defined. Seven ML models were trained and hyperparameters tuned using stratified 5-fold cross-validation. Area under the curve (AUC) from receiver operator characteristic analysis was used to assess performance.

Results

A total of 289 patients (153 males), median age 36 (range 16–88 years), were included. There was no significant difference between training (n = 231) and test cohorts (n = 58) (p value > 0.05). A ridge regression model using a 1.5 × mean liver SUV segmentation had the highest performance, with mean training, validation and test AUCs of 0.82 ± 0.002, 0.79 ± 0.01 and 0.81 ± 0.12. However, there was no significant difference between a logistic model derived from metabolic tumour volume and clinical features or the highest performing radiomic model.

Conclusions

Outcome prediction using pre-treatment FDG PET/CT–derived ML models is feasible in cHL patients. Further work is needed to determine optimum predictive thresholds for clinical use.

Key points

• A fixed threshold segmentation method led to more robust radiomic features.

• A radiomic-based model for predicting 2-year event-free survival in classical Hodgkin lymphoma patients is feasible.

• A predictive model based on ridge regression was the best performing model on our dataset.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00330-022-09039-0.

The potential of predictive and prognostic breast MRI (P2-bMRI)

Magnetic resonance imaging (MRI) is an important part of breast cancer diagnosis and multimodal workup. It provides unsurpassed soft tissue contrast to analyse the underlying pathophysiology, and it is adopted for a variety of clinical indications. Predictive and prognostic breast MRI (P2-bMRI) is an emerging application next to these indications. The general objective of P2-bMRI is to provide predictive and/or prognostic biomarkers in order to support personalisation of breast cancer treatment. We believe P2-bMRI has a great clinical potential, thanks to the in vivo examination of the whole tumour and of the surrounding tissue, establishing a link between pathophysiology and response to therapy (prediction) as well as patient outcome (prognostication). The tools used for P2-bMRI cover a wide spectrum: standard and advanced multiparametric pulse sequences; structured reporting criteria (for instance BI-RADS descriptors); artificial intelligence methods, including machine learning (with emphasis on radiomics data analysis); and deep learning that have shown compelling potential for this purpose. P2-bMRI reuses the imaging data of examinations performed in the current practice. Accordingly, P2-bMRI could optimise clinical workflow, enabling cost savings and ultimately improving personalisation of treatment. This review introduces the concept of P2-bMRI, focusing on the clinical application of P2-bMRI by using semantic criteria.

Deep learning for prediction of isocitrate dehydrogenase mutation in gliomas: a critical approach, systematic review and meta-analysis of the diagnostic test performance using a Bayesian approach

Background

Conventionally, identifying isocitrate dehydrogenase (IDH) mutation in gliomas is based on histopathological analysis of tissue specimens acquired via stereotactic biopsy or definitive resection. Accurate pre-treatment prediction of IDH mutation status using magnetic resonance imaging (MRI) can guide clinical decision-making. We aim to evaluate the diagnostic performance of deep learning (DL) to determine IDH mutation status in gliomas.

Methods

A systematic search of Cochrane Library, Web of Science, Medline, and Scopus was conducted to identify relevant publications until August 1, 2021. Articles were included if all the following criteria were met: (I) patients with histopathologically confirmed World Health Organization (WHO) grade II, III, or IV gliomas; (II) histopathological examination with the IDH mutation; (III) DL was used to predict the IDH mutation status; (IV) sufficient data for reconstruction of confusion matrices in terms of the diagnostic performance of the DL algorithms; and (V) original research articles. Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) and Checklist for Artificial Intelligence in Medical Imaging (CLAIM) was used to assess the studies' quality. Bayes theorem was utilized to calculate the posttest probability.

Results

Four studies with a total of 1,295 patients were included. In the training set, the pooled sensitivity, specificity, and area under the summary receiver operating characteristic (SROC) curve were 93.9%, 90.9% and 0.958, respectively. In the validation set, the pooled sensitivity, specificity, and area under the SROC curve were 90.8%, 85.5% and 0.939, respectively. With a known pretest probability of 80.2%, the Bayes theorem yielded a posttest probability of 97.6% and 96.0% for a positive test and 27.0% and 30.6% for a negative test for training sets and validation sets, respectively.

Discussion

This is the first meta-analysis that summarizes the diagnostic performance of DL in predicting IDH mutation status in gliomas via the Bayes theorem. DL algorithms demonstrate excellent diagnostic performance in predicting IDH mutation in gliomas. Radiomic features associated with IDH mutation, and its underlying pathophysiology extracted from advanced MRI may improve prediction probability. However, more studies are required to optimize and increase its reliability. Limitations include obtaining some data via email and lack of training and test sets statistics.

Localization-adjusted diagnostic performance and assistance effect of a computer-aided detection system for pneumothorax and consolidation

While many deep-learning-based computer-aided detection systems (CAD) have been developed and commercialized for abnormality detection in chest radiographs (CXR), their ability to localize a target abnormality is rarely reported. Localization accuracy is important in terms of model interpretability, which is crucial in clinical settings. Moreover, diagnostic performances are likely to vary depending on thresholds which define an accurate localization. In a multi-center, stand-alone clinical trial using temporal and external validation datasets of 1,050 CXRs, we evaluated localization accuracy, localization-adjusted discrimination, and calibration of a commercially available deep-learning-based CAD for detecting consolidation and pneumothorax. The CAD achieved image-level AUROC (95% CI) of 0.960 (0.945, 0.975), sensitivity of 0.933 (0.899, 0.959), specificity of 0.948 (0.930, 0.963), dice of 0.691 (0.664, 0.718), moderate calibration for consolidation, and image-level AUROC of 0.978 (0.965, 0.991), sensitivity of 0.956 (0.923, 0.978), specificity of 0.996 (0.989, 0.999), dice of 0.798 (0.770, 0.826), moderate calibration for pneumothorax. Diagnostic performances varied substantially when localization accuracy was accounted for but remained high at the minimum threshold of clinical relevance. In a separate trial for diagnostic impact using 461 CXRs, the causal effect of the CAD assistance on clinicians’ diagnostic performances was estimated. After adjusting for age, sex, dataset, and abnormality type, the CAD improved clinicians’ diagnostic performances on average (OR [95% CI] = 1.73 [1.30, 2.32]; p < 0.001), although the effects varied substantially by clinical backgrounds. The CAD was found to have high stand-alone diagnostic performances and may beneficially impact clinicians’ diagnostic performances when used in clinical settings.

AutoRadiomics: A Framework for Reproducible Radiomics Research

Purpose

Machine learning based on radiomics features has seen huge success in a variety of clinical applications. However, the need for standardization and reproducibility has been increasingly recognized as a necessary step for future clinical translation. We developed a novel, intuitive open-source framework to facilitate all data analysis steps of a radiomics workflow in an easy and reproducible manner and evaluated it by reproducing classification results in eight available open-source datasets from different clinical entities.

Methods

The framework performs image preprocessing, feature extraction, feature selection, modeling, and model evaluation, and can automatically choose the optimal parameters for a given task. All analysis steps can be reproduced with a web application, which offers an interactive user interface and does not require programming skills. We evaluated our method in seven different clinical applications using eight public datasets: six datasets from the recently published WORC database, and two prostate MRI datasets-Prostate MRI and Ultrasound With Pathology and Coordinates of Tracked Biopsy (Prostate-UCLA) and PROSTATEx.

Results

In the analyzed datasets, AutoRadiomics successfully created and optimized models using radiomics features. For WORC datasets, we achieved AUCs ranging from 0.56 for lung melanoma metastases detection to 0.93 for liposarcoma detection and thereby managed to replicate the previously reported results. No significant overfitting between training and test sets was observed. For the prostate cancer detection task, results were better in the PROSTATEx dataset (AUC = 0.73 for prostate and 0.72 for lesion mask) than in the Prostate-UCLA dataset (AUC 0.61 for prostate and 0.65 for lesion mask), with external validation results varying from AUC = 0.51 to AUC = 0.77.

Conclusion

AutoRadiomics is a robust tool for radiomic studies, which can be used as a comprehensive solution, one of the analysis steps, or an exploratory tool. Its wide applicability was confirmed by the results obtained in the diverse analyzed datasets. The framework, as well as code for this analysis, are publicly available under https://github.com/pwoznicki/AutoRadiomics.

Meningioma Radiomics: At the Nexus of Imaging, Pathology and Biomolecular Characterization

Simple Summary

Meningiomas are typically benign, common extra-axial tumors of the central nervous system. Routine clinical assessment by radiologists presents some limitations regarding long-term patient outcome prediction and risk stratification. Given the exponential growth of interest in radiomics and artificial intelligence in medical imaging, numerous studies have evaluated the potential of these tools in the setting of meningioma imaging. These were aimed at the development of reliable and reproducible models based on quantitative data. Although several limitations have yet to be overcome for their routine use in clinical practice, their innovative potential is evident. In this review, we present a wide-ranging overview of radiomics and artificial intelligence applications in meningioma imaging.

Abstract

Meningiomas are the most common extra-axial tumors of the central nervous system (CNS). Even though recurrence is uncommon after surgery and most meningiomas are benign, an aggressive behavior may still be exhibited in some cases. Although the diagnosis can be made by radiologists, typically with magnetic resonance imaging, qualitative analysis has some limitations in regard to outcome prediction and risk stratification. The acquisition of this information could help the referring clinician in the decision-making process and selection of the appropriate treatment. Following the increased attention and potential of radiomics and artificial intelligence in the healthcare domain, including oncological imaging, researchers have investigated their use over the years to overcome the current limitations of imaging. The aim of these new tools is the replacement of subjective and, therefore, potentially variable medical image analysis by more objective quantitative data, using computational algorithms. Although radiomics has not yet fully entered clinical practice, its potential for the detection, diagnostic, and prognostic characterization of tumors is evident. In this review, we present a wide-ranging overview of radiomics and artificial intelligence applications in meningioma imaging.

A Semi-Unsupervised Segmentation Methodology Based on Texture Recognition for Radiomics: A Preliminary Study on Brain Tumours

Because of the intrinsic anatomic complexity of the brain structures, brain tumors have a high mortality and disability rate, and an early diagnosis is mandatory to contain damages. The commonly used biopsy is the diagnostic gold standard method, but it is invasive and, due to intratumoral heterogeneity, biopsies may lead to an incorrect result. Moreover, some tumors cannot be resectable if located in critical eloquent areas. On the other hand, medical imaging procedures can evaluate the entire tumor in a non-invasive and reproducible way. Radiomics is an emerging diagnosis technique based on quantitative medical image analyses, which makes use of data provided by non-invasive diagnosis techniques such as X-ray, computer-tomography (CT), magnetic resonance (MR), and proton emission tomography (PET). Radiomics techniques require the comprehensive analysis of huge numbers of medical images to extract a large and useful number of phenotypic features (usually called radiomics biomarkers). The goal is to explore and obtain the associations between features of tumors, diagnosis and patients’ prognoses to choose the best treatments and maximize the patient’s survival rate. Current radiomics techniques are not standardized in term of segmentation, feature extraction, and selection, moreover, the decision on suitable therapies still requires the supervision of an expert doctor. In this paper, we propose a semi-automatic methodology aimed to help the identification and segmentation of malignant tissues by using the combination of binary texture recognition, growing area algorithm, and machine learning techniques. In particular, the proposed method not only helps to better identify pathologic tissues but also permits to analyze in a fast way the huge amount of data, in Dicom format, provided by non-invasive diagnostic techniques. A preliminary experimental assessment has been conducted, considering a real MRI database of brain tumors. The method has been compared with the segmentation software’s tools “slicer 3D”. The obtained results are quite promising and demonstrate the potentialities of the proposed semi-unsupervised segmentation methodology.

Lymph Nodes Evaluation in Rectal Cancer: Where Do We Stand and Future Perspective

The assessment of nodal involvement in patients with rectal cancer (RC) is fundamental in disease management. Magnetic Resonance Imaging (MRI) is routinely used for local and nodal staging of RC by using morphological criteria. The actual dimensional and morphological criteria for nodal assessment present several limitations in terms of sensitivity and specificity. For these reasons, several different techniques, such as Diffusion Weighted Imaging (DWI), Intravoxel Incoherent Motion (IVIM), Diffusion Kurtosis Imaging (DKI), and Dynamic Contrast Enhancement (DCE) in MRI have been introduced but still not fully validated. Positron Emission Tomography (PET)/CT plays a pivotal role in the assessment of LNs; more recently PET/MRI has been introduced. The advantages and limitations of these imaging modalities will be provided in this narrative review. The second part of the review includes experimental techniques, such as iron-oxide particles (SPIO), and dual-energy CT (DECT). Radiomics analysis is an active field of research, and the evidence about LNs in RC will be discussed. The review also discusses the different recommendations between the European and North American guidelines for the evaluation of LNs in RC, from anatomical considerations to structured reporting.

Reproducibility for Hepatocellular Carcinoma CT Radiomic Features: Influence of Delineation Variability Based on 3D-CT, 4D-CT and Multiple-Parameter MR Images

Purpose

Accurate lesion segmentation is a prerequisite for radiomic feature extraction. It helps to reduce the features variability so as to improve the reporting quality of radiomics study. In this research, we aimed to conduct a radiomic feature reproducibility test of inter-/intra-observer delineation variability in hepatocellular carcinoma using 3D-CT images, 4D-CT images and multiple-parameter MR images.

Materials and Methods

For this retrospective study, 19 HCC patients undergoing 3D-CT, 4D-CT and multiple-parameter MR scans were included in this study. The gross tumor volume (GTV) was independently delineated twice by two observers based on contrast-enhanced computed tomography (CECT), maximum intensity projection (MIP), LAVA-Flex, T2W FRFSE and DWI-EPI images. We also delineated the peritumoral region, which was defined as 0 to 5 mm radius surrounding the GTV. 107 radiomic features were automatically extracted from CECT images using 3D-Slicer software. Quartile coefficient of dispersion (QCD) and intraclass correlation coefficient (ICC) were applied to assess the variability of each radiomic feature. QCD<10% and ICC≥0.75 were considered small variations and excellent reliability. Finally, the principal component analysis (PCA) was used to test the feasibility of dimensionality reduction.

Results

For tumor tissues, the numbers of radiomic features with QCD<10% indicated no obvious inter-/intra-observer differences or discrepancies in 3D-CT, 4D-CT and multiple-parameter MR delineation. However, the number of radiomic features (mean 89) with ICC≥0.75 was the highest in the multiple-parameter MR group, followed by the 3DCT group (mean 77) and the MIP group (mean 73). The peritumor tissues also showed similar results. A total of 15 and 7 radiomic features presented excellent reproducibility and small variation in tumor and peritumoral tissues, respectively. Two robust features showed excellent reproducibility and small variation in tumor and peritumoral tissues. In addition, the values of the two features both represented statistically significant differences among tumor and peritumoral tissues (P<0.05). The PCA results indicated that the first seven principal components could preserve at least 90% of the variance of the original set of features.

Conclusion

Delineation on multiple-parameter MR images could help to improve the reproducibility of the HCC CT radiomic features and weaken the inter-/intra-observer influence.

Harmonisation of scanner-dependent contrast variations in magnetic resonance imaging for radiation oncology, using style-blind auto-encoders

Background and purpose

Magnetic Resonance Imaging (MRI) exhibits scanner dependent contrast, which limits generalisability of radiomics and machine-learning for radiation oncology. Current deep-learning harmonisation requires paired data, retraining for new scanners and often suffers from geometry-shift which alters anatomical information. The aim of this study was to investigate style-blind auto-encoders for MRI harmonisation to accommodate unpaired training data, avoid geometry-shift and harmonise data from previously unseen scanners.

Materials and methods

A style-blind auto-encoder, using adversarial classification on the latent-space, was designed for MRI harmonisation. The public CC359 T1-w MRI brain dataset includes six scanners (three manufacturers, two field strengths), of which five were used for training. MRI from all six (including one unseen) scanner were harmonised to common contrast. Harmonisation extent was quantified via Kolmogorov-Smirnov testing of residual scanner dependence of 3D radiomic features, and compared to WhiteStripe normalisation. Anatomical content preservation was measured through change in structural similarity index on contrast-cycling (δSSIM).

Results

The percentage of radiomics features showing statistically significant scanner-dependence was reduced from 41% (WhiteStripe) to 16% for white matter and from 39% to 27% for grey matter. δSSIM < 0.0025 on harmonisation and de-harmonisation indicated excellent anatomical content preservation.

Conclusions

Our method harmonised MRI contrast effectively, preserved critical anatomical details at high fidelity, trained on unpaired data and allowed zero-shot harmonisation. Robust and clinically translatable harmonisation of MRI will enable generalisable radiomic and deep-learning models for a range of applications, including radiation oncology treatment stratification, planning and response monitoring.

Discovery of Pre-Treatment FDG PET/CT-Derived Radiomics-Based Models for Predicting Outcome in Diffuse Large B-Cell Lymphoma

Simple Summary

Diffuse large B-cell lymphoma (DLBCL) is the most common type of lymphoma. Even with the improvements in the treatment of DLBCL, around a quarter of patients will experience recurrence. The aim of this single centre retrospective study was to predict which patients would have recurrence within 2 years of their treatment using machine learning techniques based on radiomics extracted from the staging PET/CT images. Our study demonstrated that in our dataset of 229 patients (training data = 183, test data = 46) that a combined radiomic and clinical based model performed better than a simple model based on metabolic tumour volume, and that it had a good predictive ability which was maintained when tested on an unseen test set.

Abstract

Background: Approximately 30% of patients with diffuse large B-cell lymphoma (DLBCL) will have recurrence. The aim of this study was to develop a radiomic based model derived from baseline PET/CT to predict 2-year event free survival (2-EFS). Methods: Patients with DLBCL treated with R-CHOP chemotherapy undergoing pre-treatment PET/CT between January 2008 and January 2018 were included. The dataset was split into training and internal unseen test sets (ratio 80:20). A logistic regression model using metabolic tumour volume (MTV) and six different machine learning classifiers created from clinical and radiomic features derived from the baseline PET/CT were trained and tuned using four-fold cross validation. The model with the highest mean validation receiver operator characteristic (ROC) curve area under the curve (AUC) was tested on the unseen test set. Results: 229 DLBCL patients met the inclusion criteria with 62 (27%) having 2-EFS events. The training cohort had 183 patients with 46 patients in the unseen test cohort. The model with the highest mean validation AUC combined clinical and radiomic features in a ridge regression model with a mean validation AUC of 0.75 ± 0.06 and a test AUC of 0.73. Conclusions: Radiomics based models demonstrate promise in predicting outcomes in DLBCL patients.