Multiparametric radiomics methods for breast cancer tissue characterization using radiological imaging

Prediction of immunotherapy response in nasopharyngeal carcinoma: a comparative study using MRI-based radiomics signature and programmed cell death ligand 1 expression score

OBJECTIVES

To compare an MRI-based radiomics signature with the programmed cell death ligand 1 (PD-L1) expression score for predicting immunotherapy response in nasopharyngeal carcinoma (NPC).

METHODS

Consecutive patients with NPC who received immunotherapy between January 2019 and June 2022 were divided into training (n = 111) and validation (n = 66) sets. Tumor radiomics features were extracted from pretreatment MR images. PD-L1 combined positive score (CPS) was calculated using immunohistochemistry. The least absolute shrinkage and selection operator (LASSO) algorithm was used for feature selection and radiomics signature construction. Receiver operating characteristic (ROC) curve analysis was performed to assess prediction performance.

RESULTS

A total of eleven radiomics features with the greatest discrimination capability were identified by the LASSO algorithm to construct the radiomics signature. In predicting patients with objective response to immunotherapy, radiomics score (Rd-score) yielded a significantly higher area under the ROC curve than that of CPS in both the training (0.790 vs. 0.645, p = 0.025) and the validation (0.735 vs. 0.608, p = 0.038) sets. Multivariate analysis identified the Rd-score as an independent influencing factor in predicting immunotherapy response (odds ratio = 19.963, p < 0.001). Kaplan-Meier analysis indicated that patients with Rd-score ≥ 0.5 showed longer progression-free survival than patients with Rd-score < 0.5 (log-rank p < 0.01).

CONCLUSION

An MRI-based radiomics signature demonstrated greater efficacy than the PD-L1 expression score in predicting immunotherapy response in patients with NPC.

KEY POINTS

Question How does an MRI-based radiomics signature compare with the programmed cell death ligand 1 expression score for predicting immunotherapy response in nasopharyngeal carcinoma? Findings The MRI-based radiomics signature demonstrated superior predictive value compared with programmed cell death ligand 1 expression score in identifying immunotherapy responders. Clinical relevance MRI-based radiomics are a promising novel noninvasive tool for predicting immunotherapy outcomes in nasopharyngeal carcinoma.

An updated overview of radiomics-based artificial intelligence (AI) methods in breast cancer screening and diagnosis

Current imaging methods for diagnosing breast cancer (BC) are associated with limited sensitivity and specificity and modest positive predictive power. The recent progress in image analysis using artificial intelligence (AI) has created great promise to improve BC diagnosis and subtype differentiation. In this case, novel quantitative computational methods, such as radiomics, have been developed to enhance the sensitivity and specificity of early BC diagnosis and classification. The potential of radiomics in improving the diagnostic efficacy of imaging studies has been shown in several studies. In this review article, we discuss the radiomics workflow and current handcrafted radiomics methods in the diagnosis and classification of BC based on the most recent studies on different imaging modalities, e.g., MRI, mammography, contrast-enhanced spectral mammography (CESM), ultrasound imaging, and digital breast tumosynthesis (DBT). We also discuss current challenges and potential strategies to improve the specificity and sensitivity of radiomics in breast cancer to help achieve a higher level of BC classification and diagnosis in the clinical setting. The growing field of AI incorporation with imaging information has opened a great opportunity to provide a higher level of care for BC patients.

Clinical applications of radiomics and deep learning in breast and lung cancer: A narrative literature review on current evidence and future perspectives

Radiomics, analysing quantitative features from medical imaging, has rapidly become an emerging field in translational oncology. Radiomics has been investigated in several neoplastic malignancies as it might allow for a non-invasive tumour characterization and for the identification of predictive and prognostic biomarkers. Over the last few years, evidence has been accumulating regarding potential clinical applications of machine learning in many crucial moments of cancer patients' history. However, the incorporation of radiomics in clinical decision-making process is still limited by low data reproducibility and study variability. Moreover, the need for prospective validations and standardizations is emerging. In this narrative review, we summarize current evidence regarding radiomic applications in high-incidence cancers (breast and lung) for screening, diagnosis, staging, treatment choice, response, and clinical outcome evaluation. We also discuss pro and cons of the radiomic approach, suggesting possible solutions to critical issues which might invalidate radiomics studies and propose future perspectives.

Multi-modality radiomics model predicts axillary lymph node metastasis of breast cancer using MRI and mammography

OBJECTIVES

We aimed to develop a multi-modality model to predict axillary lymph node (ALN) metastasis by combining clinical predictors with radiomic features from magnetic resonance imaging (MRI) and mammography (MMG) in breast cancer. This model might potentially eliminate unnecessary axillary surgery in cases without ALN metastasis, thereby minimizing surgery-related complications.

METHODS

We retrospectively enrolled 485 breast cancer patients from two hospitals and extracted radiomics features from tumor and lymph node regions on MRI and MMG images. After feature selection, three random forest models were built using the retained features, respectively. Significant clinical factors were integrated with these radiomics models to construct a multi-modality model. The multi-modality model was compared to radiologists' diagnoses on axillary ultrasound and MRI. It was also used to assist radiologists in making a secondary diagnosis on MRI.

RESULTS

The multi-modality model showed superior performance with AUCs of 0.964 in the training cohort, 0.916 in the internal validation cohort, and 0.892 in the external validation cohort. It surpassed single-modality models and radiologists' ALN diagnosis on MRI and axillary ultrasound in all validation cohorts. Additionally, the multi-modality model improved radiologists' MRI-based ALN diagnostic ability, increasing the average accuracy from 70.70 to 78.16% for radiologist A and from 75.42 to 81.38% for radiologist B.

CONCLUSION

The multi-modality model can predict ALN metastasis of breast cancer accurately. Moreover, the artificial intelligence (AI) model also assisted the radiologists to improve their diagnostic ability on MRI.

CLINICAL RELEVANCE STATEMENT

The multi-modality model based on both MRI and mammography images allows preoperative prediction of axillary lymph node metastasis in breast cancer patients. With the assistance of the model, the diagnostic efficacy of radiologists can be further improved.

KEY POINTS

• We developed a novel multi-modality model that combines MRI and mammography radiomics with clinical factors to accurately predict axillary lymph node (ALN) metastasis, which has not been previously reported. • Our multi-modality model outperformed both the radiologists' ALN diagnosis based on MRI and axillary ultrasound, as well as single-modality radiomics models based on MRI or mammography. • The multi-modality model can serve as a potential decision support tool to improve the radiologists' ALN diagnosis on MRI.

Interpretable Radiomic Signature for Breast Microcalcification Detection and Classification

Breast microcalcifications are observed in 80% of mammograms, and a notable proportion can lead to invasive tumors. However, diagnosing microcalcifications is a highly complicated and error-prone process due to their diverse sizes, shapes, and subtle variations. In this study, we propose a radiomic signature that effectively differentiates between healthy tissue, benign microcalcifications, and malignant microcalcifications. Radiomic features were extracted from a proprietary dataset, composed of 380 healthy tissue, 136 benign, and 242 malignant microcalcifications ROIs. Subsequently, two distinct signatures were selected to differentiate between healthy tissue and microcalcifications (detection task) and between benign and malignant microcalcifications (classification task). Machine learning models, namely Support Vector Machine, Random Forest, and XGBoost, were employed as classifiers. The shared signature selected for both tasks was then used to train a multi-class model capable of simultaneously classifying healthy, benign, and malignant ROIs. A significant overlap was discovered between the detection and classification signatures. The performance of the models was highly promising, with XGBoost exhibiting an AUC-ROC of 0.830, 0.856, and 0.876 for healthy, benign, and malignant microcalcifications classification, respectively. The intrinsic interpretability of radiomic features, and the use of the Mean Score Decrease method for model introspection, enabled models' clinical validation. In fact, the most important features, namely GLCM Contrast, FO Minimum and FO Entropy, were compared and found important in other studies on breast cancer.

Machine learning and new insights for breast cancer diagnosis

Breast cancer (BC) is the most prominent form of cancer among females all over the world. The current methods of BC detection include X-ray mammography, ultrasound, computed tomography, magnetic resonance imaging, positron emission tomography and breast thermographic techniques. More recently, machine learning (ML) tools have been increasingly employed in diagnostic medicine for its high efficiency in detection and intervention. The subsequent imaging features and mathematical analyses can then be used to generate ML models, which stratify, differentiate and detect benign and malignant breast lesions. Given its marked advantages, radiomics is a frequently used tool in recent research and clinics. Artificial neural networks and deep learning (DL) are novel forms of ML that evaluate data using computer simulation of the human brain. DL directly processes unstructured information, such as images, sounds and language, and performs precise clinical image stratification, medical record analyses and tumour diagnosis. Herein, this review thoroughly summarizes prior investigations on the application of medical images for the detection and intervention of BC using radiomics, namely DL and ML. The aim was to provide guidance to scientists regarding the use of artificial intelligence and ML in research and the clinic.

MRI-Based Breast Cancer Classification and Localization by Multiparametric Feature Extraction and Combination Using Deep Learning

BACKGROUND

Deep learning (DL) have been reported feasible in breast MRI. However, the effectiveness of DL method in mpMRI combinations for breast cancer detection has not been well investigated.

PURPOSE

To implement a DL method for breast cancer classification and detection using feature extraction and combination from multiple sequences.

STUDY TYPE

Retrospective.

POPULATION

A total of 569 local cases as internal cohort (50.2 ± 11.2 years; 100% female), divided among training (218), validation (73) and testing (278); 125 cases from a public dataset as the external cohort (53.6 ± 11.5 years; 100% female).

FIELD STRENGTH/SEQUENCE

T1-weighted imaging and dynamic contrast-enhanced MRI (DCE-MRI) with gradient echo sequences, T2-weighted imaging (T2WI) with spin-echo sequences, diffusion-weighted imaging with single-shot echo-planar sequence and at 1.5-T.

ASSESSMENT

A convolutional neural network and long short-term memory cascaded network was implemented for lesion classification with histopathology as the ground truth for malignant and benign categories and contralateral breasts as healthy category in internal/external cohorts. BI-RADS categories were assessed by three independent radiologists as comparison, and class activation map was employed for lesion localization in internal cohort. The classification and localization performances were assessed with DCE-MRI and non-DCE sequences, respectively.

STATISTICAL TESTS

Sensitivity, specificity, area under the curve (AUC), DeLong test, and Cohen's kappa for lesion classification. Sensitivity and mean squared error for localization. A P-value <0.05 was considered statistically significant.

RESULTS

With the optimized mpMRI combinations, the lesion classification achieved an AUC = 0.98/0.91, sensitivity = 0.96/0.83 in the internal/external cohorts, respectively. Without DCE-MRI, the DL-based method was superior to radiologists' readings (AUC 0.96 vs. 0.90). The lesion localization achieved sensitivities of 0.97/0.93 with DCE-MRI/T2WI alone, respectively.

DATA CONCLUSION

The DL method achieved high accuracy for lesion detection in the internal/external cohorts. The classification performance with a contrast agent-free combination is comparable to DCE-MRI alone and the radiologists' reading in AUC and sensitivity.

EVIDENCE LEVEL

3.

TECHNICAL EFFICACY

Stage 2.

Radiomics to Differentiate Malignant and Benign Breast Lesions: A Systematic Review and Diagnostic Test Accuracy Meta-Analysis

Breast cancer is a prevalent global health concern, necessitating accurate diagnostic tools for effective management. Diagnostic imaging plays a pivotal role in breast cancer diagnosis, staging, treatment planning, and outcome evaluation. Radiomics is an emerging field of study in medical imaging that contains a broad set of computational methods to extract quantitative features from radiographic images. This can be utilized to guide diagnosis, treatment response, and prognosis in clinical settings.  A systematic review was performed in concordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines and the Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy. Quality was assessed using the radiomics quality score. Diagnostic sensitivity and specificity of radiomics analysis, with 95% confidence intervals (CIs), were included for meta-analysis. The area under the curve analysis was recorded. An extensive statistical analysis was performed following the Cochrane guidelines. Statistical significance was determined if p-values were less than 0.05. Statistical analyses were conducted using Review Manager (RevMan), Version 5.4.1. A total of 31 manuscripts involving 8,773 patients were included, with 17 contributing to the meta-analysis. The cohort comprised 56.2% malignant breast cancers and 43.8% benign breast lesions. MRI demonstrated a sensitivity of 0.91 (95% CI: 0.89-0.92) and a specificity of 0.84 (95% CI: 0.82-0.86) in differentiating between benign and malignant breast cancers. Mammography-based radiomic features predicted breast cancer subtype with a sensitivity of 0.79 (95% CI: 0.76-0.82) and a specificity of 0.81 (95% CI: 0.79-0.84). Ultrasound-based analysis yielded a sensitivity of 0.92 (95% CI: 0.90-0.94) and a specificity of 0.85 (95% CI: 0.83-0.88). Only one study reported the results of radiomic evaluation from CT, which had a sensitivity of 0.95 (95% CI: 0.88-0.99) and a specificity of 0.56 (95% CI: 0.45-0.67).  Across different imaging modalities, radiomics exhibited robust diagnostic accuracy in differentiating benign and malignant breast lesions. The results underscore the potential of radiomic assessment as a minimally invasive alternative or adjunctive diagnostic tool for breast cancer. This is pioneering data that reports on a novel diagnostic approach that is understudied and underreported. However, due to study limitations, the complexity of this technology, and the need for future development, biopsy still remains the current gold standard method of determining breast cancer type.

Application of DCE-MRI radiomics signature analysis in differentiating molecular subtypes of luminal and non-luminal breast cancer

Background

The goal of this study was to develop and validate a radiomics signature based on dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) preoperatively differentiating luminal and non-luminal molecular subtypes in patients with invasive breast cancer.

Methods

One hundred and thirty-five invasive breast cancer patients with luminal (n = 78) and non-luminal (n = 57) molecular subtypes were divided into training set (n = 95) and testing set (n = 40) in a 7:3 ratio. Demographics and MRI radiological features were used to construct clinical risk factors. Radiomics signature was constructed by extracting radiomics features from the second phase of DCE-MRI images and radiomics score (rad-score) was calculated. Finally, the prediction performance was evaluated in terms of calibration, discrimination, and clinical usefulness.

Results

Multivariate logistic regression analysis showed that no clinical risk factors were independent predictors of luminal and non-luminal molecular subtypes in invasive breast cancer patients. Meanwhile, the radiomics signature showed good discrimination in the training set (AUC, 0.86; 95% CI, 0.78-0.93) and the testing set (AUC, 0.80; 95% CI, 0.65-0.95).

Conclusion

The DCE-MRI radiomics signature is a promising tool to discrimination luminal and non-luminal molecular subtypes in invasive breast cancer patients preoperatively and noninvasively.

Diagnostic value of ultrasound elastography in triple negative breast cancer: A meta-analysis

BACKGROUND

The purpose of this study was to determine the value of ultrasound elastic imaging (UE) in the differential diagnosis of the 3 negative breast cancer (TNBC) and non-TNBC.

METHODS

We searched the PubMed, Cochrane Library, and CBM databases from inception to July 20, 2022 and used STATA version 14.0 and Meta-Disc version 1.4 software. We computed summary statistics for sensitivity (Sen), specificity, positive and negative likelihood ratio (LR+/LR-), diagnostic odds ratio, and summary receiver operating characteristic curves. Cochran Q-statistic and I2 test were used to assess potential heterogeneity between studies. Sen analysis was carried out to evaluate the effect of a single study on overall estimation. We also conducted a meta regression analysis to investigate potential sources of heterogeneity.

RESULTS

Nine studies that fulfilled all the criteria for acceptance were incorporated into the meta-analysis. TNBC 317 and non-TNBC 1055 cases were evaluated. All breast tumors were histologically confirmed. The pooled Sen was 0.78 (95% confidence interval [CI] = 0.58-0.90); the pooled specificity was 0.86 (95%CI = 0.78-0.91). The pooled LR+ was 5.46 (95%CI = 3.07-9.73); the pooled negative LR- was 0.26 (95%CI = 0.12-0.55). The pooled diagnostic odds ratio of UE was 21.00 (95% CI = 6.14-71.78). The area under the summary receiver operating characteristic curve was 0.89 (SE = 0.0378). No evidence was found to reveal bias (t = 0.10, P = .92).

CONCLUSION

Our meta-analysis showed that UE could have high diagnostic accuracy in distinguishing TNBC and non-TNBC.

Multiparametric Data-driven Imaging Markers: Guidelines for Development, Application and Reporting of Model Outputs in Radiomics

This paper is the fifth in a five-part series on statistical methodology for performance assessment of multi-parametric quantitative imaging biomarkers (mpQIBs) for radiomic analysis. Radiomics is the process of extracting visually imperceptible features from radiographic medical images using data-driven algorithms. We refer to the radiomic features as data-driven imaging markers (DIMs), which are quantitative measures discovered under a data-driven framework from images beyond visual recognition but evident as patterns of disease processes irrespective of whether or not ground truth exists for the true value of the DIM. This paper aims to set guidelines on how to build machine learning models using DIMs in radiomics and to apply and report them appropriately. We provide a list of recommendations, named RANDAM (an abbreviation of "Radiomic ANalysis and DAta Modeling"), for analysis, modeling, and reporting in a radiomic study to make machine learning analyses in radiomics more reproducible. RANDAM contains five main components to use in reporting radiomics studies: design, data preparation, data analysis and modeling, reporting, and material availability. Real case studies in lung cancer research are presented along with simulation studies to compare different feature selection methods and several validation strategies.

Fully automatic classification of breast lesions on multi-parameter MRI using a radiomics model with minimal number of stable, interpretable features

PURPOSE

To build an automatic computer-aided diagnosis (CAD) pipeline based on multiparametric magnetic resonance imaging (mpMRI) and explore the role of different imaging features in the classification of breast cancer.

MATERIALS AND METHODS

A total of 222 histopathology-confirmed breast lesions, together with their BI-RADS scores, were included in the analysis. The cohort was randomly split into training (159) and test (63) cohorts, and another 50 lesions were collected as an external cohort. An nnUNet-based lesion segmentation model was trained to automatically segment lesion ROI, from which radiomics features were extracted for diffusion-weighted imaging (DWI), T2-weighted imaging (T2WI), and contrast-enhanced (DCE) pharmacokinetic parametric maps. Models based on combinations of sequences were built using support vector machine (SVM) and logistic regression (LR). Also, the performance of these sequence combinations and BI-RADS scores were compared. The Dice coefficient and AUC were calculated  to evaluate the segmentation and classification results. Decision curve analysis (DCA) was used to assess clinical utility.

RESULTS

The segmentation model achieved a Dice coefficient of 0.831 in the test cohort. The radiomics model used only three features from diffusion coefficient (ADC) images, T2WI, and DCE-derived kinetic mapping, and achieved an AUC of 0.946 [0.883-0.990], AUC of 0.842 [0.6856-0.998] in the external cohort, which was higher than the BI-RADS score with an AUC of 0.872 [0.752-0.975]. The joint model using both radiomics score and BI-RADS score achieved the highest test AUC of 0.975 [0.935-1.000], with a sensitivity of 0.920 and a specificity of 0.923.

CONCLUSION

Three radiomics features can be used to construct an automatic radiomics-based pipeline to improve the diagnosis of breast lesions and reduce unnecessary biopsies, especially when using jointly with BI-RADS scores.

A multidomain fusion model of radiomics and deep learning to discriminate between PDAC and AIP based on 18F-FDG PET/CT images

PURPOSE

To explore a multidomain fusion model of radiomics and deep learning features based on ¹⁸F-fluorodeoxyglucose positron emission tomography/computed tomography (¹⁸F-FDG PET/CT) images to distinguish pancreatic ductal adenocarcinoma (PDAC) and autoimmune pancreatitis (AIP), which could effectively improve the accuracy of diseases diagnosis.

MATERIALS AND METHODS

This retrospective study included 48 patients with AIP (mean age, 65 ± 12.0 years; range, 37-90 years) and 64 patients with PDAC patients (mean age, 66 ± 11.3 years; range, 32-88 years). Three different methods were discussed to identify PDAC and AIP based on ¹⁸F-FDG PET/CT images, including the radiomics model (RAD_model), the deep learning model (DL_model), and the multidomain fusion model (MF_model). We also compared the classification results of PET/CT, PET, and CT images in these three models. In addition, we explored the attributes of deep learning abstract features by analyzing the correlation between radiomics and deep learning features. Five-fold cross-validation was used to calculate receiver operating characteristic (ROC), area under the roc curve (AUC), accuracy (Acc), sensitivity (Sen), and specificity (Spe) to quantitatively evaluate the performance of different classification models.

RESULTS

The experimental results showed that the multidomain fusion model had the best comprehensive performance compared with radiomics and deep learning models, and the AUC, accuracy, sensitivity, specificity were 96.4% (95% CI 95.4-97.3%), 90.1% (95% CI 88.7-91.5%), 87.5% (95% CI 84.3-90.6%), and 93.0% (95% CI 90.3-95.6%), respectively. And our study proved that the multimodal features of PET/CT were superior to using either PET or CT features alone. First-order features of radiomics provided valuable complementary information for the deep learning model.

CONCLUSION

The preliminary results of this paper demonstrated that our proposed multidomain fusion model fully exploits the value of radiomics and deep learning features based on ¹⁸F-FDG PET/CT images, which provided competitive accuracy for the discrimination of PDAC and AIP.

MRI Breast: Current Imaging Trends, Clinical Applications, and Future Research Directions

Magnetic Resonance Imaging (MRI) is the most sensitive and advanced imaging technique in diagnosing breast cancer and is essential in improving cancer detection, lesion characterization, and determining therapy response. In addition to the dynamic contrast-enhanced (DCE) technique, functional techniques such as magnetic resonance spectroscopy (MRS), diffusion-weighted imaging (DWI), diffusion kurtosis imaging (DKI), and intravoxel incoherent motion (IVIM) further characterize and differentiate benign and malignant lesions thus, improving diagnostic accuracy. There is now an increasing clinical usage of MRI breast, including screening in high risk and supplementary screening tools in average-risk patients. MRI is becoming imperative in assisting breast surgeons in planning breast-conserving surgery for preoperative local staging and evaluation of neoadjuvant chemotherapy response. Other clinical applications for MRI breast include occult breast cancer detection, investigation of nipple discharge, and breast implant assessment. There is now an abundance of research publications on MRI Breast with several areas that still remain to be explored. This review gives a comprehensive overview of the clinical trends of MRI breast with emphasis on imaging features and interpretation using conventional and advanced techniques. In addition, future research areas in MRI breast include developing techniques to make MRI more accessible and costeffective for screening. The abbreviated MRI breast procedure and an area of focused research in the enhancement of radiologists' work with artificial intelligence have high impact for the future in MRI Breast.

Diagnostic Strategies for Breast Cancer Detection: From Image Generation to Classification Strategies Using Artificial Intelligence Algorithms

Breast cancer is one the main death causes for women worldwide, as 16% of the diagnosed malignant lesions worldwide are its consequence. In this sense, it is of paramount importance to diagnose these lesions in the earliest stage possible, in order to have the highest chances of survival. While there are several works that present selected topics in this area, none of them present a complete panorama, that is, from the image generation to its interpretation. This work presents a comprehensive state-of-the-art review of the image generation and processing techniques to detect Breast Cancer, where potential candidates for the image generation and processing are presented and discussed. Novel methodologies should consider the adroit integration of artificial intelligence-concepts and the categorical data to generate modern alternatives that can have the accuracy, precision and reliability expected to mitigate the misclassifications.

Identification of Radiomic Features as an Imaging Marker to Differentiate Benign and Malignant Breast Masses Based on Magnetic Resonance Imaging

Background - Breast cancer is one of the most common cancers among women globally and early identification is known to increase patient outcomes. Therefore, the main aim of this study is to identify the essential radiomic features as an image marker and compare the diagnostic feasibility of feature parameters derived from radiomics analysis and conventional Magnetic Resonance Imaging (MRI) to differentiate benign and malignant breast masses.

Methods and Material - T1-weighted Dynamic Contrast-Enhanced (DCE) breast MR axial images of 151 (benign (79) and malignant (72)) patients were chosen. Regions of interest were selected using both manual and semi-automatic segmentation from each lesion. 382 radiomic features computed on the selected regions. A random forest model was employed to detect the most important features that differentiate benign and malignant breast masses. The ten most important radiomics features were obtained from manual and semi-automatic segmentation based on the Gini index to train a support vector machine. MATLAB and IBM SPSS Statistics Subscription software used for statistical analysis.

Results - The accuracy (sensitivity) of the models built from the ten most significant features obtained from manual and semi-automatic segmentation were 0.815 (0.84), 0.821 (0.87), respectively. The top 10 features obtained from manual delineation and semi-automatic segmentation showed a significant difference (p<0.05) between benign and malignant breast lesions.

Conclusion - This radiomics analysis based on DCE-BMRI revealed distinct radiomic features to differentiate benign and malignant breast masses. Therefore, the radiomics analysis can be used as a supporting tool in detecting breast MRI lesions.

Radiomics in medical imaging: pitfalls and challenges in clinical management

BACKGROUND

Radiomics and radiogenomics are two words that recur often in language of radiologists, nuclear doctors and medical physicists especially in oncology field. Radiomics is the technique of medical images analysis to extract quantitative data that are not detected by human eye.

METHODS

This article is a narrative review on Radiomics in Medical Imaging. In particular, the review exposes the process, the limitations related to radiomics, and future prospects are discussed.

RESULTS

Several studies showed that radiomics is very promising. However, there were some critical issues: poor standardization and generalization of radiomics results, data-quality control, repeatability, reproducibility, database balancing and issues related to model overfitting.

CONCLUSIONS

Radiomics procedure should made considered all pitfalls and challenges to obtain robust and reproducible results that could be generalized in other patients cohort.

Preoperative Prediction Power of Radiomics for Breast Cancer: A Systemic Review and Meta-Analysis

Background

To evaluate the preoperative predictive value of radiomics in the diagnosis of breast cancer (BC).

Methods

By searching PubMed and Embase libraries, our study identified 19 eligible studies. We conducted a meta-analysis to assess the differential value in the preoperative assessment of BC using radiomics methods.

Results

Nineteen radiomics studies focusing on the diagnostic efficacy of BC and involving 5865 patients were enrolled. The integrated sensitivity and specificity were 0.84 (95% CI: 0.80–0.87, I^{2 =} 76.44%) and 0.83 (95% CI: 0.78–0.87, I^{2 =} 81.79%), respectively. The AUC based on the SROC curve was 0.91, indicating a high diagnostic value.

Conclusion

Radiomics has shown excellent diagnostic performance in the preoperative prediction of BC and is expected to be a promising method in clinical practice.

PET/MR fusion texture analysis for the clinical outcome prediction in soft-tissue sarcoma

BACKGROUND

Various fusion strategies (feature-level fusion, matrix-level fusion, and image-level fusion) were used to fuse PET and MR images, which might lead to different feature values and classification performance. The purpose of this study was to measure the classification capability of features extracted using various PET/MR fusion methods in a dataset of soft-tissue sarcoma (STS).

METHODS

The retrospective dataset included 51 patients with histologically proven STS. All patients had pre-treatment PET and MR images. The image-level fusion was conducted using discrete wavelet transformation (DWT). During the DWT process, the MR weight was set as 0.1, 0.2, 0.3, 0.4, …, 0.9. And the corresponding PET weight was set as 1- (MR weight). The fused PET/MR images was generated using the inverse DWT. The matrix-level fusion was conducted by fusing the feature calculation matrix during the feature extracting process. The feature-level fusion was conducted by concatenating and averaging the features. We measured the predictive performance of features using univariate analysis and multivariable analysis. The univariate analysis included the Mann-Whitney U test and receiver operating characteristic (ROC) analysis. The multivariable analysis was used to develop the signatures by jointing the maximum relevance minimum redundancy method and multivariable logistic regression. The area under the ROC curve (AUC) value was calculated to evaluate the classification performance.

RESULTS

By using the univariate analysis, the features extracted using image-level fusion method showed the optimal classification performance. For the multivariable analysis, the signatures developed using the image-level fusion-based features showed the best performance. For the T1/PET image-level fusion, the signature developed using the MR weight of 0.1 showed the optimal performance (0.9524(95% confidence interval (CI), 0.8413-0.9999)). For the T2/PET image-level fusion, the signature developed using the MR weight of 0.3 showed the optimal performance (0.9048(95%CI, 0.7356-0.9999)).

CONCLUSIONS

For the fusion of PET/MR images in patients with STS, the signatures developed using the image-level fusion-based features showed the optimal classification performance than the signatures developed using the feature-level fusion and matrix-level fusion-based features, as well as the single modality features. The image-level fusion method was more recommended to fuse PET/MR images in future radiomics studies.

Breast Cancer Classification on Multiparametric MRI - Increased Performance of Boosting Ensemble Methods

Introduction: This study aims to assess the utility of Boosting ensemble classification methods for increasing the diagnostic performance of multiparametric Magnetic Resonance Imaging (mpMRI) radiomic models, in differentiating benign and malignant breast lesions. Methods: The dataset includes mpMR images of 140 female patients with mass-like breast lesions (70 benign and 70 malignant), consisting of Dynamic Contrast Enhanced (DCE) and T2-weighted sequences, and the Apparent Diffusion Coefficient (ADC) calculated from the Diffusion Weighted Imaging (DWI) sequence. Tumor masks were manually defined in all consecutive slices of the respective MRI volumes and 3D radiomic features were extracted with the Pyradiomics package. Feature dimensionality reduction was based on statistical tests and the Boruta wrapper. Hierarchical Clustering on Spearman's rank correlation coefficients between features and Random Forest classification for obtaining feature importance, were implemented for selecting the final feature subset. Adaptive Boosting (AdaBoost), Gradient Boosting (GB), Extreme Gradient Boosting (XGBoost) and Light Gradient Boosting Machine (LightGBM) classifiers, were trained and tested with bootstrap validation in differentiating breast lesions. A Support Vector Machine (SVM) classifier was also exploited for comparison. The Receiver Operator Characteristic (ROC) curves and DeLong's test were utilized to evaluate the classification performances. Results: The final feature subset consisted of 5 features derived from the lesion shape and the first order histogram of DCE and ADC images volumes. XGboost and LGBM achieved statistically significantly higher average classification performances [AUC = 0.95 and 0.94 respectively], followed by Adaboost [AUC = 0.90], GB [AUC = 0.89] and SVM [AUC = 0.88]. Conclusion: Overall, the integration of Ensemble Learning methods within mpMRI radiomic analysis can improve the performance of computer-assisted diagnosis of breast cancer lesions.

Multiparametric radiomic tissue signature and machine learning for distinguishing radiation necrosis from tumor progression after stereotactic radiosurgery

Background

Stereotactic radiosurgery (SRS) may cause radiation necrosis (RN) that is difficult to distinguish from tumor progression (TP) by conventional MRI. We hypothesize that MRI-based multiparametric radiomics (mpRad) and machine learning (ML) can differentiate TP from RN in a multi-institutional cohort.

Methods

Patients with growing brain metastases after SRS at 2 institutions underwent surgery, and RN or TP were confirmed by histopathology. A radiomic tissue signature (RTS) was selected from mpRad, as well as single T₁ post-contrast (T₁c) and T₂ fluid-attenuated inversion recovery (T₂-FLAIR) radiomic features. Feature selection and supervised ML were performed in a randomly selected training cohort (N = 95) and validated in the remaining cases (N = 40) using surgical pathology as the gold standard.

Results

One hundred and thirty-five discrete lesions (37 RN, 98 TP) from 109 patients were included. Radiographic diagnoses by an experienced neuroradiologist were concordant with histopathology in 67% of cases (sensitivity 69%, specificity 59% for TP). Radiomic analysis indicated institutional origin as a significant confounding factor for diagnosis. A random forest model incorporating 1 mpRad, 4 T₁c, and 4 T₂-FLAIR features had an AUC of 0.77 (95% confidence interval [CI]: 0.66–0.88), sensitivity of 67% and specificity of 86% in the training cohort, and AUC of 0.71 (95% CI: 0.51–0.91), sensitivity of 52% and specificity of 90% in the validation cohort.

Conclusions

MRI-based mpRad and ML can distinguish TP from RN with high specificity, which may facilitate the triage of patients with growing brain metastases after SRS for repeat radiation versus surgical intervention.

Overall Survival Prognostic Modelling of Non-small Cell Lung Cancer Patients Using Positron Emission Tomography/Computed Tomography Harmonised Radiomics Features: The Quest for the Optimal Machine Learning Algorithm

AIMS

Despite the promising results achieved by radiomics prognostic models for various clinical applications, multiple challenges still need to be addressed. The two main limitations of radiomics prognostic models include information limitation owing to single imaging modalities and the selection of optimum machine learning and feature selection methods for the considered modality and clinical outcome. In this work, we applied several feature selection and machine learning methods to single-modality positron emission tomography (PET) and computed tomography (CT) and multimodality PET/CT fusion to identify the best combinations for different radiomics modalities towards overall survival prediction in non-small cell lung cancer patients.

MATERIALS AND METHODS

A PET/CT dataset from The Cancer Imaging Archive, including subjects from two independent institutions (87 and 95 patients), was used in this study. Each cohort was used once as training and once as a test, followed by averaging of the results. ComBat harmonisation was used to address the centre effect. In our proposed radiomics framework, apart from single-modality PET and CT models, multimodality radiomics models were developed using multilevel (feature and image levels) fusion. Two different methods were considered for the feature-level strategy, including concatenating PET and CT features into a single feature set and alternatively averaging them. For image-level fusion, we used three different fusion methods, namely wavelet fusion, guided filtering-based fusion and latent low-rank representation fusion. In the proposed prognostic modelling framework, combinations of four feature selection and seven machine learning methods were applied to all radiomics modalities (two single and five multimodalities), machine learning hyper-parameters were optimised and finally the models were evaluated in the test cohort with 1000 repetitions via bootstrapping. Feature selection and machine learning methods were selected as popular techniques in the literature, supported by open source software in the public domain and their ability to cope with continuous time-to-event survival data. Multifactor ANOVA was used to carry out variability analysis and the proportion of total variance explained by radiomics modality, feature selection and machine learning methods was calculated by a bias-corrected effect size estimate known as ω².

RESULTS

Optimum feature selection and machine learning methods differed owing to the applied radiomics modality. However, minimum depth (MD) as feature selection and Lasso and Elastic-Net regularized generalized linear model (glmnet) as machine learning method had the highest average results. Results from the ANOVA test indicated that the variability that each factor (radiomics modality, feature selection and machine learning methods) introduces to the performance of models is case specific, i.e. variances differ regarding different radiomics modalities and fusion strategies. Overall, the greatest proportion of variance was explained by machine learning, except for models in feature-level fusion strategy.

CONCLUSION

The identification of optimal feature selection and machine learning methods is a crucial step in developing sound and accurate radiomics risk models. Furthermore, optimum methods are case specific, differing due to the radiomics modality and fusion strategy used.

Radiomics in breast MRI: current progress toward clinical application in the era of artificial intelligence

Breast magnetic resonance imaging (MRI) is the most sensitive imaging modality for breast cancer diagnosis and is widely used clinically. Dynamic contrast-enhanced MRI is the basis for breast MRI, but ultrafast images, T2-weighted images, and diffusion-weighted images are also taken to improve the characteristics of the lesion. Such multiparametric MRI with numerous morphological and functional data poses new challenges to radiologists, and thus, new tools for reliable, reproducible, and high-volume quantitative assessments are warranted. In this context, radiomics, which is an emerging field of research involving the conversion of digital medical images into mineable data for clinical decision-making and outcome prediction, has been gaining ground in oncology. Recent development in artificial intelligence has promoted radiomics studies in various fields including breast cancer treatment and numerous studies have been conducted. However, radiomics has shown a translational gap in clinical practice, and many issues remain to be solved. In this review, we will outline the steps of radiomics workflow and investigate clinical application of radiomics focusing on breast MRI based on published literature, as well as current discussion about limitations and challenges in radiomics.

Breast lesion detection through MammoWave device: Empirical detection capability assessment of microwave images' parameters

MammoWave is a microwave imaging device for breast lesions detection, which operates using two (azimuthally rotating) antennas without any matching liquid. Images, subsequently obtained by resorting to Huygens Principle, are intensity maps, representing the homogeneity of tissues' dielectric properties. In this paper, we propose to generate, for each breast, a set of conductivity weighted microwave images by using different values of conductivity in the Huygens Principle imaging algorithm. Next, microwave images' parameters, i.e. features, are introduced to quantify the non-homogenous behaviour of the image. We empirically verify on 103 breasts that a selection of these features may allow distinction between breasts with no radiological finding (NF) and breasts with radiological findings (WF), i.e. with lesions which may be benign or malignant. Statistical significance was set at p<0.05. We obtained single features Area Under the receiver operating characteristic Curves (AUCs) spanning from 0.65 to 0.69. In addition, an empirical rule-of-thumb allowing breast assessment is introduced using a binary score S operating on an appropriate combination of features. Performances of such rule-of-thumb are evaluated empirically, obtaining a sensitivity of 74%, which increases to 82% when considering dense breasts only.

Brain tissues have single-voxel signatures in multi-spectral MRI

Since the seminal works by Brodmann and contemporaries, it is well-known that different brain regions exhibit unique cytoarchitectonic and myeloarchitectonic features. Transferring the approach of classifying brain tissues - and other tissues - based on their intrinsic features to the realm of magnetic resonance (MR) is a longstanding endeavor. In the 1990s, atlas-based segmentation replaced earlier multi-spectral classification approaches because of the large overlap between the class distributions. Here, we explored the feasibility of performing global brain classification based on intrinsic MR features, and used several technological advances: ultra-high field MRI, q-space trajectory diffusion imaging revealing voxel-intrinsic diffusion properties, chemical exchange saturation transfer and semi-solid magnetization transfer imaging as a marker of myelination and neurochemistry, and current neural network architectures to analyze the data. In particular, we used the raw image data as well to increase the number of input features. We found that a global brain classification of roughly 97 brain regions was feasible with gross classification accuracy of 60%; and that mapping from voxel-intrinsic MR data to the brain region to which the data belongs is possible. This indicates the presence of unique MR signals of different brain regions, similar to their cytoarchitectonic and myeloarchitectonic fingerprints.

Application of radiomics and machine learning in head and neck cancers

With the continuous development of medical image informatics technology, more and more high-throughput quantitative data could be extracted from digital medical images, which has resulted in a new kind of omics-Radiomics. In recent years, in addition to genomics, proteomics and metabolomics, radiomic has attracted the interest of more and more researchers. Compared to other omics, radiomics can be perfectly integrated with clinical data, even with the pathology and molecular biomarker, so that the study can be closer to the clinical reality and more revealing of the tumor development. Mass data will also be generated in this process. Machine learning, due to its own characteristics, has a unique advantage in processing massive radiomic data. By analyzing mass amounts of data with strong clinical relevance, people can construct models that more accurately reflect tumor development and progression, thereby providing the possibility of personalized and sequential treatment of patients. As one of the cancer types whose treatment and diagnosis rely on imaging examination, radiomics has a very broad application prospect in head and neck cancers (HNC). Until now, there have been some notable results in HNC. In this review, we will introduce the concepts and workflow of radiomics and machine learning and their current applications in head and neck cancers, as well as the directions and applications of artificial intelligence in the treatment and diagnosis of HNC.

Preoperative ultrasound-based radiomics score can improve the accuracy of the Memorial Sloan Kettering Cancer Center nomogram for predicting sentinel lymph node metastasis in breast cancer

PURPOSE

To develop a combined nomogram by incorporating the Memorial Sloan Kettering Cancer Center (MSKCC) nomogram and ultrasound (US)-based radiomics score (Radscore) for predicting sentinel lymph node (SLN) metastasis in invasive breast cancer.

MATERIALS AND METHODS

This retrospective study was approved by the ethics committee of our institution, and written informed consent was waived. A total of 452 patients with invasive breast cancer who received SLN Biopsy in a single center were included between January 2016 and December 2019. The patients were divided into a training set (n = 318) and a validation set (n = 134). A total of 1216 features were extracted from the regions of interest (ROIs) of the tumors on conventional ultrasound. The maximum relevance minimum redundancy (mRMR) and the least absolute shrinkage and selection operator (LASSO) algorithm were used to build the Radscore. Afterward, the diagnostic performance was assessed and validated. Comparison of receiver operating characteristic (ROC) curves and decision curve analysis (DCA) were performed to evaluate the incremental value of the combined model.

RESULTS

Obtained from 18 features, the Radscore indicated a favorable discriminatory capability in the training set with an area under the curve (AUC) of 0.834, whereas a value of 0.770 was observed in the validation set. The AUC of the combined model was 0.901 (95 % confidence interval (95 % CI): 0.865-0.938) in the training set and 0.833 (95 % CI: 0.788-0.878) in the validation set. Both of them were superior to MSKCC or imaging Radscore alone (P < 0.05). DCA demonstrated that the combined model was superior to the others in terms of clinical practicability.

CONCLUSION

Preoperative US-based Radscore can improve the accuracy of clinical MSKCC nomogram for SLN metastasis prediction in breast cancer.

Toward radiomics for assessment of response to systemic therapies in lung cancer

This editorial comment explains recent developments in radiomics regarding the use of quantitative imaging biomarkers to predict lung cancer sensitivity to a variety of cancer therapies. Tumor response assessment has been a crucial component guiding cancer treatment. Evaluation of treatment response was standardized and classically based on measuring changes in tumor lesion size. Recent breakthroughs in artificial intelligence pave the way for the use of radiomics in tumor response assessment. Such objective techniques would bring a remarkable transformation to conventional methods, which can be inherently subjective. Successful implementation of these technologies would allow for faster and more accurate predictions of treatment efficacy, which will be critical to the advancement of personalized medicine.

Radiomics of high-resolution computed tomography for the differentiation between cholesteatoma and middle ear inflammation: effects of post-reconstruction methods in a dual-center study

Objectives

To evaluate the performance of radiomic features extracted from high-resolution computed tomography (HRCT) for the differentiation between cholesteatoma and middle ear inflammation (MEI), and to investigate the impact of post-reconstruction harmonization and data resampling.

Methods

One hundred patients were included in this retrospective dual-center study: 48 with histology-proven cholesteatoma (center A: 23; center B: 25) and 52 with MEI (A: 27; B: 25). Radiomic features (co-occurrence and run-length matrix, absolute gradient, autoregressive model, Haar wavelet transform) were extracted from manually defined 2D-ROIs. The ten best features for lesion differentiation were selected using probability of error and average correlation coefficients. A multi-layer perceptron feed-forward artificial neural network (MLP-ANN) was used for radiomics-based classification, with histopathology serving as the reference standard (70% of cases for training, 30% for validation). The analysis was performed five times each on (a) unmodified data and on data that were (b) resampled to the same matrix size, and (c) corrected for acquisition protocol differences using ComBat harmonization.

Results

Using unmodified data, the MLP-ANN classification yielded an overall median area under the receiver operating characteristic curve (AUC) of 0.78 (0.72–0.84). Using original data from center A and resampled data from center B, an overall median AUC of 0.88 (0.82–0.99) was yielded, while using ComBat harmonized data, an overall median AUC of 0.89 (0.79–0.92) was revealed.

Conclusion

Radiomic features extracted from HRCT differentiate between cholesteatoma and MEI. When using multi-centric data obtained with differences in CT acquisition parameters, data resampling and ComBat post-reconstruction harmonization clearly improve radiomics-based lesion classification.

Key Points

• Unenhanced high-resolution CT coupled with radiomics analysis may be useful for the differentiation between cholesteatoma and middle ear inflammation.

• Pooling of data extracted from inhomogeneous CT datasets does not appear meaningful without further post-processing.

• When using multi-centric CT data obtained with differences in acquisition parameters, post-reconstruction harmonization and data resampling clearly improve radiomics-based soft-tissue differentiation.

Integrated Multiparametric Radiomics and Informatics System for Characterizing Breast Tumor Characteristics with the OncotypeDX Gene Assay

Optimal use of multiparametric magnetic resonance imaging (mpMRI) can identify key MRI parameters and provide unique tissue signatures defining phenotypes of breast cancer. We have developed and implemented a new machine-learning informatic system, termed Informatics Radiomics Integration System (IRIS) that integrates clinical variables, derived from imaging and electronic medical health records (EHR) with multiparametric radiomics (mpRad) for identifying potential risk of local or systemic recurrence in breast cancer patients. We tested the model in patients (n = 80) who had Estrogen Receptor positive disease and underwent OncotypeDX gene testing, radiomic analysis, and breast mpMRI. The IRIS method was trained using the mpMRI, clinical, pathologic, and radiomic descriptors for prediction of the OncotypeDX risk score. The trained mpRad IRIS model had a 95% and specificity was 83% with an Area Under the Curve (AUC) of 0.89 for classifying low risk patients from the intermediate and high-risk groups. The lesion size was larger for the high-risk group (2.9 ± 1.7 mm) and lower for both low risk (1.9 ± 1.3 mm) and intermediate risk (1.7 ± 1.4 mm) groups. The lesion apparent diffusion coefficient (ADC) map values for high- and intermediate-risk groups were significantly (p < 0.05) lower than the low-risk group (1.14 vs. 1.49 × 10-3 mm2/s). These initial studies provide deeper insight into the clinical, pathological, quantitative imaging, and radiomic features, and provide the foundation to relate these features to the assessment of treatment response for improved personalized medicine.

Editorial for "Radiomics Based on Multimodal MRI for the Differential Diagnosis of Benign and Malignant Breast Lesions"

LEVEL OF EVIDENCE

5 TECHNICAL EFFICACY STAGE: 2 J. Magn. Reson. Imaging 2020;52:608-609.