Predicting breast cancer types on and beyond molecular level in a multi-modal fashion

Preoperative Prediction of Axillary Lymph Node Metastasis in Patients With Breast Cancer Through Multimodal Deep Learning Based on Ultrasound and Magnetic Resonance Imaging Images

RATIONALE AND OBJECTIVES

Deep learning can enhance the performance of multimodal image analysis, which is known for its noninvasive attributes and complementary efficacy, in predicting axillary lymph node (ALN) metastasis. Therefore, we established a multimodal deep learning model incorporating ultrasound (US) and magnetic resonance imaging (MRI) images to predict ALN metastasis in patients with breast cancer.

MATERIALS AND METHODS

A retrospective cohort of patients with histologically confirmed breast cancer from two hospitals composed of the primary cohort (n = 465) and the external validation cohort (n = 123). All patients had undergone both preoperative US and MRI scans. After data preprocessing, three convolutional neural network models were used to analyze the US and MRI images, respectively. After integrating the US and MRI deep learning prediction results (DLUS and DLMRI, respectively), a multimodal deep learning (DLMRI+US+Clinical parameter) model was constructed. The predictive ability of the proposed model was compared to that of the DLUS, DLMRI, combined bimodal (DLMRI+US), and clinical parameter models. Evaluation was performed using the area under the receiver operating characteristic curves (AUCs) and decision curves.

RESULTS

A total of 588 patients with breast cancer participated in this study. The DLMRI+US+Clinical parameter model outperformed the alternative models, achieving the highest AUCs of 0.819 (95% confidence interval [CI] 0.734-0.903) and 0.809 (95% CI 0.723-0.895) on the internal and external validation sets, respectively. The decision curve analysis confirmed its clinical usefulness.

CONCLUSION

The DLMRI+US＋Clinical parameter model demonstrates the feasibility and reliability of its performance for ALN metastasis prediction in patients with breast cancer.

Identifying radiogenomic associations of breast cancer based on DCE-MRI by using Siamese Neural Network with manufacturer bias normalization

BACKGROUND AND PURPOSE

The immunohistochemical test (IHC) for Human Epidermal Growth Factor Receptor 2 (HER2) and hormone receptors (HR) provides prognostic information and guides treatment for patients with invasive breast cancer. The objective of this paper is to establish a non-invasive system for identifying HER2 and HR in breast cancer using dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI).

METHODS

In light of the absence of high-performance algorithms and external validation in previously published methods, this study utilizes 3D deep features and radiomics features to represent the information of the Region of Interest (ROI). A Siamese Neural Network was employed as the classifier, with 3D deep features and radiomics features serving as the network input. To neutralize manufacturer bias, a batch effect normalization method, ComBat, was introduced. To enhance the reliability of the study, two datasets, Predict Your Therapeutic Response with Imaging and moLecular Analysis (I-SPY 1) and I-SPY 2, were incorporated. I-SPY 2 was utilized for model training and validation, while I-SPY 1 was exclusively employed for external validation. Additionally, a breast tumor segmentation network was trained to improve radiomic feature extraction.

RESULTS

The results indicate that our approach achieved an average Area Under the Curve (AUC) of 0.632, with a Standard Error of the Mean (SEM) of 0.042 for HER2 prediction in the I-SPY 2 dataset. For HR prediction, our method attained an AUC of 0.635 (SEM 0.041), surpassing other published methods in the AUC metric. Moreover, the proposed method yielded competitive results in other metrics. In external validation using the I-SPY 1 dataset, our approach achieved an AUC of 0.567 (SEM 0.032) for HR prediction and 0.563 (SEM 0.033) for HER2 prediction.

CONCLUSION

This study proposes a non-invasive system for identifying HER2 and HR in breast cancer. Although the results do not conclusively demonstrate superiority in both tasks, they indicate that the proposed method achieved good performance and is a competitive classifier compared to other reference methods. Ablation studies demonstrate that both radiomics features and deep features for the Siamese Neural Network are beneficial for the model. The introduced manufacturer bias normalization method has been shown to enhance the method's performance. Furthermore, the external validation of the method enhances the reliability of this research. Source code, pre-trained segmentation network, Radiomics and deep features, data for statistical analysis, and Supporting Information of this article are online at: https://github.com/FORRESTHUACHEN/Siamese_Neural_Network_based_Brest_cancer_Radiogenomic.

Breast cancer prognosis through the use of multi-modal classifiers: current state of the art and the way forward

We present a survey of the current state-of-the-art in breast cancer detection and prognosis. We analyze the evolution of Artificial Intelligence-based approaches from using just uni-modal information to multi-modality for detection and how such paradigm shift facilitates the efficacy of detection, consistent with clinical observations. We conclude that interpretable AI-based predictions and ability to handle class imbalance should be considered priority.

Precision treatment in advanced hepatocellular carcinoma

The past decade has witnessed significant advances in the systemic treatment of advanced hepatocellular carcinoma (HCC). Nevertheless, the newly developed treatment strategies have not achieved universal success and HCC patients frequently exhibit therapeutic resistance to these therapies. Precision treatment represents a paradigm shift in cancer treatment in recent years. This approach utilizes the unique molecular characteristics of individual patient to personalize treatment modalities, aiming to maximize therapeutic efficacy while minimizing side effects. Although precision treatment has shown significant success in multiple cancer types, its application in HCC remains in its infancy. In this review, we discuss key aspects of precision treatment in HCC, including therapeutic biomarkers, molecular classifications, and the heterogeneity of the tumor microenvironment. We also propose future directions, ranging from revolutionizing current treatment methodologies to personalizing therapy through functional assays, which will accelerate the next phase of advancements in this area.

iCluF: an unsupervised iterative cluster-fusion method for patient stratification using multiomics data

Motivation

Patient stratification is crucial for the effective treatment or management of heterogeneous diseases, including cancers. Multiomic technologies facilitate molecular characterization of human diseases; however, the complexity of data warrants the need for the development of robust data integration tools for patient stratification using machine-learning approaches.

Results

iCluF iteratively integrates three types of multiomic data (mRNA, miRNA, and DNA methylation) using pairwise patient similarity matrices built from each omic data. The intermediate omic-specific neighborhood matrices implement iterative matrix fusion and message passing among the similarity matrices to derive a final integrated matrix representing all the omics profiles of a patient, which is used to further cluster patients into subtypes. iCluF outperforms other methods with significant differences in the survival profiles of 8581 patients belonging to 30 different cancers in TCGA. iCluF also predicted the four intrinsic subtypes of Breast Invasive Carcinomas with adjusted rand index and Fowlkes-Mallows scores of 0.72 and 0.83, respectively. The Gini importance score showed that methylation features were the primary decisive players, followed by mRNA and miRNA to identify disease subtypes. iCluF can be applied to stratify patients with any disease containing multiomic datasets.

Availability and implementation

Source code and datasets are available at https://github.com/GudaLab/iCluF_core.

Artificial Intelligence in Breast Cancer Diagnosis and Personalized Medicine

Breast cancer is a significant cause of cancer-related mortality in women worldwide. Early and precise diagnosis is crucial, and clinical outcomes can be markedly enhanced. The rise of artificial intelligence (AI) has ushered in a new era, notably in image analysis, paving the way for major advancements in breast cancer diagnosis and individualized treatment regimens. In the diagnostic workflow for patients with breast cancer, the role of AI encompasses screening, diagnosis, staging, biomarker evaluation, prognostication, and therapeutic response prediction. Although its potential is immense, its complete integration into clinical practice is challenging. Particularly, these challenges include the imperatives for extensive clinical validation, model generalizability, navigating the "black-box" conundrum, and pragmatic considerations of embedding AI into everyday clinical environments. In this review, we comprehensively explored the diverse applications of AI in breast cancer care, underlining its transformative promise and existing impediments. In radiology, we specifically address AI in mammography, tomosynthesis, risk prediction models, and supplementary imaging methods, including magnetic resonance imaging and ultrasound. In pathology, our focus is on AI applications for pathologic diagnosis, evaluation of biomarkers, and predictions related to genetic alterations, treatment response, and prognosis in the context of breast cancer diagnosis and treatment. Our discussion underscores the transformative potential of AI in breast cancer management and emphasizes the importance of focused research to realize the full spectrum of benefits of AI in patient care.

Molecular Classifiers in Skin Cancers: Challenges and Promises

Skin cancers are common and heterogenous malignancies affecting up to two in three Australians before age 70. Despite recent developments in diagnosis and therapeutic strategies, the mortality rate and costs associated with managing patients with skin cancers remain high. The lack of well-defined clinical and histopathological features makes their diagnosis and classification difficult in some cases and the prognostication difficult in most skin cancers. Recent advancements in large-scale "omics" studies, including genomics, transcriptomics, proteomics, metabolomics and imaging-omics, have provided invaluable information about the molecular and visual landscape of skin cancers. On many occasions, it has refined tumor classification and has improved prognostication and therapeutic stratification, leading to improved patient outcomes. Therefore, this paper reviews the recent advancements in omics approaches and appraises their limitations and potential for better classification and stratification of skin cancers.

Ultrasound-based radiomics model for predicting molecular biomarkers in breast cancer

Background

Breast cancer (BC) is the most common cancer in women and is highly heterogeneous. BC can be classified into four molecular subtypes based on the status of estrogen receptor (ER), progesterone receptor (PR), human epidermal growth factor receptor 2 (HER2) and proliferation marker protein Ki-67. However, they can only be obtained by biopsy or surgery, which is invasive. Radiomics can noninvasively predict molecular expression via extracting the image features. Nevertheless, there is a scarcity of data available regarding the prediction of molecular biomarker expression using ultrasound (US) images in BC.

Objectives

To investigate the prediction performance of US radiomics for the assessment of molecular profiling in BC.

Methods

A total of 342 patients with BC who underwent preoperative US examination between January 2013 and December 2021 were retrospectively included. They were confirmed by pathology and molecular subtype analysis of ER, PR, HER2 and Ki-67. The radiomics features were extracted and four molecular models were constructed through support vector machine (SVM). Pearson correlation coefficient heatmaps are employed to analyze the relationship between selected features and their predictive power on molecular expression. The receiver operating characteristic curve was used for the prediction performance of US radiomics in the assessment of molecular profiling.

Results

359 lesions with 129 ER- and 230 ER+, 163 PR- and 196 PR+, 265 HER2- and 94 HER2+, 114 Ki-67- and 245 Ki-67+ expression were included. 1314 features were extracted from each ultrasound image. And there was a significant difference of some specific radiomics features between the molecule positive and negative groups. Multiple features demonstrated significant association with molecular biomarkers. The area under curves (AUCs) were 0.917, 0.835, 0.771, and 0.896 in the training set, while 0.868, 0.811, 0.722, and 0.706 in the validation set to predict ER, PR, HER2, and Ki-67 expression respectively.

Conclusion

Ultrasound-based radiomics provides a promising method for predicting molecular biomarker expression of ER, PR, HER2, and Ki-67 in BC.

Characterization of Breast Tumors from MR Images Using Radiomics and Machine Learning Approaches

Determining histological subtypes, such as invasive ductal and invasive lobular carcinomas (IDCs and ILCs) and immunohistochemical markers, such as estrogen response (ER), progesterone response (PR), and the HER2 protein status is important in planning breast cancer treatment. MRI-based radiomic analysis is emerging as a non-invasive substitute for biopsy to determine these signatures. We explore the effectiveness of radiomics-based and CNN (convolutional neural network)-based classification models to this end. T1-weighted dynamic contrast-enhanced, contrast-subtracted T1, and T2-weighted MR images of 429 breast cancer tumors from 323 patients are used. Various combinations of input data and classification schemes are applied for ER⁺ vs. ER^-, PR⁺ vs. PR^-, HER2⁺ vs. HER2^-, and IDC vs. ILC classification tasks. The best results were obtained for the ER⁺ vs. ER^- and IDC vs. ILC classification tasks, with their respective AUCs reaching 0.78 and 0.73 on test data. The results with multi-contrast input data were generally better than the mono-contrast alone. The radiomics and CNN-based approaches generally exhibited comparable results. ER and IDC/ILC classification results were promising. PR and HER2 classifications need further investigation through a larger dataset. Better results by using multi-contrast data might indicate that multi-parametric quantitative MRI could be used to achieve more reliable classifiers.