1
|
Zhang L, Fan M, Li L. Deconvolution-Based Pharmacokinetic Analysis to Improve the Prediction of Pathological Information of Breast Cancer. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:13-24. [PMID: 38343210 DOI: 10.1007/s10278-023-00915-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 08/30/2023] [Accepted: 09/01/2023] [Indexed: 03/02/2024]
Abstract
Pharmacokinetic (PK) parameters, revealing changes in the tumor microenvironment, are related to the pathological information of breast cancer. Tracer kinetic models (e.g., Tofts-Kety model) with a nonlinear least square solver are commonly used to estimate PK parameters. However, the method is sensitive to noise in images. To relieve the effects of noise, a deconvolution (DEC) method, which was validated on synthetic concentration-time series, was proposed to accurately calculate PK parameters from breast dynamic contrast-enhanced magnetic resonance imaging. A time-to-peak-based tumor partitioning method was used to divide the whole tumor into three tumor subregions with different kinetic patterns. Radiomic features were calculated from the tumor subregion and whole tumor-based PK parameter maps. The optimal features determined by the fivefold cross-validation method were used to build random forest classifiers to predict molecular subtypes, Ki-67, and tumor grade. The diagnostic performance evaluated by the area under the receiver operating characteristic curve (AUC) was compared between the subregion and whole tumor-based PK parameters. The results showed that the DEC method obtained more accurate PK parameters than the Tofts method. Moreover, the results showed that the subregion-based Ktrans (best AUCs = 0.8319, 0.7032, 0.7132, 0.7490, 0.8074, and 0.6950) achieved a better diagnostic performance than the whole tumor-based Ktrans (AUCs = 0.8222, 0.6970, 0.6511, 0.7109, 0.7620, and 0.5894) for molecular subtypes, Ki-67, and tumor grade. These findings indicate that DEC-based Ktrans in the subregion has the potential to accurately predict molecular subtypes, Ki-67, and tumor grade.
Collapse
Affiliation(s)
- Liangliang Zhang
- School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, 310018, China
- School of Computer and Information, Anqing Normal University, Anqing, 246133, China
| | - Ming Fan
- Institute of Intelligent Biomedicine, School of Automation, Hangzhou Dianzi University, Hangzhou, 310018, China.
| | - Lihua Li
- School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, 310018, China.
- Institute of Intelligent Biomedicine, School of Automation, Hangzhou Dianzi University, Hangzhou, 310018, China.
| |
Collapse
|
2
|
Yang Y, Xiang T, Lv X, Li L, Lui LM, Zeng T. Double Transformer Super-Resolution for Breast Cancer ADC Images. IEEE J Biomed Health Inform 2024; 28:917-928. [PMID: 38079366 DOI: 10.1109/jbhi.2023.3341250] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2024]
Abstract
Diffusion-weighted imaging (DWI) has been extensively explored in guiding the clinic management of patients with breast cancer. However, due to the limited resolution, accurately characterizing tumors using DWI and the corresponding apparent diffusion coefficient (ADC) is still a challenging problem. In this paper, we aim to address the issue of super-resolution (SR) of ADC images and evaluate the clinical utility of SR-ADC images through radiomics analysis. To this end, we propose a novel double transformer-based network (DTformer) to enhance the resolution of ADC images. More specifically, we propose a symmetric U-shaped encoder-decoder network with two different types of transformer blocks, named as UTNet, to extract deep features for super-resolution. The basic backbone of UTNet is composed of a locally-enhanced Swin transformer block (LeSwin-T) and a convolutional transformer block (Conv-T), which are responsible for capturing long-range dependencies and local spatial information, respectively. Additionally, we introduce a residual upsampling network (RUpNet) to expand image resolution by leveraging initial residual information from the original low-resolution (LR) images. Extensive experiments show that DTformer achieves superior SR performance. Moreover, radiomics analysis reveals that improving the resolution of ADC images is beneficial for tumor characteristic prediction, such as histological grade and human epidermal growth factor receptor 2 (HER2) status.
Collapse
|
3
|
Zhang L, Fan M, Li L. Efficient estimation of pharmacokinetic parameters from breast dynamic contrast-enhanced MRI based on a convolutional neural network for predicting molecular subtypes. Phys Med Biol 2023; 68:245001. [PMID: 37983902 DOI: 10.1088/1361-6560/ad0e39] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2023] [Accepted: 11/20/2023] [Indexed: 11/22/2023]
Abstract
Objective. Tracer kinetic models allow for estimating pharmacokinetic (PK) parameters, which are related to pathological characteristics, from breast dynamic contrast-enhanced magnetic resonance imaging. However, existing tracer kinetic models subject to inaccuracy are time-consuming for PK parameters estimation. This study aimed to accurately and efficiently estimate PK parameters for predicting molecular subtypes based on convolutional neural network (CNN).Approach. A CNN integrating global and local features (GL-CNN) was trained using synthetic data where known PK parameters map was used as the ground truth, and subsequently used to directly estimate PK parameters (volume transfer constantKtransand flux rate constantKep) map. The accuracy assessed by the peak signal-to-noise ratio (PSNR), structural similarity (SSIM), and concordance correlation coefficient (CCC) was compared between the GL-CNN and Tofts-based PK parameters in synthetic data. Radiomic features were calculated from the PK parameters map in 208 breast tumors. A random forest classifier was constructed to predict molecular subtypes using a discovery cohort (n= 144). The diagnostic performance evaluated on a validation cohort (n= 64) using the area under the receiver operating characteristic curve (AUC) was compared between the GL-CNN and Tofts-based PK parameters.Main results. The average PSNR (48.8884), SSIM (0.9995), and CCC (0.9995) between the GL-CNN-basedKtransmap and ground truth were significantly higher than those between the Tofts-basedKtransmap and ground truth. The GL-CNN-basedKtransobtained significantly better diagnostic performance (AUCs = 0.7658 and 0.8528) than the Tofts-basedKtransfor luminal B and HER2 tumors. The GL-CNN method accelerated the computation by speed approximately 79 times compared to the Tofts method for the whole breast of all patients.Significance. Our results indicate that the GL-CNN method can be used to accurately and efficiently estimate PK parameters for predicting molecular subtypes.
Collapse
Affiliation(s)
- Liangliang Zhang
- School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, 310018, People's Republic of China
- School of Computer and Information, Anqing Normal University, Anqing, 246133, People's Republic of China
| | - Ming Fan
- Institute of Intelligent Biomedicine, Hangzhou Dianzi University, Hangzhou, 310018, People's Republic of China
| | - Lihua Li
- School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, 310018, People's Republic of China
- Institute of Intelligent Biomedicine, Hangzhou Dianzi University, Hangzhou, 310018, People's Republic of China
| |
Collapse
|
4
|
Elsayed B, Alksas A, Shehata M, Mahmoud A, Zaky M, Alghandour R, Abdelwahab K, Abdelkhalek M, Ghazal M, Contractor S, El-Din Moustafa H, El-Baz A. Exploring Neoadjuvant Chemotherapy, Predictive Models, Radiomic, and Pathological Markers in Breast Cancer: A Comprehensive Review. Cancers (Basel) 2023; 15:5288. [PMID: 37958461 PMCID: PMC10648987 DOI: 10.3390/cancers15215288] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2023] [Revised: 10/30/2023] [Accepted: 11/01/2023] [Indexed: 11/15/2023] Open
Abstract
Breast cancer retains its position as the most prevalent form of malignancy among females on a global scale. The careful selection of appropriate treatment for each patient holds paramount importance in effectively managing breast cancer. Neoadjuvant chemotherapy (NACT) plays a pivotal role in the comprehensive treatment of this disease. Administering chemotherapy before surgery, NACT becomes a powerful tool in reducing tumor size, potentially enabling fewer invasive surgical procedures and even rendering initially inoperable tumors amenable to surgery. However, a significant challenge lies in the varying responses exhibited by different patients towards NACT. To address this challenge, researchers have focused on developing prediction models that can identify those who would benefit from NACT and those who would not. Such models have the potential to reduce treatment costs and contribute to a more efficient and accurate management of breast cancer. Therefore, this review has two objectives: first, to identify the most effective radiomic markers correlated with NACT response, and second, to explore whether integrating radiomic markers extracted from radiological images with pathological markers can enhance the predictive accuracy of NACT response. This review will delve into addressing these research questions and also shed light on the emerging research direction of leveraging artificial intelligence techniques for predicting NACT response, thereby shaping the future landscape of breast cancer treatment.
Collapse
Affiliation(s)
- Basma Elsayed
- Biomedical Engineering Program, Faculty of Engineering, Mansoura University, Mansoura 35516, Egypt;
| | - Ahmed Alksas
- Department of Bioengineering, University of Louisville, Louisville, KY 40292, USA; (A.A.); (M.S.); (A.M.)
| | - Mohamed Shehata
- Department of Bioengineering, University of Louisville, Louisville, KY 40292, USA; (A.A.); (M.S.); (A.M.)
| | - Ali Mahmoud
- Department of Bioengineering, University of Louisville, Louisville, KY 40292, USA; (A.A.); (M.S.); (A.M.)
| | - Mona Zaky
- Diagnostic Radiology Department, Faculty of Medicine, Mansoura University, Mansoura 35516, Egypt;
| | - Reham Alghandour
- Medical Oncology Department, Mansoura Oncology Center, Mansoura University, Mansoura 35516, Egypt;
| | - Khaled Abdelwahab
- Surgical Oncology Department, Mansoura Oncology Center, Mansoura University, Mansoura 35516, Egypt; (K.A.); (M.A.)
| | - Mohamed Abdelkhalek
- Surgical Oncology Department, Mansoura Oncology Center, Mansoura University, Mansoura 35516, Egypt; (K.A.); (M.A.)
| | - Mohammed Ghazal
- Electrical, Computer, and Biomedical Engineering Department, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates;
| | - Sohail Contractor
- Department of Radiology, University of Louisville, Louisville, KY 40202, USA;
| | | | - Ayman El-Baz
- Department of Bioengineering, University of Louisville, Louisville, KY 40292, USA; (A.A.); (M.S.); (A.M.)
| |
Collapse
|
5
|
Huang T, Fan B, Qiu Y, Zhang R, Wang X, Wang C, Lin H, Yan T, Dong W. Application of DCE-MRI radiomics signature analysis in differentiating molecular subtypes of luminal and non-luminal breast cancer. Front Med (Lausanne) 2023; 10:1140514. [PMID: 37181350 PMCID: PMC10166881 DOI: 10.3389/fmed.2023.1140514] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Accepted: 04/03/2023] [Indexed: 05/16/2023] Open
Abstract
Background The goal of this study was to develop and validate a radiomics signature based on dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) preoperatively differentiating luminal and non-luminal molecular subtypes in patients with invasive breast cancer. Methods One hundred and thirty-five invasive breast cancer patients with luminal (n = 78) and non-luminal (n = 57) molecular subtypes were divided into training set (n = 95) and testing set (n = 40) in a 7:3 ratio. Demographics and MRI radiological features were used to construct clinical risk factors. Radiomics signature was constructed by extracting radiomics features from the second phase of DCE-MRI images and radiomics score (rad-score) was calculated. Finally, the prediction performance was evaluated in terms of calibration, discrimination, and clinical usefulness. Results Multivariate logistic regression analysis showed that no clinical risk factors were independent predictors of luminal and non-luminal molecular subtypes in invasive breast cancer patients. Meanwhile, the radiomics signature showed good discrimination in the training set (AUC, 0.86; 95% CI, 0.78-0.93) and the testing set (AUC, 0.80; 95% CI, 0.65-0.95). Conclusion The DCE-MRI radiomics signature is a promising tool to discrimination luminal and non-luminal molecular subtypes in invasive breast cancer patients preoperatively and noninvasively.
Collapse
Affiliation(s)
- Ting Huang
- Department of Radiology, Jiangxi Provincial People’s Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Bing Fan
- Department of Radiology, Jiangxi Provincial People’s Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Yingying Qiu
- Department of Radiology, Jiangxi Provincial People’s Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Rui Zhang
- Department of Radiology, Jiangxi Provincial People’s Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Xiaolian Wang
- Department of Radiology, Jiangxi Provincial People’s Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Chaoxiong Wang
- Department of Radiology, Jiangxi Provincial People’s Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Huashan Lin
- Department of Pharmaceutical Diagnosis, GE Healthcare, Changsha, China
| | - Ting Yan
- Department of Radiology, Jiangxi Provincial People’s Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Wentao Dong
- Department of Radiology, Jiangxi Provincial People’s Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| |
Collapse
|
6
|
Lin CX, Tian Y, Li JM, Liao ST, Liu YT, Zhan RG, Du ZL, Yu XR. Diagnostic value of multiple b-value diffusion-weighted imaging in discriminating the malignant from benign breast lesions. BMC Med Imaging 2023; 23:10. [PMID: 36631781 PMCID: PMC9832757 DOI: 10.1186/s12880-022-00950-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Accepted: 12/14/2022] [Indexed: 01/13/2023] Open
Abstract
OBJECTIVE The conventional breast Diffusion-weighted imaging (DWI) was subtly influenced by microcirculation owing to the insufficient selection of the b values. However, the multiparameter derived from multiple b-value exhibits more reliable image quality and maximize the diagnostic accuracy. We aim to evaluate the diagnostic performance of stand-alone parameter or in combination with multiparameter derived from multiple b-value DWI in differentiating malignant from benign breast lesions. METHODS A total of forty-one patients diagnosed with benign breast tumor and thirty-eight patients with malignant breast tumor underwent DWI using thirteen b values and other MRI functional sequence at 3.0 T magnetic resonance. Data were accepted mono-exponential, bi-exponential, stretched-exponential, aquaporins (AQP) model analysis. A receiver operating characteristic curve (ROC) was used to evaluate the diagnostic performance of quantitative parameter or multiparametric combination. The Youden index, sensitivity and specificity were used to assess the optimal diagnostic model. T-test, logistic regression analysis, and Z-test were used. P value < 0.05 was considered statistically significant. RESULT The ADCavg, ADCmax, f, and α value of the malignant group were lower than the benign group, while the ADCfast value was higher instead. The ADCmin, ADCslow, DDC and ADCAQP showed no statistical significance. The combination (ADCavg-ADCfast) yielded the largest area under curve (AUC = 0.807) with sensitivity (68.42%), specificity (87.8%) and highest Youden index, indicating that multiparametric combination (ADCavg-ADCfast) was validated to be a useful model in differentiating the benign from breast malignant lesion. CONCLUSION The current study based on the multiple b-value diffusion model demonstrated quantitatively multiparametric combination (ADCavg-ADCfast) exhibited the optimal diagnostic efficacy to differentiate malignant from benign breast lesions, suggesting that multiparameter would be a promising non-invasiveness to diagnose breast lesions.
Collapse
Affiliation(s)
- Chu-Xin Lin
- grid.452930.90000 0004 1757 8087Department of Radiology, Zhuhai Hospital Affiliated With Jinan University (Zhuhai People’s Hospital), 79 Kangning Road, Zhuhai, 519000 People’s Republic of China
| | - Ye Tian
- grid.452930.90000 0004 1757 8087Department of Radiology, Zhuhai Hospital Affiliated With Jinan University (Zhuhai People’s Hospital), 79 Kangning Road, Zhuhai, 519000 People’s Republic of China
| | - Jia-Min Li
- grid.452930.90000 0004 1757 8087Department of Radiology, Zhuhai Hospital Affiliated With Jinan University (Zhuhai People’s Hospital), 79 Kangning Road, Zhuhai, 519000 People’s Republic of China
| | - Shu-Ting Liao
- grid.452930.90000 0004 1757 8087Department of Radiology, Zhuhai Hospital Affiliated With Jinan University (Zhuhai People’s Hospital), 79 Kangning Road, Zhuhai, 519000 People’s Republic of China
| | - Yu-Tao Liu
- grid.452930.90000 0004 1757 8087Department of Radiology, Zhuhai Hospital Affiliated With Jinan University (Zhuhai People’s Hospital), 79 Kangning Road, Zhuhai, 519000 People’s Republic of China
| | - Run-Gen Zhan
- grid.452930.90000 0004 1757 8087Department of Radiology, Zhuhai Hospital Affiliated With Jinan University (Zhuhai People’s Hospital), 79 Kangning Road, Zhuhai, 519000 People’s Republic of China
| | - Zhong-Li Du
- grid.452930.90000 0004 1757 8087Department of Radiology, Zhuhai Hospital Affiliated With Jinan University (Zhuhai People’s Hospital), 79 Kangning Road, Zhuhai, 519000 People’s Republic of China
| | - Xiang-Rong Yu
- grid.452930.90000 0004 1757 8087Department of Radiology, Zhuhai Hospital Affiliated With Jinan University (Zhuhai People’s Hospital), 79 Kangning Road, Zhuhai, 519000 People’s Republic of China
| |
Collapse
|
7
|
A hybrid hemodynamic knowledge-powered and feature reconstruction-guided scheme for breast cancer segmentation based on DCE-MRI. Med Image Anal 2022; 82:102572. [PMID: 36055051 DOI: 10.1016/j.media.2022.102572] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2021] [Revised: 07/08/2022] [Accepted: 08/11/2022] [Indexed: 11/24/2022]
Abstract
Automatically and accurately annotating tumor in dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI), which provides a noninvasive in vivo method to evaluate tumor vasculature architectures based on contrast accumulation and washout, is a crucial step in computer-aided breast cancer diagnosis and treatment. However, it remains challenging due to the varying sizes, shapes, appearances and densities of tumors caused by the high heterogeneity of breast cancer, and the high dimensionality and ill-posed artifacts of DCE-MRI. In this paper, we propose a hybrid hemodynamic knowledge-powered and feature reconstruction-guided scheme that integrates pharmacokinetics prior and feature refinement to generate sufficiently adequate features in DCE-MRI for breast cancer segmentation. The pharmacokinetics prior expressed by time intensity curve (TIC) is incorporated into the scheme through objective function called dynamic contrast-enhanced prior (DCP) loss. It contains contrast agent kinetic heterogeneity prior knowledge, which is important to optimize our model parameters. Besides, we design a spatial fusion module (SFM) embedded in the scheme to exploit intra-slices spatial structural correlations, and deploy a spatial-kinetic fusion module (SKFM) to effectively leverage the complementary information extracted from spatial-kinetic space. Furthermore, considering that low spatial resolution often leads to poor image quality in DCE-MRI, we integrate a reconstruction autoencoder into the scheme to refine feature maps in an unsupervised manner. We conduct extensive experiments to validate the proposed method and show that our approach can outperform recent state-of-the-art segmentation methods on breast cancer DCE-MRI dataset. Moreover, to explore the generalization for other segmentation tasks on dynamic imaging, we also extend the proposed method to brain segmentation in DSC-MRI sequence. Our source code will be released on https://github.com/AI-medical-diagnosis-team-of-JNU/DCEDuDoFNet.
Collapse
|
8
|
Zhang L, Fan M, Wang S, Xu M, Li L. Radiomic Analysis of Pharmacokinetic Heterogeneity Within Tumor Based on the Unsupervised Decomposition of Dynamic Contrast-Enhanced MRI for Predicting Histological Characteristics of Breast Cancer. J Magn Reson Imaging 2021; 55:1636-1647. [PMID: 34773446 DOI: 10.1002/jmri.27993] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2021] [Revised: 10/31/2021] [Accepted: 11/02/2021] [Indexed: 12/24/2022] Open
Abstract
BACKGROUND Breast tumor heterogeneity is associated with histological characteristics. However, pharmacokinetic (PK) heterogeneity within tumor might merit further exploration. PURPOSE To enhance the predictive power of molecular subtypes, Ki-67, and tumor grade by analyzing PK heterogeneity within tumor based on dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI). STUDY TYPE Retrospective. POPULATION Two hundred and eight biopsy-proven breast cancer patients, randomly divided into a training cohort (N = 144) and a testing cohort (N = 64). FIELD STRENGTH/SEQUENCE T1 -weighted DCE-MRI at 3.0 T. ASSESSMENT A convex analysis of mixtures-compartmental modeling decomposition method was used to estimate the PK parameter (i.e., the volume transfer constant Ktrans ) in tumor subregions with distinct physiological kinetic patterns, including fast-flow kinetics, slow-flow kinetics, and plasma input. Radiomic features based on the PK parameter were calculated from each tumor subregion. STATISTICAL TESTS The training cohort was used to build random forest classifiers based on the optimal features determined by the 5-fold cross-validation method. The performance was assessed on the testing cohort using the area under the receiver operating characteristic curve (AUC). The AUCs derived from the tumor subregion-based PK parameter were compared with those of the original images of the entire tumor using the DeLong test. A P-value of <0.05 was considered statistically significant. RESULTS The tumor subregion-based PK parameter, which yielded the highest AUCs of 0.8782, 0.7568, 0.7019, 0.7963, 0.8080, and 0.7375 for luminal A, luminal B, basal-like, human epidermal growth factor receptor 2, Ki-67, and tumor grade, respectively, obtained better diagnostic performance than the original images in the entire tumor (highest AUCs = 0.8612, 0.6191, 0.5593, 0.7704, 0.7494, and 0.6261, respectively). In particular, statistically significant improvement in the diagnostic performance was obtained for luminal B. DATA CONCLUSION Radiomic analysis of PK heterogeneity within tumor can enhance the predictive performance of radiomic models compared with that of the entire tumor. LEVEL OF EVIDENCE 4 TECHNICAL EFFICACY STAGE: 3.
Collapse
Affiliation(s)
- Liangliang Zhang
- School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, China
| | - Ming Fan
- Institute of Biomedical Engineering and Instrumentation, School of Automation, Hangzhou Dianzi University, Hangzhou, China
| | - Shiwei Wang
- Department of Radiology, First Affiliated Hospital of Zhejiang Chinese Medical University, Hangzhou, China
| | - Maosheng Xu
- Department of Radiology, First Affiliated Hospital of Zhejiang Chinese Medical University, Hangzhou, China
| | - Lihua Li
- School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, China.,Institute of Biomedical Engineering and Instrumentation, School of Automation, Hangzhou Dianzi University, Hangzhou, China
| |
Collapse
|
9
|
Pathak P, Jalal AS, Rai R. Breast Cancer Image Classification: A Review. Curr Med Imaging 2020; 17:720-740. [PMID: 33371857 DOI: 10.2174/0929867328666201228125208] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2020] [Revised: 09/23/2020] [Accepted: 10/14/2020] [Indexed: 11/22/2022]
Abstract
BACKGROUND Breast cancer represents uncontrolled breast cell growth. Breast cancer is the most diagnosed cancer in women worldwide. Early detection of breast cancer improves the chances of survival and increases treatment options. There are various methods for screening breast cancer, such as mammogram, ultrasound, computed tomography and Magnetic Resonance Imaging (MRI). MRI is gaining prominence as an alternative screening tool for early detection and breast cancer diagnosis. Nevertheless, MRI can hardly be examined without the use of a Computer-Aided Diagnosis (CAD) framework, due to the vast amount of data. OBJECTIVE This paper aims to cover the approaches used in the CAD system for the detection of breast cancer. METHODS In this paper, the methods used in CAD systems are categories into two classes: the conventional approach and artificial intelligence (AI) approach. RESULTS The conventional approach covers the basic steps of image processing, such as preprocessing, segmentation, feature extraction and classification. The AI approach covers the various convolutional and deep learning networks used for diagnosis. CONCLUSION This review discusses some of the core concepts used in breast cancer and presents a comprehensive review of efforts in the past to address this problem.
Collapse
Affiliation(s)
- Pooja Pathak
- Department of Mathematics, GLA University, Mathura, India
| | - Anand Singh Jalal
- Department of Computer Engineering & Applications, GLA University, Mathura, India
| | - Ritu Rai
- Department of Computer Engineering & Applications, GLA University, Mathura, India
| |
Collapse
|
10
|
Bouchebbah F, Slimani H. Levels Propagation Approach to Image Segmentation: Application to Breast MR Images. J Digit Imaging 2020; 32:433-449. [PMID: 30706211 DOI: 10.1007/s10278-018-00171-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022] Open
Abstract
Accurate segmentation of a breast tumor region is fundamental for treatment. Magnetic resonance imaging (MRI) is a widely used diagnostic tool. In this paper, a new semi-automatic segmentation approach for MRI breast tumor segmentation called Levels Propagation Approach (LPA) is introduced. The introduced segmentation approach takes inspiration from tumor propagation and relies on a finite set of nested and non-overlapped levels. LPA has several features: it is highly suitable to parallelization and offers a simple and dynamic possibility to automate the threshold selection. Furthermore, it allows stopping of the segmentation at any desired limit. Particularly, it allows to avoid to reach the breast skin-line region which is known as a significant issue that reduces the precision and the effectiveness of the breast tumor segmentation. The proposed approach have been tested on two clinical datasets, namely RIDER breast tumor dataset and CMH-LIMED breast tumor dataset. The experimental evaluations have shown that LPA has produced competitive results to some state-of-the-art methods and has acceptable computation complexity.
Collapse
Affiliation(s)
- Fatah Bouchebbah
- LIMED Laboratory, Computer Science Department, University of Bejaia, 06000, Bejaia, Algeria.
| | - Hachem Slimani
- LIMED Laboratory, Computer Science Department, University of Bejaia, 06000, Bejaia, Algeria
| |
Collapse
|
11
|
Feng H, Cao J, Wang H, Xie Y, Yang D, Feng J, Chen B. A knowledge-driven feature learning and integration method for breast cancer diagnosis on multi-sequence MRI. Magn Reson Imaging 2020; 69:40-48. [PMID: 32173583 DOI: 10.1016/j.mri.2020.03.001] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2019] [Revised: 02/12/2020] [Accepted: 03/05/2020] [Indexed: 02/07/2023]
Abstract
BACKGROUND The classification of benign versus malignant breast lesions on multi-sequence Magnetic Resonance Imaging (MRI) is a challenging task since breast lesions are heterogeneous and complex. Recently, deep learning methods have been used for breast lesion diagnosis with raw image input. However, without the guidance of domain knowledge, these data-driven methods cannot ensure that the features extracted from images are comprehensive for breast cancer diagnosis. Specifically, these features are difficult to relate to clinically relevant phenomena. PURPOSE Inspired by the cognition process of radiologists, we propose a Knowledge-driven Feature Learning and Integration (KFLI) framework, to discriminate between benign and malignant breast lesions using Multi-sequences MRI. METHODS Starting from sequence division based on characteristics, we use domain knowledge to guide the feature learning process so that the feature vectors of sub-sequence are constrained to lie in characteristic-related semantic space. Then, different deep networks are designed to extract various sub-sequence features. Furthermore, a weighting module is employed for the integration of the features extracted from different sub-sequence images adaptively. RESULTS The KFLI is a domain knowledge and deep network ensemble, which can extract sufficient and effective features from each sub-sequence for a comprehensive diagnosis of breast cancer. Experiments on 100 MRI studies have demonstrated that the KFLI achieves sensitivity, specificity, and accuracy of 84.6%, 85.7% and 85.0%, respectively, which outperforms other state-of-the-art algorithms.
Collapse
Affiliation(s)
- Hongwei Feng
- Department of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, China
| | - Jiaqi Cao
- Department of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, China
| | - Hongyu Wang
- School of Computer Science and Technology, Xi'an University of Posts and Telecommunications, Xi'an, Shaanxi 710121, China; Shaanxi Key Laboratory of Network Data Analysis and Intelligent Processing, Xi'an University of Posts and Telecommunications, Xi'an, Shaanxi 710121, China.
| | - Yilin Xie
- Department of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, China
| | - Di Yang
- Department of Radiology (& Functional and Molecular Imaging Key Lab) of Shaanxi Province, Tangdu Hospital, Fourth Military Medical University, Xi'an, Shaanxi 710038, China
| | - Jun Feng
- Department of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, China
| | - Baoying Chen
- Imaging Diagnosis and Treatment Center, Xi'an International Medical Center Hospital, Xi'an, 710100, P.R. China.
| |
Collapse
|
12
|
Application and Analysis of Biomedical Imaging Technology in Early Diagnosis of Breast Cancer. Methods Mol Biol 2020; 2204:63-73. [PMID: 32710315 DOI: 10.1007/978-1-0716-0904-0_6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Breast cancer is the primary malignant tumor that endangers women's health. The incidence of breast cancer is increasing rapidly in recent years. Accurate disease evaluation before treatment is the key to the selection of treatment options. Biomedical imaging technology plays an irreplaceable role in the diagnosis and staging of tumors. Various imaging methods can provide excellent temporal and spatial resolution from multiple levels and perspectives and have become one of the most commonly used means of breast cancer early detection. With the development of radiomics, it has been found that early imaging diagnosis of breast cancer plays an important guiding role in clinical decision-making. The purpose of this study is to explore the characteristics of various breast cancer imaging technologies, promote the development of individualized accurate diagnosis and treatment of imaging, and improve the clinical application value of radiomics in the early diagnosis of breast cancer.
Collapse
|
13
|
Automated Breast Cancer Diagnosis Based on Machine Learning Algorithms. JOURNAL OF HEALTHCARE ENGINEERING 2019; 2019:4253641. [PMID: 31814951 PMCID: PMC6878785 DOI: 10.1155/2019/4253641] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/24/2019] [Revised: 08/19/2019] [Accepted: 09/17/2019] [Indexed: 12/21/2022]
Abstract
There have been several empirical studies addressing breast cancer using machine learning and soft computing techniques. Many claim that their algorithms are faster, easier, or more accurate than others are. This study is based on genetic programming and machine learning algorithms that aim to construct a system to accurately differentiate between benign and malignant breast tumors. The aim of this study was to optimize the learning algorithm. In this context, we applied the genetic programming technique to select the best features and perfect parameter values of the machine learning classifiers. The performance of the proposed method was based on sensitivity, specificity, precision, accuracy, and the roc curves. The present study proves that genetic programming can automatically find the best model by combining feature preprocessing methods and classifier algorithms.
Collapse
|
14
|
Molecular Subtypes Recognition of Breast Cancer in Dynamic Contrast-Enhanced Breast Magnetic Resonance Imaging Phenotypes from Radiomics Data. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2019; 2019:6978650. [PMID: 31827586 PMCID: PMC6885255 DOI: 10.1155/2019/6978650] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/09/2019] [Accepted: 10/10/2019] [Indexed: 12/28/2022]
Abstract
Background and Objective Breast cancer is a major cause of mortality among women if not treated in early stages. Recognizing molecular markers from DCE-MRI directly to distinguish the four molecular subtypes without invasive biopsy is helpful for guiding treatment plans for breast cancer, which provides a fast way to consequential treatment plan decision in early time and best opportunity for patients. Methods This study presents an approach of molecular subtypes recognition from breast cancer image phenotypes by radiomics. An improved region growth algorithm with dynamic threshold without user interaction is proposed for cancer lesion segmentation, which gives the precise border of lesion other than area with background. The lesions are extracted automatically based on radiologists' annotation which guarantees the lesion is segmented correctly. Various features are extracted on lesions data including texture, morphology, dynamic kinetics, and statistics features carried out on a large patient cohort, which are used to validate the relationship between image phenotypes and the molecular subtypes. A new algorithm of multimodel-based recursive feature elimination is applied on the radiomics data generated by the feature extraction process. This method obtains the feature subset with stable performance for different classification models, and the gradient boosting decision tree model gets the best results of both classification performance and imbalance performance on molecular subtypes. Result From the experimental results, 69 optimal features from 143 original features are found by the multimodel-based recursive feature elimination algorithms and the gradient boosting decision tree classifier obtains a good performance with accuracy 0.87, precise 0.88, recall 0.87, and F1-score 0.87. The dataset with 637 patients in this paper has serious imbalance problem on different molecular subtypes, and the the robust features that are generated by multimodel-based recursive feature eliminiation algorithm make the gradient boosting decision tree classifier have good behaviors. The recognition precision for the four molecular subtypes of luminal A, luminal B, HER-2, and basal-like are 0.91, 0.89, 0.83, and 0.87, respectively. Conclusions The improved lesion segmentation method gives more precise lesion edge, which not only saves the time of automatic extraction of lesion region of interest without threshold setting for each case, but also prevents the segmentation error by manual and prejudice from different radiologists. The feature selection algorithm of multimodel-based recursive feature elimination has the ability to find robust and optimal features that distinguish the four molecular subtypes from image phenotypes. The gradient boosting decision tree classifier rather plays a main role in recognition than other models used in this paper.
Collapse
|
15
|
Qiu X, Wang H, Wang Z, Fu Y, Yin J. Expression of PCNA, Ki-67 and COX-2 in breast cancer based on DCE-MRI image information. J Infect Public Health 2019; 13:2032-2037. [PMID: 31289003 DOI: 10.1016/j.jiph.2019.06.024] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2019] [Revised: 06/19/2019] [Accepted: 06/21/2019] [Indexed: 12/14/2022] Open
Abstract
In order to explore the application value of DCE-MRI in clinical diagnosis and treatment, guide early clinical diagnosis, evaluate prognosis, guide clinical selection of treatment options and improve medical level, the expression of adenocarcinoma, its relationship with clinicopathology, and the significance of co-expression of the proliferating cell nuclear antigen (PCNA), Ki67 protein and cyclooxygenase 2 (COX-2) in breast cancer are analyzed. The results show that the positive expression rates of ki67, PCNA, and COX-2 in breast cancer patients are significantly higher than those in breast cancer patients (P<0.05). Positive expressions of ki67, PCNA, and COX-2 in breast cancer patients are not correlated with age, tumor size and clinical stage (P>0.05). There is no significant difference (P>0.05) between the pathological types of breast cancer and positive expressions of ki67, PCNA and COX-2 in all the samples studied. Therefore, there is a correlation between DCE-MRI imaging features and prognostic indicators in breast cancer.
Collapse
Affiliation(s)
- Xiaoming Qiu
- Department of Radiology, Huangshi Central Hospital, Affiliated Hospital of Hubei Polytechnic University, Edong Healthcare Group, Huangshi City 435000, China
| | - Hong Wang
- Department of Radiology, Huangshi Central Hospital, Affiliated Hospital of Hubei Polytechnic University, Edong Healthcare Group, Huangshi City 435000, China
| | - Zhen Wang
- Department of Radiology, Huangshi Central Hospital, Affiliated Hospital of Hubei Polytechnic University, Edong Healthcare Group, Huangshi City 435000, China
| | - Yufei Fu
- Department of Radiology, Huangshi Central Hospital, Affiliated Hospital of Hubei Polytechnic University, Edong Healthcare Group, Huangshi City 435000, China
| | - Jianjun Yin
- Department of Radiology, Huangshi Central Hospital, Affiliated Hospital of Hubei Polytechnic University, Edong Healthcare Group, Huangshi City 435000, China.
| |
Collapse
|
16
|
Rundo L, Tangherloni A, Cazzaniga P, Nobile MS, Russo G, Gilardi MC, Vitabile S, Mauri G, Besozzi D, Militello C. A novel framework for MR image segmentation and quantification by using MedGA. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2019; 176:159-172. [PMID: 31200903 DOI: 10.1016/j.cmpb.2019.04.016] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/06/2018] [Revised: 04/14/2019] [Accepted: 04/16/2019] [Indexed: 06/09/2023]
Abstract
BACKGROUND AND OBJECTIVES Image segmentation represents one of the most challenging issues in medical image analysis to distinguish among different adjacent tissues in a body part. In this context, appropriate image pre-processing tools can improve the result accuracy achieved by computer-assisted segmentation methods. Taking into consideration images with a bimodal intensity distribution, image binarization can be used to classify the input pictorial data into two classes, given a threshold intensity value. Unfortunately, adaptive thresholding techniques for two-class segmentation work properly only for images characterized by bimodal histograms. We aim at overcoming these limitations and automatically determining a suitable optimal threshold for bimodal Magnetic Resonance (MR) images, by designing an intelligent image analysis framework tailored to effectively assist the physicians during their decision-making tasks. METHODS In this work, we present a novel evolutionary framework for image enhancement, automatic global thresholding, and segmentation, which is here applied to different clinical scenarios involving bimodal MR image analysis: (i) uterine fibroid segmentation in MR guided Focused Ultrasound Surgery, and (ii) brain metastatic cancer segmentation in neuro-radiosurgery therapy. Our framework exploits MedGA as a pre-processing stage. MedGA is an image enhancement method based on Genetic Algorithms that improves the threshold selection, obtained by the efficient Iterative Optimal Threshold Selection algorithm, between the underlying sub-distributions in a nearly bimodal histogram. RESULTS The results achieved by the proposed evolutionary framework were quantitatively evaluated, showing that the use of MedGA as a pre-processing stage outperforms the conventional image enhancement methods (i.e., histogram equalization, bi-histogram equalization, Gamma transformation, and sigmoid transformation), in terms of both MR image enhancement and segmentation evaluation metrics. CONCLUSIONS Thanks to this framework, MR image segmentation accuracy is considerably increased, allowing for measurement repeatability in clinical workflows. The proposed computational solution could be well-suited for other clinical contexts requiring MR image analysis and segmentation, aiming at providing useful insights for differential diagnosis and prognosis.
Collapse
Affiliation(s)
- Leonardo Rundo
- Department of Informatics, Systems and Communication, University of Milano-Bicocca, Milan, Italy; Institute of Molecular Bioimaging and Physiology, Italian National Research Council, Cefalù, PA, Italy; Department of Radiology, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Centre, Cambridge, UK.
| | - Andrea Tangherloni
- Department of Informatics, Systems and Communication, University of Milano-Bicocca, Milan, Italy; Department of Haematology, University of Cambridge, Cambridge, UK; Wellcome Trust Sanger Institute, Wellcome Trust Genome Campus, Hinxton, UK.
| | - Paolo Cazzaniga
- Department of Human and Social Sciences, University of Bergamo, Bergamo, Italy; SYSBIO.IT Centre of Systems Biology, Milan, Italy.
| | - Marco S Nobile
- Department of Informatics, Systems and Communication, University of Milano-Bicocca, Milan, Italy; SYSBIO.IT Centre of Systems Biology, Milan, Italy.
| | - Giorgio Russo
- Institute of Molecular Bioimaging and Physiology, Italian National Research Council, Cefalù, PA, Italy.
| | - Maria Carla Gilardi
- Institute of Molecular Bioimaging and Physiology, Italian National Research Council, Cefalù, PA, Italy.
| | - Salvatore Vitabile
- Department of Biomedicine, Neuroscience and Advanced Diagnostics, University of Palermo, Palermo, Italy.
| | - Giancarlo Mauri
- Department of Informatics, Systems and Communication, University of Milano-Bicocca, Milan, Italy; SYSBIO.IT Centre of Systems Biology, Milan, Italy.
| | - Daniela Besozzi
- Department of Informatics, Systems and Communication, University of Milano-Bicocca, Milan, Italy.
| | - Carmelo Militello
- Institute of Molecular Bioimaging and Physiology, Italian National Research Council, Cefalù, PA, Italy.
| |
Collapse
|
17
|
Yu Q, Huang K, Zhu Y, Chen X, Meng W. Preliminary results of computer-aided diagnosis for magnetic resonance imaging of solid breast lesions. Breast Cancer Res Treat 2019; 177:419-426. [PMID: 31203487 DOI: 10.1007/s10549-019-05297-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2019] [Accepted: 05/25/2019] [Indexed: 11/26/2022]
Abstract
PURPOSE The present study aimed to determine suitable optimal classifiers and investigate the general applicability of computer-aided diagnosis (CAD) to compare magnetic resonance (MR)-CAD with MR imaging (MRI) in distinguishing benign from malignant solid breast masses. METHODS We analyzed a total of 251 patients (mean age: 44.8 ± 12.3 years; range: 21-81 years) with 274 breast masses (154 benign masses, 120 malignant masses) using a Gaussian mixture model and a random forest machine model for segmentation and classification. RESULTS The diagnostic performance of MRI alone and MRI plus CAD were compared with respect to sensitivity, specificity, and area under the curve (AUC), using receiver operating characteristic curve analysis. The discriminating power to detect malignancy using MR-CAD with an AUC of 0.955 (sensitivity was 95.8% and the specificity was 92.9%) was significantly higher than that of MRI alone with an AUC of 0.785 (sensitivity was 71.7% and the specificity was 85.7%). CONCLUSION CAD is feasible to differentiate breast lesions, and it can complement MRI, thereby making it easier to diagnose breast lesions and obviating the need for unnecessary biopsies.
Collapse
Affiliation(s)
- Qiujie Yu
- Radiology Department, Harbin Medical University, The Third Affiliated Hospital of Harbin Medical University, 150 Haping Road, Harbin, 150081, Heilongjiang, China
| | - Kuan Huang
- Department of Computer Science, Utah State University, Old Main Hill, Logan, Utah, 84322, USA
| | - Ye Zhu
- Department of Obstetrics and Gynecology, Peking University People's Hospital, No.11 Xizhimen South Street, Xicheng District, Beijing, 100044, China
| | - Xiaodan Chen
- Department of Computer Technology, Harbin Institute of Technology University, 92 West street, Harbin, 150000, Heilongjiang, China
| | - Wei Meng
- Radiology Department, Harbin Medical University, The Third Affiliated Hospital of Harbin Medical University, 150 Haping Road, Harbin, 150081, Heilongjiang, China.
| |
Collapse
|
18
|
da Silva Neto OP, Araújo JDL, Caldas Oliveira AG, Cutrim M, Silva AC, Paiva AC, Gattass M. Pathophysiological mapping of tumor habitats in the breast in DCE-MRI using molecular texture descriptor. Comput Biol Med 2019; 106:114-125. [PMID: 30711799 DOI: 10.1016/j.compbiomed.2019.01.017] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2018] [Revised: 01/16/2019] [Accepted: 01/19/2019] [Indexed: 11/25/2022]
Abstract
BACKGROUND We propose a computational methodology capable of detecting and analyzing breast tumor habitats in images acquired by magnetic resonance imaging with dynamic contrast enhancement (DCE-MRI), based on the pathophysiological behavior of the contrast agent (CA). METHODS The proposed methodology comprises three steps. In summary, the first step is the acquisition of images from the Quantitative Imaging Network Breast. In the second step, the segmentation of the breasts is performed to remove the background, noise, and other unwanted objects from the image. In the third step, the generation of habitats is performed by applying two techniques: the molecular texture descriptor (MTD) that highlights the CA regions in the breast, and pathophysiological texture mapping (MPT), which generates tumor habitats based on the behavior of the CA. The combined use of these two techniques allows the automatic detection of tumors in the breast and analysis of each separate habitat with respect to their malignancy type. RESULTS The results found in this study were promising, with 100% of breast tumors being identified. The segmentation results exhibited an accuracy of 99.95%, sensitivity of 71.07%, specificity of 99.98%, and volumetric similarity of 77.75%. Moreover, we were able to classify the malignancy of the tumors, with 6 classified as malignant type III (WashOut) and 14 as malignant type II (Plateau), for a total of 20 cases. CONCLUSION We proposed a method for the automatic detection of tumors in the breast in DCE-MRI and performed the pathophysiological mapping of tumor habitats by analyzing the behavior of the CA, combining MTD and MPT, which allowed the mapping of internal tumor habitats.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Marcelo Gattass
- Pontifical Catholic University of Rio de Janeiro, Rio de Janeiro, Brazil.
| |
Collapse
|