1
|
Wang M, Liu Z, Ma L. Application of artificial intelligence in ultrasound imaging for predicting lymph node metastasis in breast cancer: A meta-analysis. Clin Imaging 2024; 106:110048. [PMID: 38065024 DOI: 10.1016/j.clinimag.2023.110048] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 11/22/2023] [Accepted: 11/27/2023] [Indexed: 01/15/2024]
Abstract
BACKGROUND This study aims to comprehensively evaluate the accuracy and effectiveness of ultrasound imaging based on artificial intelligence algorithms in predicting lymph node metastasis in breast cancer patients through a meta-analysis. METHODS We systematically searched PubMed, Embase, and Cochrane Library for literature published up to May 2023. The search terms included artificial intelligence, ultrasound, breast cancer, and lymph node. Studies meeting the inclusion criteria were selected, and data were extracted for analysis. The main evaluation indicators included sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, and area under the curve (AUC). The heterogeneity was assessed using the Cochrane Q test combined with the I^2 statistic expressing the percentage of total effect variation that can be attributed to the effect variation between studies, as recommended by the Cochrane Handbook for heterogeneity quantification. A threshold p-value of 0.10 was considered to compensate for the low power of the Q test. Sensitivity analysis was performed to assess the stability of individual studies, and publication bias was determined with funnel plots. Additionally, fagan plots were used to assess clinical utility. RESULTS Ten studies involving 4726 breast cancer patients were included in the meta-analysis. The results showed that ultrasound imaging based on artificial intelligence algorithms had high accuracy and effectiveness in predicting lymph node metastasis in breast cancer patients. The pooled sensitivity was 0.88 (95% CI: 0.81-0.93; P < 0.001; I2 = 84.68), specificity was 0.75 (95% CI: 0.66-0.83; P < 0.001; I2 = 91.11), and AUC was 0.89 (95% CI: 0.86-0.91). The positive likelihood ratio was 3.5 (95% CI: 2.6-4.8), negative likelihood ratio was 0.16 (95% CI: 0.10-0.26), and diagnostic odds ratio was 23 (95% CI: 13-40). However, the combined sensitivity of ultrasound imaging based on non-AI algorithms for predicting lymph node metastasis in breast cancer patients was 0.78 (95%CI: 0.63-0.88), the specificity was 0.76 (95%CI: 0.63-0.86), and the AUC was 0.84 (95%CI: 0.80-0.87). The positive likelihood ratio was 3.3 (95% CI: 1.9-5.6), the negative likelihood ratio was 0.29 (95% CI: 0.15-0.54), and the diagnostic odds ratio was 11 (95% CI: 4-33). Due to limited sample size (n = 2), meta-analysis was not conducted for the outcome of predicting lymph node metastasis burden. CONCLUSION Ultrasound imaging based on artificial intelligence algorithms holds promise in predicting lymph node metastasis in breast cancer patients, demonstrating high accuracy and effectiveness. The application of this technology helps in the diagnosis and treatment decisions for breast cancer patients and is expected to become an important tool in future clinical practice.
Collapse
Affiliation(s)
- Minghui Wang
- Department of Breast Surgery, Affiliate Hospital of Chengde Medical University, Hebei 067000, China
| | - Zihui Liu
- Department of Pathology, Affiliate Hospital of Chengde Medical University, Hebei 067000, China
| | - Lihui Ma
- Department of Breast Surgery, Affiliate Hospital of Chengde Medical University, Hebei 067000, China.
| |
Collapse
|
2
|
Hossain S, Azam S, Montaha S, Karim A, Chowa SS, Mondol C, Zahid Hasan M, Jonkman M. Automated breast tumor ultrasound image segmentation with hybrid UNet and classification using fine-tuned CNN model. Heliyon 2023; 9:e21369. [PMID: 37885728 PMCID: PMC10598544 DOI: 10.1016/j.heliyon.2023.e21369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 10/11/2023] [Accepted: 10/20/2023] [Indexed: 10/28/2023] Open
Abstract
Introduction Breast cancer stands as the second most deadly form of cancer among women worldwide. Early diagnosis and treatment can significantly mitigate mortality rates. Purpose The study aims to classify breast ultrasound images into benign and malignant tumors. This approach involves segmenting the breast's region of interest (ROI) employing an optimized UNet architecture and classifying the ROIs through an optimized shallow CNN model utilizing an ablation study. Method Several image processing techniques are utilized to improve image quality by removing text, artifacts, and speckle noise, and statistical analysis is done to check the enhanced image quality is satisfactory. With the processed dataset, the segmentation of breast tumor ROI is carried out, optimizing the UNet model through an ablation study where the architectural configuration and hyperparameters are altered. After obtaining the tumor ROIs from the fine-tuned UNet model (RKO-UNet), an optimized CNN model is employed to classify the tumor into benign and malignant classes. To enhance the CNN model's performance, an ablation study is conducted, coupled with the integration of an attention unit. The model's performance is further assessed by classifying breast cancer with mammogram images. Result The proposed classification model (RKONet-13) results in an accuracy of 98.41 %. The performance of the proposed model is further compared with five transfer learning models for both pre-segmented and post-segmented datasets. K-fold cross-validation is done to assess the proposed RKONet-13 model's performance stability. Furthermore, the performance of the proposed model is compared with previous literature, where the proposed model outperforms existing methods, demonstrating its effectiveness in breast cancer diagnosis. Lastly, the model demonstrates its robustness for breast cancer classification, delivering an exceptional performance of 96.21 % on a mammogram dataset. Conclusion The efficacy of this study relies on image pre-processing, segmentation with hybrid attention UNet, and classification with fine-tuned robust CNN model. This comprehensive approach aims to determine an effective technique for detecting breast cancer within ultrasound images.
Collapse
Affiliation(s)
- Shahed Hossain
- Health Informatics Research Laboratory (HIRL), Department of Computer Science and Engineering, Daffodil International University, Dhaka, 1341, Bangladesh
| | - Sami Azam
- Faculty of Science and Technology, Charles Darwin University, Casuarina, 0909, NT, Australia
| | - Sidratul Montaha
- Department of Computer Science, University of Calgary, Calgary, AB, T2N 1N4, Canada
| | - Asif Karim
- Faculty of Science and Technology, Charles Darwin University, Casuarina, 0909, NT, Australia
| | - Sadia Sultana Chowa
- Health Informatics Research Laboratory (HIRL), Department of Computer Science and Engineering, Daffodil International University, Dhaka, 1341, Bangladesh
| | - Chaity Mondol
- Health Informatics Research Laboratory (HIRL), Department of Computer Science and Engineering, Daffodil International University, Dhaka, 1341, Bangladesh
| | - Md Zahid Hasan
- Health Informatics Research Laboratory (HIRL), Department of Computer Science and Engineering, Daffodil International University, Dhaka, 1341, Bangladesh
| | - Mirjam Jonkman
- Faculty of Science and Technology, Charles Darwin University, Casuarina, 0909, NT, Australia
| |
Collapse
|
3
|
Zhang H, Meng Z, Ru J, Meng Y, Wang K. Application and prospects of AI-based radiomics in ultrasound diagnosis. Vis Comput Ind Biomed Art 2023; 6:20. [PMID: 37828411 PMCID: PMC10570254 DOI: 10.1186/s42492-023-00147-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Accepted: 09/20/2023] [Indexed: 10/14/2023] Open
Abstract
Artificial intelligence (AI)-based radiomics has attracted considerable research attention in the field of medical imaging, including ultrasound diagnosis. Ultrasound imaging has unique advantages such as high temporal resolution, low cost, and no radiation exposure. This renders it a preferred imaging modality for several clinical scenarios. This review includes a detailed introduction to imaging modalities, including Brightness-mode ultrasound, color Doppler flow imaging, ultrasound elastography, contrast-enhanced ultrasound, and multi-modal fusion analysis. It provides an overview of the current status and prospects of AI-based radiomics in ultrasound diagnosis, highlighting the application of AI-based radiomics to static ultrasound images, dynamic ultrasound videos, and multi-modal ultrasound fusion analysis.
Collapse
Affiliation(s)
- Haoyan Zhang
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100190, China
| | - Zheling Meng
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100190, China
| | - Jinyu Ru
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100190, China
| | - Yaqing Meng
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100190, China
| | - Kun Wang
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China.
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100190, China.
| |
Collapse
|
4
|
You C, Shen Y, Sun S, Zhou J, Li J, Su G, Michalopoulou E, Peng W, Gu Y, Guo W, Cao H. Artificial intelligence in breast imaging: Current situation and clinical challenges. EXPLORATION (BEIJING, CHINA) 2023; 3:20230007. [PMID: 37933287 PMCID: PMC10582610 DOI: 10.1002/exp.20230007] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Accepted: 04/30/2023] [Indexed: 11/08/2023]
Abstract
Breast cancer ranks among the most prevalent malignant tumours and is the primary contributor to cancer-related deaths in women. Breast imaging is essential for screening, diagnosis, and therapeutic surveillance. With the increasing demand for precision medicine, the heterogeneous nature of breast cancer makes it necessary to deeply mine and rationally utilize the tremendous amount of breast imaging information. With the rapid advancement of computer science, artificial intelligence (AI) has been noted to have great advantages in processing and mining of image information. Therefore, a growing number of scholars have started to focus on and research the utility of AI in breast imaging. Here, an overview of breast imaging databases and recent advances in AI research are provided, the challenges and problems in this field are discussed, and then constructive advice is further provided for ongoing scientific developments from the perspective of the National Natural Science Foundation of China.
Collapse
Affiliation(s)
- Chao You
- Department of RadiologyFudan University Shanghai Cancer CenterShanghaiChina
- Department of OncologyShanghai Medical CollegeFudan UniversityShanghaiChina
| | - Yiyuan Shen
- Department of RadiologyFudan University Shanghai Cancer CenterShanghaiChina
- Department of OncologyShanghai Medical CollegeFudan UniversityShanghaiChina
| | - Shiyun Sun
- Department of RadiologyFudan University Shanghai Cancer CenterShanghaiChina
- Department of OncologyShanghai Medical CollegeFudan UniversityShanghaiChina
| | - Jiayin Zhou
- Department of RadiologyFudan University Shanghai Cancer CenterShanghaiChina
- Department of OncologyShanghai Medical CollegeFudan UniversityShanghaiChina
| | - Jiawei Li
- Department of RadiologyFudan University Shanghai Cancer CenterShanghaiChina
- Department of OncologyShanghai Medical CollegeFudan UniversityShanghaiChina
| | - Guanhua Su
- Department of OncologyShanghai Medical CollegeFudan UniversityShanghaiChina
- Department of Breast SurgeryKey Laboratory of Breast Cancer in ShanghaiFudan University Shanghai Cancer CenterShanghaiChina
| | | | - Weijun Peng
- Department of RadiologyFudan University Shanghai Cancer CenterShanghaiChina
- Department of OncologyShanghai Medical CollegeFudan UniversityShanghaiChina
| | - Yajia Gu
- Department of RadiologyFudan University Shanghai Cancer CenterShanghaiChina
- Department of OncologyShanghai Medical CollegeFudan UniversityShanghaiChina
| | - Weisheng Guo
- Department of Minimally Invasive Interventional RadiologyKey Laboratory of Molecular Target and Clinical PharmacologySchool of Pharmaceutical Sciences and The Second Affiliated HospitalGuangzhou Medical UniversityGuangzhouChina
| | - Heqi Cao
- Department of Health SciencesNational Natural Science Foundation of ChinaBeijingChina
| |
Collapse
|
5
|
Zhang XY, Wei Q, Wu GG, Tang Q, Pan XF, Chen GQ, Zhang D, Dietrich CF, Cui XW. Artificial intelligence - based ultrasound elastography for disease evaluation - a narrative review. Front Oncol 2023; 13:1197447. [PMID: 37333814 PMCID: PMC10272784 DOI: 10.3389/fonc.2023.1197447] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Accepted: 05/22/2023] [Indexed: 06/20/2023] Open
Abstract
Ultrasound elastography (USE) provides complementary information of tissue stiffness and elasticity to conventional ultrasound imaging. It is noninvasive and free of radiation, and has become a valuable tool to improve diagnostic performance with conventional ultrasound imaging. However, the diagnostic accuracy will be reduced due to high operator-dependence and intra- and inter-observer variability in visual observations of radiologists. Artificial intelligence (AI) has great potential to perform automatic medical image analysis tasks to provide a more objective, accurate and intelligent diagnosis. More recently, the enhanced diagnostic performance of AI applied to USE have been demonstrated for various disease evaluations. This review provides an overview of the basic concepts of USE and AI techniques for clinical radiologists and then introduces the applications of AI in USE imaging that focus on the following anatomical sites: liver, breast, thyroid and other organs for lesion detection and segmentation, machine learning (ML) - assisted classification and prognosis prediction. In addition, the existing challenges and future trends of AI in USE are also discussed.
Collapse
Affiliation(s)
- Xian-Ya Zhang
- Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Qi Wei
- Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Ge-Ge Wu
- Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Qi Tang
- Department of Ultrasonography, The First Hospital of Changsha, Changsha, China
| | - Xiao-Fang Pan
- Health Medical Department, Dalian Municipal Central Hospital, Dalian, China
| | - Gong-Quan Chen
- Department of Medical Ultrasound, Minda Hospital of Hubei Minzu University, Enshi, China
| | - Di Zhang
- Department of Medical Ultrasound, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | | | - Xin-Wu Cui
- Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| |
Collapse
|
6
|
Trepanier C, Huang A, Liu M, Ha R. Emerging uses of artificial intelligence in breast and axillary ultrasound. Clin Imaging 2023; 100:64-68. [PMID: 37243994 DOI: 10.1016/j.clinimag.2023.05.007] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Accepted: 05/02/2023] [Indexed: 05/29/2023]
Abstract
Breast ultrasound is a valuable adjunctive tool to mammography in detecting breast cancer, especially in women with dense breasts. Ultrasound also plays an important role in staging breast cancer by assessing axillary lymph nodes. However, its utility is limited by operator dependence, high recall rate, low positive predictive value and low specificity. These limitations present an opportunity for artificial intelligence (AI) to improve diagnostic performance and pioneer novel uses of ultrasound. Research in developing AI for radiology has flourished over the past few years. A subset of AI, deep learning, uses interconnected computational nodes to form a neural network, which extracts complex visual features from image data to train itself into a predictive model. This review summarizes several key studies evaluating AI programs' performance in predicting breast cancer and demonstrates that AI can assist radiologists and address limitations of ultrasound by acting as a decision support tool. This review also touches on how AI programs allow for novel predictive uses of ultrasound, particularly predicting molecular subtypes of breast cancer and response to neoadjuvant chemotherapy, which have the potential to change how breast cancer is managed by providing non-invasive prognostic and treatment data from ultrasound images. Lastly, this review explores how AI programs demonstrate improved diagnostic accuracy in predicting axillary lymph node metastasis. The limitations and future challenges in developing and implementing AI for breast and axillary ultrasound will also be discussed.
Collapse
Affiliation(s)
- Christopher Trepanier
- Columbia University Irving Medical Center, 622 W 168th St, New York, NY 10032, United States of America.
| | - Alice Huang
- Columbia University Irving Medical Center, 622 W 168th St, New York, NY 10032, United States of America.
| | - Michael Liu
- Columbia University Irving Medical Center, 622 W 168th St, New York, NY 10032, United States of America.
| | - Richard Ha
- Columbia University Irving Medical Center, 622 W 168th St, New York, NY 10032, United States of America.
| |
Collapse
|
7
|
Alhussan AA, Eid MM, Towfek SK, Khafaga DS. Breast Cancer Classification Depends on the Dynamic Dipper Throated Optimization Algorithm. Biomimetics (Basel) 2023; 8:163. [PMID: 37092415 PMCID: PMC10123690 DOI: 10.3390/biomimetics8020163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 04/12/2023] [Accepted: 04/14/2023] [Indexed: 04/25/2023] Open
Abstract
According to the American Cancer Society, breast cancer is the second largest cause of mortality among women after lung cancer. Women's death rates can be decreased if breast cancer is diagnosed and treated early. Due to the lengthy duration of manual breast cancer diagnosis, an automated approach is necessary for early cancer identification. This research proposes a novel framework integrating metaheuristic optimization with deep learning and feature selection for robustly classifying breast cancer from ultrasound images. The structure of the proposed methodology consists of five stages, namely, data augmentation to improve the learning of convolutional neural network (CNN) models, transfer learning using GoogleNet deep network for feature extraction, selection of the best set of features using a novel optimization algorithm based on a hybrid of dipper throated and particle swarm optimization algorithms, and classification of the selected features using CNN optimized using the proposed optimization algorithm. To prove the effectiveness of the proposed approach, a set of experiments were conducted on a breast cancer dataset, freely available on Kaggle, to evaluate the performance of the proposed feature selection method and the performance of the optimized CNN. In addition, statistical tests were established to study the stability and difference of the proposed approach compared to state-of-the-art approaches. The achieved results confirmed the superiority of the proposed approach with a classification accuracy of 98.1%, which is better than the other approaches considered in the conducted experiments.
Collapse
Affiliation(s)
- Amel Ali Alhussan
- Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
| | - Marwa M. Eid
- Faculty of Artificial Intelligence, Delta University for Science and Technology, Mansoura 35712, Egypt
| | - S. K. Towfek
- Delta Higher Institute for Engineering and Technology, Mansoura 35111, Egypt
- Computer Science and Intelligent Systems Research Center, Blacksburg, VA 24060, USA
| | - Doaa Sami Khafaga
- Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
| |
Collapse
|
8
|
Liu J, Yoon H, Emelianov SY. Noninvasive ultrasound assessment of tissue internal pressure using dual mode elasticity imaging: a phantom study. Phys Med Biol 2022; 68. [PMID: 36562591 DOI: 10.1088/1361-6560/aca9b8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Accepted: 12/07/2022] [Indexed: 12/12/2022]
Abstract
Objective.Tissue internal pressure, such as interstitial fluid pressure in solid tumors and intramuscular pressure in compartment syndrome, is closely related to the pathological state of tissues. It is of great diagnostic value to measure and/or monitor the internal pressure of targeted tissues. Because most of the current methods for measuring tissue pressure are invasive, noninvasive methods are highly desired. In this study, we developed a noninvasive method for qualitative assessment of tissue internal pressure based on a combination of two ultrasound elasticity imaging methods: strain imaging and shear wave elasticity imaging.Approach.The method was verified through experimental investigation using two tissue-mimicking phantoms each having an inclusion confined by a membrane, in which hydrostatic pressures can be applied and maintained. To examine the sensitivity of the elasticity imaging methods to pressure variation, strain ratio and shear modulus ratio (SMR) between the inclusion and background of phantom were obtained.Main results.The results first experimentally prove that pressure, in addition to elasticity, is a contrast mechanism of strain imaging, and further demonstrate that a comparative analysis of strain ratio and SMR is an effective method for noninvasive tissue internal pressure detection.Significance.This work provides a new perspective in interpreting the strain ratio data in medical diagnosis, and it also provides a noninvasive alternative for assessing tissue internal pressure, which could be valuable for the diagnosis of pressure-related diseases.
Collapse
Affiliation(s)
- Jingfei Liu
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30322, United States of America
| | - Heechul Yoon
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30322, United States of America.,School of Electronics and Electrical Engineering, Dankook University, Yongin-si 16890, Republic of Korea
| | - Stanislav Y Emelianov
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30322, United States of America.,Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University School of Medicine, Atlanta, GA 30322 United States of America
| |
Collapse
|
9
|
Feng H, Tang Q, Yu Z, Tang H, Yin M, Wei A. A Machine Learning Applied Diagnosis Method for Subcutaneous Cyst by Ultrasonography. OXIDATIVE MEDICINE AND CELLULAR LONGEVITY 2022; 2022:1526540. [PMID: 36299601 PMCID: PMC9592196 DOI: 10.1155/2022/1526540] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Revised: 09/19/2022] [Accepted: 09/28/2022] [Indexed: 11/18/2022]
Abstract
For decades, ultrasound images have been widely used in the detection of various diseases due to their high security and efficiency. However, reading ultrasound images requires years of experience and training. In order to support the diagnosis of clinicians and reduce the workload of doctors, many ultrasonic computer aided diagnostic systems have been proposed. In recent years, the success of deep learning in image classification and segmentation has made more and more scholars realize the potential performance improvement brought by the application of deep learning in ultrasonic computer-aided diagnosis systems. This study is aimed at applying several machine learning algorithms and develop a machine learning method to diagnose subcutaneous cyst. Clinical features are extracted from datasets and images of ultrasonography of 132 patients from Hunan Provincial People's Hospital in China. All datasets are separated into 70% training and 30% testing. Four kinds of machine learning algorithms including decision tree (DT), support vector machine (SVM), K-nearest neighbors (KNN), and neural networks (NN) had been approached to determine the best performance. Compared with all the results from each feature, SVM achieved the best performance from 91.7% to 100%. Results show that SVM performed the highest accuracy in the diagnosis of subcutaneous cyst by ultrasonography, which provide a good reference in further application to clinical practice of ultrasonography of subcutaneous cyst.
Collapse
Affiliation(s)
- Hao Feng
- Department of Dermatology, Hunan Provincial People's Hospital (The First Affiliated Hospital of Hunan Normal University), Changsha 410005, China
| | - Qian Tang
- Department of Dermatology, Hunan Provincial People's Hospital (The First Affiliated Hospital of Hunan Normal University), Changsha 410005, China
| | - Zhengyu Yu
- Faculty of Engineering and IT, University of Technology, Sydney, Sydney, NSW 2007, Australia
| | - Hua Tang
- Department of Dermatology, Hunan Provincial People's Hospital (The First Affiliated Hospital of Hunan Normal University), Changsha 410005, China
| | - Ming Yin
- Department of Dermatology, Hunan Provincial People's Hospital (The First Affiliated Hospital of Hunan Normal University), Changsha 410005, China
| | - An Wei
- Department of Ultrasound, Hunan Provincial People's Hospital (The First Affiliated Hospital of Hunan Normal University), Changsha 410005, China
| |
Collapse
|
10
|
Li H, Bhatt M, Qu Z, Zhang S, Hartel MC, Khademhosseini A, Cloutier G. Deep learning in ultrasound elastography imaging: A review. Med Phys 2022; 49:5993-6018. [PMID: 35842833 DOI: 10.1002/mp.15856] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2021] [Revised: 02/04/2022] [Accepted: 07/06/2022] [Indexed: 11/11/2022] Open
Abstract
It is known that changes in the mechanical properties of tissues are associated with the onset and progression of certain diseases. Ultrasound elastography is a technique to characterize tissue stiffness using ultrasound imaging either by measuring tissue strain using quasi-static elastography or natural organ pulsation elastography, or by tracing a propagated shear wave induced by a source or a natural vibration using dynamic elastography. In recent years, deep learning has begun to emerge in ultrasound elastography research. In this review, several common deep learning frameworks in the computer vision community, such as multilayer perceptron, convolutional neural network, and recurrent neural network are described. Then, recent advances in ultrasound elastography using such deep learning techniques are revisited in terms of algorithm development and clinical diagnosis. Finally, the current challenges and future developments of deep learning in ultrasound elastography are prospected. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Hongliang Li
- Laboratory of Biorheology and Medical Ultrasonics, University of Montreal Hospital Research Center, Montréal, Québec, Canada.,Institute of Biomedical Engineering, University of Montreal, Montréal, Québec, Canada
| | - Manish Bhatt
- Laboratory of Biorheology and Medical Ultrasonics, University of Montreal Hospital Research Center, Montréal, Québec, Canada
| | - Zhen Qu
- Laboratory of Biorheology and Medical Ultrasonics, University of Montreal Hospital Research Center, Montréal, Québec, Canada
| | - Shiming Zhang
- California Nanosystems Institute, University of California, Los Angeles, California, USA
| | - Martin C Hartel
- California Nanosystems Institute, University of California, Los Angeles, California, USA
| | - Ali Khademhosseini
- California Nanosystems Institute, University of California, Los Angeles, California, USA
| | - Guy Cloutier
- Laboratory of Biorheology and Medical Ultrasonics, University of Montreal Hospital Research Center, Montréal, Québec, Canada.,Institute of Biomedical Engineering, University of Montreal, Montréal, Québec, Canada.,Department of Radiology, Radio-Oncology and Nuclear Medicine, University of Montreal, Montréal, Québec, Canada
| |
Collapse
|
11
|
Bai S, Wang Z, Wang M, Li J, Wei Y, Xu R, Du J. Tumor-Derived Exosomes Modulate Primary Site Tumor Metastasis. Front Cell Dev Biol 2022; 10:752818. [PMID: 35309949 PMCID: PMC8924426 DOI: 10.3389/fcell.2022.752818] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Accepted: 02/10/2022] [Indexed: 12/12/2022] Open
Abstract
Tumor-derived exosomes (TDEs) are actively produced and released by tumor cells and carry messages from tumor cells to healthy cells or abnormal cells, and they participate in tumor metastasis. In this review, we explore the underlying mechanism of action of TDEs in tumor metastasis. TDEs transport tumor-derived proteins and non-coding RNA to tumor cells and promote migration. Transport to normal cells, such as vascular endothelial cells and immune cells, promotes angiogenesis, inhibits immune cell activation, and improves chances of tumor implantation. Thus, TDEs contribute to tumor metastasis. We summarize the function of TDEs and their components in tumor metastasis and illuminate shortcomings for advancing research on TDEs in tumor metastasis.
Collapse
Affiliation(s)
- Suwen Bai
- Longgang District People´s Hospital of Shenzhen, The Second Affiliated Hospital of The Chinese University of Hong Kong, Shenzhen, China.,School of Basic Medical Sciences, Anhui Medical University, Hefei, China
| | - Zunyun Wang
- School of Basic Medical Sciences, Anhui Medical University, Hefei, China
| | - Minghua Wang
- Longgang District People´s Hospital of Shenzhen, The Second Affiliated Hospital of The Chinese University of Hong Kong, Shenzhen, China
| | - Junai Li
- Longgang District People´s Hospital of Shenzhen, The Second Affiliated Hospital of The Chinese University of Hong Kong, Shenzhen, China
| | - Yuan Wei
- Longgang District People´s Hospital of Shenzhen, The Second Affiliated Hospital of The Chinese University of Hong Kong, Shenzhen, China
| | - Ruihuan Xu
- Longgang District People´s Hospital of Shenzhen, The Second Affiliated Hospital of The Chinese University of Hong Kong, Shenzhen, China
| | - Juan Du
- Longgang District People´s Hospital of Shenzhen, The Second Affiliated Hospital of The Chinese University of Hong Kong, Shenzhen, China
| |
Collapse
|
12
|
Niu Z, Xiao M, Ma L, Qin J, Li W, Zhang J, Zhu Q, Jiang Y. The value of contrast-enhanced ultrasound enhancement patterns for the diagnosis of sentinel lymph node status in breast cancer: systematic review and meta-analysis. Quant Imaging Med Surg 2022; 12:936-948. [PMID: 35111595 DOI: 10.21037/qims-21-416] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2021] [Accepted: 08/20/2021] [Indexed: 02/01/2023]
Abstract
BACKGROUND The sentinel lymph node (SLN) can represent the metastasis status of axillary lymph nodes and is a prognostic factor of breast cancer. Preoperative imaging provides information for axillary surgery decision-making, and this meta-analysis evaluated the diagnostic value of contrast-enhanced ultrasound (CEUS) for SLN status in breast cancer patients. METHODS The PubMed, Embase, Medline, Google Scholar, Clinical Trails gov. and Cochrane Library databases were searched from inception until 31 March 2020. Two review authors independently screened and selected the relevant studies and extracted data, and the assessment of the methodological quality of studies was according to the QUADAS-2 tool. The diagnostic value of CEUS was assessed by calculating the pooled sensitivity, specificity, area under the curve, positive likelihood ratio, negative likelihood ratio, and diagnostic odds ratio, and a summary receiver operating characteristic curve and hierarchical modeling method was used to conduct the meta-analysis. RESULTS Five studies with 771 breast cancer patients were included, and the results showed CEUS could provide additional information for SLN preoperative diagnosis. A homogeneous or uniform enhancement pattern suggested a benign lymph node, and a heterogeneous, no pattern, or weak enhancement pattern suggested a node was malignant, demonstrating high sensitivity of 0.960 (95% CI: 0.856, 0.989) and moderate specificity of 0.807 (0.581, 0.926). The pooled positive likelihood ratio, negative likelihood ratio, and diagnostic odds ratio were 4.987 (2.104, 11.822) and 0.049 (0.014, 0.168), and 101.294 (31.202, 328.837), respectively. CONCLUSIONS A homogeneous enhancement pattern was highly suggestive of benign lymph nodes with high sensitivity. CEUS could effectively identify the SLN, and facilitate the diagnosis of its metastatic status. REGISTRATION NUMBER PROSPERO protocol CRD42020176828.
Collapse
Affiliation(s)
- Zihan Niu
- Department of Ultrasound, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Mengsu Xiao
- Department of Ultrasound, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Li Ma
- Department of Ultrasound, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Jing Qin
- Department of Ultrasound, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Wenbo Li
- Department of Ultrasound, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Jing Zhang
- Department of Ultrasound, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Qingli Zhu
- Department of Ultrasound, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Yuxin Jiang
- Department of Ultrasound, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| |
Collapse
|
13
|
Jabeen K, Khan MA, Alhaisoni M, Tariq U, Zhang YD, Hamza A, Mickus A, Damaševičius R. Breast Cancer Classification from Ultrasound Images Using Probability-Based Optimal Deep Learning Feature Fusion. SENSORS 2022; 22:s22030807. [PMID: 35161552 PMCID: PMC8840464 DOI: 10.3390/s22030807] [Citation(s) in RCA: 56] [Impact Index Per Article: 28.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Revised: 01/12/2022] [Accepted: 01/17/2022] [Indexed: 12/11/2022]
Abstract
After lung cancer, breast cancer is the second leading cause of death in women. If breast cancer is detected early, mortality rates in women can be reduced. Because manual breast cancer diagnosis takes a long time, an automated system is required for early cancer detection. This paper proposes a new framework for breast cancer classification from ultrasound images that employs deep learning and the fusion of the best selected features. The proposed framework is divided into five major steps: (i) data augmentation is performed to increase the size of the original dataset for better learning of Convolutional Neural Network (CNN) models; (ii) a pre-trained DarkNet-53 model is considered and the output layer is modified based on the augmented dataset classes; (iii) the modified model is trained using transfer learning and features are extracted from the global average pooling layer; (iv) the best features are selected using two improved optimization algorithms known as reformed differential evaluation (RDE) and reformed gray wolf (RGW); and (v) the best selected features are fused using a new probability-based serial approach and classified using machine learning algorithms. The experiment was conducted on an augmented Breast Ultrasound Images (BUSI) dataset, and the best accuracy was 99.1%. When compared with recent techniques, the proposed framework outperforms them.
Collapse
Affiliation(s)
- Kiran Jabeen
- Department of Computer Science, HITEC University Taxila, Taxila 47080, Pakistan; (K.J.); (M.A.K.); (A.H.)
| | - Muhammad Attique Khan
- Department of Computer Science, HITEC University Taxila, Taxila 47080, Pakistan; (K.J.); (M.A.K.); (A.H.)
| | - Majed Alhaisoni
- College of Computer Science and Engineering, University of Ha’il, Ha’il 55211, Saudi Arabia;
| | - Usman Tariq
- College of Computer Engineering and Science, Prince Sattam Bin Abdulaziz University, Al-Kharaj 11942, Saudi Arabia;
| | - Yu-Dong Zhang
- Department of Informatics, University of Leicester, Leicester LE1 7RH, UK;
| | - Ameer Hamza
- Department of Computer Science, HITEC University Taxila, Taxila 47080, Pakistan; (K.J.); (M.A.K.); (A.H.)
| | - Artūras Mickus
- Department of Applied Informatics, Vytautas Magnus University, LT-44404 Kaunas, Lithuania;
| | - Robertas Damaševičius
- Department of Applied Informatics, Vytautas Magnus University, LT-44404 Kaunas, Lithuania;
- Correspondence:
| |
Collapse
|
14
|
Tahmasebi A, Qu E, Sevrukov A, Liu JB, Wang S, Lyshchik A, Yu J, Eisenbrey JR. Assessment of Axillary Lymph Nodes for Metastasis on Ultrasound Using Artificial Intelligence. ULTRASONIC IMAGING 2021; 43:329-336. [PMID: 34416827 DOI: 10.1177/01617346211035315] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
The purpose of this study was to evaluate an artificial intelligence (AI) system for the classification of axillary lymph nodes on ultrasound compared to radiologists. Ultrasound images of 317 axillary lymph nodes from patients referred for ultrasound guided fine needle aspiration or core needle biopsy and corresponding pathology findings were collected. Lymph nodes were classified into benign and malignant groups with histopathological result serving as the reference. Google Cloud AutoML Vision (Mountain View, CA) was used for AI image classification. Three experienced radiologists also classified the images and gave a level of suspicion score (1-5). To test the accuracy of AI, an external testing dataset of 64 images from 64 independent patients was evaluated by three AI models and the three readers. The diagnostic performance of AI and the humans were then quantified using receiver operating characteristics curves. In the complete set of 317 images, AutoML achieved a sensitivity of 77.1%, positive predictive value (PPV) of 77.1%, and an area under the precision recall curve of 0.78, while the three radiologists showed a sensitivity of 87.8% ± 8.5%, specificity of 50.3% ± 16.4%, PPV of 61.1% ± 5.4%, negative predictive value (NPV) of 84.1% ± 6.6%, and accuracy of 67.7% ± 5.7%. In the three external independent test sets, AI and human readers achieved sensitivity of 74.0% ± 0.14% versus 89.9% ± 0.06% (p = .25), specificity of 64.4% ± 0.11% versus 50.1 ± 0.20% (p = .22), PPV of 68.3% ± 0.04% versus 65.4 ± 0.07% (p = .50), NPV of 72.6% ± 0.11% versus 82.1% ± 0.08% (p = .33), and accuracy of 69.5% ± 0.06% versus 70.1% ± 0.07% (p = .90), respectively. These preliminary results indicate AI has comparable performance to trained radiologists and could be used to predict the presence of metastasis in ultrasound images of axillary lymph nodes.
Collapse
Affiliation(s)
- Aylin Tahmasebi
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
| | - Enze Qu
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
- Department of Ultrasound, The Third Affiliated Hospital of Sun Yat-Sen University, Guangzhou, China
| | - Alexander Sevrukov
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
| | - Ji-Bin Liu
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
| | - Shuo Wang
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
| | - Andrej Lyshchik
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
| | - Joshua Yu
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
| | - John R Eisenbrey
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
| |
Collapse
|
15
|
Shen Y, Shamout FE, Oliver JR, Witowski J, Kannan K, Park J, Wu N, Huddleston C, Wolfson S, Millet A, Ehrenpreis R, Awal D, Tyma C, Samreen N, Gao Y, Chhor C, Gandhi S, Lee C, Kumari-Subaiya S, Leonard C, Mohammed R, Moczulski C, Altabet J, Babb J, Lewin A, Reig B, Moy L, Heacock L, Geras KJ. Artificial intelligence system reduces false-positive findings in the interpretation of breast ultrasound exams. Nat Commun 2021; 12:5645. [PMID: 34561440 PMCID: PMC8463596 DOI: 10.1038/s41467-021-26023-2] [Citation(s) in RCA: 70] [Impact Index Per Article: 23.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2021] [Accepted: 09/14/2021] [Indexed: 02/08/2023] Open
Abstract
Though consistently shown to detect mammographically occult cancers, breast ultrasound has been noted to have high false-positive rates. In this work, we present an AI system that achieves radiologist-level accuracy in identifying breast cancer in ultrasound images. Developed on 288,767 exams, consisting of 5,442,907 B-mode and Color Doppler images, the AI achieves an area under the receiver operating characteristic curve (AUROC) of 0.976 on a test set consisting of 44,755 exams. In a retrospective reader study, the AI achieves a higher AUROC than the average of ten board-certified breast radiologists (AUROC: 0.962 AI, 0.924 ± 0.02 radiologists). With the help of the AI, radiologists decrease their false positive rates by 37.3% and reduce requested biopsies by 27.8%, while maintaining the same level of sensitivity. This highlights the potential of AI in improving the accuracy, consistency, and efficiency of breast ultrasound diagnosis.
Collapse
Affiliation(s)
- Yiqiu Shen
- grid.137628.90000 0004 1936 8753Center for Data Science, New York University, New York, NY USA
| | - Farah E. Shamout
- grid.440573.1Engineering Division, NYU Abu Dhabi, Abu Dhabi, UAE
| | - Jamie R. Oliver
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Jan Witowski
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Kawshik Kannan
- grid.482020.c0000 0001 1089 179XDepartment of Computer Science, Courant Institute, New York University, New York, NY USA
| | - Jungkyu Park
- grid.137628.90000 0004 1936 8753Vilcek Institute of Graduate Biomedical Sciences, NYU Grossman School of Medicine, New York, NY USA
| | - Nan Wu
- grid.137628.90000 0004 1936 8753Center for Data Science, New York University, New York, NY USA
| | - Connor Huddleston
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Stacey Wolfson
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Alexandra Millet
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Robin Ehrenpreis
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Divya Awal
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Cathy Tyma
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Naziya Samreen
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Yiming Gao
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Chloe Chhor
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Stacey Gandhi
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Cindy Lee
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Sheila Kumari-Subaiya
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Cindy Leonard
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Reyhan Mohammed
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Christopher Moczulski
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Jaime Altabet
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - James Babb
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Alana Lewin
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Beatriu Reig
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Linda Moy
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA ,grid.137628.90000 0004 1936 8753Vilcek Institute of Graduate Biomedical Sciences, NYU Grossman School of Medicine, New York, NY USA
| | - Laura Heacock
- grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA
| | - Krzysztof J. Geras
- grid.137628.90000 0004 1936 8753Center for Data Science, New York University, New York, NY USA ,grid.137628.90000 0004 1936 8753Department of Radiology, NYU Grossman School of Medicine, New York, NY USA ,grid.137628.90000 0004 1936 8753Vilcek Institute of Graduate Biomedical Sciences, NYU Grossman School of Medicine, New York, NY USA
| |
Collapse
|
16
|
Bitencourt A, Daimiel Naranjo I, Lo Gullo R, Rossi Saccarelli C, Pinker K. AI-enhanced breast imaging: Where are we and where are we heading? Eur J Radiol 2021; 142:109882. [PMID: 34392105 PMCID: PMC8387447 DOI: 10.1016/j.ejrad.2021.109882] [Citation(s) in RCA: 35] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Revised: 07/15/2021] [Accepted: 07/26/2021] [Indexed: 12/22/2022]
Abstract
Significant advances in imaging analysis and the development of high-throughput methods that can extract and correlate multiple imaging parameters with different clinical outcomes have led to a new direction in medical research. Radiomics and artificial intelligence (AI) studies are rapidly evolving and have many potential applications in breast imaging, such as breast cancer risk prediction, lesion detection and classification, radiogenomics, and prediction of treatment response and clinical outcomes. AI has been applied to different breast imaging modalities, including mammography, ultrasound, and magnetic resonance imaging, in different clinical scenarios. The application of AI tools in breast imaging has an unprecedented opportunity to better derive clinical value from imaging data and reshape the way we care for our patients. The aim of this study is to review the current knowledge and future applications of AI-enhanced breast imaging in clinical practice.
Collapse
Affiliation(s)
- Almir Bitencourt
- Department of Imaging, A.C.Camargo Cancer Center, Sao Paulo, SP, Brazil; Dasa, Sao Paulo, SP, Brazil
| | - Isaac Daimiel Naranjo
- Department of Radiology, Breast Imaging Service, Guy's and St. Thomas' NHS Trust, Great Maze Pond, London, UK
| | - Roberto Lo Gullo
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | | | - Katja Pinker
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
| |
Collapse
|
17
|
Zheng Q, Yang L, Zeng B, Li J, Guo K, Liang Y, Liao G. Artificial intelligence performance in detecting tumor metastasis from medical radiology imaging: A systematic review and meta-analysis. EClinicalMedicine 2021; 31:100669. [PMID: 33392486 PMCID: PMC7773591 DOI: 10.1016/j.eclinm.2020.100669] [Citation(s) in RCA: 31] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/07/2020] [Revised: 11/14/2020] [Accepted: 11/17/2020] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND Early diagnosis of tumor metastasis is crucial for clinical treatment. Artificial intelligence (AI) has shown great promise in the field of medicine. We therefore aimed to evaluate the diagnostic accuracy of AI algorithms in detecting tumor metastasis using medical radiology imaging. METHODS We searched PubMed and Web of Science for studies published from January 1, 1997, to January 30, 2020. Studies evaluating an AI model for the diagnosis of tumor metastasis from medical images were included. We excluded studies that used histopathology images or medical wave-form data and those focused on the region segmentation of interest. Studies providing enough information to construct contingency tables were included in a meta-analysis. FINDINGS We identified 2620 studies, of which 69 were included. Among them, 34 studies were included in a meta-analysis with a pooled sensitivity of 82% (95% CI 79-84%), specificity of 84% (82-87%) and AUC of 0·90 (0·87-0·92). Analysis for different AI algorithms showed a pooled sensitivity of 87% (83-90%) for machine learning and 86% (82-89%) for deep learning, and a pooled specificity of 89% (82-93%) for machine learning, and 87% (82-91%) for deep learning. INTERPRETATION AI algorithms may be used for the diagnosis of tumor metastasis using medical radiology imaging with equivalent or even better performance to health-care professionals, in terms of sensitivity and specificity. At the same time, rigorous reporting standards with external validation and comparison to health-care professionals are urgently needed for AI application in the medical field. FUNDING College students' innovative entrepreneurial training plan program .
Collapse
Affiliation(s)
- Qiuhan Zheng
- Department of Oral and Maxillofacial Surgery, Guanghua School of Stomatology, Hospital of Stomatology, Sun Yat-sen University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Stomatology, Guangzhou, China
| | - Le Yang
- Department of Oral and Maxillofacial Surgery, Guanghua School of Stomatology, Hospital of Stomatology, Sun Yat-sen University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Stomatology, Guangzhou, China
| | - Bin Zeng
- Department of Oral and Maxillofacial Surgery, Guanghua School of Stomatology, Hospital of Stomatology, Sun Yat-sen University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Stomatology, Guangzhou, China
| | - Jiahao Li
- Department of Oral and Maxillofacial Surgery, Guanghua School of Stomatology, Hospital of Stomatology, Sun Yat-sen University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Stomatology, Guangzhou, China
| | - Kaixin Guo
- Department of Oral and Maxillofacial Surgery, Guanghua School of Stomatology, Hospital of Stomatology, Sun Yat-sen University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Stomatology, Guangzhou, China
| | - Yujie Liang
- Department of Oral and Maxillofacial Surgery, Guanghua School of Stomatology, Hospital of Stomatology, Sun Yat-sen University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Stomatology, Guangzhou, China
| | - Guiqing Liao
- Department of Oral and Maxillofacial Surgery, Guanghua School of Stomatology, Hospital of Stomatology, Sun Yat-sen University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Stomatology, Guangzhou, China
| |
Collapse
|
18
|
Morgan MB, Mates JL. Applications of Artificial Intelligence in Breast Imaging. Radiol Clin North Am 2021; 59:139-148. [DOI: 10.1016/j.rcl.2020.08.007] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
|
19
|
Huang XW, Huang QX, Huang H, Cheng MQ, Tong WJ, Xian MF, Liang JY, Wang W. Diagnostic Performance of Quantitative and Qualitative Elastography for Axillary Lymph Node Metastasis in Breast Cancer: A Systematic Review and Meta-Analysis. Front Oncol 2020; 10:552177. [PMID: 33178580 PMCID: PMC7593678 DOI: 10.3389/fonc.2020.552177] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2020] [Accepted: 09/09/2020] [Indexed: 12/31/2022] Open
Abstract
Background: Studies have shown inconsistent results regarding the diagnostic performance of ultrasound elastography for axillary lymph node metastasis (ALNM) in breast cancer. This meta-analysis aimed to estimate the diagnostic performance of ultrasound elastography (divided into quantitative and qualitative elastography) for ALNM in patients with breast cancer. Methods: The PubMed and Embase databases were searched for eligible studies exploring the diagnostic performance of ultrasound elastography for ALNM in patients with breast cancer. The included studies were divided into quantitative and qualitative elastography groups to perform separate meta-analyses. The diagnostic performance was investigated with pooled sensitivity and specificity and diagnostic odds ratio (DOR) using a bivariate mixed-effects regression model. A summary receiver operating characteristic curve was constructed, and the area under the curve (AUC) was calculated. Results: Seven and 11 studies were included in the quantitative and qualitative elastography meta-analyses, respectively. The pooled sensitivity and specificity, DOR, and AUC with their corresponding 95% confidence intervals were 0.82 (0.75, 0.87), 0.88 (0.78, 0.93), 33 (13, 83), and 0.89 (0.86, 0.91), respectively, for quantitative elastography and 0.81 (0.69, 0.89), 0.92 (0.79, 0.97), 46 (12, 181), and 0.92 (0.89, 0.94), respectively, for qualitative elastography. No significant publication bias existed. Fagan plots demonstrated good clinical utility. However, substantial heterogeneity existed among studies. Study design, measurement, and reference standard served as potential sources of heterogeneity for quantitative studies, which were measurement and reference standard for qualitative studies. Conclusions: Both quantitative and qualitative elastography seem to be feasible, non-invasive diagnostic tools for ALNM in breast cancer. Nevertheless, the results must be interpreted carefully, paying attention to heterogeneity issues, especially for quantitative elastography studies.
Collapse
Affiliation(s)
- Xiao-Wen Huang
- Zhongshan Hospital of Traditional Chinese Medicine, Affiliated to Guangzhou University of Chinese Medicine, Zhongshan, China
| | - Qing-Xiu Huang
- Zhongshan Hospital of Traditional Chinese Medicine, Affiliated to Guangzhou University of Chinese Medicine, Zhongshan, China
| | - Hui Huang
- Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Mei-Qing Cheng
- Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Wen-Juan Tong
- Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Meng-Fei Xian
- Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Jin-Yu Liang
- Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Wei Wang
- Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| |
Collapse
|
20
|
Chen Y, Jiang J, Shi J, Chang W, Shi J, Chen M, Zhang Q. Dual-mode ultrasound radiomics and intrinsic imaging phenotypes for diagnosis of lymph node lesions. ANNALS OF TRANSLATIONAL MEDICINE 2020; 8:742. [PMID: 32647667 PMCID: PMC7333147 DOI: 10.21037/atm-19-4630] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
Background The ultrasonic diagnosis of lymph node lesions is usually based on a small number of subjective visual features from a single ultrasonic modality, which limits diagnostic accuracy. Therefore, our study aimed to propose a computerized method for using dual-mode ultrasound radiomics and the intrinsic imaging phenotypes for accurately differentiating benign, lymphomatous, and metastatic lymph nodes. Methods A total of 543 lymph nodes from 538 patients were examined with both B-mode ultrasonography and elastography. The data set was randomly divided into a training set of 407 nodes and a validation set of 136 nodes. First, we extracted 430 radiomic features from dual-mode images. Then, we combined the least absolute shrinkage and selection operator with the analysis of variance to select several typical features. We retrieved the intrinsic imaging phenotypes by using a hierarchical clustering of all radiomics features, and we integrated the phenotypes with the selected features for the classification of benign, lymphomatous, and metastatic nodes. Results The areas under the receiver operating characteristic curves (AUCs) on the validation set were 0.960 for benign vs. lymphomatous, 0.716 for benign vs. metastatic, 0.933 for lymphomatous vs. metastatic, and 0.856 for benign vs. malignant. Conclusions The radiomics features and intrinsic imaging phenotypes derived from the dual-mode ultrasound can capture the distinctions between benign, lymphomatous, and metastatic nodes and are valuable in node differentiation.
Collapse
Affiliation(s)
- Ying Chen
- Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai, China.,The SMART (Smart Medicine and AI-based Radiology Technology) Lab, Institute of Biomedical Engineering, Shanghai University, Shanghai, China.,School of Communication and Information Engineering, Shanghai University, Shanghai, China
| | - Jianwei Jiang
- Department of Ultrasound Medicine, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Jie Shi
- Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai, China.,The SMART (Smart Medicine and AI-based Radiology Technology) Lab, Institute of Biomedical Engineering, Shanghai University, Shanghai, China.,School of Communication and Information Engineering, Shanghai University, Shanghai, China
| | - Wanying Chang
- Department of Ultrasound Medicine, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Jun Shi
- Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai, China.,School of Communication and Information Engineering, Shanghai University, Shanghai, China
| | - Man Chen
- Department of Ultrasound Medicine, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Qi Zhang
- Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai, China.,The SMART (Smart Medicine and AI-based Radiology Technology) Lab, Institute of Biomedical Engineering, Shanghai University, Shanghai, China.,School of Communication and Information Engineering, Shanghai University, Shanghai, China.,Hangzhou YITU Healthcare Technology, Hangzhou, China
| |
Collapse
|
21
|
Tang GX, Xiao XY, Xu XL, Yang HY, Cai YC, Liu XD, Tian J, Luo BM. Diagnostic value of ultrasound elastography for differentiation of benign and malignant axillary lymph nodes: a meta-analysis. Clin Radiol 2020; 75:481.e9-481.e16. [PMID: 32291079 DOI: 10.1016/j.crad.2020.03.021] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2019] [Accepted: 03/12/2020] [Indexed: 12/18/2022]
Abstract
AIM To investigate the diagnostic value of ultrasound elastography (UE) for benign and malignant axillary lymph nodes. MATERIALS AND METHODS A literature search was conducted from PubMed, Cochrane EMBASE, and Medline. Fourteen studies including 1,186 patients with 1,411 lymph nodes were enrolled. Overall, diagnostic descriptive statistics included pooled sensitivity, specificity, and area under the receiver operating characteristic curve (AUC) with corresponding 95% confidence intervals (95% CIs) were generated by random effect model. Subgroup analyses were performed in (real-time elastography [RTE] versus shear wave elastography [SWE]) and (conventional ultrasound versus combination of traditional ultrasound and elastography). Meta-regression was used to explore potential sources of heterogeneity. RESULTS The overall pooled sensitivity, specificity, and AUC of UE was 0.79 (95% CI: 0.71-0.86), 0.90 (95% CI: 0.83-0.95), and 0.91 (95% CI: 0.88-0.93), respectively. In the subgroup analysis of the two UE techniques, the pooled sensitivity, specificity, and AUC of SWE was higher than that of RTE (sensitivity: 0.82>0.77; specificity: 0.91>0.89; AUC: 0.94>0.89). The pooled diagnostic value of ultrasound combined with UE were significantly improving compared with traditional ultrasound (sensitivity: 0.87>0.82, specificity: 0.83>0.78, and AUC: 0.91>0.87). No independent heterogeneous factor was found in meta-regression. CONCLUSION The results indicate that UE was an effective technique for identifying malignant axillary lymph nodes due to its high diagnostic efficiency, which can provide useful information for surgical procedure selection.
Collapse
Affiliation(s)
- G-X Tang
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou, 510120, China; Department of Ultrasound, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou, 510120, China
| | - X-Y Xiao
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou, 510120, China; Department of Ultrasound, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou, 510120, China
| | - X-L Xu
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou, 510120, China; Department of Ultrasound, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou, 510120, China
| | - H-Y Yang
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou, 510120, China; Department of Ultrasound, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou, 510120, China
| | - Y-C Cai
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou, 510120, China; Department of Ultrasound, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou, 510120, China
| | - X-D Liu
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou, 510120, China; Department of Ultrasound, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou, 510120, China
| | - J Tian
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou, 510120, China; Department of Ultrasound, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou, 510120, China.
| | - B-M Luo
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou, 510120, China; Department of Ultrasound, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, No. 107 Yanjiang Road West, Guangzhou, 510120, China.
| |
Collapse
|
22
|
Li Y, Liu Y, Zhang M, Zhang G, Wang Z, Luo J. Radiomics With Attribute Bagging for Breast Tumor Classification Using Multimodal Ultrasound Images. JOURNAL OF ULTRASOUND IN MEDICINE : OFFICIAL JOURNAL OF THE AMERICAN INSTITUTE OF ULTRASOUND IN MEDICINE 2020; 39:361-371. [PMID: 31432552 DOI: 10.1002/jum.15115] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/20/2019] [Revised: 07/03/2019] [Accepted: 07/23/2019] [Indexed: 06/10/2023]
Abstract
OBJECTIVES We aimed to develop radiomics with attribute bagging, which leverages multimodal ultrasound (US) images to improve the classification accuracy of breast tumors. METHODS A retrospective study was conducted. B-mode US, shear wave elastographic, and contrast-enhanced US images of 178 patients with 181 tumors (67 malignant and 114 benign) were included. Radiomics with attribute bagging consisted of extraction of 1226 radiomic features and analysis of them with attribute bagging. Histologic examination results acted as the reference standard. Radiomics with several feature selection algorithms were used for comparison. Cross-validation and a holdout test were performed to evaluate their performances. RESULTS The accuracy, sensitivity, specificity, and area under the receiver operating characteristic curve of radiomics with attribute bagging with the multimodal US images were 84.12%, 92.86%, 78.80%, and 0.919, respectively, exceeding all the comparison methods. CONCLUSIONS Radiomics with attribute bagging combined with multimodal US images has the potential to be used for accurate diagnosis of breast tumors in the clinic.
Collapse
Affiliation(s)
- Yongshuai Li
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China
| | - Yuan Liu
- Department of Ultrasound, Chinese People's Liberation Army General Hospital, Beijing, China
| | - Mengke Zhang
- Department of Ultrasound, Chinese People's Liberation Army General Hospital, Beijing, China
| | - Guanglei Zhang
- Institute of Medical Photonics, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, China
| | - Zhili Wang
- Department of Ultrasound, Chinese People's Liberation Army General Hospital, Beijing, China
| | - Jianwen Luo
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China
| |
Collapse
|
23
|
Breast Cancer Assessment With Pulse-Echo Speed of Sound Ultrasound From Intrinsic Tissue Reflections: Proof-of-Concept. Invest Radiol 2020; 54:419-427. [PMID: 30913054 DOI: 10.1097/rli.0000000000000553] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Abstract
PURPOSE The aim of this study was to differentiate malignant and benign solid breast lesions with a novel ultrasound (US) technique, which measures speed of sound (SoS) using standard US transducers and intrinsic tissue reflections and scattering (speckles) as internal reference. MATERIALS AND METHODS This prospective, institutional review board-approved, Health Insurance Portability and Accountability Act-compliant prospective comparison study was performed with prior written informed consent from 20 women. Ten women with histological proven breast cancer and 10 with fibroadenoma were measured. A conventional US system with a linear probe was used for SoS-US (SonixTouch; Ultrasonix, Richmond, British Columbia, Canada). Tissue speckle reflections served as a timing reference for the US signals transmitted through the breasts. Relative phase inconsistencies were detected using plane wave measurements from different angular directions, and SoS images with 0.5-mm resolution were generated using a spatial domain reconstruction algorithm. The SoS of tumors were compared with the breast density of a larger cohort of 106 healthy women. RESULTS Breast lesions show focal increments ΔSoS (meters per second) with respect to the tissue background. Peak ΔSoS values were evaluated. Breast carcinoma showed significantly higher ΔSoS than fibroadenomas ([INCREMENT]SoS > 41.64 m/s: sensitivity, 90%; specificity, 80%; area under curve, 0.910) and healthy breast tissue of different densities (area under curve, 0.938; sensitivity, 90%; specificity, 96.5%). The lesion localization in SoS-US images was consistent with B-mode imaging and repeated SoS-US measurements were reproducible. CONCLUSIONS Using SoS-US, based on conventional US and tissue speckles as timing reference, breast carcinoma showed significantly higher SoS values than fibroadenoma and healthy breast tissue of different densities. The SoS presents a promising technique for differentiating solid breast lesions.
Collapse
|
24
|
Wu GG, Zhou LQ, Xu JW, Wang JY, Wei Q, Deng YB, Cui XW, Dietrich CF. Artificial intelligence in breast ultrasound. World J Radiol 2019; 11:19-26. [PMID: 30858931 PMCID: PMC6403465 DOI: 10.4329/wjr.v11.i2.19] [Citation(s) in RCA: 50] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/28/2018] [Revised: 01/14/2019] [Accepted: 01/27/2019] [Indexed: 02/06/2023] Open
Abstract
Artificial intelligence (AI) is gaining extensive attention for its excellent performance in image-recognition tasks and increasingly applied in breast ultrasound. AI can conduct a quantitative assessment by recognizing imaging information automatically and make more accurate and reproductive imaging diagnosis. Breast cancer is the most commonly diagnosed cancer in women, severely threatening women’s health, the early screening of which is closely related to the prognosis of patients. Therefore, utilization of AI in breast cancer screening and detection is of great significance, which can not only save time for radiologists, but also make up for experience and skill deficiency on some beginners. This article illustrates the basic technical knowledge regarding AI in breast ultrasound, including early machine learning algorithms and deep learning algorithms, and their application in the differential diagnosis of benign and malignant masses. At last, we talk about the future perspectives of AI in breast ultrasound.
Collapse
Affiliation(s)
- Ge-Ge Wu
- Sino-German Tongji-Caritas Research Center of Ultrasound in Medicine, Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China
| | - Li-Qiang Zhou
- Sino-German Tongji-Caritas Research Center of Ultrasound in Medicine, Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China
| | - Jian-Wei Xu
- Department of Ultrasound, The First Affiliated Hospital of Zhengzhou University, Zhengzhou 450052, Henan Province, China
| | - Jia-Yu Wang
- Sino-German Tongji-Caritas Research Center of Ultrasound in Medicine, Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China
| | - Qi Wei
- Sino-German Tongji-Caritas Research Center of Ultrasound in Medicine, Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China
| | - You-Bin Deng
- Sino-German Tongji-Caritas Research Center of Ultrasound in Medicine, Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China
| | - Xin-Wu Cui
- Sino-German Tongji-Caritas Research Center of Ultrasound in Medicine, Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China
| | - Christoph F Dietrich
- Sino-German Tongji-Caritas Research Center of Ultrasound in Medicine, Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China
- Medical Clinic 2, Caritas-Krankenhaus Bad Mergentheim, Academic Teaching Hospital of the University of Würzburg, Würzburg 97980, Germany
| |
Collapse
|
25
|
Zhang Q, Song S, Xiao Y, Chen S, Shi J, Zheng H. Dual-mode artificially-intelligent diagnosis of breast tumours in shear-wave elastography and B-mode ultrasound using deep polynomial networks. Med Eng Phys 2018; 64:1-6. [PMID: 30578163 DOI: 10.1016/j.medengphy.2018.12.005] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2018] [Revised: 11/21/2018] [Accepted: 12/04/2018] [Indexed: 12/31/2022]
Abstract
The main goal of this study is to build an artificial intelligence (AI) architecture for automated extraction of dual-modal image features from both shear-wave elastography (SWE) and B-mode ultrasound, and to evaluate the AI architecture for classification between benign and malignant breast tumors. In this AI architecture, ultrasound images were segmented by the reaction diffusion level set model combined with the Gabor-based anisotropic diffusion algorithm. Then morphological features and texture features were extracted from SWE and B-mode ultrasound images at the contourlet domain. Finally, we employed a framework for feature learning and classification with the deep polynomial network (DPN) on dual-modal features to distinguish between malignant and benign breast tumors. With the leave-one-out cross validation, the DPN method on dual-modal features achieved a sensitivity of 97.8%, a specificity of 94.1%, an accuracy of 95.6%, a Youden's index of 91.9% and an area under the receiver operating characteristic curve of 0.961, which was superior to the classic single-modal methods, and the dual-modal methods using the principal component analysis and multiple kernel learning. These results have demonstrated that the dual-modal AI-based technique with DPN has the potential for breast tumor classification in future clinical practice.
Collapse
Affiliation(s)
- Qi Zhang
- Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Room 803, Xiangying Building, No. 333, Nanchen Road, Shanghai 200444, China; The SMART (Smart Medicine and AI-based Radiology Technology) Lab, Institute of Biomedical Engineering, Shanghai University, Shanghai 200444, China.
| | - Shuang Song
- Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Room 803, Xiangying Building, No. 333, Nanchen Road, Shanghai 200444, China; The SMART (Smart Medicine and AI-based Radiology Technology) Lab, Institute of Biomedical Engineering, Shanghai University, Shanghai 200444, China
| | - Yang Xiao
- Paul C. Lauterbur Research Center for Biomedical Imaging, Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, 1068 Xueyuan Ave., SZ University Town, Shenzhen 518055, China.
| | - Shuai Chen
- Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Room 803, Xiangying Building, No. 333, Nanchen Road, Shanghai 200444, China; The SMART (Smart Medicine and AI-based Radiology Technology) Lab, Institute of Biomedical Engineering, Shanghai University, Shanghai 200444, China
| | - Jun Shi
- Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Room 803, Xiangying Building, No. 333, Nanchen Road, Shanghai 200444, China
| | - Hairong Zheng
- Paul C. Lauterbur Research Center for Biomedical Imaging, Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, 1068 Xueyuan Ave., SZ University Town, Shenzhen 518055, China
| |
Collapse
|
26
|
Machine Learning in Ultrasound Computer-Aided Diagnostic Systems: A Survey. BIOMED RESEARCH INTERNATIONAL 2018; 2018:5137904. [PMID: 29687000 PMCID: PMC5857346 DOI: 10.1155/2018/5137904] [Citation(s) in RCA: 72] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/26/2017] [Revised: 01/12/2018] [Accepted: 02/06/2018] [Indexed: 12/13/2022]
Abstract
The ultrasound imaging is one of the most common schemes to detect diseases in the clinical practice. There are many advantages of ultrasound imaging such as safety, convenience, and low cost. However, reading ultrasound imaging is not easy. To support the diagnosis of clinicians and reduce the load of doctors, many ultrasound computer-aided diagnosis (CAD) systems are proposed. In recent years, the success of deep learning in the image classification and segmentation led to more and more scholars realizing the potential of performance improvement brought by utilizing the deep learning in the ultrasound CAD system. This paper summarized the research which focuses on the ultrasound CAD system utilizing machine learning technology in recent years. This study divided the ultrasound CAD system into two categories. One is the traditional ultrasound CAD system which employed the manmade feature and the other is the deep learning ultrasound CAD system. The major feature and the classifier employed by the traditional ultrasound CAD system are introduced. As for the deep learning ultrasound CAD, newest applications are summarized. This paper will be useful for researchers who focus on the ultrasound CAD system.
Collapse
|