1
|
Kim HJ, Kim HH, Kim KH, Lee JS, Choi WJ, Chae EY, Shin HJ, Cha JH, Shim WH. Use of a commercial artificial intelligence-based mammography analysis software for improving breast ultrasound interpretations. Eur Radiol 2024; 34:6320-6331. [PMID: 38570382 DOI: 10.1007/s00330-024-10718-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2024] [Revised: 02/22/2024] [Accepted: 03/13/2024] [Indexed: 04/05/2024]
Abstract
OBJECTIVES To evaluate the use of a commercial artificial intelligence (AI)-based mammography analysis software for improving the interpretations of breast ultrasound (US)-detected lesions. METHODS A retrospective analysis was performed on 1109 breasts that underwent both mammography and US-guided breast biopsy. The AI software processed mammograms and provided an AI score ranging from 0 to 100 for each breast, indicating the likelihood of malignancy. The performance of the AI score in differentiating mammograms with benign outcomes from those revealing cancers following US-guided breast biopsy was evaluated. In addition, prediction models for benign outcomes were constructed based on clinical and imaging characteristics with and without AI scores, using logistic regression analysis. RESULTS The AI software had an area under the receiver operating characteristics curve (AUROC) of 0.79 (95% CI, 0.79-0.82) in differentiating between benign and cancer cases. The prediction models that did not include AI scores (non-AI model), only used AI scores (AI-only model), and included AI scores (integrated model) had AUROCs of 0.79 (95% CI, 0.75-0.83), 0.78 (95% CI, 0.74-0.82), and 0.85 (95% CI, 0.81-0.88) in the development cohort, and 0.75 (95% CI, 0.68-0.81), 0.82 (95% CI, 0.76-0.88), and 0.84 (95% CI, 0.79-0.90) in the validation cohort, respectively. The integrated model outperformed the non-AI model in the development and validation cohorts (p < 0.001 for both). CONCLUSION The commercial AI-based mammography analysis software could be a valuable adjunct to clinical decision-making for managing US-detected breast lesions. CLINICAL RELEVANCE STATEMENT The commercial AI-based mammography analysis software could potentially reduce unnecessary biopsies and improve patient outcomes. KEY POINTS • Breast US has high rates of false-positive interpretations. • A commercial AI-based mammography analysis software could distinguish mammograms having benign outcomes from those revealing cancers after US-guided breast biopsy. • A commercial AI-based mammography analysis software may improve interpretations for breast US-detected lesions.
Collapse
Affiliation(s)
- Hee Jeong Kim
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, 88, Olympic-Ro 43-Gil, Songpa-Gu, Seoul, 05505, South Korea
| | - Hak Hee Kim
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, 88, Olympic-Ro 43-Gil, Songpa-Gu, Seoul, 05505, South Korea.
| | - Ki Hwan Kim
- Lunit Inc., 15F, 27, Teheran-Ro 2-Gil, Gangnam-Gu, Seoul, 06241, South Korea
| | - Ji Sung Lee
- Department of Clinical Epidemiology and Biostatistics, Asan Medical Center, University of Ulsan College, Ulsan, South Korea
| | - Woo Jung Choi
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, 88, Olympic-Ro 43-Gil, Songpa-Gu, Seoul, 05505, South Korea
| | - Eun Young Chae
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, 88, Olympic-Ro 43-Gil, Songpa-Gu, Seoul, 05505, South Korea
| | - Hee Jung Shin
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, 88, Olympic-Ro 43-Gil, Songpa-Gu, Seoul, 05505, South Korea
| | - Joo Hee Cha
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, 88, Olympic-Ro 43-Gil, Songpa-Gu, Seoul, 05505, South Korea
| | - Woo Hyun Shim
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, 88, Olympic-Ro 43-Gil, Songpa-Gu, Seoul, 05505, South Korea
| |
Collapse
|
2
|
Guldogan N, Taskin F, Icten GE, Yilmaz E, Turk EB, Erdemli S, Parlakkilic UT, Turkoglu O, Aribal E. Artificial Intelligence in BI-RADS Categorization of Breast Lesions on Ultrasound: Can We Omit Excessive Follow-ups and Biopsies? Acad Radiol 2024; 31:2194-2202. [PMID: 38087719 DOI: 10.1016/j.acra.2023.11.031] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 11/18/2023] [Accepted: 11/20/2023] [Indexed: 07/01/2024]
Abstract
RATIONALE AND OBJECTIVES Artificial intelligence (AI) systems have been increasingly applied to breast ultrasonography. They are expected to decrease the workload of radiologists and to improve diagnostic accuracy. The aim of this study is to evaluate the performance of an AI system for the BI-RADS category assessment in breast masses detected on breast ultrasound. MATERIALS AND METHODS: A total of 715 masses detected in 530 patients were analyzed. Three breast imaging centers of the same institution and nine breast radiologists participated in this study. Ultrasound was performed by one radiologist who obtained two orthogonal views of each detected lesion. These images were retrospectively reviewed by a second radiologist blinded to the patient's clinical data. A commercial AI system evaluated images. The level of agreement between the AI system and the two radiologists and their diagnostic performance were calculated according to dichotomic BI-RADS category assessment. RESULTS This study included 715 breast masses. Of these, 134 (18.75%) were malignant, and 581 (81.25%) were benign. In discriminating benign and probably benign from suspicious lesions, the agreement between AI and the first and second radiologists was moderate statistically. The sensitivity and specificity of radiologist 1, radiologist 2, and AI were calculated as 98.51% and 80.72%, 97.76% and 75.56%, and 98.51% and 65.40%, respectively. For radiologist 1, the positive predictive value (PPV) was 54.10%, the negative predictive value (NPV) was 99.58%, and the accuracy was 84.06%. Radiologist 2 achieved a PPV of 47.99%, NPV of 99.32%, and accuracy of 79.72%. The AI system exhibited a PPV of 39.64%, NPV of 99.48%, and accuracy of 71.61%. Notably, none of the lesions categorized as BI-RADS 2 by AI were malignant, while 2 of the lesions classified as BI-RADS 3 by AI were subsequently confirmed as malignant. By considering AI-assigned BI-RADS 2 as safe, we could potentially avoid 11% (18 out of 163) of benign lesion biopsies and 46.2% (110 out of 238) of follow-ups. CONCLUSION AI proves effective in predicting malignancy. Integrating it into the clinical workflow has the potential to reduce unnecessary biopsies and short-term follow-ups, which, in turn, can contribute to sustainability in healthcare practices.
Collapse
Affiliation(s)
- Nilgun Guldogan
- Breast Clinic, Acibadem Altunizade Hospital, 34662, Istanbul, Turkey (N.G., E.Y., E.B.T., E.A.).
| | - Fusun Taskin
- Department of Radiology, Acibadem M.A.A. University School of Medicine, Atakent University Hospital, 34755, Istanbul, Turkey (F.T., S.E.); Acibadem M.A.A. University Senology Research Institute, 34457, Sarıyer, Istanbul, Turkey (F.T., G.E.I., U.T.P.)
| | - Gul Esen Icten
- Acibadem M.A.A. University Senology Research Institute, 34457, Sarıyer, Istanbul, Turkey (F.T., G.E.I., U.T.P.); Department of Radiology, Acibadem M.A.A. University School of Medicine, Acıbadem Maslak Hospital, Büyükdere St. 40, 34457, Maslak, Istanbul, Turkey (G.E.I.)
| | - Ebru Yilmaz
- Breast Clinic, Acibadem Altunizade Hospital, 34662, Istanbul, Turkey (N.G., E.Y., E.B.T., E.A.)
| | - Ebru Banu Turk
- Breast Clinic, Acibadem Altunizade Hospital, 34662, Istanbul, Turkey (N.G., E.Y., E.B.T., E.A.)
| | - Servet Erdemli
- Department of Radiology, Acibadem M.A.A. University School of Medicine, Atakent University Hospital, 34755, Istanbul, Turkey (F.T., S.E.)
| | - Ulku Tuba Parlakkilic
- Acibadem M.A.A. University Senology Research Institute, 34457, Sarıyer, Istanbul, Turkey (F.T., G.E.I., U.T.P.)
| | - Ozlem Turkoglu
- Department of Radiology, Taksim Training and Research Hospital, Istanbul, Turkey (O.T.)
| | - Erkin Aribal
- Breast Clinic, Acibadem Altunizade Hospital, 34662, Istanbul, Turkey (N.G., E.Y., E.B.T., E.A.); Department of Radiology, Acibadem M.A.A. University School of Medicine, Istanbul, Turkey (E.A.)
| |
Collapse
|
3
|
Dan Q, Xu Z, Burrows H, Bissram J, Stringer JSA, Li Y. Diagnostic performance of deep learning in ultrasound diagnosis of breast cancer: a systematic review. NPJ Precis Oncol 2024; 8:21. [PMID: 38280946 PMCID: PMC10821881 DOI: 10.1038/s41698-024-00514-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Accepted: 12/08/2023] [Indexed: 01/29/2024] Open
Abstract
Deep learning (DL) has been widely investigated in breast ultrasound (US) for distinguishing between benign and malignant breast masses. This systematic review of test diagnosis aims to examine the accuracy of DL, compared to human readers, for the diagnosis of breast cancer in the US under clinical settings. Our literature search included records from databases including PubMed, Embase, Scopus, and Cochrane Library. Test accuracy outcomes were synthesized to compare the diagnostic performance of DL and human readers as well as to evaluate the assistive role of DL to human readers. A total of 16 studies involving 9238 female participants were included. There were no prospective studies comparing the test accuracy of DL versus human readers in clinical workflows. Diagnostic test results varied across the included studies. In 14 studies employing standalone DL systems, DL showed significantly lower sensitivities in 5 studies with comparable specificities and outperformed human readers at higher specificities in another 4 studies; in the remaining studies, DL models and human readers showed equivalent test outcomes. In 12 studies that assessed assistive DL systems, no studies proved the assistive role of DL in the overall diagnostic performance of human readers. Current evidence is insufficient to conclude that DL outperforms human readers or enhances the accuracy of diagnostic breast US in a clinical setting. Standardization of study methodologies is required to improve the reproducibility and generalizability of DL research, which will aid in clinical translation and application.
Collapse
Affiliation(s)
- Qing Dan
- Department of Ultrasound, Nanfang Hospital, Southern Medical University, 510515, Guangzhou, China
- Global Women's Health, The University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA
| | - Ziting Xu
- Department of Ultrasound, Nanfang Hospital, Southern Medical University, 510515, Guangzhou, China
| | - Hannah Burrows
- Health Sciences Library, The University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA
| | - Jennifer Bissram
- Health Sciences Library, The University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA
| | - Jeffrey S A Stringer
- Global Women's Health, The University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA.
| | - Yingjia Li
- Department of Ultrasound, Nanfang Hospital, Southern Medical University, 510515, Guangzhou, China.
| |
Collapse
|
4
|
Fruchtman Brot H, Mango VL. Artificial intelligence in breast ultrasound: application in clinical practice. Ultrasonography 2024; 43:3-14. [PMID: 38109894 PMCID: PMC10766882 DOI: 10.14366/usg.23116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 08/14/2023] [Accepted: 08/29/2023] [Indexed: 12/20/2023] Open
Abstract
Ultrasound (US) is a widely accessible and extensively used tool for breast imaging. It is commonly used as an additional screening tool, especially for women with dense breast tissue. Advances in artificial intelligence (AI) have led to the development of various AI systems that assist radiologists in identifying and diagnosing breast lesions using US. This article provides an overview of the background and supporting evidence for the use of AI in hand held breast US. It discusses the impact of AI on clinical workflow, covering breast cancer detection, diagnosis, prediction of molecular subtypes, evaluation of axillary lymph node status, and response to neoadjuvant chemotherapy. Additionally, the article highlights the potential significance of AI in breast US for low and middle income countries.
Collapse
|
5
|
Irmici G, Cè M, Pepa GD, D'Ascoli E, De Berardinis C, Giambersio E, Rabiolo L, La Rocca L, Carriero S, Depretto C, Scaperrotta G, Cellina M. Exploring the Potential of Artificial Intelligence in Breast Ultrasound. Crit Rev Oncog 2024; 29:15-28. [PMID: 38505878 DOI: 10.1615/critrevoncog.2023048873] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/21/2024]
Abstract
Breast ultrasound has emerged as a valuable imaging modality in the detection and characterization of breast lesions, particularly in women with dense breast tissue or contraindications for mammography. Within this framework, artificial intelligence (AI) has garnered significant attention for its potential to improve diagnostic accuracy in breast ultrasound and revolutionize the workflow. This review article aims to comprehensively explore the current state of research and development in harnessing AI's capabilities for breast ultrasound. We delve into various AI techniques, including machine learning, deep learning, as well as their applications in automating lesion detection, segmentation, and classification tasks. Furthermore, the review addresses the challenges and hurdles faced in implementing AI systems in breast ultrasound diagnostics, such as data privacy, interpretability, and regulatory approval. Ethical considerations pertaining to the integration of AI into clinical practice are also discussed, emphasizing the importance of maintaining a patient-centered approach. The integration of AI into breast ultrasound holds great promise for improving diagnostic accuracy, enhancing efficiency, and ultimately advancing patient's care. By examining the current state of research and identifying future opportunities, this review aims to contribute to the understanding and utilization of AI in breast ultrasound and encourage further interdisciplinary collaboration to maximize its potential in clinical practice.
Collapse
Affiliation(s)
- Giovanni Irmici
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Maurizio Cè
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Gianmarco Della Pepa
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Elisa D'Ascoli
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Claudia De Berardinis
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Emilia Giambersio
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Lidia Rabiolo
- Dipartimento di Biomedicina, Neuroscienze e Diagnostica Avanzata, Policlinico Università di Palermo, Palermo, Italy
| | - Ludovica La Rocca
- Postgraduation School in Radiodiagnostics, Università degli Studi di Napoli
| | - Serena Carriero
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Catherine Depretto
- Breast Radiology Unit, Fondazione IRCCS, Istituto Nazionale Tumori, Milano, Italy
| | | | - Michaela Cellina
- Radiology Department, Fatebenefratelli Hospital, ASST Fatebenefratelli Sacco, Milano, Piazza Principessa Clotilde 3, 20121, Milan, Italy
| |
Collapse
|
6
|
Villa-Camacho JC, Baikpour M, Chou SHS. Artificial Intelligence for Breast US. JOURNAL OF BREAST IMAGING 2023; 5:11-20. [PMID: 38416959 DOI: 10.1093/jbi/wbac077] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Indexed: 03/01/2024]
Abstract
US is a widely available, commonly used, and indispensable imaging modality for breast evaluation. It is often the primary imaging modality for the detection and diagnosis of breast cancer in low-resource settings. In addition, it is frequently employed as a supplemental screening tool via either whole breast handheld US or automated breast US among women with dense breasts. In recent years, a variety of artificial intelligence systems have been developed to assist radiologists with the detection and diagnosis of breast lesions on US. This article reviews the background and evidence supporting the use of artificial intelligence tools for breast US, describes implementation strategies and impact on clinical workflow, and discusses potential emerging roles and future directions.
Collapse
Affiliation(s)
| | - Masoud Baikpour
- Massachusetts General Hospital, Department of Radiology, Boston, MA, USA
| | - Shinn-Huey S Chou
- Massachusetts General Hospital, Department of Radiology, Boston, MA, USA
| |
Collapse
|
7
|
Artificial Intelligence in Breast Ultrasound: From Diagnosis to Prognosis-A Rapid Review. Diagnostics (Basel) 2022; 13:diagnostics13010058. [PMID: 36611350 PMCID: PMC9818181 DOI: 10.3390/diagnostics13010058] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2022] [Revised: 12/19/2022] [Accepted: 12/20/2022] [Indexed: 12/28/2022] Open
Abstract
BACKGROUND Ultrasound (US) is a fundamental diagnostic tool in breast imaging. However, US remains an operator-dependent examination. Research into and the application of artificial intelligence (AI) in breast US are increasing. The aim of this rapid review was to assess the current development of US-based artificial intelligence in the field of breast cancer. METHODS Two investigators with experience in medical research performed literature searching and data extraction on PubMed. The studies included in this rapid review evaluated the role of artificial intelligence concerning BC diagnosis, prognosis, molecular subtypes of breast cancer, axillary lymph node status, and the response to neoadjuvant chemotherapy. The mean values of sensitivity, specificity, and AUC were calculated for the main study categories with a meta-analytical approach. RESULTS A total of 58 main studies, all published after 2017, were included. Only 9/58 studies were prospective (15.5%); 13/58 studies (22.4%) used an ML approach. The vast majority (77.6%) used DL systems. Most studies were conducted for the diagnosis or classification of BC (55.1%). At present, all the included studies showed that AI has excellent performance in breast cancer diagnosis, prognosis, and treatment strategy. CONCLUSIONS US-based AI has great potential and research value in the field of breast cancer diagnosis, treatment, and prognosis. More prospective and multicenter studies are needed to assess the potential impact of AI in breast ultrasound.
Collapse
|