1
|
Zuckerman SP, Periaswamy S, Shisler JL, Elahi A, Edmonds CE, Hoffmeister J, Conant EF. Evaluating the Impact of Changes in Artificial Intelligence-derived Case Scores over Time on Digital Breast Tomosynthesis Screening Outcomes. Radiol Artif Intell 2025; 7:e230597. [PMID: 39812586 PMCID: PMC11950889 DOI: 10.1148/ryai.230597] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2024] [Revised: 11/14/2024] [Accepted: 12/30/2024] [Indexed: 01/16/2025]
Abstract
Purpose To evaluate the change in digital breast tomosynthesis artificial intelligence (DBT-AI) case scores over sequential screenings. Materials and Methods This retrospective review included 21 108 female patients (mean age ± SD, 58.1 years ± 11.5) with 31 741 DBT screening examinations performed at a single site from February 3, 2020, to September 12, 2022. Among 7000 patients with two or more DBT-AI screenings, 1799 had a 1-year follow-up and were included in the analysis. DBT-AI case scores and differences in case score over time were determined. Case scores ranged from 0 to 100. For each screening outcome (true positive [TP], false positive [FP], true negative [TN], false negative [FN]), mean and median case score change was calculated. Results The highest average case score was seen in TP examinations (average, 75; range, 7-100; n = 41), and the lowest average case score was seen in TN examinations (average, 34; range, 0-100; n = 1640). The largest positive case score change was seen in TP examinations (mean case score change, 21.1; median case score change, 17). FN examinations included mammographically occult cancers diagnosed following supplemental screening and those found at symptomatic diagnostic imaging. Differences between TP and TN mean case score change (P < .001) and between TP and FP mean case score change (P = .02) were statistically significant. Conclusion Using the combination of DBT AI case score with change in case score over time may help radiologists make recall decisions in DBT screening. All studies with high case score and/or case score changes should be carefully scrutinized to maximize screening performance. Keywords: Mammography, Breast, Computer Aided Diagnosis (CAD) Supplemental material is available for this article. © RSNA, 2025.
Collapse
Affiliation(s)
- Samantha P. Zuckerman
- Hospital of the University of Pennsylvania, 3400 Spruce
Street, 1 Silverstein Place, Philadelphia, PA 19104
| | | | - Julie L. Shisler
- Hospital of the University of Pennsylvania, 3400 Spruce
Street, 1 Silverstein Place, Philadelphia, PA 19104
- Now with JLS Consulting, Jupiter, Fla
| | - Ameena Elahi
- Hospital of the University of Pennsylvania, 3400 Spruce
Street, 1 Silverstein Place, Philadelphia, PA 19104
| | - Christine E. Edmonds
- Hospital of the University of Pennsylvania, 3400 Spruce
Street, 1 Silverstein Place, Philadelphia, PA 19104
| | | | - Emily F. Conant
- Hospital of the University of Pennsylvania, 3400 Spruce
Street, 1 Silverstein Place, Philadelphia, PA 19104
| |
Collapse
|
2
|
Wu DY, Vo DT, Seiler SJ. Long overdue national big data policies hinder accurate and equitable cancer detection AI systems. J Med Imaging Radiat Sci 2024; 55:101387. [PMID: 38443215 DOI: 10.1016/j.jmir.2024.02.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Revised: 02/04/2024] [Accepted: 02/09/2024] [Indexed: 03/07/2024]
Affiliation(s)
- Dolly Y Wu
- Volunteer Services, UT Southwestern Medical Center, Dallas, TX, USA.
| | - Dat T Vo
- Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX, USA
| | - Stephen J Seiler
- Department of Radiology, UT Southwestern Medical Center, Dallas, TX, USA
| |
Collapse
|
3
|
Park GE, Kang BJ, Kim SH, Mun HS. Efficacy of Mammographic Artificial Intelligence-Based Computer-Aided Detection in Predicting Pathologic Complete Response to Neoadjuvant Chemotherapy. Life (Basel) 2024; 14:1449. [PMID: 39598247 PMCID: PMC11595249 DOI: 10.3390/life14111449] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2024] [Revised: 10/30/2024] [Accepted: 11/06/2024] [Indexed: 11/29/2024] Open
Abstract
This study evaluates the potential of an AI-based computer-aided detection (AI-CAD) system in digital mammography for predicting pathologic complete response (pCR) in breast cancer patients after neoadjuvant chemotherapy (NAC). A retrospective analysis of 132 patients who underwent NAC and surgery between January 2020 and December 2022 was performed. Pre- and post-NAC mammograms were analyzed using conventional CAD and AI-CAD systems, with negative exams defined by the absence of marked abnormalities. Two radiologists reviewed mammography, ultrasound, MRI, and diffusion-weighted imaging (DWI). Concordance rates between CAD and AI-CAD were calculated, and the diagnostic performance, including the area under the receiver operating characteristics curve (AUC), was assessed. The pre-NAC concordance rates were 90.9% for CAD and 97% for AI-CAD, while post-NAC rates were 88.6% for CAD and 89.4% for AI-CAD. The MRI had the highest diagnostic performance for pCR prediction, with AI-CAD performing comparably to other modalities. Univariate analysis identified significant predictors of pCR, including AI-CAD, mammography, ultrasound, MRI, histologic grade, ER, PR, HER2, and Ki-67. In multivariable analysis, negative MRI, histologic grade 3, and HER2 positivity remained significant predictors. In conclusion, this study demonstrates that AI-CAD in digital mammography shows the potential to examine the pCR of breast cancer patients following NAC.
Collapse
Affiliation(s)
| | - Bong Joo Kang
- Department of Radiology, Seoul Saint Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul 06591, Republic of Korea
| | | | | |
Collapse
|
4
|
Leung JH, Karmakar R, Mukundan A, Thongsit P, Chen MM, Chang WY, Wang HC. Systematic Meta-Analysis of Computer-Aided Detection of Breast Cancer Using Hyperspectral Imaging. Bioengineering (Basel) 2024; 11:1060. [PMID: 39593720 PMCID: PMC11591395 DOI: 10.3390/bioengineering11111060] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2024] [Revised: 10/19/2024] [Accepted: 10/21/2024] [Indexed: 11/28/2024] Open
Abstract
The most commonly occurring cancer in the world is breast cancer with more than 500,000 cases across the world. The detection mechanism for breast cancer is endoscopist-dependent and necessitates a skilled pathologist. However, in recent years many computer-aided diagnoses (CADs) have been used to diagnose and classify breast cancer using traditional RGB images that analyze the images only in three-color channels. Nevertheless, hyperspectral imaging (HSI) is a pioneering non-destructive testing (NDT) image-processing technique that can overcome the disadvantages of traditional image processing which analyzes the images in a wide-spectrum band. Eight studies were selected for systematic diagnostic test accuracy (DTA) analysis based on the results of the Quadas-2 tool. Each of these studies' techniques is categorized according to the ethnicity of the data, the methodology employed, the wavelength that was used, the type of cancer diagnosed, and the year of publication. A Deeks' funnel chart, forest charts, and accuracy plots were created. The results were statistically insignificant, and there was no heterogeneity among these studies. The methods and wavelength bands that were used with HSI technology to detect breast cancer provided high sensitivity, specificity, and accuracy. The meta-analysis of eight studies on breast cancer diagnosis using HSI methods reported average sensitivity, specificity, and accuracy of 78%, 89%, and 87%, respectively. The highest sensitivity and accuracy were achieved with SVM (95%), while CNN methods were the most commonly used but had lower sensitivity (65.43%). Statistical analyses, including meta-regression and Deeks' funnel plots, showed no heterogeneity among the studies and highlighted the evolving performance of HSI techniques, especially after 2019.
Collapse
Affiliation(s)
- Joseph-Hang Leung
- Department of Radiology, Ditmanson Medical Foundation Chia-Yi Christian Hospital, Chiayi City 600566, Taiwan;
| | - Riya Karmakar
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Rd., Min Hsiung, Chiayi City 62102, Taiwan; (R.K.); (A.M.)
| | - Arvind Mukundan
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Rd., Min Hsiung, Chiayi City 62102, Taiwan; (R.K.); (A.M.)
| | - Pacharasak Thongsit
- Faculty of Mechanical Engineering, King Mongkut’s University of Technology North Bangkok, Pracharat 1 Road, Wongsawang, Bangsue, Bangkok 10800, Thailand;
| | - Meei-Maan Chen
- Center for Innovative Research on Aging Society (CIRAS), National Chung Cheng University, 168, University Rd., Min Hsiung, Chiayi 62102, Taiwan;
| | - Wen-Yen Chang
- Department of General Surgery, Kaohsiung Armed Forces General Hospital, 2, Zhongzheng 1st.Rd., Lingya District, Kaohsiung City 80284, Taiwan
| | - Hsiang-Chen Wang
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Rd., Min Hsiung, Chiayi City 62102, Taiwan; (R.K.); (A.M.)
- Department of Medical Research, Dalin Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, No. 2, Minsheng Road, Dalin, Chiayi 62247, Taiwan
- Hitspectra Intelligent Technology Co., Ltd., 4F., No. 2, Fuxing 4th Rd., Qianzhen Dist., Kaohsiung City 80661, Taiwan
| |
Collapse
|
5
|
Patterson F, Kunar MA. The message matters: changes to binary Computer Aided Detection recommendations affect cancer detection in low prevalence search. Cogn Res Princ Implic 2024; 9:59. [PMID: 39218972 PMCID: PMC11366737 DOI: 10.1186/s41235-024-00576-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Accepted: 07/09/2024] [Indexed: 09/04/2024] Open
Abstract
Computer Aided Detection (CAD) has been used to help readers find cancers in mammograms. Although these automated systems have been shown to help cancer detection when accurate, the presence of CAD also leads to an over-reliance effect where miss errors and false alarms increase when the CAD system fails. Previous research investigated CAD systems which overlayed salient exogenous cues onto the image to highlight suspicious areas. These salient cues capture attention which may exacerbate the over-reliance effect. Furthermore, overlaying CAD cues directly on the mammogram occludes sections of breast tissue which may disrupt global statistics useful for cancer detection. In this study we investigated whether an over-reliance effect occurred with a binary CAD system, which instead of overlaying a CAD cue onto the mammogram, reported a message alongside the mammogram indicating the possible presence of a cancer. We manipulated the certainty of the message and whether it was presented only to indicate the presence of a cancer, or whether a message was displayed on every mammogram to state whether a cancer was present or absent. The results showed that although an over-reliance effect still occurred with binary CAD systems miss errors were reduced when the CAD message was more definitive and only presented to alert readers of a possible cancer.
Collapse
Affiliation(s)
| | - Melina A Kunar
- Department of Psychology, The University of Warwick, Coventry, CV4 7AL, UK
| |
Collapse
|
6
|
Sritharan N, Gutierrez C, Perez-Raya I, Gonzalez-Hernandez JL, Owens A, Dabydeen D, Medeiros L, Kandlikar S, Phatak P. Breast Cancer Screening Using Inverse Modeling of Surface Temperatures and Steady-State Thermal Imaging. Cancers (Basel) 2024; 16:2264. [PMID: 38927969 PMCID: PMC11201981 DOI: 10.3390/cancers16122264] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2024] [Revised: 06/06/2024] [Accepted: 06/14/2024] [Indexed: 06/28/2024] Open
Abstract
Cancer is characterized by increased metabolic activity and vascularity, leading to temperature changes in cancerous tissues compared to normal cells. This study focused on patients with abnormal mammogram findings or a clinical suspicion of breast cancer, exclusively those confirmed by biopsy. Utilizing an ultra-high sensitivity thermal camera and prone patient positioning, we measured surface temperatures integrated with an inverse modeling technique based on heat transfer principles to predict malignant breast lesions. Involving 25 breast tumors, our technique accurately predicted all tumors, with maximum errors below 5 mm in size and less than 1 cm in tumor location. Predictive efficacy was unaffected by tumor size, location, or breast density, with no aberrant predictions in the contralateral normal breast. Infrared temperature profiles and inverse modeling using both techniques successfully predicted breast cancer, highlighting its potential in breast cancer screening.
Collapse
Affiliation(s)
- Nithya Sritharan
- Department of Hematology-Oncology, Rochester Regional Health, Rochester, NY 14621, USA; (N.S.); (D.D.); (L.M.)
| | - Carlos Gutierrez
- Department of Mechanical Engineering, Rochester Institute of Technology, Rochester, NY 14623, USA; (C.G.); (I.P.-R.); (J.-L.G.-H.); (A.O.); (S.K.)
| | - Isaac Perez-Raya
- Department of Mechanical Engineering, Rochester Institute of Technology, Rochester, NY 14623, USA; (C.G.); (I.P.-R.); (J.-L.G.-H.); (A.O.); (S.K.)
- BiRed Imaging Inc., Rochester, NY 14609, USA
| | - Jose-Luis Gonzalez-Hernandez
- Department of Mechanical Engineering, Rochester Institute of Technology, Rochester, NY 14623, USA; (C.G.); (I.P.-R.); (J.-L.G.-H.); (A.O.); (S.K.)
| | - Alyssa Owens
- Department of Mechanical Engineering, Rochester Institute of Technology, Rochester, NY 14623, USA; (C.G.); (I.P.-R.); (J.-L.G.-H.); (A.O.); (S.K.)
| | - Donnette Dabydeen
- Department of Hematology-Oncology, Rochester Regional Health, Rochester, NY 14621, USA; (N.S.); (D.D.); (L.M.)
| | - Lori Medeiros
- Department of Hematology-Oncology, Rochester Regional Health, Rochester, NY 14621, USA; (N.S.); (D.D.); (L.M.)
| | - Satish Kandlikar
- Department of Mechanical Engineering, Rochester Institute of Technology, Rochester, NY 14623, USA; (C.G.); (I.P.-R.); (J.-L.G.-H.); (A.O.); (S.K.)
- BiRed Imaging Inc., Rochester, NY 14609, USA
| | - Pradyumna Phatak
- Department of Hematology-Oncology, Rochester Regional Health, Rochester, NY 14621, USA; (N.S.); (D.D.); (L.M.)
- BiRed Imaging Inc., Rochester, NY 14609, USA
| |
Collapse
|
7
|
Díaz O, Rodríguez-Ruíz A, Sechopoulos I. Artificial Intelligence for breast cancer detection: Technology, challenges, and prospects. Eur J Radiol 2024; 175:111457. [PMID: 38640824 DOI: 10.1016/j.ejrad.2024.111457] [Citation(s) in RCA: 18] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2024] [Accepted: 04/08/2024] [Indexed: 04/21/2024]
Abstract
PURPOSE This review provides an overview of the current state of artificial intelligence (AI) technology for automated detection of breast cancer in digital mammography (DM) and digital breast tomosynthesis (DBT). It aims to discuss the technology, available AI systems, and the challenges faced by AI in breast cancer screening. METHODS The review examines the development of AI technology in breast cancer detection, focusing on deep learning (DL) techniques and their differences from traditional computer-aided detection (CAD) systems. It discusses data pre-processing, learning paradigms, and the need for independent validation approaches. RESULTS DL-based AI systems have shown significant improvements in breast cancer detection. They have the potential to enhance screening outcomes, reduce false negatives and positives, and detect subtle abnormalities missed by human observers. However, challenges like the lack of standardised datasets, potential bias in training data, and regulatory approval hinder their widespread adoption. CONCLUSIONS AI technology has the potential to improve breast cancer screening by increasing accuracy and reducing radiologist workload. DL-based AI systems show promise in enhancing detection performance and eliminating variability among observers. Standardised guidelines and trustworthy AI practices are necessary to ensure fairness, traceability, and robustness. Further research and validation are needed to establish clinical trust in AI. Collaboration between researchers, clinicians, and regulatory bodies is crucial to address challenges and promote AI implementation in breast cancer screening.
Collapse
Affiliation(s)
- Oliver Díaz
- Artificial Intelligence in Medicine Laboratory, Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Spain; Computer Vision Center, Barcelona, Spain.
| | | | - Ioannis Sechopoulos
- Department of Medical Imaging, Radboud University Medical Center, Nijmegen, the Netherlands; Dutch Expert Centre for Screening (LRCB), Nijmegen, the Netherlands; Technical Medicine Center, University of Twente, Enschede, the Netherlands.
| |
Collapse
|
8
|
Wu DY, Vo DT, Seiler SJ. Opinion: Big Data Elements Key to Medical Imaging Machine Learning Tool Development. JOURNAL OF BREAST IMAGING 2024; 6:217-219. [PMID: 38271153 DOI: 10.1093/jbi/wbad102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Indexed: 01/27/2024]
Affiliation(s)
- Dolly Y Wu
- UT Southwestern Medical Center, Volunteer Services, Dallas, TX, USA
| | - Dat T Vo
- Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX, USA
| | - Stephen J Seiler
- Department of Radiology, UT Southwestern Medical Center, Dallas, TX, USA
| |
Collapse
|
9
|
Wu DY, Fang YV, Vo DT, Spangler A, Seiler SJ. Detailed Image Data Quality and Cleaning Practices for Artificial Intelligence Tools for Breast Cancer. JCO Clin Cancer Inform 2024; 8:e2300074. [PMID: 38552191 PMCID: PMC10994436 DOI: 10.1200/cci.23.00074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Revised: 11/30/2023] [Accepted: 02/13/2024] [Indexed: 04/02/2024] Open
Abstract
Standardizing image-data preparation practices to improve accuracy/consistency of AI diagnostic tools.
Collapse
Affiliation(s)
- Dolly Y. Wu
- Volunteer Services, UT Southwestern Medical Center, Dallas, TX
| | - Yisheng V. Fang
- Department of Pathology, UT Southwestern Medical Center, Dallas, TX
| | - Dat T. Vo
- Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX
| | - Ann Spangler
- Retired, Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX
| | | |
Collapse
|
10
|
da Silva HEC, Santos GNM, Leite AF, Mesquita CRM, Figueiredo PTDS, Stefani CM, de Melo NS. The use of artificial intelligence tools in cancer detection compared to the traditional diagnostic imaging methods: An overview of the systematic reviews. PLoS One 2023; 18:e0292063. [PMID: 37796946 PMCID: PMC10553229 DOI: 10.1371/journal.pone.0292063] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2022] [Accepted: 09/12/2023] [Indexed: 10/07/2023] Open
Abstract
BACKGROUND AND PURPOSE In comparison to conventional medical imaging diagnostic modalities, the aim of this overview article is to analyze the accuracy of the application of Artificial Intelligence (AI) techniques in the identification and diagnosis of malignant tumors in adult patients. DATA SOURCES The acronym PIRDs was used and a comprehensive literature search was conducted on PubMed, Cochrane, Scopus, Web of Science, LILACS, Embase, Scielo, EBSCOhost, and grey literature through Proquest, Google Scholar, and JSTOR for systematic reviews of AI as a diagnostic model and/or detection tool for any cancer type in adult patients, compared to the traditional diagnostic radiographic imaging model. There were no limits on publishing status, publication time, or language. For study selection and risk of bias evaluation, pairs of reviewers worked separately. RESULTS In total, 382 records were retrieved in the databases, 364 after removing duplicates, 32 satisfied the full-text reading criterion, and 09 papers were considered for qualitative synthesis. Although there was heterogeneity in terms of methodological aspects, patient differences, and techniques used, the studies found that several AI approaches are promising in terms of specificity, sensitivity, and diagnostic accuracy in the detection and diagnosis of malignant tumors. When compared to other machine learning algorithms, the Super Vector Machine method performed better in cancer detection and diagnosis. Computer-assisted detection (CAD) has shown promising in terms of aiding cancer detection, when compared to the traditional method of diagnosis. CONCLUSIONS The detection and diagnosis of malignant tumors with the help of AI seems to be feasible and accurate with the use of different technologies, such as CAD systems, deep and machine learning algorithms and radiomic analysis when compared with the traditional model, although these technologies are not capable of to replace the professional radiologist in the analysis of medical images. Although there are limitations regarding the generalization for all types of cancer, these AI tools might aid professionals, serving as an auxiliary and teaching tool, especially for less trained professionals. Therefore, further longitudinal studies with a longer follow-up duration are required for a better understanding of the clinical application of these artificial intelligence systems. TRIAL REGISTRATION Systematic review registration. Prospero registration number: CRD42022307403.
Collapse
Affiliation(s)
| | | | - André Ferreira Leite
- Faculty of Health Science, Dentistry of Department, Brasilia University, Brasilia, Brazil
| | | | | | - Cristine Miron Stefani
- Faculty of Health Science, Dentistry of Department, Brasilia University, Brasilia, Brazil
| | - Nilce Santos de Melo
- Faculty of Health Science, Dentistry of Department, Brasilia University, Brasilia, Brazil
| |
Collapse
|
11
|
Fatima Qizilbash F, Sartaj A, Qamar Z, Kumar S, Imran M, Mohammed Y, Ali J, Baboota S, Ali A. Nanotechnology revolutionises breast cancer treatment: harnessing lipid-based nanocarriers to combat cancer cells. J Drug Target 2023; 31:794-816. [PMID: 37525966 DOI: 10.1080/1061186x.2023.2243403] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Revised: 07/21/2023] [Accepted: 07/26/2023] [Indexed: 08/02/2023]
Abstract
One of the most common cancers that occur in females is breast cancer. Despite the significant leaps and bounds that have been made in treatment of breast cancer, the disease remains one of the leading causes of death among women and a major public health challenge. The therapeutic efficacy of chemotherapeutics is hindered by chemoresistance and toxicity. Nano-based lipid drug delivery systems offer controlled drug release, nanometric size and site-specific targeting. Breast cancer treatment includes surgery, chemotherapy and radiotherapy. Despite this, no single method of treatment for the condition is currently effective due to cancer stem cell metastasis and chemo-resistance. Therefore, the employment of nanocarrier systems is necessary in order to target breast cancer stem cells. This article addresses breast cancer treatment options, including modern treatment procedures such as chemotherapy, etc. and some innovative therapeutic options highlighting the role of lipidic nanocarriers loaded with chemotherapeutic drugs such as nanoemulsion, solid-lipid nanoparticles, nanostructured lipid carriers and liposomes, and their investigations have demonstrated that they can limit cancer cell growth, reduce the risk of recurrence, as well as minimise post-chemotherapy metastasis. This article also explores FDA-approved lipid-based nanocarriers, commercially available formulations, and ligand-based formulations that are being considered for further research.
Collapse
Affiliation(s)
| | - Ali Sartaj
- Department of Pharmaceutics, School of Pharmaceutical Education and Research, New Delhi, India
- Lloyd School of Pharmacy, Greater Noida, India
| | - Zufika Qamar
- Department of Pharmaceutics, School of Pharmaceutical Education and Research, New Delhi, India
| | - Shobhit Kumar
- Department of Pharmaceutical Technology, Meerut Institute of Engineering and Technology (MIET), Meerut, India
| | - Mohammad Imran
- Therapeutics Research Group, Frazer Institute, Faculty of Medicine, The University of Queensland, Brisbane, Australia
| | - Yousuf Mohammed
- Therapeutics Research Group, Frazer Institute, Faculty of Medicine, The University of Queensland, Brisbane, Australia
- School of Pharmacy, The University of Queensland, Brisbane, Australia
| | - Javed Ali
- Department of Pharmaceutics, School of Pharmaceutical Education and Research, New Delhi, India
| | - Sanjula Baboota
- Department of Pharmaceutics, School of Pharmaceutical Education and Research, New Delhi, India
| | - Asgar Ali
- Department of Pharmaceutics, School of Pharmaceutical Education and Research, New Delhi, India
| |
Collapse
|
12
|
Kunar MA, Watson DG. Framing the fallibility of Computer-Aided Detection aids cancer detection. Cogn Res Princ Implic 2023; 8:30. [PMID: 37222932 PMCID: PMC10209366 DOI: 10.1186/s41235-023-00485-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2022] [Accepted: 04/29/2023] [Indexed: 05/25/2023] Open
Abstract
Computer-Aided Detection (CAD) has been proposed to help operators search for cancers in mammograms. Previous studies have found that although accurate CAD leads to an improvement in cancer detection, inaccurate CAD leads to an increase in both missed cancers and false alarms. This is known as the over-reliance effect. We investigated whether providing framing statements of CAD fallibility could keep the benefits of CAD while reducing over-reliance. In Experiment 1, participants were told about the benefits or costs of CAD, prior to the experiment. Experiment 2 was similar, except that participants were given a stronger warning and instruction set in relation to the costs of CAD. The results showed that although there was no effect of framing in Experiment 1, a stronger message in Experiment 2 led to a reduction in the over-reliance effect. A similar result was found in Experiment 3 where the target had a lower prevalence. The results show that although the presence of CAD can result in over-reliance on the technology, these effects can be mitigated by framing and instruction sets in relation to CAD fallibility.
Collapse
Affiliation(s)
- Melina A Kunar
- Department of Psychology, The University of Warwick, Coventry, CV4 7AL, UK.
| | - Derrick G Watson
- Department of Psychology, The University of Warwick, Coventry, CV4 7AL, UK
| |
Collapse
|
13
|
Ng CKC. Diagnostic Performance of Artificial Intelligence-Based Computer-Aided Detection and Diagnosis in Pediatric Radiology: A Systematic Review. CHILDREN (BASEL, SWITZERLAND) 2023; 10:children10030525. [PMID: 36980083 PMCID: PMC10047006 DOI: 10.3390/children10030525] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 02/13/2023] [Accepted: 03/07/2023] [Indexed: 03/30/2023]
Abstract
Artificial intelligence (AI)-based computer-aided detection and diagnosis (CAD) is an important research area in radiology. However, only two narrative reviews about general uses of AI in pediatric radiology and AI-based CAD in pediatric chest imaging have been published yet. The purpose of this systematic review is to investigate the AI-based CAD applications in pediatric radiology, their diagnostic performances and methods for their performance evaluation. A literature search with the use of electronic databases was conducted on 11 January 2023. Twenty-three articles that met the selection criteria were included. This review shows that the AI-based CAD could be applied in pediatric brain, respiratory, musculoskeletal, urologic and cardiac imaging, and especially for pneumonia detection. Most of the studies (93.3%, 14/15; 77.8%, 14/18; 73.3%, 11/15; 80.0%, 8/10; 66.6%, 2/3; 84.2%, 16/19; 80.0%, 8/10) reported model performances of at least 0.83 (area under receiver operating characteristic curve), 0.84 (sensitivity), 0.80 (specificity), 0.89 (positive predictive value), 0.63 (negative predictive value), 0.87 (accuracy), and 0.82 (F1 score), respectively. However, a range of methodological weaknesses (especially a lack of model external validation) are found in the included studies. In the future, more AI-based CAD studies in pediatric radiology with robust methodology should be conducted for convincing clinical centers to adopt CAD and realizing its benefits in a wider context.
Collapse
Affiliation(s)
- Curtise K C Ng
- Curtin Medical School, Curtin University, GPO Box U1987, Perth, WA 6845, Australia
- Curtin Health Innovation Research Institute (CHIRI), Faculty of Health Sciences, Curtin University, GPO Box U1987, Perth, WA 6845, Australia
| |
Collapse
|
14
|
Huang HY, Hsiao YP, Mukundan A, Tsao YM, Chang WY, Wang HC. Classification of Skin Cancer Using Novel Hyperspectral Imaging Engineering via YOLOv5. J Clin Med 2023; 12:1134. [PMID: 36769781 PMCID: PMC9918106 DOI: 10.3390/jcm12031134] [Citation(s) in RCA: 39] [Impact Index Per Article: 19.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2023] [Revised: 01/30/2023] [Accepted: 01/30/2023] [Indexed: 02/04/2023] Open
Abstract
Many studies have recently used several deep learning methods for detecting skin cancer. However, hyperspectral imaging (HSI) is a noninvasive optics system that can obtain wavelength information on the location of skin cancer lesions and requires further investigation. Hyperspectral technology can capture hundreds of narrow bands of the electromagnetic spectrum both within and outside the visible wavelength range as well as bands that enhance the distinction of image features. The dataset from the ISIC library was used in this study to detect and classify skin cancer on the basis of basal cell carcinoma (BCC), squamous cell carcinoma (SCC), and seborrheic keratosis (SK). The dataset was divided into training and test sets, and you only look once (YOLO) version 5 was applied to train the model. The model performance was judged according to the generated confusion matrix and five indicating parameters, including precision, recall, specificity, accuracy, and the F1-score of the trained model. Two models, namely, hyperspectral narrowband image (HSI-NBI) and RGB classification, were built and then compared in this study to understand the performance of HSI with the RGB model. Experimental results showed that the HSI model can learn the SCC feature better than the original RGB image because the feature is more prominent or the model is not captured in other categories. The recall rate of the RGB and HSI models were 0.722 to 0.794, respectively, thereby indicating an overall increase of 7.5% when using the HSI model.
Collapse
Affiliation(s)
- Hung-Yi Huang
- Department of Dermatology, Ditmanson Medical Foundation Chiayi Christian Hospital, Chiayi 60002, Taiwan
| | - Yu-Ping Hsiao
- Department of Dermatology, Chung Shan Medical University Hospital, No. 110, Sec. 1, Jianguo N. Rd., South District, Taichung City 40201, Taiwan
- Institute of Medicine, School of Medicine, Chung Shan Medical University, No. 110, Sec. 1, Jianguo N. Rd., South District, Taichung City 40201, Taiwan
| | - Arvind Mukundan
- Department of Mechanical Engineering, Advanced Institute of Manufacturing with High Tech Innovations (AIM-HI) and Center for Innovative Research on Aging Society (CIRAS), National Chung Cheng University, No. 168, University Rd., Min Hsiung, Chiayi 62102, Taiwan
| | - Yu-Ming Tsao
- Department of Mechanical Engineering, Advanced Institute of Manufacturing with High Tech Innovations (AIM-HI) and Center for Innovative Research on Aging Society (CIRAS), National Chung Cheng University, No. 168, University Rd., Min Hsiung, Chiayi 62102, Taiwan
| | - Wen-Yen Chang
- Department of General Surgery, Kaohsiung Armed Forces General Hospital, No. 2, Zhongzheng 1st Rd., Lingya District, Kaohsiung 80284, Taiwan
| | - Hsiang-Chen Wang
- Department of Mechanical Engineering, Advanced Institute of Manufacturing with High Tech Innovations (AIM-HI) and Center for Innovative Research on Aging Society (CIRAS), National Chung Cheng University, No. 168, University Rd., Min Hsiung, Chiayi 62102, Taiwan
- Hitspectra Intelligent Technology Co., Ltd., 4F, No. 2, Fuxing 4th Rd., Qianzhen District, Kaohsiung 80661, Taiwan
- Department of Medical Research, Dalin Tzu Chi General Hospital, No. 2, Min-Sheng Rd., Dalin Town, Chiayi 62247, Taiwan
| |
Collapse
|
15
|
Magni V, Cozzi A, Schiaffino S, Colarieti A, Sardanelli F. Artificial intelligence for digital breast tomosynthesis: Impact on diagnostic performance, reading times, and workload in the era of personalized screening. Eur J Radiol 2023; 158:110631. [PMID: 36481480 DOI: 10.1016/j.ejrad.2022.110631] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Accepted: 11/24/2022] [Indexed: 12/05/2022]
Abstract
The ultimate goals of the application of artificial intelligence (AI) to digital breast tomosynthesis (DBT) are the reduction of reading times, the increase of diagnostic performance, and the reduction of interval cancer rates. In this review, after outlining the journey from computer-aided detection/diagnosis systems to AI applied to digital mammography (DM), we summarize the results of studies where AI was applied to DBT, noting that long-term advantages of DBT screening and its crucial ability to decrease the interval cancer rate are still under scrutiny. AI has shown the capability to overcome some shortcomings of DBT in the screening setting by improving diagnostic performance and by reducing recall rates (from -2 % to -27 %) and reading times (up to -53 %, with an average 20 % reduction), but the ability of AI to reduce interval cancer rates has not yet been clearly investigated. Prospective validation is needed to assess the cost-effectiveness and real-world impact of AI models assisting DBT interpretation, especially in large-scale studies with low breast cancer prevalence. Finally, we focus on the incoming era of personalized and risk-stratified screening that will first see the application of contrast-enhanced breast imaging to screen women with extremely dense breasts. As the diagnostic advantage of DBT over DM was concentrated in this category, we try to understand if the application of AI to DM in the remaining cohorts of women with heterogeneously dense or non-dense breast could close the gap in diagnostic performance between DM and DBT, thus neutralizing the usefulness of AI application to DBT.
Collapse
Affiliation(s)
- Veronica Magni
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Luigi Mangiagalli 31, 20133 Milano, Italy.
| | - Andrea Cozzi
- Unit of Radiology, IRCCS Policlinico San Donato, Via Rodolfo Morandi 30, 20097 San Donato Milanese, Italy
| | - Simone Schiaffino
- Unit of Radiology, IRCCS Policlinico San Donato, Via Rodolfo Morandi 30, 20097 San Donato Milanese, Italy
| | - Anna Colarieti
- Unit of Radiology, IRCCS Policlinico San Donato, Via Rodolfo Morandi 30, 20097 San Donato Milanese, Italy
| | - Francesco Sardanelli
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Luigi Mangiagalli 31, 20133 Milano, Italy; Unit of Radiology, IRCCS Policlinico San Donato, Via Rodolfo Morandi 30, 20097 San Donato Milanese, Italy.
| |
Collapse
|
16
|
Li X, Cui J, Song J, Jia M, Zou Z, Ding G, Zheng Y. Contextual Features and Information Bottleneck-Based Multi-Input Network for Breast Cancer Classification from Contrast-Enhanced Spectral Mammography. Diagnostics (Basel) 2022; 12:3133. [PMID: 36553140 PMCID: PMC9777091 DOI: 10.3390/diagnostics12123133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Revised: 12/02/2022] [Accepted: 12/07/2022] [Indexed: 12/14/2022] Open
Abstract
In computer-aided diagnosis methods for breast cancer, deep learning has been shown to be an effective method to distinguish whether lesions are present in tissues. However, traditional methods only classify masses as benign or malignant, according to their presence or absence, without considering the contextual features between them and their adjacent tissues. Furthermore, for contrast-enhanced spectral mammography, the existing studies have only performed feature extraction on a single image per breast. In this paper, we propose a multi-input deep learning network for automatic breast cancer classification. Specifically, we simultaneously input four images of each breast with different feature information into the network. Then, we processed the feature maps in both horizontal and vertical directions, preserving the pixel-level contextual information within the neighborhood of the tumor during the pooling operation. Furthermore, we designed a novel loss function according to the information bottleneck theory to optimize our multi-input network and ensure that the common information in the multiple input images could be fully utilized. Our experiments on 488 images (256 benign and 232 malignant images) from 122 patients show that the method's accuracy, precision, sensitivity, specificity, and f1-score values are 0.8806, 0.8803, 0.8810, 0.8801, and 0.8806, respectively. The qualitative, quantitative, and ablation experiment results show that our method significantly improves the accuracy of breast cancer classification and reduces the false positive rate of diagnosis. It can reduce misdiagnosis rates and unnecessary biopsies, helping doctors determine accurate clinical diagnoses of breast cancer from multiple CESM images.
Collapse
Affiliation(s)
- Xinmeng Li
- School of Information Science and Engineering, Shandong Normal University, Jinan 250358, China
| | - Jia Cui
- School of Information Science and Engineering, Shandong Normal University, Jinan 250358, China
| | - Jingqi Song
- School of Information Science and Engineering, Shandong Normal University, Jinan 250358, China
| | - Mingyu Jia
- School of Information Science and Engineering, Shandong Normal University, Jinan 250358, China
| | - Zhenxing Zou
- Department of Radiology, Yantai Yuhuangding Hospital, Yantai 264001, China
| | - Guocheng Ding
- Department of Radiology, Yantai Yuhuangding Hospital, Yantai 264001, China
| | - Yuanjie Zheng
- School of Information Science and Engineering, Shandong Normal University, Jinan 250358, China
| |
Collapse
|
17
|
Jiang J, Peng J, Hu C, Jian W, Wang X, Liu W. Breast cancer detection and classification in mammogram using a three-stage deep learning framework based on PAA algorithm. Artif Intell Med 2022; 134:102419. [PMID: 36462904 DOI: 10.1016/j.artmed.2022.102419] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2021] [Revised: 07/20/2022] [Accepted: 10/02/2022] [Indexed: 12/13/2022]
Abstract
In recent years, deep learning has been used to develop an automatic breast cancer detection and classification tool to assist doctors. In this paper, we proposed a three-stage deep learning framework based on an anchor-free object detection algorithm, named the Probabilistic Anchor Assignment (PAA) to improve diagnosis performance by automatically detecting breast lesions (i.e., mass and calcification) and further classifying mammograms into benign or malignant. Firstly, a single-stage PAA-based detector roundly finds suspicious breast lesions in mammogram. Secondly, we designed a two-branch ROI detector to further classify and regress these lesions that aim to reduce the number of false positives. Besides, in this stage, we introduced a threshold-adaptive post-processing algorithm with dense breast information. Finally, the benign or malignant lesions would be classified by an ROI classifier which combines local-ROI features and global-image features. In addition, considering the strong correlation between the task of detection head of PAA and the task of whole mammogram classification, we added an image classifier that utilizes the same global-image features to perform image classification. The image classifier and the ROI classifier jointly guide to enhance the feature extraction ability and further improve the performance of classification. We integrated three public datasets of mammograms (CBIS-DDSM, INbreast, MIAS) to train and test our model and compared our framework with recent state-of-the-art methods. The results show that our proposed method can improve the diagnostic efficiency of radiologists by automatically detecting and classifying breast lesions and classifying benign and malignant mammograms.
Collapse
Affiliation(s)
- Jiale Jiang
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen 518060, Guangdong, China; Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, Shenzhen University, Shenzhen 518060, Guangdong, China; National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Shenzhen University, Shenzhen 518060, Guangdong, China
| | - Junchuan Peng
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen 518060, Guangdong, China; Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, Shenzhen University, Shenzhen 518060, Guangdong, China; National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Shenzhen University, Shenzhen 518060, Guangdong, China
| | - Chuting Hu
- Department of Breast and Thyroid Surgery, The Second People's Hospital of Shenzhen, Shenzhen 518035, Guangdong, China
| | - Wenjing Jian
- Department of Breast and Thyroid Surgery, The Second People's Hospital of Shenzhen, Shenzhen 518035, Guangdong, China
| | - Xianming Wang
- Department of Breast and Thyroid Surgery, South China Hospital Affiliated to Shenzhen University, Shenzhen 518111, Guangdong, China.
| | - Weixiang Liu
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen 518060, Guangdong, China; Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, Shenzhen University, Shenzhen 518060, Guangdong, China; National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Shenzhen University, Shenzhen 518060, Guangdong, China; College of Mechatronics and Control Engineering, Shenzhen University, Shenzhen 518060, Guangdong, China.
| |
Collapse
|
18
|
Kato S, Amemiya S, Takao H, Yamashita H, Sakamoto N, Miki S, Watanabe Y, Suzuki F, Fujimoto K, Mizuki M, Abe O. Computer-aided detection improves brain metastasis identification on non-enhanced CT in less experienced radiologists. Acta Radiol 2022; 64:1958-1965. [PMID: 36426577 DOI: 10.1177/02841851221139124] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
Background Brain metastases (BMs) are the most common intracranial tumors causing neurological complications associated with significant morbidity and mortality. Purpose To evaluate the effect of computer-aided detection (CAD) on the performance of observers in detecting BMs on non-enhanced computed tomography (NECT). Material and Methods Three less experienced and three experienced radiologists interpreted 30 NECT scans with 89 BMs in 25 cases to detect BMs with and without the assistance of CAD. The observers’ sensitivity, number of false positives (FPs), positive predictive value (PPV), and reading time with and without CAD were compared using paired t-tests. The sensitivity of CAD and the observers were compared using a one-sample t-test Results With CAD, less experienced radiologists’ sensitivity significantly increased from 27.7% ± 4.6% to 32.6% ± 4.8% ( P = 0.007), while the experienced radiologists’ sensitivity did not show a significant difference (from 33.3% ± 3.5% to 31.9% ± 3.7%; P = 0.54). There was no significant difference between conditions with CAD and without CAD for FPs (less experienced radiologists: 23.0 ± 10.4 and 25.0 ± 9.3; P = 0.32; experienced radiologists: 18.3 ± 7.4 and 17.3 ± 6.7; P = 0.76) and PPVs (less experienced radiologists: 57.9% ± 8.3% and 50.9% ± 7.0%; P = 0.14; experienced radiologists: 61.8% ± 12.7% and 64.0% ± 12.1%; P = 0.69). There were no significant differences in reading time with and without CAD (85.0 ± 45.6 s and 73.7 ± 36.7 s; P = 0.09). The sensitivity of CAD was 47.2% (with a PPV of 8.9%), which was significantly higher than that of any radiologist ( P < 0.001). Conclusion CAD improved BM detection sensitivity on NECT without increasing FPs or reading time among less experienced radiologists, but this was not the case among experienced radiologists.
Collapse
Affiliation(s)
- Shimpei Kato
- Department of Radiology, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Shiori Amemiya
- Department of Radiology, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Hidemasa Takao
- Department of Radiology, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Hiroshi Yamashita
- Department of Radiology, Teikyo University Hospital, Kawasaki, Kanagawa, Japan
| | - Naoya Sakamoto
- Department of Radiology, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Soichiro Miki
- Department of Radiology, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Yusuke Watanabe
- Department of Radiology, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Fumio Suzuki
- Department of Radiology, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Kotaro Fujimoto
- Department of Radiology, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Masumi Mizuki
- Department of Radiology, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Osamu Abe
- Department of Radiology, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| |
Collapse
|
19
|
Dileep G, Gianchandani Gyani SG. Artificial Intelligence in Breast Cancer Screening and Diagnosis. Cureus 2022; 14:e30318. [PMID: 36381716 PMCID: PMC9650950 DOI: 10.7759/cureus.30318] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Accepted: 10/15/2022] [Indexed: 11/05/2022] Open
Abstract
Cancer is a disease that continues to plague our modern society. Among all types of cancer, breast cancer is now the most common type of cancer occurring in women worldwide. Various factors, including genetics, lifestyle, and the environment, have contributed to the rise in the prevalence of breast cancer among women of all socioeconomic strata. Therefore, proper screening for early diagnosis and treatment becomes a major factor when fighting the disease. Artificial intelligence (AI) continues to revolutionize various spheres of our lives with its numerous applications. Using AI in the existing screening process makes obtaining results even easier and more convenient. Faster, more accurate results are some of the benefits of AI methods in breast cancer screening. Nonetheless, there are many challenges in the process of the integration of AI that needs to be addressed systematically. The following is a review of the application of AI in breast cancer screening.
Collapse
|
20
|
Jones MA, Islam W, Faiz R, Chen X, Zheng B. Applying artificial intelligence technology to assist with breast cancer diagnosis and prognosis prediction. Front Oncol 2022; 12:980793. [PMID: 36119479 PMCID: PMC9471147 DOI: 10.3389/fonc.2022.980793] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Accepted: 08/04/2022] [Indexed: 12/27/2022] Open
Abstract
Breast cancer remains the most diagnosed cancer in women. Advances in medical imaging modalities and technologies have greatly aided in the early detection of breast cancer and the decline of patient mortality rates. However, reading and interpreting breast images remains difficult due to the high heterogeneity of breast tumors and fibro-glandular tissue, which results in lower cancer detection sensitivity and specificity and large inter-reader variability. In order to help overcome these clinical challenges, researchers have made great efforts to develop computer-aided detection and/or diagnosis (CAD) schemes of breast images to provide radiologists with decision-making support tools. Recent rapid advances in high throughput data analysis methods and artificial intelligence (AI) technologies, particularly radiomics and deep learning techniques, have led to an exponential increase in the development of new AI-based models of breast images that cover a broad range of application topics. In this review paper, we focus on reviewing recent advances in better understanding the association between radiomics features and tumor microenvironment and the progress in developing new AI-based quantitative image feature analysis models in three realms of breast cancer: predicting breast cancer risk, the likelihood of tumor malignancy, and tumor response to treatment. The outlook and three major challenges of applying new AI-based models of breast images to clinical practice are also discussed. Through this review we conclude that although developing new AI-based models of breast images has achieved significant progress and promising results, several obstacles to applying these new AI-based models to clinical practice remain. Therefore, more research effort is needed in future studies.
Collapse
Affiliation(s)
- Meredith A. Jones
- School of Biomedical Engineering, University of Oklahoma, Norman, OK, United States
| | - Warid Islam
- School of Electrical and Computer Engineering, University of Oklahoma, Norman, OK, United States
| | - Rozwat Faiz
- School of Electrical and Computer Engineering, University of Oklahoma, Norman, OK, United States
| | - Xuxin Chen
- School of Electrical and Computer Engineering, University of Oklahoma, Norman, OK, United States
| | - Bin Zheng
- School of Electrical and Computer Engineering, University of Oklahoma, Norman, OK, United States
| |
Collapse
|
21
|
Ibrahim A, Mohamed HK, Maher A, Zhang B. A Survey on Human Cancer Categorization Based on Deep Learning. Front Artif Intell 2022; 5:884749. [PMID: 35832207 PMCID: PMC9271903 DOI: 10.3389/frai.2022.884749] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2022] [Accepted: 05/09/2022] [Indexed: 11/13/2022] Open
Abstract
In recent years, we have witnessed the fast growth of deep learning, which involves deep neural networks, and the development of the computing capability of computer devices following the advance of graphics processing units (GPUs). Deep learning can prototypically and successfully categorize histopathological images, which involves imaging classification. Various research teams apply deep learning to medical diagnoses, especially cancer diseases. Convolutional neural networks (CNNs) detect the conventional visual features of disease diagnoses, e.g., lung, skin, brain, prostate, and breast cancer. A CNN has a procedure for perfectly investigating medicinal science images. This study assesses the main deep learning concepts relevant to medicinal image investigation and surveys several charities in the field. In addition, it covers the main categories of imaging procedures in medication. The survey comprises the usage of deep learning for object detection, classification, and human cancer categorization. In addition, the most popular cancer types have also been introduced. This article discusses the Vision-Based Deep Learning System among the dissimilar sorts of data mining techniques and networks. It then introduces the most extensively used DL network category, which is convolutional neural networks (CNNs) and investigates how CNN architectures have evolved. Starting with Alex Net and progressing with the Google and VGG networks, finally, a discussion of the revealed challenges and trends for upcoming research is held.
Collapse
Affiliation(s)
- Ahmad Ibrahim
- Department of Computer Science, October 6 University, Cairo, Egypt
| | - Hoda K. Mohamed
- Department of Computer Engineering, Ain Shams University, Cairo, Egypt
| | - Ali Maher
- Department of Computer Science, October 6 University, Cairo, Egypt
| | - Baochang Zhang
- School of Automation Science and Electrical Engineering, Beihang University, Beijing, China
| |
Collapse
|
22
|
AI-CAD for differentiating lesions presenting as calcifications only on mammography: outcome analysis incorporating the ACR BI-RADS descriptors for calcifications. Eur Radiol 2022; 32:6565-6574. [PMID: 35748900 DOI: 10.1007/s00330-022-08961-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2022] [Revised: 06/03/2022] [Accepted: 06/09/2022] [Indexed: 12/24/2022]
Abstract
OBJECTIVES To evaluate how AI-CAD triages calcifications and to compare its performance to an experienced breast radiologist. METHODS Among routine mammography performed between June 2016 and May 2018, 535 lesions detected as calcifications only on mammography in 500 women (mean age, 48.8 years) that were additionally interpreted with additional magnification views were included in this study. One dedicated breast radiologist retrospectively reviewed the magnification mammograms to assess morphology, distribution, and final assessment category according to ACR BI-RADS. AI-CAD analyzed routine mammograms providing AI-CAD marks and corresponding AI-CAD scores (ranging from 0 to 100%), for which values ≥ 10% were considered positive. Ground truth in terms of malignancy or benignity was confirmed with a histopathologic diagnosis or at least 1 year of imaging follow - up. RESULTS Of the 535 calcifications, 215 (40.2%) were malignant. Calcifications with positive AI-CAD scores showed significantly higher PPVs compared to calcifications with negative scores for all morphology (all p < 0.05). PPVs were significantly higher in calcifications with positive AI-CAD scores compared to those with negative scores for BI-RADS 3, 4a, or 4b assessments (all p < 0.05). AI-CAD and the experienced radiologist did not show significant difference in diagnostic performance; sensitivity 92.1% vs 95.4% (p = 0.125), specificity 71.9% vs 72.5% (p = 0.842), and accuracy 80.0% vs 81.7% (p = 0.413). CONCLUSION Among calcifications with same morphology or BI-RADS assessment, those with positive AI-CAD scores had significantly higher PPVs. AI-CAD showed similar diagnostic performances to the experienced radiologist for calcifications detected on mammography. KEY POINTS • Among calcifications with same morphology or BI-RADS assessment, those with positive AI-CAD scores had significantly higher PPVs. • AI-CAD showed similar diagnostic performance to an experienced radiologist in assessing lesions detected as calcifications only on mammography. • Among malignant calcifications, calcifications with positive AI-CAD scores showed higher rates of invasive cancers than calcifications with negative scores (all p > 0.05).
Collapse
|
23
|
A Comparison of Computer-Aided Diagnosis Schemes Optimized Using Radiomics and Deep Transfer Learning Methods. Bioengineering (Basel) 2022; 9:bioengineering9060256. [PMID: 35735499 PMCID: PMC9219621 DOI: 10.3390/bioengineering9060256] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2022] [Revised: 05/25/2022] [Accepted: 06/13/2022] [Indexed: 01/29/2023] Open
Abstract
Objective: Radiomics and deep transfer learning are two popular technologies used to develop computer-aided detection and diagnosis (CAD) schemes of medical images. This study aims to investigate and to compare the advantages and the potential limitations of applying these two technologies in developing CAD schemes. Methods: A relatively large and diverse retrospective dataset including 3000 digital mammograms was assembled in which 1496 images depicted malignant lesions and 1504 images depicted benign lesions. Two CAD schemes were developed to classify breast lesions. The first scheme was developed using four steps namely, applying an adaptive multi-layer topographic region growing algorithm to segment lesions, computing initial radiomics features, applying a principal component algorithm to generate an optimal feature vector, and building a support vector machine classifier. The second CAD scheme was built based on a pre-trained residual net architecture (ResNet50) as a transfer learning model to classify breast lesions. Both CAD schemes were trained and tested using a 10-fold cross-validation method. Several score fusion methods were also investigated to classify breast lesions. CAD performances were evaluated and compared by the areas under the ROC curve (AUC). Results: The ResNet50 model-based CAD scheme yielded AUC = 0.85 ± 0.02, which was significantly higher than the radiomics feature-based CAD scheme with AUC = 0.77 ± 0.02 (p < 0.01). Additionally, the fusion of classification scores generated by the two CAD schemes did not further improve classification performance. Conclusion: This study demonstrates that using deep transfer learning is more efficient to develop CAD schemes and it enables a higher lesion classification performance than CAD schemes developed using radiomics-based technology.
Collapse
|
24
|
Estai M, Tennant M, Gebauer D, Brostek A, Vignarajan J, Mehdizadeh M, Saha S. Deep learning for automated detection and numbering of permanent teeth on panoramic images. Dentomaxillofac Radiol 2022; 51:20210296. [PMID: 34644152 PMCID: PMC8802702 DOI: 10.1259/dmfr.20210296] [Citation(s) in RCA: 38] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2021] [Revised: 09/23/2021] [Accepted: 09/23/2021] [Indexed: 02/03/2023] Open
Abstract
OBJECTIVE This study aimed to evaluate an automated detection system to detect and classify permanent teeth on orthopantomogram (OPG) images using convolutional neural networks (CNNs). METHODS In total, 591 digital OPGs were collected from patients older than 18 years. Three qualified dentists performed individual teeth labelling on images to generate the ground truth annotations. A three-step procedure, relying upon CNNs, was proposed for automated detection and classification of teeth. Firstly, U-Net, a type of CNN, performed preliminary segmentation of tooth regions or detecting regions of interest (ROIs) on panoramic images. Secondly, the Faster R-CNN, an advanced object detection architecture, identified each tooth within the ROI determined by the U-Net. Thirdly, VGG-16 architecture classified each tooth into 32 categories, and a tooth number was assigned. A total of 17,135 teeth cropped from 591 radiographs were used to train and validate the tooth detection and tooth numbering modules. 90% of OPG images were used for training, and the remaining 10% were used for validation. 10-folds cross-validation was performed for measuring the performance. The intersection over union (IoU), F1 score, precision, and recall (i.e. sensitivity) were used as metrics to evaluate the performance of resultant CNNs. RESULTS The ROI detection module had an IoU of 0.70. The tooth detection module achieved a recall of 0.99 and a precision of 0.99. The tooth numbering module had a recall, precision and F1 score of 0.98. CONCLUSION The resultant automated method achieved high performance for automated tooth detection and numbering from OPG images. Deep learning can be helpful in the automatic filing of dental charts in general dentistry and forensic medicine.
Collapse
Affiliation(s)
| | - Marc Tennant
- School of Human Sciences, The University of Western Australia, Crawley, Australia
| | | | - Andrew Brostek
- The UWA Dental School, The University of Western Australia, Crawley, Australia
| | | | | | - Sajib Saha
- The Australian e-Health Research Centre, CSIRO, Floreat, Australia
| |
Collapse
|
25
|
Zhou K, Li W, Zhao D. Deep learning-based breast region extraction of mammographic images combining pre-processing methods and semantic segmentation supported by Deeplab v3. Technol Health Care 2022; 30:173-190. [PMID: 35124595 PMCID: PMC9028646 DOI: 10.3233/thc-228017] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
Abstract
BACKGROUND Breast cancer has long been one of the major global life-threatening illnesses among women. Surgery and adjuvant therapy, coupled with early detection, could save many lives. This underscores the importance of mammography, a cost-effective and accurate method for early detection. Due to the poor contrast, noise and artifacts which results in difficulty for radiologists to diagnose, Computer-Aided Diagnosis (CAD) systems are hence developed. The extraction of breast region is a fundamental and crucial preparation step for further development of CAD systems. OBJECTIVE The proposed method aims to extract breast region accurately from mammographic images where noise is suppressed, contrast is enhanced and pectoral muscle region is removed. METHODS This paper presents a new deep learning-based breast region extraction method that combines pre-processing methods containing noise suppression using median filter, contrast enhancement using CLAHE and semantic segmentation using Deeplab v3+ model. RESULTS The method is trained and evaluated on mini-MIAS dataset. It has also been evaluated on INbreast dataset. The results outperform those generated by other recent researches and are indicative of the capacity of the model to retain its accuracy and runtime advantage across different databases with different image resolutions. CONCLUSIONS The proposed method shows state-of-the-art performance at extracting breast region from mammographic images. Wide range of evaluation on two commonly used mammography datasets proves the ability and adaptability of the method.
Collapse
Affiliation(s)
- Kuochen Zhou
- School of Computer Science and Engineering, Northeastern University, Shenyang, Liaoning, China
| | - Wei Li
- School of Computer Science and Engineering, Northeastern University, Shenyang, Liaoning, China
| | - Dazhe Zhao
- School of Computer Science and Engineering, Northeastern University, Shenyang, Liaoning, China
| |
Collapse
|
26
|
Dahlblom V, Andersson I, Lång K, Tingberg A, Zackrisson S, Dustler M. Artificial Intelligence Detection of Missed Cancers at Digital Mammography That Were Detected at Digital Breast Tomosynthesis. Radiol Artif Intell 2021; 3:e200299. [PMID: 34870215 DOI: 10.1148/ryai.2021200299] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2020] [Revised: 07/12/2021] [Accepted: 08/09/2021] [Indexed: 11/11/2022]
Abstract
Purpose To investigate how an artificial intelligence (AI) system performs at digital mammography (DM) from a screening population with ground truth defined by digital breast tomosynthesis (DBT), and whether AI could detect breast cancers at DM that had originally only been detected at DBT. Materials and Methods In this secondary analysis of data from a prospective study, DM examinations from 14 768 women (mean age, 57 years), examined with both DM and DBT with independent double reading in the Malmӧ Breast Tomosynthesis Screening Trial (MBTST) (ClinicalTrials.gov: NCT01091545; data collection, 2010-2015), were analyzed with an AI system. Of 136 screening-detected cancers, 95 cancers were detected at DM and 41 cancers were detected only at DBT. The system identifies suspicious areas in the image, scored 1-100, and provides a risk score of 1 to 10 for the whole examination. A cancer was defined as AI detected if the cancer lesion was correctly localized and scored at least 62 (threshold determined by the AI system developers), therefore resulting in the highest examination risk score of 10. Data were analyzed with descriptive statistics, and detection performance was analyzed with receiver operating characteristics. Results The highest examination risk score was assigned to 10% (1493 of 14 786) of the examinations. With 90.8% specificity, the AI system detected 75% (71 of 95) of the DM-detected cancers and 44% (18 of 41) of cancers at DM that had originally been detected only at DBT. The majority were invasive cancers (17 of 18). Conclusion Almost half of the additional DBT-only screening-detected cancers in the MBTST were detected at DM with AI. AI did not reach double reading performance; however, if combined with double reading, AI has the potential to achieve a substantial portion of the benefit of DBT screening.Keywords: Computer-aided Diagnosis, Mammography, Breast, Diagnosis, Classification, Application DomainClinical trial registration no. NCT01091545© RSNA, 2021.
Collapse
Affiliation(s)
- Victor Dahlblom
- Diagnostic Radiology (V.D., I.A., K.L., S.Z., M.D.) and Medical Radiation Physics (A.T., M.D.), Department of Translational Medicine, Lund University, Malmö, Sweden; and Department of Medical Imaging and Physiology (V.D., S.Z.), Unilabs Breast Centre (I.A., K.L.), and Department of Radiation Physics (A.T.), Skåne University Hospital, Carl Bertil Laurells gata 9, 205 02 Malmö, Sweden
| | - Ingvar Andersson
- Diagnostic Radiology (V.D., I.A., K.L., S.Z., M.D.) and Medical Radiation Physics (A.T., M.D.), Department of Translational Medicine, Lund University, Malmö, Sweden; and Department of Medical Imaging and Physiology (V.D., S.Z.), Unilabs Breast Centre (I.A., K.L.), and Department of Radiation Physics (A.T.), Skåne University Hospital, Carl Bertil Laurells gata 9, 205 02 Malmö, Sweden
| | - Kristina Lång
- Diagnostic Radiology (V.D., I.A., K.L., S.Z., M.D.) and Medical Radiation Physics (A.T., M.D.), Department of Translational Medicine, Lund University, Malmö, Sweden; and Department of Medical Imaging and Physiology (V.D., S.Z.), Unilabs Breast Centre (I.A., K.L.), and Department of Radiation Physics (A.T.), Skåne University Hospital, Carl Bertil Laurells gata 9, 205 02 Malmö, Sweden
| | - Anders Tingberg
- Diagnostic Radiology (V.D., I.A., K.L., S.Z., M.D.) and Medical Radiation Physics (A.T., M.D.), Department of Translational Medicine, Lund University, Malmö, Sweden; and Department of Medical Imaging and Physiology (V.D., S.Z.), Unilabs Breast Centre (I.A., K.L.), and Department of Radiation Physics (A.T.), Skåne University Hospital, Carl Bertil Laurells gata 9, 205 02 Malmö, Sweden
| | - Sophia Zackrisson
- Diagnostic Radiology (V.D., I.A., K.L., S.Z., M.D.) and Medical Radiation Physics (A.T., M.D.), Department of Translational Medicine, Lund University, Malmö, Sweden; and Department of Medical Imaging and Physiology (V.D., S.Z.), Unilabs Breast Centre (I.A., K.L.), and Department of Radiation Physics (A.T.), Skåne University Hospital, Carl Bertil Laurells gata 9, 205 02 Malmö, Sweden
| | - Magnus Dustler
- Diagnostic Radiology (V.D., I.A., K.L., S.Z., M.D.) and Medical Radiation Physics (A.T., M.D.), Department of Translational Medicine, Lund University, Malmö, Sweden; and Department of Medical Imaging and Physiology (V.D., S.Z.), Unilabs Breast Centre (I.A., K.L.), and Department of Radiation Physics (A.T.), Skåne University Hospital, Carl Bertil Laurells gata 9, 205 02 Malmö, Sweden
| |
Collapse
|
27
|
Connected-UNets: a deep learning architecture for breast mass segmentation. NPJ Breast Cancer 2021; 7:151. [PMID: 34857755 PMCID: PMC8640011 DOI: 10.1038/s41523-021-00358-x] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2021] [Accepted: 11/01/2021] [Indexed: 12/19/2022] Open
Abstract
Breast cancer analysis implies that radiologists inspect mammograms to detect suspicious breast lesions and identify mass tumors. Artificial intelligence techniques offer automatic systems for breast mass segmentation to assist radiologists in their diagnosis. With the rapid development of deep learning and its application to medical imaging challenges, UNet and its variations is one of the state-of-the-art models for medical image segmentation that showed promising performance on mammography. In this paper, we propose an architecture, called Connected-UNets, which connects two UNets using additional modified skip connections. We integrate Atrous Spatial Pyramid Pooling (ASPP) in the two standard UNets to emphasize the contextual information within the encoder–decoder network architecture. We also apply the proposed architecture on the Attention UNet (AUNet) and the Residual UNet (ResUNet). We evaluated the proposed architectures on two publically available datasets, the Curated Breast Imaging Subset of Digital Database for Screening Mammography (CBIS-DDSM) and INbreast, and additionally on a private dataset. Experiments were also conducted using additional synthetic data using the cycle-consistent Generative Adversarial Network (CycleGAN) model between two unpaired datasets to augment and enhance the images. Qualitative and quantitative results show that the proposed architecture can achieve better automatic mass segmentation with a high Dice score of 89.52%, 95.28%, and 95.88% and Intersection over Union (IoU) score of 80.02%, 91.03%, and 92.27%, respectively, on CBIS-DDSM, INbreast, and the private dataset.
Collapse
|
28
|
Hooshmand S, Reed WM, Suleiman ME, Brennan PC. SCREENING MAMMOGRAPHY: DIAGNOSTIC EFFICACY-ISSUES AND CONSIDERATIONS FOR THE 2020S. RADIATION PROTECTION DOSIMETRY 2021; 197:54-62. [PMID: 34729603 DOI: 10.1093/rpd/ncab160] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/07/2021] [Revised: 10/04/2021] [Accepted: 10/08/2021] [Indexed: 06/13/2023]
Abstract
Diagnostic efficacy in medical imaging is ultimately a reflection of radiologist performance. This can be influenced by numerous factors, some of which are patient related, such as the physical size and density of the breast, and machine related, where some lesions are difficult to visualise on traditional imaging techniques. Other factors are human reader errors that occur during the diagnostic process, which relate to reader experience and their perceptual and cognitive oversights. Given the large-scale nature of breast cancer screening, even small increases in diagnostic performance equate to large numbers of women saved. It is important to identify the causes of diagnostic errors and how detection efficacy can be improved. This narrative review will therefore explore the various factors that influence mammographic performance and the potential solutions used in an attempt to ameliorate the errors made.
Collapse
Affiliation(s)
- Sahand Hooshmand
- Faculty of Medicine and Health, The Discipline of Medical Imaging Sciences, The University of Sydney, Susan Wakil Health Building (D18), Sydney, NSW 2050, Australia
| | - Warren M Reed
- Faculty of Medicine and Health, The Discipline of Medical Imaging Sciences, The University of Sydney, Susan Wakil Health Building (D18), Sydney, NSW 2050, Australia
| | - Mo'ayyad E Suleiman
- Faculty of Medicine and Health, The Discipline of Medical Imaging Sciences, The University of Sydney, Susan Wakil Health Building (D18), Sydney, NSW 2050, Australia
| | - Patrick C Brennan
- Faculty of Medicine and Health, The Discipline of Medical Imaging Sciences, The University of Sydney, Susan Wakil Health Building (D18), Sydney, NSW 2050, Australia
| |
Collapse
|
29
|
Winder M, Owczarek AJ, Chudek J, Pilch-Kowalczyk J, Baron J. Are We Overdoing It? Changes in Diagnostic Imaging Workload during the Years 2010-2020 including the Impact of the SARS-CoV-2 Pandemic. Healthcare (Basel) 2021; 9:1557. [PMID: 34828603 PMCID: PMC8621920 DOI: 10.3390/healthcare9111557] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Revised: 11/09/2021] [Accepted: 11/10/2021] [Indexed: 12/30/2022] Open
Abstract
Since the 1990s, there has been a significant increase in the number of imaging examinations as well as a related increase in the healthcare expenditure and the exposure of the population to X-rays. This study aimed to analyze the workload trends in radiology during the last decade, including the impact of COVID-19 in a single university hospital in Poland and to identify possible solutions to the challenges that radiology could face in the future. We compared the annual amount of computed tomography (CT), radiography (X-ray), and ultrasound (US) examinations performed between the years 2010 and 2020 and analyzed the changes in the number of practicing radiologists in Poland. The mean number of patients treated in our hospital was 60,727 per year. During the last decade, the number of CT and US examinations nearly doubled (from 87.4 to 155.7 and from 52.1 to 86.5 per 1000 patients in 2010 and 2020 respectively), while X-ray examinations decreased from 115.1 to 96.9 per 1000 patients. The SARS-CoV-2 pandemic did not change the workload trends as more chest examinations were performed. AI, which contributed to the COVID-19 diagnosis, could aid radiologists in the future with the growing workload by increasing the efficiency of radiology departments as well as by potentially minimizing the related costs.
Collapse
Affiliation(s)
- Mateusz Winder
- Department of Radiology and Nuclear Medicine, Medical University of Silesia, 40-055 Katowice, Poland; (J.P.-K.); (J.B.)
| | - Aleksander Jerzy Owczarek
- Health Promotion and Obesity Management Unit, Department of Pathophysiology, Medical University of Silesia, 40-055 Katowice, Poland;
| | - Jerzy Chudek
- Department of Internal Medicine and Oncological Chemotherapy, Medical University of Silesia, 40-055 Katowice, Poland;
| | - Joanna Pilch-Kowalczyk
- Department of Radiology and Nuclear Medicine, Medical University of Silesia, 40-055 Katowice, Poland; (J.P.-K.); (J.B.)
| | - Jan Baron
- Department of Radiology and Nuclear Medicine, Medical University of Silesia, 40-055 Katowice, Poland; (J.P.-K.); (J.B.)
| |
Collapse
|
30
|
Reponen J, Niinimäki J. Emergence of teleradiology, PACS, and other radiology IT solutions in Acta Radiologica. Acta Radiol 2021; 62:1525-1533. [PMID: 34637341 DOI: 10.1177/02841851211051003] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
For this historical review, we searched a database containing all the articles published in Acta Radiologica during its 100-year history to find those on the use of information technology (IT) in radiology. After reading the full texts, we selected the presented articles according to major radiology IT domains such as teleradiology, picture archiving and communication systems, image processing, image analysis, and computer-aided diagnostics in order to describe the development as it appeared in the journal. Publications generally follow IT megatrends, but because the contents of Acta Radiologica are mainly clinically oriented, some technology achievements appear later than they do in journals discussing mainly imaging informatics topics.
Collapse
Affiliation(s)
- Jarmo Reponen
- Research Unit of Medical Imaging, Physics and Technology, University of Oulu, Oulu, Finland
- Medical Research Center Oulu, Oulu University Hospital and University of Oulu, Oulu, Finland
| | - Jaakko Niinimäki
- Research Unit of Medical Imaging, Physics and Technology, University of Oulu, Oulu, Finland
- Department of Diagnostic Radiology, Oulu University Hospital, Oulu, Finland
| |
Collapse
|
31
|
Homayoun H, Ebrahimpour-komleh H. Automated Segmentation of Abnormal Tissues in Medical Images. J Biomed Phys Eng 2021; 11:415-424. [PMID: 34458189 PMCID: PMC8385212 DOI: 10.31661/jbpe.v0i0.958] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2018] [Accepted: 08/14/2018] [Indexed: 11/29/2022]
Abstract
Nowadays, medical image modalities are almost available everywhere. These modalities are bases of diagnosis of various diseases sensitive to specific tissue type.
Usually physicians look for abnormalities in these modalities in diagnostic procedures. Count and volume of abnormalities are very important for optimal treatment of patients.
Segmentation is a preliminary step for these measurements and also further analysis. Manual segmentation of abnormalities is cumbersome, error prone, and subjective. As a result,
automated segmentation of abnormal tissue is a need. In this study, representative techniques for segmentation of abnormal tissues are reviewed. Main focus is on the segmentation of
multiple sclerosis lesions, breast cancer masses, lung nodules, and skin lesions. As experimental results demonstrate, the methods based on deep learning techniques perform better than
other methods that are usually based on handy feature engineering techniques. Finally, the most common measures to evaluate automated abnormal tissue segmentation methods are reported
Collapse
Affiliation(s)
- Hassan Homayoun
- PhD, Department of Computer Engineering, Faculty of Electrical and Computer Engineering, University of Kashan, Kashan, Iran
| | - Hossein Ebrahimpour-komleh
- PhD, Department of Computer Engineering, Faculty of Electrical and Computer Engineering, University of Kashan, Kashan, Iran
| |
Collapse
|
32
|
Chaudhari AS, Sandino CM, Cole EK, Larson DB, Gold GE, Vasanawala SS, Lungren MP, Hargreaves BA, Langlotz CP. Prospective Deployment of Deep Learning in MRI: A Framework for Important Considerations, Challenges, and Recommendations for Best Practices. J Magn Reson Imaging 2021; 54:357-371. [PMID: 32830874 PMCID: PMC8639049 DOI: 10.1002/jmri.27331] [Citation(s) in RCA: 46] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2020] [Revised: 07/27/2020] [Accepted: 07/31/2020] [Indexed: 12/16/2022] Open
Abstract
Artificial intelligence algorithms based on principles of deep learning (DL) have made a large impact on the acquisition, reconstruction, and interpretation of MRI data. Despite the large number of retrospective studies using DL, there are fewer applications of DL in the clinic on a routine basis. To address this large translational gap, we review the recent publications to determine three major use cases that DL can have in MRI, namely, that of model-free image synthesis, model-based image reconstruction, and image or pixel-level classification. For each of these three areas, we provide a framework for important considerations that consist of appropriate model training paradigms, evaluation of model robustness, downstream clinical utility, opportunities for future advances, as well recommendations for best current practices. We draw inspiration for this framework from advances in computer vision in natural imaging as well as additional healthcare fields. We further emphasize the need for reproducibility of research studies through the sharing of datasets and software. LEVEL OF EVIDENCE: 5 TECHNICAL EFFICACY STAGE: 2.
Collapse
Affiliation(s)
| | - Christopher M Sandino
- Department of Radiology, Stanford University, Stanford, California, USA
- Department of Electrical Engineering, Stanford University, Stanford, California, USA
| | - Elizabeth K Cole
- Department of Radiology, Stanford University, Stanford, California, USA
- Department of Electrical Engineering, Stanford University, Stanford, California, USA
| | - David B Larson
- Department of Radiology, Stanford University, Stanford, California, USA
| | - Garry E Gold
- Department of Radiology, Stanford University, Stanford, California, USA
- Department of Orthopaedic Surgery, Stanford University, Stanford, California, USA
- Department of Bioengineering, Stanford University, Stanford, California, USA
| | | | - Matthew P Lungren
- Department of Radiology, Stanford University, Stanford, California, USA
| | - Brian A Hargreaves
- Department of Radiology, Stanford University, Stanford, California, USA
- Department of Electrical Engineering, Stanford University, Stanford, California, USA
- Department of Biomedical Informatics, Stanford University, Stanford, California, USA
| | - Curtis P Langlotz
- Department of Radiology, Stanford University, Stanford, California, USA
- Department of Biomedical Informatics, Stanford University, Stanford, California, USA
| |
Collapse
|
33
|
Lou M, Qi Y, Meng J, Xu C, Wang Y, Pi J, Ma Y. DCANet: Dual contextual affinity network for mass segmentation in whole mammograms. Med Phys 2021; 48:4291-4303. [PMID: 34061371 DOI: 10.1002/mp.15010] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2021] [Revised: 04/27/2021] [Accepted: 05/25/2021] [Indexed: 12/26/2022] Open
Abstract
PURPOSE Breast mass segmentation in mammograms remains a crucial yet challenging topic in computer-aided diagnosis systems. Existing algorithms mainly used mass-centered patches to achieve mass segmentation, which is time-consuming and unstable in clinical diagnosis. Therefore, we aim to directly perform fully automated mass segmentation in whole mammograms with deep learning solutions. METHODS In this work, we propose a novel dual contextual affinity network (a.k.a., DCANet) for mass segmentation in whole mammograms. Based on the encoder-decoder structure, two lightweight yet effective contextual affinity modules including the global-guided affinity module (GAM) and the local-guided affinity module (LAM) are proposed. The former aggregates the features integrated by all positions and captures long-range contextual dependencies, aiming to enhance the feature representations of homogeneous regions. The latter emphasizes semantic information around each position and exploits contextual affinity based on the local field-of-view, aiming to improve the indistinction among heterogeneous regions. RESULTS The proposed DCANet is greatly demonstrated on two public mammographic databases including the DDSM and the INbreast, achieving the Dice similarity coefficient (DSC) of 85.95% and 84.65%, respectively. Both segmentation performance and computational efficiency outperform the current state-of-the-art methods. CONCLUSION According to extensive qualitative and quantitative analyses, we believe that the proposed fully automated approach has sufficient robustness to provide fast and accurate diagnoses for possible clinical breast mass segmentation.
Collapse
Affiliation(s)
- Meng Lou
- School of Information Science and Engineering, Lanzhou University, Lanzhou, Gansu, China
| | - Yunliang Qi
- School of Information Science and Engineering, Lanzhou University, Lanzhou, Gansu, China
| | - Jie Meng
- School of Information Science and Engineering, Lanzhou University, Lanzhou, Gansu, China
| | - Chunbo Xu
- School of Information Science and Engineering, Lanzhou University, Lanzhou, Gansu, China
| | - Yiming Wang
- School of Information Science and Engineering, Lanzhou University, Lanzhou, Gansu, China
| | - Jiande Pi
- School of Information Science and Engineering, Lanzhou University, Lanzhou, Gansu, China
| | - Yide Ma
- School of Information Science and Engineering, Lanzhou University, Lanzhou, Gansu, China
| |
Collapse
|
34
|
Zhang P, Ma Z, Zhang Y, Chen X, Wang G. Improved Inception V3 method and its effect on radiologists' performance of tumor classification with automated breast ultrasound system. Gland Surg 2021; 10:2232-2245. [PMID: 34422594 PMCID: PMC8340346 DOI: 10.21037/gs-21-328] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Accepted: 06/17/2021] [Indexed: 11/06/2022]
Abstract
BACKGROUND The automated breast ultrasound system (ABUS) is recognized as a valuable detection tool in addition to mammography. The purpose of this study was to propose a novel computer-aided diagnosis (CAD) system by extracting the textural features from ABUS images and to investigate the efficiency of using this CAD for breast cancer detection. METHODS This retrospective study involved 149 breast nodules [maximum diameter: mean size 18.89 mm, standard deviation (SD) 10.238, and range 5-59 mm] in 135. We assigned 3 novice readers (<3 years of experience and 3 experienced readers (≥10 years of experience to review the imaging data and stratify the 149 breast nodules as either malignant or benign. The Improved Inception V3 (II3) method was developed and used as an assistant tool to help the 6 readers to re-interpret the images. RESULTS Our method (II3) achieved an accuracy of 88.6% for the final result. The 3 novice readers had an average accuracy of 71.37%±4.067% while the 3 experienced readers was 83.03%±3.371% on the first-reading. With the help of II3 on the second-reading, the average accuracy of the novice readers increased to 84.13%±1.662% and the experienced readers increased to 89.50%±0.346%.The areas under the curve (AUCs) were similar compared with linear algorithms. The mean AUC of the novice readers was improved from 0.7751 (without II3) to 0.8232 (with II3). The mean AUC of the experienced readers was improved from 0.8939 (without II3) to 0.9211 (with II3). The mean AUC for all readers improved in both the second-reading mode (from 0.8345 to 0.8722, P=0.0081<0.05). CONCLUSIONS With the help of the II3, the diagnostic accuracy of the two groups were both improved, and II3 was more helpful for novice readers than for experienced readers. Our results showed that II3 is valuable in the differentiation of benign and malignant breast nodules and it also improves the experience and skill of some novice radiologists. The II3 cannot completely replace the influence of experience in the diagnostic process and will retain an auxiliary role in the clinic at present.
Collapse
Affiliation(s)
- Panpan Zhang
- Department of Ultrasound, Taizhou Hospital of Zhejiang Province, Zhejiang University, Linhai, China
| | - Zhaosheng Ma
- Department of Ultrasound, Taizhou Hospital of Zhejiang Province, Zhejiang University, Linhai, China
| | - Yingtao Zhang
- Department of Computer Science and Technology, Harbin Institute of Technology, Harbin, China
| | - Xiaodan Chen
- Department of Computer Science and Technology, Harbin Institute of Technology, Harbin, China
| | - Gang Wang
- Department of Ultrasound, Taizhou Hospital of Zhejiang Province, Zhejiang University, Linhai, China
| |
Collapse
|
35
|
Khojasteh Poor F, Keivan M, Ramazii M, Ghaedrahmati F, Anbiyaiee A, Panahandeh S, Khoshnam SE, Farzaneh M. Mini review: The FDA-approved prescription drugs that target the MAPK signaling pathway in women with breast cancer. Breast Dis 2021; 40:51-62. [PMID: 33896802 DOI: 10.3233/bd-201063] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Breast cancer (BC) is the most common cancer and the prevalent type of malignancy among women. Multiple risk factors, including genetic changes, biological age, dense breast tissue, and obesity are associated with BC. The mitogen-activated protein kinases (MAPK) signaling pathway has a pivotal role in regulating biological functions such as cell proliferation, differentiation, apoptosis, and survival. It has become evident that the MAPK pathway is associated with tumorigenesis and may promote breast cancer development. The MAPK/RAS/RAF cascade is closely associated with breast cancer. RAS signaling can enhance BC cell growth and progression. B-Raf is an important kinase and a potent RAF isoform involved in breast tumor initiation and differentiation. Depending on the reasons for cancer, there are different strategies for treatment of women with BC. Till now, several FDA-approved treatments have been investigated that inhibit the MAPK pathway and reduce metastatic progression in breast cancer. The most common breast cancer drugs that regulate or inhibit the MAPK pathway may include Farnesyltransferase inhibitors (FTIs), Sorafenib, Vemurafenib, PLX8394, Dabrafenib, Ulixertinib, Simvastatin, Alisertib, and Teriflunomide. In this review, we will discuss the roles of the MAPK/RAS/RAF/MEK/ERK pathway in BC and summarize the FDA-approved prescription drugs that target the MAPK signaling pathway in women with BC.
Collapse
Affiliation(s)
- Fatemeh Khojasteh Poor
- Department of Obstetrics and Gynecology, School of Medicine, Hamadan University of Medical Sciences, Hamadan, Iran
| | - Mona Keivan
- Fertility and Infertility Research Center, Kermanshah University of Medical Sciences, Kermanshah, Iran.,Fertility, Infertility and Perinatology Research Center, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran
| | - Mohammad Ramazii
- Kerman University of Medical Sciences, University of Kerman, Kerman, Iran
| | - Farhoodeh Ghaedrahmati
- Department of Immunology, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Amir Anbiyaiee
- Department of Surgery, School of Medicine, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran
| | - Samira Panahandeh
- School of Health, Faculty of Medicine, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran
| | - Seyed Esmaeil Khoshnam
- Persian Gulf Physiology Research Center, Medical Basic Sciences Research Institute, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran
| | - Maryam Farzaneh
- Fertility, Infertility and Perinatology Research Center, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran
| |
Collapse
|
36
|
Ou WC, Polat D, Dogan BE. Deep learning in breast radiology: current progress and future directions. Eur Radiol 2021; 31:4872-4885. [PMID: 33449174 DOI: 10.1007/s00330-020-07640-9] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2020] [Revised: 10/30/2020] [Accepted: 12/17/2020] [Indexed: 12/13/2022]
Abstract
This review provides an overview of current applications of deep learning methods within breast radiology. The diagnostic capabilities of deep learning in breast radiology continue to improve, giving rise to the prospect that these methods may be integrated not only into detection and classification of breast lesions, but also into areas such as risk estimation and prediction of tumor responses to therapy. Remaining challenges include limited availability of high-quality data with expert annotations and ground truth determinations, the need for further validation of initial results, and unresolved medicolegal considerations. KEY POINTS: • Deep learning (DL) continues to push the boundaries of what can be accomplished by artificial intelligence (AI) in breast imaging with distinct advantages over conventional computer-aided detection. • DL-based AI has the potential to augment the capabilities of breast radiologists by improving diagnostic accuracy, increasing efficiency, and supporting clinical decision-making through prediction of prognosis and therapeutic response. • Remaining challenges to DL implementation include a paucity of prospective data on DL utilization and yet unresolved medicolegal questions regarding increasing AI utilization.
Collapse
Affiliation(s)
- William C Ou
- Department of Radiology, Seay Biomedical Building, University of Texas Southwestern Medical Center, 2201 Inwood Road, Dallas, TX, 75390, USA.
| | - Dogan Polat
- Department of Radiology, Seay Biomedical Building, University of Texas Southwestern Medical Center, 2201 Inwood Road, Dallas, TX, 75390, USA
| | - Basak E Dogan
- Department of Radiology, Seay Biomedical Building, University of Texas Southwestern Medical Center, 2201 Inwood Road, Dallas, TX, 75390, USA
| |
Collapse
|
37
|
Lotter W, Diab AR, Haslam B, Kim JG, Grisot G, Wu E, Wu K, Onieva JO, Boyer Y, Boxerman JL, Wang M, Bandler M, Vijayaraghavan GR, Gregory Sorensen A. Robust breast cancer detection in mammography and digital breast tomosynthesis using an annotation-efficient deep learning approach. Nat Med 2021; 27:244-249. [PMID: 33432172 DOI: 10.1038/s41591-020-01174-9] [Citation(s) in RCA: 178] [Impact Index Per Article: 44.5] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/01/2020] [Accepted: 11/10/2020] [Indexed: 02/07/2023]
Abstract
Breast cancer remains a global challenge, causing over 600,000 deaths in 2018 (ref. 1). To achieve earlier cancer detection, health organizations worldwide recommend screening mammography, which is estimated to decrease breast cancer mortality by 20-40% (refs. 2,3). Despite the clear value of screening mammography, significant false positive and false negative rates along with non-uniformities in expert reader availability leave opportunities for improving quality and access4,5. To address these limitations, there has been much recent interest in applying deep learning to mammography6-18, and these efforts have highlighted two key difficulties: obtaining large amounts of annotated training data and ensuring generalization across populations, acquisition equipment and modalities. Here we present an annotation-efficient deep learning approach that (1) achieves state-of-the-art performance in mammogram classification, (2) successfully extends to digital breast tomosynthesis (DBT; '3D mammography'), (3) detects cancers in clinically negative prior mammograms of patients with cancer, (4) generalizes well to a population with low screening rates and (5) outperforms five out of five full-time breast-imaging specialists with an average increase in sensitivity of 14%. By creating new 'maximum suspicion projection' (MSP) images from DBT data, our progressively trained, multiple-instance learning approach effectively trains on DBT exams using only breast-level labels while maintaining localization-based interpretability. Altogether, our results demonstrate promise towards software that can improve the accuracy of and access to screening mammography worldwide.
Collapse
Affiliation(s)
- William Lotter
- DeepHealth Inc., RadNet AI Solutions, Cambridge, MA, USA.
| | | | - Bryan Haslam
- DeepHealth Inc., RadNet AI Solutions, Cambridge, MA, USA
| | - Jiye G Kim
- DeepHealth Inc., RadNet AI Solutions, Cambridge, MA, USA
| | - Giorgia Grisot
- DeepHealth Inc., RadNet AI Solutions, Cambridge, MA, USA
| | - Eric Wu
- DeepHealth Inc., RadNet AI Solutions, Cambridge, MA, USA.,Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | - Kevin Wu
- DeepHealth Inc., RadNet AI Solutions, Cambridge, MA, USA.,Department of Biomedical Data Science, Stanford University, Stanford, CA, USA
| | | | - Yun Boyer
- DeepHealth Inc., RadNet AI Solutions, Cambridge, MA, USA
| | - Jerrold L Boxerman
- Department of Diagnostic Imaging, Rhode Island Hospital, Providence, RI, USA.,Department of Diagnostic Imaging, Alpert Medical School of Brown University, Providence, RI, USA
| | - Meiyun Wang
- Department of Medical Imaging, Henan Provincial People's Hospital, Zhengzhou, Henan, China
| | | | | | | |
Collapse
|
38
|
Sawyer Lee R, Dunnmon JA, He A, Tang S, Ré C, Rubin DL. Comparison of segmentation-free and segmentation-dependent computer-aided diagnosis of breast masses on a public mammography dataset. J Biomed Inform 2021; 113:103656. [PMID: 33309994 PMCID: PMC7987253 DOI: 10.1016/j.jbi.2020.103656] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2020] [Revised: 11/09/2020] [Accepted: 12/07/2020] [Indexed: 01/01/2023]
Abstract
PURPOSE To compare machine learning methods for classifying mass lesions on mammography images that use predefined image features computed over lesion segmentations to those that leverage segmentation-free representation learning on a standard, public evaluation dataset. METHODS We apply several classification algorithms to the public Curated Breast Imaging Subset of the Digital Database for Screening Mammography (CBIS-DDSM), in which each image contains a mass lesion. Segmentation-free representation learning techniques for classifying lesions as benign or malignant include both a Bag-of-Visual-Words (BoVW) method and a Convolutional Neural Network (CNN). We compare classification performance of these techniques to that obtained using two different segmentation-dependent approaches from the literature that rely on specific combinations of end classifiers (e.g. linear discriminant analysis, neural networks) and predefined features computed over the lesion segmentation (e.g. spiculation measure, morphological characteristics, intensity metrics). RESULTS We report area under the receiver operating characteristic curve (AZ) values for malignancy classification on CBIS-DDSM for each technique. We find average AZ values of 0.73 for a segmentation-free BoVW method, 0.86 for a segmentation-free CNN method, 0.75 for a segmentation-dependent linear discriminant analysis of Rubber-Band Straightening Transform features, and 0.58 for a hybrid rule-based neural network classification using a small number of hand-designed features. CONCLUSIONS We find that malignancy classification performance on the CBIS-DDSM dataset using segmentation-free BoVW features is comparable to that of the best segmentation-dependent methods we study, but also observe that a common segmentation-free CNN model substantially and significantly outperforms each of these (p < 0.05). These results reinforce recent findings suggesting that representation learning techniques such as BoVW and CNNs are advantageous for mammogram analysis because they do not require lesion segmentation, the quality and specific characteristics of which can vary substantially across datasets. We further observe that segmentation-dependent methods achieve performance levels on CBIS-DDSM inferior to those achieved on the original evaluation datasets reported in the literature. Each of these findings reinforces the need for standardization of datasets, segmentation techniques, and model implementations in performance assessments of automated classifiers for medical imaging.
Collapse
Affiliation(s)
- Rebecca Sawyer Lee
- Stanford University Biomedical Informatics Training Program, United States
| | - Jared A Dunnmon
- Stanford University Department of Computer Science, United States.
| | - Ann He
- Stanford University Department of Computer Science, United States
| | - Siyi Tang
- Stanford University Department of Electrical Engineering, United States
| | - Christopher Ré
- Stanford University Department of Computer Science, United States
| | - Daniel L Rubin
- Stanford University Departments of Radiology and Biomedical Data Science, United States
| |
Collapse
|
39
|
Deep-Learning-Based Computer-Aided Systems for Breast Cancer Imaging: A Critical Review. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10228298] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
This paper provides a critical review of the literature on deep learning applications in breast tumor diagnosis using ultrasound and mammography images. It also summarizes recent advances in computer-aided diagnosis/detection (CAD) systems, which make use of new deep learning methods to automatically recognize breast images and improve the accuracy of diagnoses made by radiologists. This review is based upon published literature in the past decade (January 2010–January 2020), where we obtained around 250 research articles, and after an eligibility process, 59 articles were presented in more detail. The main findings in the classification process revealed that new DL-CAD methods are useful and effective screening tools for breast cancer, thus reducing the need for manual feature extraction. The breast tumor research community can utilize this survey as a basis for their current and future studies.
Collapse
|
40
|
Ghieh D, Saade C, Najem E, El Zeghondi R, Rawashdeh MA, Berjawi G. Staying abreast of imaging - Current status of breast cancer detection in high density breast. Radiography (Lond) 2020; 27:229-235. [PMID: 32611494 DOI: 10.1016/j.radi.2020.06.003] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2020] [Revised: 05/26/2020] [Accepted: 06/08/2020] [Indexed: 11/18/2022]
Abstract
OBJECTIVES The aim of this paper is to illustrate the current status of imaging in high breast density as we enter a new decade of advancing medicine and technology to diagnose breast lesions. KEY FINDINGS Early detection of breast cancer has become the chief focus of research from governments to individuals. However, with varying breast densities across the globe, the explosion of breast density information related to imaging, phenotypes, diet, computer aided diagnosis and artificial intelligence has witnessed a dramatic shift in new screening recommendations in mammography, physical examination, screening younger women and women with comorbid conditions, screening women at high risk, and new screening technologies. Breast density is well known to be a risk factor in patients with suspected/known breast neoplasia. Extensive research in the field of qualitative and quantitative analysis on different tissue characteristics of the breast has rapidly become the chief focus of breast imaging. A summary of the available guidelines and modalities of breast imaging, as well as new emerging techniques under study that can potentially provide an augmentation or even a replacement of those currently available. CONCLUSION Despite all the advances in technology and all the research directed towards breast cancer, detection of breast cancer in dense breasts remains a dilemma. IMPLICATIONS FOR PRACTICE It is of utmost importance to develop highly sensitive screening modalities for early detection of breast cancer.
Collapse
Affiliation(s)
- D Ghieh
- Diagnostic Radiology Department, American University of Beirut Medical Center, P.O.Box: 11-0236, Riad El-Solh, Beirut, 1107 2020, Lebanon.
| | - C Saade
- Department of Medical Imaging Sciences, Faculty of Health Sciences, American University of Beirut, P.O.Box: 11-0236, Riad El-Solh, Beirut, 1107 2020, Lebanon.
| | - E Najem
- Diagnostic Radiology Department, American University of Beirut Medical Center, P.O.Box: 11-0236, Riad El-Solh, Beirut, 1107 2020, Lebanon.
| | - R El Zeghondi
- Department of Medical Imaging Sciences, Faculty of Health Sciences, American University of Beirut, P.O.Box: 11-0236, Riad El-Solh, Beirut, 1107 2020, Lebanon.
| | - M A Rawashdeh
- Department of Allied Medical Sciences, Jordan University of Science and Technology, P.O.Box: 3030, Irbid 22110, Jordan.
| | - G Berjawi
- Diagnostic Radiology Department, American University of Beirut Medical Center, P.O.Box: 11-0236, Riad El-Solh, Beirut, 1107 2020, Lebanon.
| |
Collapse
|
41
|
Peng J, Bao C, Hu C, Wang X, Jian W, Liu W. Automated mammographic mass detection using deformable convolution and multiscale features. Med Biol Eng Comput 2020; 58:1405-1417. [PMID: 32297129 DOI: 10.1007/s11517-020-02170-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2019] [Accepted: 03/26/2020] [Indexed: 10/24/2022]
Abstract
Designing computer-assisted diagnosis (CAD) systems that can precisely identify lesions from mammography images would be useful for clinicians. Considering the morphological variation in breast cancer, it is necessary to extract robust features from the mammogram. Here, we propose a mass detection CAD system that is based on Faster R-CNN. First, we applied a novel convolution network in the backbone of Faster R-CNN, namely deformable convolution network (DCN), which improves the detection of lesions with varying shapes and sizes. Second, the original Faster R-CNN uses the output of the last layer of the backbone as a single-scale feature map. To facilitate the detection of small lesions, we used a multiscale feature pyramid network of multiple cross-scale connections between the different output layers of the backbone, called the neural architecture search-feature pyramid network (NAS-FPN). Thus, we were able to integrate the best features into the model. We then evaluated our method by using the datasets the Curated Breast Imaging Subset of Digital Database for Screening Mammography (CBIS-DDSM) and INbreast, respectively. Our method yielded a true positive rate of 0.9345 at 2.2805 false positive per image on CBIS-DDSM and a true positive rate of 0.9554 at 0.3829 false positive per image on INbreast. Graphical abstract.
Collapse
Affiliation(s)
- Junchuan Peng
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, 518060, Guangdong, People's Republic of China.,Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, Shenzhen University, Shenzhen, 518060, Guangdong, People's Republic of China.,National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Shenzhen University, Shenzhen, 518060, Guangdong, People's Republic of China
| | - Changyu Bao
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, 518060, Guangdong, People's Republic of China.,Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, Shenzhen University, Shenzhen, 518060, Guangdong, People's Republic of China.,National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Shenzhen University, Shenzhen, 518060, Guangdong, People's Republic of China
| | - Chuting Hu
- Department of Breast and Thyroid Surgery, The Second People's Hospital of Shenzhen, Shenzhen, 518035, Guangdong, China
| | - Xianming Wang
- Department of Breast and Thyroid Surgery, The Second People's Hospital of Shenzhen, Shenzhen, 518035, Guangdong, China.
| | - Wenjing Jian
- Department of Breast and Thyroid Surgery, The Second People's Hospital of Shenzhen, Shenzhen, 518035, Guangdong, China
| | - Weixiang Liu
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, 518060, Guangdong, People's Republic of China. .,Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, Shenzhen University, Shenzhen, 518060, Guangdong, People's Republic of China. .,National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Shenzhen University, Shenzhen, 518060, Guangdong, People's Republic of China.
| |
Collapse
|
42
|
Multiple analyte profiling (MAP) index as a powerful diagnostic and therapeutic monitoring tool. Methods 2020; 190:26-32. [PMID: 32243921 DOI: 10.1016/j.ymeth.2020.03.006] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2019] [Revised: 03/09/2020] [Accepted: 03/29/2020] [Indexed: 11/20/2022] Open
Abstract
A robust data mining algorithm is presented as a critical solution to the challenge of managing intensive data generated from the recently developed multiplexing techniques, which allow simultaneous detection of up to 500 biomarkers in a few microliters of a single sample. Furthermore, detailed methodology is provided for exploiting the new algorithm along with examples for description of the first application as a powerful diagnostic and therapeutic monitoring tool in the management of breast cancer, as a disease model.
Collapse
|
43
|
Boudraa S, Melouah A, Merouani HF. Improving mass discrimination in mammogram-CAD system using texture information and super-resolution reconstruction. EVOLVING SYSTEMS 2020. [DOI: 10.1007/s12530-019-09322-4] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
44
|
New Frontiers: An Update on Computer-Aided Diagnosis for Breast Imaging in the Age of Artificial Intelligence. AJR Am J Roentgenol 2019; 212:300-307. [PMID: 30667309 DOI: 10.2214/ajr.18.20392] [Citation(s) in RCA: 71] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
OBJECTIVE The purpose of this article is to compare traditional versus machine learning-based computer-aided detection (CAD) platforms in breast imaging with a focus on mammography, to underscore limitations of traditional CAD, and to highlight potential solutions in new CAD systems under development for the future. CONCLUSION CAD development for breast imaging is undergoing a paradigm shift based on vast improvement of computing power and rapid emergence of advanced deep learning algorithms, heralding new systems that may hold real potential to improve clinical care.
Collapse
|
45
|
Sun C, Xu A, Liu D, Xiong Z, Zhao F, Ding W. Deep Learning-Based Classification of Liver Cancer Histopathology Images Using Only Global Labels. IEEE J Biomed Health Inform 2019; 24:1643-1651. [PMID: 31670686 DOI: 10.1109/jbhi.2019.2949837] [Citation(s) in RCA: 37] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
Liver cancer is a leading cause of cancer deaths worldwide due to its high morbidity and mortality. Histopathological image analysis (HIA) is a crucial step in the early diagnosis of liver cancer and is routinely performed manually. However, this process is time-consuming, error-prone, and easily affected by the expertise of pathologists. Recently, computer-aided methods have been widely applied to medical image analysis; however, the current medical image analysis studies have not yet focused on the histopathological morphology of liver cancer due to its complex features and the insufficiency of training images with detailed annotations. This paper proposes a deep learning method for liver cancer histopathological image classification using only global labels. To compensate for the lack of detailed cancer region annotations in those images, patch features are extracted and fully utilized. Transfer learning is used to obtain the patch-level features and then combined with multiple-instance learning to acquire the image-level features for classification. The method proposed here solves the processing of large-scale images and training sample insufficiency in liver cancer histopathological images for image classification. The proposed method can distinguish and classify liver histopathological images as abnormal or normal with high accuracy, thus providing support for the early diagnosis of liver cancer.
Collapse
|
46
|
Classification of Microcalcification Clusters in Digital Mammograms Using a Stack Generalization Based Classifier. J Imaging 2019; 5:jimaging5090076. [PMID: 34460670 PMCID: PMC8320960 DOI: 10.3390/jimaging5090076] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2019] [Revised: 09/07/2019] [Accepted: 09/09/2019] [Indexed: 12/24/2022] Open
Abstract
This paper presents a machine learning based approach for the discrimination of malignant and benign microcalcification (MC) clusters in digital mammograms. A series of morphological operations was carried out to facilitate the feature extraction from segmented microcalcification. A combination of morphological, texture, and distribution features from individual MC components and MC clusters were extracted and a correlation-based feature selection technique was used. The clinical relevance of the selected features is discussed. The proposed method was evaluated using three different databases: Optimam Mammography Image Database (OMI-DB), Digital Database for Screening Mammography (DDSM), and Mammographic Image Analysis Society (MIAS) database. The best classification accuracy (95.00±0.57%) was achieved for OPTIMAM using a stack generalization classifier with 10-fold cross validation obtaining an Az value equal to 0.97±0.01.
Collapse
|
47
|
George M, Chen Z, Zwiggelaar R. Multiscale connected chain topological modelling for microcalcification classification. Comput Biol Med 2019; 114:103422. [PMID: 31521895 DOI: 10.1016/j.compbiomed.2019.103422] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2019] [Revised: 08/29/2019] [Accepted: 08/29/2019] [Indexed: 01/26/2023]
Abstract
Computer-aided diagnosis (CAD) systems can be employed to help classify mammographic microcalcification clusters. In this paper, a novel method for the classification of the microcalcification clusters based on topology/connectivity has been introduced. The proposed method is distinct from existing techniques which concentrate on morphology and texture of microcalcifications and surrounding tissue. The proposed approach used multiscale morphological relationship of connectivity between microcalcifications where connected chains between nearest microcalcifications were generated at each scale. Subsequently, graph connectivity features at each scale were extracted to estimate the topological connectivity structure of microcalcification clusters for benign versus malignant classification. The proposed approach was evaluated using publicly available digitized datasets: MIAS and DDSM, in addition to the digital OPTIMAM dataset. The classification of features using KNN obtained a classification accuracy of 86.47±1.30%, 90.0±0.00%, 82.5±2.63%, 76.75±0.66% for the DDSM, MIAS-manual, MIAS-auto and OPTIMAM datasets respectively. The study showed that topological/connectivity modelling using a multiscale approach was appropriate for microcalcification cluster analysis and classification; topological connectivity and distribution can be linked to clinical understanding of microcalcification spatial distribution.
Collapse
Affiliation(s)
- Minu George
- Department of Computer Science, Aberystwyth University, SY23 3DB, UK.
| | - Zhili Chen
- School of Information and Control Engineering, Shenyang Jianzhu University, Shenyang, 110168, China
| | - Reyer Zwiggelaar
- Department of Computer Science, Aberystwyth University, SY23 3DB, UK
| |
Collapse
|
48
|
Screening mammography beyond breast cancer: breast arterial calcifications as a sex-specific biomarker of cardiovascular risk. Eur J Radiol 2019; 119:108636. [PMID: 31493727 DOI: 10.1016/j.ejrad.2019.08.005] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2019] [Revised: 06/07/2019] [Accepted: 08/09/2019] [Indexed: 01/08/2023]
Abstract
PURPOSE To highlight the importance of quantitative breast arterial calcifications (BAC) assessment for an effective stratification of cardiovascular (CV) risk in women, for whom current preventive strategies are inadequate. BAC, easily detectable on mammograms, are associated with CV disease and represent a potential imaging biomarker for CV disease prevention in women. METHOD We summarized the available evidence on this topic. RESULTS Age, parity, diabetes, and hyperlipidemia were found to positively correlate with BAC. Women with BAC have a higher CV risk than those without BAC: the relative risk was reported to be 1.4 for transient ischemic attack/stroke, 1.5 for thrombosis, 1.8 for myocardial infarction; the reported hazard ratio was 1.32 for coronary artery disease (CAD), 1.52 for heart failure, 1.29 for CV death, 1.44 for death from CAD. However, BAC do not alarm radiologists; when reported, they are commonly mentioned as "present", not impacting on CV decision-making. Of 18 published studies, 9 reported only presence/absence of BAC, 4 used a semi-quantitative scale, and 5 a continuous scale (with manual, automatic or semiautomatic segmentation). Various appearance, topological complexity, and vessels overlap make BAC quantification difficult to standardize. Nevertheless, machine learning approaches showed promising results in BAC quantification on mammograms. CONCLUSIONS There is a strong rationale for mammography to become a dual test for breast cancer screening and CV disease prevention. However, robust and automated quantification methods are needed for a deeper insight on the association between BAC and CV disease, to stratifying CV risk and define personalized preventive actions.
Collapse
|
49
|
S R SC, Rajaguru H. Comparison Analysis of Linear Discriminant Analysis and Cuckoo-Search Algorithm in the Classification of Breast Cancer from Digital Mammograms. Asian Pac J Cancer Prev 2019; 20:2333-2337. [PMID: 31450903 PMCID: PMC6852837 DOI: 10.31557/apjcp.2019.20.8.2333] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2019] [Indexed: 01/03/2023] Open
Abstract
Objective: Breast cancer is the most common invasive severity which leads to the second primary cause of death among women. The objective of this paper is to propose a computer-aided approach for the breast cancer classification from the digital mammograms. Methods: Designing an effective classification approach will assist in resolving the difficulties in analyzing digital mammograms. The proposed work utilized the Mammogram Image Analysis Society (MIAS) database for the analysis of breast cancer. Five distinct wavelet families are used for extraction of features from the mammograms of MIAS database. These extracted features are statistical in nature and served as input to the Linear Discriminant Analysis (LDA) and Cuckoo-Search Algorithm (CSA) classifiers. Results: Error rate, Sensitivity, Specificity and Accuracy are the performance measures used and the obtained results clearly state that the CSA used as a classifier affords an accuracy of 97.5% while compared with the LDA classifier. Conclusion: The results of comparative performance analysis show that the CSA classifier outperforms the performance of LDA in terms of breast cancer classification.
Collapse
Affiliation(s)
- Sannasi Chakravarthy S R
- Department of Electronics and Communication Engineering, Anna University (Bannari Amman Institute of Technology), Sathyamangalam, India
| | - Harikumar Rajaguru
- Department of Electronics and Communication Engineering, Anna University (Bannari Amman Institute of Technology), Sathyamangalam, India
| |
Collapse
|
50
|
Negrão de Figueiredo G, Ingrisch M, Fallenberg EM. Digital Analysis in Breast Imaging. Breast Care (Basel) 2019; 14:142-150. [PMID: 31316312 DOI: 10.1159/000501099] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2019] [Accepted: 05/21/2019] [Indexed: 01/02/2023] Open
Abstract
Breast imaging is a multimodal approach that plays an essential role in the diagnosis of breast cancer. Mammography, sonography, magnetic resonance, and image-guided biopsy are imaging techniques used to search for malignant changes in the breast or precursors of malignant changes in, e.g., screening programs or follow-ups after breast cancer treatment. However, these methods still have some disadvantages such as interobserver variability and the mammography sensitivity in women with radiologically dense breasts. In order to overcome these difficulties and decrease the number of false positive findings, improvements in imaging analysis with the help of artificial intelligence are constantly being developed and tested. In addition, the extraction and correlation of imaging features with special tumor characteristics and genetics of the patients in order to get more information about treatment response, prognosis, and also cancer risk are coming more and more in focus. The aim of this review is to address recent developments in digital analysis of images and demonstrate their potential value in multimodal breast imaging.
Collapse
Affiliation(s)
| | - Michael Ingrisch
- Department of Radiology, Ludwig Maximilian University of Munich - Grosshadern Campus, Munich, Germany
| | - Eva Maria Fallenberg
- Department of Radiology, Ludwig Maximilian University of Munich - Grosshadern Campus, Munich, Germany
| |
Collapse
|