1
|
Ayana G, Dese K, Dereje Y, Kebede Y, Barki H, Amdissa D, Husen N, Mulugeta F, Habtamu B, Choe SW. Vision-Transformer-Based Transfer Learning for Mammogram Classification. Diagnostics (Basel) 2023; 13:diagnostics13020178. [PMID: 36672988 PMCID: PMC9857963 DOI: 10.3390/diagnostics13020178] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2022] [Revised: 12/27/2022] [Accepted: 12/27/2022] [Indexed: 01/06/2023] Open
Abstract
Breast mass identification is a crucial procedure during mammogram-based early breast cancer diagnosis. However, it is difficult to determine whether a breast lump is benign or cancerous at early stages. Convolutional neural networks (CNNs) have been used to solve this problem and have provided useful advancements. However, CNNs focus only on a certain portion of the mammogram while ignoring the remaining and present computational complexity because of multiple convolutions. Recently, vision transformers have been developed as a technique to overcome such limitations of CNNs, ensuring better or comparable performance in natural image classification. However, the utility of this technique has not been thoroughly investigated in the medical image domain. In this study, we developed a transfer learning technique based on vision transformers to classify breast mass mammograms. The area under the receiver operating curve of the new model was estimated as 1 ± 0, thus outperforming the CNN-based transfer-learning models and vision transformer models trained from scratch. The technique can, hence, be applied in a clinical setting, to improve the early diagnosis of breast cancer.
Collapse
Affiliation(s)
- Gelan Ayana
- Department of Medical IT Convergence Engineering, Kumoh National Institute of Technology, Gumi 39253, Republic of Korea
- School of Biomedical Engineering, Jimma University, Jimma 378, Ethiopia
| | - Kokeb Dese
- School of Biomedical Engineering, Jimma University, Jimma 378, Ethiopia
| | - Yisak Dereje
- Department of Information Engineering, Marche Polytechnic University, 60121 Ancona, Italy
| | - Yonas Kebede
- Biomedical Engineering Unit, Black Lion Hospital, Addis Ababa University, Addis Ababa 1000, Ethiopia
| | - Hika Barki
- Department of Artificial Intelligence Convergence, Pukyong National University, Busan 48513, Republic of Korea
| | - Dechassa Amdissa
- Department of Basic and Applied Science for Engineering, Sapienza University of Rome, 00161 Roma, Italy
| | - Nahimiya Husen
- Department of Bioengineering and Robotics, Campus Bio-Medico University of Rome, 00128 Roma, Italy
| | - Fikadu Mulugeta
- Center of Biomedical Engineering, Addis Ababa Institute of Technology, Addis Ababa University, Addis Ababa 1000, Ethiopia
| | - Bontu Habtamu
- School of Biomedical Engineering, Jimma University, Jimma 378, Ethiopia
| | - Se-Woon Choe
- Department of Medical IT Convergence Engineering, Kumoh National Institute of Technology, Gumi 39253, Republic of Korea
- Department of IT Convergence Engineering, Kumoh National Institute of Technology, Gumi 39253, Republic of Korea
- Correspondence: ; Tel.: +82-54-478-7781; Fax: +82-54-462-1049
| |
Collapse
|
2
|
Guo Z, Xie J, Wan Y, Zhang M, Qiao L, Yu J, Chen S, Li B, Yao Y. A review of the current state of the computer-aided diagnosis (CAD) systems for breast cancer diagnosis. Open Life Sci 2022; 17:1600-1611. [PMID: 36561500 PMCID: PMC9743193 DOI: 10.1515/biol-2022-0517] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Revised: 09/07/2022] [Accepted: 09/24/2022] [Indexed: 12/13/2022] Open
Abstract
Breast cancer is one of the most common cancers affecting females worldwide. Early detection and diagnosis of breast cancer may aid in timely treatment, reducing the mortality rate to a great extent. To diagnose breast cancer, computer-aided diagnosis (CAD) systems employ a variety of imaging modalities such as mammography, computerized tomography, magnetic resonance imaging, ultrasound, and histological imaging. CAD and breast-imaging specialists are in high demand for early detection and diagnosis. This system has the potential to enhance the partiality of traditional histopathological image analysis. This review aims to highlight the recent advancements and the current state of CAD systems for breast cancer detection using different modalities.
Collapse
Affiliation(s)
- Zicheng Guo
- Department of Breast and Thyroid Surgery, Affiliated Zhongshan Hospital of Dalian University, No. 6, Jiefang Road, Dalian City, 116001, China
| | - Jiping Xie
- Department of Breast and Thyroid Surgery, Affiliated Zhongshan Hospital of Dalian University, No. 6, Jiefang Road, Dalian City, 116001, China
| | - Yi Wan
- Department of Breast and Thyroid Surgery, Affiliated Zhongshan Hospital of Dalian University, No. 6, Jiefang Road, Dalian City, 116001, China
| | - Min Zhang
- Department of Breast and Thyroid Surgery, Affiliated Zhongshan Hospital of Dalian University, No. 6, Jiefang Road, Dalian City, 116001, China
| | - Liang Qiao
- Department of Breast and Thyroid Surgery, Affiliated Zhongshan Hospital of Dalian University, No. 6, Jiefang Road, Dalian City, 116001, China
| | - Jiaxuan Yu
- Department of Breast and Thyroid Surgery, Affiliated Zhongshan Hospital of Dalian University, No. 6, Jiefang Road, Dalian City, 116001, China
| | - Sijing Chen
- Department of Breast and Thyroid Surgery, Affiliated Zhongshan Hospital of Dalian University, No. 6, Jiefang Road, Dalian City, 116001, China
| | - Bingxin Li
- Department of Breast and Thyroid Surgery, Affiliated Zhongshan Hospital of Dalian University, No. 6, Jiefang Road, Dalian City, 116001, China
| | - Yongqiang Yao
- Department of Breast and Thyroid Surgery, Affiliated Zhongshan Hospital of Dalian University, No. 6, Jiefang Road, Dalian City, 116001, China
| |
Collapse
|
3
|
Müller FC, Raaschou H, Akhtar N, Brejnebøl M, Collatz L, Andersen MB. Impact of Concurrent Use of Artificial Intelligence Tools on Radiologists Reading Time: A Prospective Feasibility Study. Acad Radiol 2022; 29:1085-1090. [PMID: 34801345 DOI: 10.1016/j.acra.2021.10.008] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Revised: 09/27/2021] [Accepted: 10/09/2021] [Indexed: 12/01/2022]
Abstract
RATIONAL AND OBJECTIVES This study investigated how an AI tool impacted radiologists reading time for non-contrast chest CT exams. MATERIALS AND METHODS An AI tool was implemented into the PACS reading workflow of non-contrast chest CT exams between April and May 2020. The reading time was recorded for one CONSULTANT RADIOLOGIST and one RADIOLOGY RESIDENT by an external observer. After each case radiologists answered questions regarding additional findings and perceived case overview. Reading times were recorded for 25 cases without and 20 cases with AI tool assistance for each reader. Differences in reading time with and without the AI tool were assessed using Welch's t-test for non-inferiority with non-inferiority limits defined as 100 seconds for the consultant and 200 seconds for the resident. RESULTS The mean reading time for the radiology resident was not significantly affected by the AI tool (without AI 370s vs with AI 437s; +67s 95% CI -28s to +163s, p = 0.16). The reading time for the radiology consultant was also not significantly affected by the AI tool (without AI 366s vs with AI 380s; +13s (95% CI - -57s to 84s, p = 0.70). The AI tool led to additional actionable findings in 5/40 (12.5%) studies and better overview in 18/20 (90%) of studies for the resident. CONCLUSION A PACS based implementation of an AI tool for concurrent reading of chest CT exams did not increase reading time with additional actionable findings made as well as a perceived better case overview for the radiology resident.
Collapse
Affiliation(s)
- Felix C Müller
- Department of Radiology, Herlev and Gentofte Hospital, Herlev, Denmark.
| | | | - Naurien Akhtar
- Department of Radiology, Herlev and Gentofte Hospital, Herlev, Denmark
| | - Mathias Brejnebøl
- Department of Radiology, Herlev and Gentofte Hospital, Herlev, Denmark; Department of Radiology, Bispebjerg and Frederiksberg Hospital, Frederiksberg, Denmark
| | - Lene Collatz
- Department of Radiology, Herlev and Gentofte Hospital, Herlev, Denmark
| | | |
Collapse
|
4
|
Breast Cancer Mammograms Classification Using Deep Neural Network and Entropy-Controlled Whale Optimization Algorithm. Diagnostics (Basel) 2022; 12:diagnostics12020557. [PMID: 35204646 PMCID: PMC8871265 DOI: 10.3390/diagnostics12020557] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Revised: 01/22/2022] [Accepted: 01/30/2022] [Indexed: 02/04/2023] Open
Abstract
Breast cancer has affected many women worldwide. To perform detection and classification of breast cancer many computer-aided diagnosis (CAD) systems have been established because the inspection of the mammogram images by the radiologist is a difficult and time taken task. To early diagnose the disease and provide better treatment lot of CAD systems were established. There is still a need to improve existing CAD systems by incorporating new methods and technologies in order to provide more precise results. This paper aims to investigate ways to prevent the disease as well as to provide new methods of classification in order to reduce the risk of breast cancer in women's lives. The best feature optimization is performed to classify the results accurately. The CAD system's accuracy improved by reducing the false-positive rates.The Modified Entropy Whale Optimization Algorithm (MEWOA) is proposed based on fusion for deep feature extraction and perform the classification. In the proposed method, the fine-tuned MobilenetV2 and Nasnet Mobile are applied for simulation. The features are extracted, and optimization is performed. The optimized features are fused and optimized by using MEWOA. Finally, by using the optimized deep features, the machine learning classifiers are applied to classify the breast cancer images. To extract the features and perform the classification, three publicly available datasets are used: INbreast, MIAS, and CBIS-DDSM. The maximum accuracy achieved in INbreast dataset is 99.7%, MIAS dataset has 99.8% and CBIS-DDSM has 93.8%. Finally, a comparison with other existing methods is performed, demonstrating that the proposed algorithm outperforms the other approaches.
Collapse
|
5
|
Nguyen DT, Kang JK, Pham TD, Batchuluun G, Park KR. Ultrasound Image-Based Diagnosis of Malignant Thyroid Nodule Using Artificial Intelligence. SENSORS (BASEL, SWITZERLAND) 2020; 20:E1822. [PMID: 32218230 PMCID: PMC7180806 DOI: 10.3390/s20071822] [Citation(s) in RCA: 37] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/18/2020] [Revised: 03/09/2020] [Accepted: 03/23/2020] [Indexed: 12/14/2022]
Abstract
Computer-aided diagnosis systems have been developed to assist doctors in diagnosing thyroid nodules to reduce errors made by traditional diagnosis methods, which are mainly based on the experiences of doctors. Therefore, the performance of such systems plays an important role in enhancing the quality of a diagnosing task. Although there have been the state-of-the art studies regarding this problem, which are based on handcrafted features, deep features, or the combination of the two, their performances are still limited. To overcome these problems, we propose an ultrasound image-based diagnosis of the malignant thyroid nodule method using artificial intelligence based on the analysis in both spatial and frequency domains. Additionally, we propose the use of weighted binary cross-entropy loss function for the training of deep convolutional neural networks to reduce the effects of unbalanced training samples of the target classes in the training data. Through our experiments with a popular open dataset, namely the thyroid digital image database (TDID), we confirm the superiority of our method compared to the state-of-the-art methods.
Collapse
Affiliation(s)
| | | | - Tuyen Danh Pham
- Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 04620, Korea; (D.T.N.); (J.K.K.); (G.B.); (K.R.P.)
| | | | | |
Collapse
|
6
|
Artificial Intelligence-Based Thyroid Nodule Classification Using Information from Spatial and Frequency Domains. J Clin Med 2019; 8:jcm8111976. [PMID: 31739517 PMCID: PMC6912332 DOI: 10.3390/jcm8111976] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2019] [Revised: 11/08/2019] [Accepted: 11/10/2019] [Indexed: 12/25/2022] Open
Abstract
Image-based computer-aided diagnosis (CAD) systems have been developed to assist doctors in the diagnosis of thyroid cancer using ultrasound thyroid images. However, the performance of these systems is strongly dependent on the selection of detection and classification methods. Although there are previous researches on this topic, there is still room for enhancement of the classification accuracy of the existing methods. To address this issue, we propose an artificial intelligence-based method for enhancing the performance of the thyroid nodule classification system. Thus, we extract image features from ultrasound thyroid images in two domains: spatial domain based on deep learning, and frequency domain based on Fast Fourier transform (FFT). Using the extracted features, we perform a cascade classifier scheme for classifying the input thyroid images into either benign (negative) or malign (positive) cases. Through expensive experiments using a public dataset, the thyroid digital image database (TDID) dataset, we show that our proposed method outperforms the state-of-the-art methods and produces up-to-date classification results for the thyroid nodule classification problem.
Collapse
|
7
|
A new approach for detecting abnormalities in mammograms using a computer-aided windowing system based on Otsu's method. Radiol Phys Technol 2019; 12:178-184. [PMID: 30931495 DOI: 10.1007/s12194-019-00509-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2018] [Revised: 03/20/2019] [Accepted: 03/21/2019] [Indexed: 10/27/2022]
Abstract
Breast cancer is the most common cancer and the leading cause of cancer deaths in women worldwide. This study aimed to provide an automatic windowing method in mammograms, based on the principles of Otsu's thresholding function, to help radiologists more easily detect abnormalities on mammograms. A total of 322 mammographic images from the Mammographic Image Analysis Society (MIAS) database were used in the present study. The image background was removed based on Otsu's method. After selecting the threshold in the computer-aided windowing (CAW) system, the pixel values were kept larger than the threshold and displayed on a grayscale. A radiologist evaluated images randomly before and after CAW. Using CAW, the radiologist correctly diagnosed all healthy images (207 images). A total of 115 mammograms were evaluated to differentiate malignancy from benign masses. All 63 benign images were accurately diagnosed after using CAW. Moreover, of 52 malignant images, all were accurately recognized as malignant except one, which was recognized as benign. Therefore, specificity and sensitivity were significantly improved to 98% and 99.6%, respectively, and the area under the receiver operating characteristic (ROC) curve was calculated to be 0.99. The study showed that the use of CAW can potentially lead to quicker image assessment and improve the diagnostic accuracy of radiologists in differentiating between benign and malignant masses on mammograms.
Collapse
|
8
|
Altunkeser A, Körez MK. Usefulness of grayscale inverted images in addition to standard images in digital mammography. BMC Med Imaging 2017; 17:26. [PMID: 28420325 PMCID: PMC5395830 DOI: 10.1186/s12880-017-0196-6] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2017] [Accepted: 04/04/2017] [Indexed: 11/20/2022] Open
Abstract
BACKGROUND Mammography is essential for early diagnosis of breast cancer, which is the most common type of cancer in females that is associated with a high mortality rate. We investigated whether evaluation of the grayscale inverted images of mammograms would aid in increasing the diagnostic sensitivity of the mammographic imaging technique. METHODS Our study included 636 mammograms of 159 women who had undergone digital mammography. Standard, grayscale inverted, and standard plus grayscale inverted images were sequentially examined three times, at 15-day intervals, for the presence or assessment of pathological changes in the skin, calcification, asymmetric density, mass lesions, structural distortions, and intramammary and axillary lymph nodes. To determine whether grayscale inverted image assessment improved detection rates, the results of the three assessment modes were compared using Cochran's Q test and the McNemar test (p < 0.05 was considered statistically significant). RESULTS The average age of 159 patients was 50.4 years (range, 35-80 years). There were significant differences among the three assessment modes with respect to calcification and intramammary lymph nodes (p < 0.05); however, no significant differences were observed for the detection of other parameters. CONCLUSIONS Assessment of grayscale inverted images in addition to standard images facilitates the detection of microcalcification.
Collapse
Affiliation(s)
- Ayşegül Altunkeser
- Department of Radiology, Konya Education and Research Hospital, Konya, Turkey
- Konya Eğitim ve Araştırma Hastanesi, Radyoloji Bölümü, Hacı Şaban Mah, Meram Yeni Yol Caddesi, No: 97, PK: 42090 Meram, Konya Turkey
| | - M. Kazım Körez
- Department of Statistics, Faculty of Science, Selcuk University, Konya, Turkey
| |
Collapse
|
9
|
Does Breast Imaging Experience During Residency Translate Into Improved Initial Performance in Digital Breast Tomosynthesis? J Am Coll Radiol 2015; 12:728-32. [DOI: 10.1016/j.jacr.2015.02.025] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2015] [Accepted: 02/25/2015] [Indexed: 01/12/2023]
|