1
|
Zhang L, Wong C, Li Y, Huang T, Wang J, Lin C. Artificial intelligence assisted diagnosis of early tc markers and its application. Discov Oncol 2024; 15:172. [PMID: 38761260 PMCID: PMC11102422 DOI: 10.1007/s12672-024-01017-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/18/2024] [Accepted: 05/06/2024] [Indexed: 05/20/2024] Open
Abstract
Thyroid cancer (TC) is a common endocrine malignancy with an increasing incidence worldwide. Early diagnosis is particularly important for TC patients, because it allows patients to receive treatment as early as possible. Artificial intelligence (AI) provides great advantages for complex healthcare systems by analyzing big data based on machine learning. Nowadays, AI is widely used in the early diagnosis of cancer such as TC. Ultrasound detection and fine needle aspiration biopsy are the main methods for early diagnosis of TC. AI has been widely used in the detection of malignancy in thyroid nodules by ultrasound images, cytopathology images and molecular markers. It shows great potential in auxiliary medical diagnosis. The latest clinical trial has shown that the performance of AI models matches with the diagnostic efficiency of experienced clinicians, and more efficient AI tools will be developed in the future. Therefore, in this review, we summarized the recent advances in the application of AI algorithms in assessing the risk of malignancy in thyroid nodules. The objective of this review was to provide a data base for the clinical use of AI-assisted diagnosis in TC, as well as to provide new ideas for the next generation of AI-assisted diagnosis in TC.
Collapse
Affiliation(s)
- Laney Zhang
- Yale School of Public Health, New Haven, CT, USA
| | - Chinting Wong
- Department of Nuclear Medicine, The First Hospital of Jilin University, Changchun, Jilin, China
| | - Yungeng Li
- Department of Nuclear Medicine, The First Hospital of Jilin University, Changchun, Jilin, China
| | | | - Jiawen Wang
- Department of Nuclear Medicine, The First Hospital of Jilin University, Changchun, Jilin, China
| | - Chenghe Lin
- Department of Nuclear Medicine, The First Hospital of Jilin University, Changchun, Jilin, China.
| |
Collapse
|
2
|
Higaki A, Kawaguchi N, Kurokawa T, Okabe H, Kazatani T, Kido S, Aono T, Matsuda K, Tanaka Y, Hosokawa S, Kosaki T, Kawamura G, Shigematsu T, Kawada Y, Hiasa G, Yamada T, Okayama H. Content-based image retrieval for the diagnosis of myocardial perfusion imaging using a deep convolutional autoencoder. J Nucl Cardiol 2023; 30:540-549. [PMID: 35802346 DOI: 10.1007/s12350-022-03030-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2022] [Accepted: 06/04/2022] [Indexed: 11/24/2022]
Abstract
BACKGROUND Single-photon emission computed tomography (SPECT) myocardial perfusion imaging (MPI) plays a crucial role in the optimal treatment strategy for patients with coronary heart disease. We tested the feasibility of feature extraction from MPI using a deep convolutional autoencoder (CAE) model. METHODS Eight hundred and forty-three pairs of stress and rest myocardial perfusion images were collected from consecutive patients who underwent cardiac scintigraphy in our hospital between December 2019 and February 2022. We trained a CAE model to reproduce the input paired image data, so as the encoder to output a 256-dimensional feature vector. The extracted feature vectors were further dimensionally reduced via principal component analysis (PCA) for data visualization. Content-based image retrieval (CBIR) was performed based on the cosine similarity of the feature vectors between the query and reference images. The agreement of the radiologist's finding between the query and retrieved MPI was evaluated using binary accuracy, precision, recall, and F1-score. RESULTS A three-dimensional scatter plot with PCA revealed that feature vectors retained clinical information such as percent summed difference score, presence of ischemia, and the location of scar reported by radiologists. When CBIR was used as a similarity-based diagnostic tool, the binary accuracy was 81.0%. CONCLUSION The results indicated the utility of unsupervised feature learning for CBIR in MPI.
Collapse
Affiliation(s)
- Akinori Higaki
- Department of Cardiology, Ehime Prefectural Central Hospital, 83, Kasuga-machi, Matsuyama, 790-0024, Japan.
- Department of Cardiology, Pulmonology, Hypertension & Nephrology, Ehime University Graduate School of Medicine, Toon, Japan.
| | - Naoto Kawaguchi
- Department of Radiology, Ehime University Graduate School of Medicine, Toon, Japan
| | - Tsukasa Kurokawa
- Department of Cardiology, Ehime Prefectural Central Hospital, 83, Kasuga-machi, Matsuyama, 790-0024, Japan
| | - Hikaru Okabe
- Department of Cardiology, Ehime Prefectural Central Hospital, 83, Kasuga-machi, Matsuyama, 790-0024, Japan
| | - Takuro Kazatani
- Department of Cardiology, Ehime Prefectural Central Hospital, 83, Kasuga-machi, Matsuyama, 790-0024, Japan
| | - Shinsuke Kido
- Department of Cardiology, Ehime Prefectural Central Hospital, 83, Kasuga-machi, Matsuyama, 790-0024, Japan
| | - Tetsuya Aono
- Department of Cardiology, Ehime Prefectural Central Hospital, 83, Kasuga-machi, Matsuyama, 790-0024, Japan
| | - Kensho Matsuda
- Department of Cardiology, Ehime Prefectural Central Hospital, 83, Kasuga-machi, Matsuyama, 790-0024, Japan
| | - Yuta Tanaka
- Department of Cardiology, Ehime Prefectural Central Hospital, 83, Kasuga-machi, Matsuyama, 790-0024, Japan
| | - Saki Hosokawa
- Department of Cardiology, Ehime Prefectural Central Hospital, 83, Kasuga-machi, Matsuyama, 790-0024, Japan
| | - Tetsuya Kosaki
- Department of Cardiology, Ehime Prefectural Central Hospital, 83, Kasuga-machi, Matsuyama, 790-0024, Japan
| | - Go Kawamura
- Department of Cardiology, Ehime Prefectural Central Hospital, 83, Kasuga-machi, Matsuyama, 790-0024, Japan
| | - Tatsuya Shigematsu
- Department of Cardiology, Ehime Prefectural Central Hospital, 83, Kasuga-machi, Matsuyama, 790-0024, Japan
| | - Yoshitaka Kawada
- Department of Cardiology, Ehime Prefectural Central Hospital, 83, Kasuga-machi, Matsuyama, 790-0024, Japan
| | - Go Hiasa
- Department of Cardiology, Ehime Prefectural Central Hospital, 83, Kasuga-machi, Matsuyama, 790-0024, Japan
| | - Tadakatsu Yamada
- Department of Cardiology, Ehime Prefectural Central Hospital, 83, Kasuga-machi, Matsuyama, 790-0024, Japan
| | - Hideki Okayama
- Department of Cardiology, Ehime Prefectural Central Hospital, 83, Kasuga-machi, Matsuyama, 790-0024, Japan
| |
Collapse
|
3
|
Yang F, Fan J. Construction of OBE Concept Autonomous Learning Mode in University Teaching Based on the Internet. JOURNAL OF CASES ON INFORMATION TECHNOLOGY 2022. [DOI: 10.4018/jcit.295250] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
In order to meet the needs of life-long learning of the Internet of Things and the economic and social development of digital learning countries, we must actively explore the teaching mode of digital self-learning courses for college students. This article aims to explore the construction of an autonomous learning model based on the OBE concept of university teaching based on the Internet of Things technology. Through self-study of college students in the environment of Internet of Things and information technology, as well as the micro-course self-directed learning that carries the OBE concept, the results show that most students hold a positive attitude towards the autonomous learning model in the information environment. A survey that carries the OBE concept shows that the scoring dimensions of the content of the students' autonomous learning attitude survey before class are both 4.11. It can be considered that the micro-curriculum resources that carry the OBE concept can effectively help students to conduct autonomous learning.
Collapse
Affiliation(s)
| | - Jiong Fan
- Wuhan University of Technology, China & Jinggangshan University, China
| |
Collapse
|
4
|
Similarity Analysis for Medical Images Using Color and Texture Histogramss. CURRENT HEALTH SCIENCES JOURNAL 2022; 48:196-202. [PMID: 36320873 PMCID: PMC9590363 DOI: 10.12865/chsj.48.02.09] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Figures] [Subscribe] [Scholar Register] [Received: 03/12/2022] [Accepted: 05/25/2022] [Indexed: 11/15/2022]
Abstract
Medical databases usually contain a significant volume of images, therefore search engines based on low-level features frequently used to retrieve similar images are necessary for a fast operation. Color, texture, and shape are the most common features used to characterize an image, however extracting the proper features for image retrievals in a similar manner with the human cognition remains a constant challenge. These algorithms work by sorting the images based on a similarity index that defines how different two or more images are, and histograms are one of the most employed methods for image comparison. In this paper, we have extended the concept of image database to the set of frames acquired following wireless capsule endoscopy (from a unique patient). Then, we have used color and texture histograms to identify very similar images (considered duplicates) and removed one of them for each pair of two successive frames. The volume reduction represented an average of 20% from the initial data set, only by removing frames with very similar informational content.
Collapse
|
5
|
Kushwaha S, Bahl S, Bagha AK, Parmar KS, Javaid M, Haleem A, Singh RP. Significant Applications of Machine Learning for COVID-19 Pandemic. JOURNAL OF INDUSTRIAL INTEGRATION AND MANAGEMENT-INNOVATION AND ENTREPRENEURSHIP 2020. [DOI: 10.1142/s2424862220500268] [Citation(s) in RCA: 71] [Impact Index Per Article: 17.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Machine learning is an innovative approach that has extensive applications in prediction. This technique needs to be applied for the COVID-19 pandemic to identify patients at high risk, their death rate, and other abnormalities. It can be used to understand the nature of this virus and further predict the upcoming issues. This literature-based review is done by searching the relevant papers on machine learning for COVID-19 from the databases of SCOPUS, Academia, Google Scholar, PubMed, and ResearchGate. This research attempts to discuss the significance of machine learning in resolving the COVID-19 pandemic crisis. This paper studied how machine learning algorithms and methods can be employed to fight the COVID-19 virus and the pandemic. It further discusses the primary machine learning methods that are helpful during the COVID-19 pandemic. We further identified and discussed algorithms used in machine learning and their significant applications. Machine learning is a useful technique, and this can be witnessed in various areas to identify the existing drugs, which also seems advantageous for the treatment of COVID-19 patients. This learning algorithm creates interferences out of unlabeled input datasets, which can be applied to analyze the unlabeled data as an input resource for COVID-19. It provides accurate and useful features rather than a traditional explicitly calculation-based method. Further, this technique is beneficial to predict the risk in healthcare during this COVID-19 crisis. Machine learning also analyses the risk factors as per age, social habits, location, and climate.
Collapse
Affiliation(s)
- Shashi Kushwaha
- Department of Mechanical Engineering, Dr. B. R. Ambedkar National Institute of Technology, Jalandhar 144011, India
| | - Shashi Bahl
- Department of Mechanical Engineering, I. K. Gujral Punjab Technical University Hoshiarpur Campus, Hoshiarpur 146001, India
| | - Ashok Kumar Bagha
- Department of Mechanical Engineering, Dr. B. R. Ambedkar National Institute of Technology, Jalandhar 144011, India
| | - Kulwinder Singh Parmar
- Department of Mathematical Sciences, I. K. Gujral Punjab Technical University Hoshiarpur Campus, Hoshiarpur 146001, India
| | - Mohd Javaid
- Department of Mechanical Engineering, Jamia Millia Islamia New Delhi 110025, India
| | - Abid Haleem
- Department of Mechanical Engineering, Jamia Millia Islamia New Delhi 110025, India
| | - Ravi Pratap Singh
- Department of Industrial and Production Engineering, Dr B. R. Ambedkar National Institute of Technology, Jalandhar 144011, India
| |
Collapse
|
6
|
Qiu B, Furst J, Rasin A, Tchoua R, Raicu D. Learning Latent Spiculated Features for Lung Nodule Characterization. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:1254-1257. [PMID: 33018215 DOI: 10.1109/embc44109.2020.9175720] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Computer-aided Diagnosis (CAD) systems have long aimed to be used in clinical practice to help doctors make decisions by providing a second opinion. However, most machine learning based CAD systems make predictions without explicitly showing how their predictions were generated. Since the cognitive process of the diagnostic imaging interpretation involves various visual characteristics of the region of interest, the explainability of the results should leverage those characteristics. We encode visual characteristics of the region of interest based on pairs of similar images rather than the image content by itself. Using a Siamese convolutional neural network (SCNN), we first learn the similarity among nodules, then encode image content using the SCNN similarity-based feature representation, and lastly, we apply the K-nearest neighbor (KNN) approach to make diagnostic characterizations using the Siamese-based image features. We demonstrate the feasibility of our approach on spiculation, a visual characteristic that radiologists consider when interpreting the degree of cancer malignancy, and the NIH/NCI Lung Image Database Consortium (LIDC) dataset that contains both spiculation and malignancy characteristics for lung nodules.Clinical Relevance - This establishes that spiculation can be quantified to automate the diagnostic characterization of lung nodules in Computed Tomography images.
Collapse
|
7
|
Hwang HJ, Seo JB, Lee SM, Kim EY, Park B, Bae HJ, Kim N. Content-Based Image Retrieval of Chest CT with Convolutional Neural Network for Diffuse Interstitial Lung Disease: Performance Assessment in Three Major Idiopathic Interstitial Pneumonias. Korean J Radiol 2020; 22:281-290. [PMID: 33169547 PMCID: PMC7817627 DOI: 10.3348/kjr.2020.0603] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2020] [Revised: 05/08/2020] [Accepted: 06/03/2020] [Indexed: 12/02/2022] Open
Abstract
Objective To assess the performance of content-based image retrieval (CBIR) of chest CT for diffuse interstitial lung disease (DILD). Materials and Methods The database was comprised by 246 pairs of chest CTs (initial and follow-up CTs within two years) from 246 patients with usual interstitial pneumonia (UIP, n = 100), nonspecific interstitial pneumonia (NSIP, n = 101), and cryptogenic organic pneumonia (COP, n = 45). Sixty cases (30-UIP, 20-NSIP, and 10-COP) were selected as the queries. The CBIR retrieved five similar CTs as a query from the database by comparing six image patterns (honeycombing, reticular opacity, emphysema, ground-glass opacity, consolidation and normal lung) of DILD, which were automatically quantified and classified by a convolutional neural network. We assessed the rates of retrieving the same pairs of query CTs, and the number of CTs with the same disease class as query CTs in top 1–5 retrievals. Chest radiologists evaluated the similarity between retrieved CTs and queries using a 5-scale grading system (5-almost identical; 4-same disease; 3-likelihood of same disease is half; 2-likely different; and 1-different disease). Results The rate of retrieving the same pairs of query CTs in top 1 retrieval was 61.7% (37/60) and in top 1–5 retrievals was 81.7% (49/60). The CBIR retrieved the same pairs of query CTs more in UIP compared to NSIP and COP (p = 0.008 and 0.002). On average, it retrieved 4.17 of five similar CTs from the same disease class. Radiologists rated 71.3% to 73.0% of the retrieved CTs with a similarity score of 4 or 5. Conclusion The proposed CBIR system showed good performance for retrieving chest CTs showing similar patterns for DILD.
Collapse
Affiliation(s)
- Hye Jeon Hwang
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - Joon Beom Seo
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea.
| | - Sang Min Lee
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - Eun Young Kim
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - Beomhee Park
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - Hyun Jin Bae
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - Namkug Kim
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| |
Collapse
|
8
|
An Efficient Content-Based Image Retrieval System for the Diagnosis of Lung Diseases. J Digit Imaging 2020; 33:971-987. [PMID: 32399717 DOI: 10.1007/s10278-020-00338-w] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022] Open
Abstract
The main problem in content-based image retrieval (CBIR) systems is the semantic gap which needs to be reduced for efficient retrieval. The common imaging signs (CISs) which appear in the patient's lung CT scan play a significant role in the identification of cancerous lung nodules and many other lung diseases. In this paper, we propose a new combination of descriptors for the effective retrieval of these imaging signs. First, we construct a feature database by combining local ternary pattern (LTP), local phase quantization (LPQ), and discrete wavelet transform. Next, joint mutual information (JMI)-based feature selection is deployed to reduce the redundancy and to select an optimal feature set for CISs retrieval. To this end, similarity measurement is performed by combining visual and semantic information in equal proportion to construct a balanced graph and the shortest path is computed for learning contextual similarity to obtain final similarity between each query and database image. The proposed system is evaluated on a publicly available database of lung CT imaging signs (LISS), and results are retrieved based on visual feature similarity comparison and graph-based similarity comparison. The proposed system achieves a mean average precision (MAP) of 60% and 0.48 AUC of precision-recall (P-R) graph using only visual features similarity comparison. These results further improve on graph-based similarity measure with a MAP of 70% and 0.58 AUC which shows the superiority of our proposed scheme.
Collapse
|
9
|
France K, Jaya A. Classification and retrieval of thoracic diseases using patch-based visual words: a study on chest x-rays. Biomed Phys Eng Express 2020; 6:025015. [PMID: 33438641 DOI: 10.1088/2057-1976/ab5c7c] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
This research work explores the Content-Based Medical Image Retrieval system (CBMIR) to categorization and retrieval of different types of common thoracic diseases such as Atelectasis, cardiomegaly, Effusion, Infiltration etc, based on local patch representation of 'Bag of Visual Words' approach, when performing patch-based image representation, the selected patch size has significant impact on image categorization and retrieval process. It is a challenging task in selecting the appropriate patch size to the current experimental dataset. Chest Xray8 medical image database is used, to analyze the impact of different patch size to categorize and retrieval of eight common thorax diseases. 1000 frontal view x-ray images is obtained (100 images from each category and 200 images combination of more than one disease) from the database. Different sizes of image patches (16 × 16 and 32 × 32) and different codebook sizes (500, 1000, 1500, 2000) created to identify best precision and recall values. From the excremental result, 32 × 32 patch size and 1500 codebook size gives the good precision and recall value using Radial Basis Function SVM kernel.
Collapse
Affiliation(s)
- K France
- Research Scholar Department of Computer Applications, B S Abdur Rahman Crescent Institute of Science and Technology, Chennai-600048, India
| | - A Jaya
- Professor Department of Computer Applications, B S Abdur Rahman Crescent Institute of Science and Technology, Chennai-600048, India
| |
Collapse
|
10
|
Mahajan A, Bothra M. Mining artificial intelligence in oncology: Tata Memorial Hospital journey. CANCER RESEARCH, STATISTICS, AND TREATMENT 2020. [DOI: 10.4103/crst.crst_59_20] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023] Open
|
11
|
Sadeghi M, Chilana P, Yap J, Tschandl P, Atkins MS. Using content-based image retrieval of dermoscopic images for interpretation and education: A pilot study. Skin Res Technol 2019; 26:503-512. [PMID: 31845429 DOI: 10.1111/srt.12822] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2019] [Accepted: 11/09/2019] [Indexed: 12/26/2022]
Abstract
BACKGROUND Dermoscopic content-based image retrieval (CBIR) systems provide a set of visually similar dermoscopic (magnified and illuminated) skin images with a pathology-confirmed diagnosis for a given dermoscopic query image of a skin lesion. Although recent advances in machine learning have spurred novel CBIR algorithms, we have few insights into how end users interact with CBIRs and to what extent CBIRs can be useful for education and image interpretation. MATERIALS AND METHODS We developed an interactive user interface for a CBIR system with dermoscopic images as a decision support tool and investigated users' interactions and decisions with the system. We performed a pilot experiment with 14 non-medically trained users for a given set of annotated dermoscopic images. RESULTS Our pilot showed that the number of correct classifications and users' confidence levels significantly increased with the CBIR interface compared with a non-CBIR interface, although the timing also increased significantly. The users found the CBIR interface of high educational value, engaging and easy to use. CONCLUSION Overall, users became more accurate, found the CBIR approach provided a useful decision aid, and had educational value for learning about skin conditions.
Collapse
Affiliation(s)
- Mahya Sadeghi
- School of Computing Science, Simon Fraser University, Burnaby, BC, Canada
| | - Parmit Chilana
- School of Computing Science, Simon Fraser University, Burnaby, BC, Canada
| | - Jordan Yap
- MetaOptima Technology Inc., Vancouver, BC, Canada
| | - Philipp Tschandl
- School of Computing Science, Simon Fraser University, Burnaby, BC, Canada.,Department of Dermatology, Medical University of Vienna, Vienna, Austria
| | - M Stella Atkins
- School of Computing Science, Simon Fraser University, Burnaby, BC, Canada.,School of Dermatology and Skin Science, University of British Columbia, Vancouver, BC, Canada
| |
Collapse
|
12
|
Mehre SA, Dhara AK, Garg M, Kalra N, Khandelwal N, Mukhopadhyay S. Content-Based Image Retrieval System for Pulmonary Nodules Using Optimal Feature Sets and Class Membership-Based Retrieval. J Digit Imaging 2019; 32:362-385. [PMID: 30361935 PMCID: PMC6499853 DOI: 10.1007/s10278-018-0136-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022] Open
Abstract
Lung cancer manifests itself in the form of lung nodules, the diagnosis of which is essential to plan the treatment. Automated retrieval of nodule cases will assist the budding radiologists in self-learning and differential diagnosis. This paper presents a content-based image retrieval (CBIR) system for lung nodules using optimal feature sets and learning to enhance the performance of retrieval. The classifiers with more features suffer from the curse of dimensionality. Like classification schemes, we found that the optimal feature set selected using the minimal-redundancy-maximal-relevance (mRMR) feature selection technique improves the precision performance of simple distance-based retrieval (SDR). The performance of the classifier is always superior to SDR, which leans researchers towards conventional classifier-based retrieval (CCBR). While CCBR improves the average precision and provides 100% precision for correct classification, it fails for misclassification leading to zero retrieval precision. The class membership-based retrieval (CMR) is found to bridge this gap for texture-based retrieval. Here, CMR is proposed for nodule retrieval using shape-, margin-, and texture-based features. It is found again that optimal feature set is important for the classifier used in CMR as well as for the feature set used for retrieval, which may lead to different feature sets. The proposed system is evaluated using two independent databases from two continents: a public database LIDC/IDRI and a private database PGIMER-IITKGP, using three distance metrics, i.e., Canberra, City block, and Euclidean. The proposed CMR-based retrieval system with optimal feature sets performs better than CCBR and SDR with optimal features in terms of average precision. Apart from average precision and standard deviation of precision, the fraction of queries with zero precision retrieval is also measured.
Collapse
Affiliation(s)
- Shrikant A. Mehre
- Department of Electronics and Electrical Communication Engineering, Indian Institute of Technology Kharagpur, Kharagpur, India
| | - Ashis Kumar Dhara
- Department of Electronics and Electrical Communication Engineering, Indian Institute of Technology Kharagpur, Kharagpur, India
- Centre for Image Analysis, Uppsala University, Uppsala, Sweden
| | - Mandeep Garg
- Department of Radiodiagnosis and Imaging, Post-graduate Institute of Medical Education and Research, Chandigarh, India
| | - Naveen Kalra
- Department of Radiodiagnosis and Imaging, Post-graduate Institute of Medical Education and Research, Chandigarh, India
| | - Niranjan Khandelwal
- Department of Radiodiagnosis and Imaging, Post-graduate Institute of Medical Education and Research, Chandigarh, India
| | - Sudipta Mukhopadhyay
- Department of Electronics and Electrical Communication Engineering, Indian Institute of Technology Kharagpur, Kharagpur, India
| |
Collapse
|
13
|
Prevedello LM, Halabi SS, Shih G, Wu CC, Kohli MD, Chokshi FH, Erickson BJ, Kalpathy-Cramer J, Andriole KP, Flanders AE. Challenges Related to Artificial Intelligence Research in Medical Imaging and the Importance of Image Analysis Competitions. Radiol Artif Intell 2019; 1:e180031. [PMID: 33937783 PMCID: PMC8017381 DOI: 10.1148/ryai.2019180031] [Citation(s) in RCA: 56] [Impact Index Per Article: 11.2] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2018] [Revised: 12/06/2018] [Accepted: 12/21/2018] [Indexed: 12/13/2022]
Abstract
In recent years, there has been enormous interest in applying artificial intelligence (AI) to radiology. Although some of this interest may have been driven by exaggerated expectations that the technology can outperform radiologists in some tasks, there is a growing body of evidence that illustrates its limitations in medical imaging. The true potential of the technique probably lies somewhere in the middle, and AI will ultimately play a key role in medical imaging in the future. The limitless power of computers makes AI an ideal candidate to provide the standardization, consistency, and dependability needed to support radiologists in their mission to provide excellent patient care. However, important roadblocks currently limit the expansion of this field in medical imaging. This article reviews some of the challenges and potential solutions to advance the field forward, with focus on the experience gained by hosting image-based competitions.
Collapse
Affiliation(s)
- Luciano M. Prevedello
- From the Department of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas–MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California–San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women’s Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.)
| | - Safwan S. Halabi
- From the Department of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas–MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California–San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women’s Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.)
| | - George Shih
- From the Department of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas–MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California–San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women’s Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.)
| | - Carol C. Wu
- From the Department of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas–MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California–San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women’s Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.)
| | - Marc D. Kohli
- From the Department of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas–MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California–San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women’s Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.)
| | - Falgun H. Chokshi
- From the Department of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas–MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California–San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women’s Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.)
| | - Bradley J. Erickson
- From the Department of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas–MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California–San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women’s Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.)
| | - Jayashree Kalpathy-Cramer
- From the Department of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas–MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California–San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women’s Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.)
| | - Katherine P. Andriole
- From the Department of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas–MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California–San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women’s Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.)
| | - Adam E. Flanders
- From the Department of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas–MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California–San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women’s Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.)
| |
Collapse
|
14
|
Abstract
Big Data promises huge benefits for medical research. Looking beyond superficial increases in the amount of data collected, we identify three key areas where Big Data differs from conventional analyses of data samples: (i) data are captured more comprehensively relative to the phenomenon under study; this reduces some bias but surfaces important trade-offs, such as between data quantity and data quality; (ii) data are often analysed using machine learning tools, such as neural networks rather than conventional statistical methods resulting in systems that over time capture insights implicit in data, but remain black boxes, rarely revealing causal connections; and (iii) the purpose of the analyses of data is no longer simply answering existing questions, but hinting at novel ones and generating promising new hypotheses. As a consequence, when performed right, Big Data analyses can accelerate research. Because Big Data approaches differ so fundamentally from small data ones, research structures, processes and mindsets need to adjust. The latent value of data is being reaped through repeated reuse of data, which runs counter to existing practices not only regarding data privacy, but data management more generally. Consequently, we suggest a number of adjustments such as boards reviewing responsible data use, and incentives to facilitate comprehensive data sharing. As data's role changes to a resource of insight, we also need to acknowledge the importance of collecting and making data available as a crucial part of our research endeavours, and reassess our formal processes from career advancement to treatment approval.
Collapse
Affiliation(s)
| | - E Ingelsson
- Division of Cardiovascular Medicine, Department of Medicine, Stanford University School of Medicine, Stanford, CA, USA
| |
Collapse
|
15
|
Content Based Image Retrieval by Using Color Descriptor and Discrete Wavelet Transform. J Med Syst 2018; 42:44. [PMID: 29372327 DOI: 10.1007/s10916-017-0880-7] [Citation(s) in RCA: 32] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2017] [Accepted: 12/13/2017] [Indexed: 10/18/2022]
Abstract
Due to recent development in technology, the complexity of multimedia is significantly increased and the retrieval of similar multimedia content is a open research problem. Content-Based Image Retrieval (CBIR) is a process that provides a framework for image search and low-level visual features are commonly used to retrieve the images from the image database. The basic requirement in any image retrieval process is to sort the images with a close similarity in term of visually appearance. The color, shape and texture are the examples of low-level image features. The feature plays a significant role in image processing. The powerful representation of an image is known as feature vector and feature extraction techniques are applied to get features that will be useful in classifying and recognition of images. As features define the behavior of an image, they show its place in terms of storage taken, efficiency in classification and obviously in time consumption also. In this paper, we are going to discuss various types of features, feature extraction techniques and explaining in what scenario, which features extraction technique will be better. The effectiveness of the CBIR approach is fundamentally based on feature extraction. In image processing errands like object recognition and image retrieval feature descriptor is an immense among the most essential step. The main idea of CBIR is that it can search related images to an image passed as query from a dataset got by using distance metrics. The proposed method is explained for image retrieval constructed on YCbCr color with canny edge histogram and discrete wavelet transform. The combination of edge of histogram and discrete wavelet transform increase the performance of image retrieval framework for content based search. The execution of different wavelets is additionally contrasted with discover the suitability of specific wavelet work for image retrieval. The proposed algorithm is prepared and tried to implement for Wang image database. For Image Retrieval Purpose, Artificial Neural Networks (ANN) is used and applied on standard dataset in CBIR domain. The execution of the recommended descriptors is assessed by computing both Precision and Recall values and compared with different other proposed methods with demonstrate the predominance of our method. The efficiency and effectiveness of the proposed approach outperforms the existing research in term of average precision and recall values.
Collapse
|
16
|
Sadeghi M, Chilana PK, Atkins MS. How Users Perceive Content-Based Image Retrieval for Identifying Skin Images. UNDERSTANDING AND INTERPRETING MACHINE LEARNING IN MEDICAL IMAGE COMPUTING APPLICATIONS 2018. [DOI: 10.1007/978-3-030-02628-8_16] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
|
17
|
Abstract
In this paper, we present a multi-texton representation method for medical image retrieval, which utilizes the locality constraint to encode each filter bank response within its local-coordinate system consisting of the k nearest neighbors in texton dictionary and subsequently employs spatial pyramid matching technique to implement feature vector representation. Comparison with the traditional nearest neighbor assignment followed by texton histogram statistics method, our strategies reduce the quantization errors in mapping process and add information about the spatial layout of texton distributions and, thus, increase the descriptive power of the image representation. We investigate the effects of different parameters on system performance in order to choose the appropriate ones for our datasets and carry out experiments on the IRMA-2009 medical collection and the mammographic patch dataset. The extensive experimental results demonstrate that the proposed method has superior performance.
Collapse
Affiliation(s)
- Qiling Tang
- South Central University for Nationalities, College of Biomedical Engineering, Wuhan, 430074, People's Republic of China.
| | - Jirong Yang
- Huibei Key Laboratory for Medical Information Analysis and Tumor Treatment, Wuhan, 430074, People's Republic of China
| | - Xianfu Xia
- Key Laboratory of Congnitive Science, State Ethnic Affairs Commission, Wuhan, 430074, People's Republic of China
| |
Collapse
|