Content-Based Image Retrieval System for Pulmonary Nodules: Assisting Radiologists in Self-Learning and Diagnosis of Lung Cancer

Artificial intelligence assisted diagnosis of early tc markers and its application

Thyroid cancer (TC) is a common endocrine malignancy with an increasing incidence worldwide. Early diagnosis is particularly important for TC patients, because it allows patients to receive treatment as early as possible. Artificial intelligence (AI) provides great advantages for complex healthcare systems by analyzing big data based on machine learning. Nowadays, AI is widely used in the early diagnosis of cancer such as TC. Ultrasound detection and fine needle aspiration biopsy are the main methods for early diagnosis of TC. AI has been widely used in the detection of malignancy in thyroid nodules by ultrasound images, cytopathology images and molecular markers. It shows great potential in auxiliary medical diagnosis. The latest clinical trial has shown that the performance of AI models matches with the diagnostic efficiency of experienced clinicians, and more efficient AI tools will be developed in the future. Therefore, in this review, we summarized the recent advances in the application of AI algorithms in assessing the risk of malignancy in thyroid nodules. The objective of this review was to provide a data base for the clinical use of AI-assisted diagnosis in TC, as well as to provide new ideas for the next generation of AI-assisted diagnosis in TC.

Content-based image retrieval for the diagnosis of myocardial perfusion imaging using a deep convolutional autoencoder

BACKGROUND

Single-photon emission computed tomography (SPECT) myocardial perfusion imaging (MPI) plays a crucial role in the optimal treatment strategy for patients with coronary heart disease. We tested the feasibility of feature extraction from MPI using a deep convolutional autoencoder (CAE) model.

METHODS

Eight hundred and forty-three pairs of stress and rest myocardial perfusion images were collected from consecutive patients who underwent cardiac scintigraphy in our hospital between December 2019 and February 2022. We trained a CAE model to reproduce the input paired image data, so as the encoder to output a 256-dimensional feature vector. The extracted feature vectors were further dimensionally reduced via principal component analysis (PCA) for data visualization. Content-based image retrieval (CBIR) was performed based on the cosine similarity of the feature vectors between the query and reference images. The agreement of the radiologist's finding between the query and retrieved MPI was evaluated using binary accuracy, precision, recall, and F1-score.

RESULTS

A three-dimensional scatter plot with PCA revealed that feature vectors retained clinical information such as percent summed difference score, presence of ischemia, and the location of scar reported by radiologists. When CBIR was used as a similarity-based diagnostic tool, the binary accuracy was 81.0%.

CONCLUSION

The results indicated the utility of unsupervised feature learning for CBIR in MPI.

Construction of OBE Concept Autonomous Learning Mode in University Teaching Based on the Internet

In order to meet the needs of life-long learning of the Internet of Things and the economic and social development of digital learning countries, we must actively explore the teaching mode of digital self-learning courses for college students. This article aims to explore the construction of an autonomous learning model based on the OBE concept of university teaching based on the Internet of Things technology. Through self-study of college students in the environment of Internet of Things and information technology, as well as the micro-course self-directed learning that carries the OBE concept, the results show that most students hold a positive attitude towards the autonomous learning model in the information environment. A survey that carries the OBE concept shows that the scoring dimensions of the content of the students' autonomous learning attitude survey before class are both 4.11. It can be considered that the micro-curriculum resources that carry the OBE concept can effectively help students to conduct autonomous learning.

Similarity Analysis for Medical Images Using Color and Texture Histogramss

Medical databases usually contain a significant volume of images, therefore search engines based on low-level features frequently used to retrieve similar images are necessary for a fast operation. Color, texture, and shape are the most common features used to characterize an image, however extracting the proper features for image retrievals in a similar manner with the human cognition remains a constant challenge. These algorithms work by sorting the images based on a similarity index that defines how different two or more images are, and histograms are one of the most employed methods for image comparison. In this paper, we have extended the concept of image database to the set of frames acquired following wireless capsule endoscopy (from a unique patient). Then, we have used color and texture histograms to identify very similar images (considered duplicates) and removed one of them for each pair of two successive frames. The volume reduction represented an average of 20% from the initial data set, only by removing frames with very similar informational content.

Significant Applications of Machine Learning for COVID-19 Pandemic

Machine learning is an innovative approach that has extensive applications in prediction. This technique needs to be applied for the COVID-19 pandemic to identify patients at high risk, their death rate, and other abnormalities. It can be used to understand the nature of this virus and further predict the upcoming issues. This literature-based review is done by searching the relevant papers on machine learning for COVID-19 from the databases of SCOPUS, Academia, Google Scholar, PubMed, and ResearchGate. This research attempts to discuss the significance of machine learning in resolving the COVID-19 pandemic crisis. This paper studied how machine learning algorithms and methods can be employed to fight the COVID-19 virus and the pandemic. It further discusses the primary machine learning methods that are helpful during the COVID-19 pandemic. We further identified and discussed algorithms used in machine learning and their significant applications. Machine learning is a useful technique, and this can be witnessed in various areas to identify the existing drugs, which also seems advantageous for the treatment of COVID-19 patients. This learning algorithm creates interferences out of unlabeled input datasets, which can be applied to analyze the unlabeled data as an input resource for COVID-19. It provides accurate and useful features rather than a traditional explicitly calculation-based method. Further, this technique is beneficial to predict the risk in healthcare during this COVID-19 crisis. Machine learning also analyses the risk factors as per age, social habits, location, and climate.

Learning Latent Spiculated Features for Lung Nodule Characterization

Computer-aided Diagnosis (CAD) systems have long aimed to be used in clinical practice to help doctors make decisions by providing a second opinion. However, most machine learning based CAD systems make predictions without explicitly showing how their predictions were generated. Since the cognitive process of the diagnostic imaging interpretation involves various visual characteristics of the region of interest, the explainability of the results should leverage those characteristics. We encode visual characteristics of the region of interest based on pairs of similar images rather than the image content by itself. Using a Siamese convolutional neural network (SCNN), we first learn the similarity among nodules, then encode image content using the SCNN similarity-based feature representation, and lastly, we apply the K-nearest neighbor (KNN) approach to make diagnostic characterizations using the Siamese-based image features. We demonstrate the feasibility of our approach on spiculation, a visual characteristic that radiologists consider when interpreting the degree of cancer malignancy, and the NIH/NCI Lung Image Database Consortium (LIDC) dataset that contains both spiculation and malignancy characteristics for lung nodules.Clinical Relevance - This establishes that spiculation can be quantified to automate the diagnostic characterization of lung nodules in Computed Tomography images.

Content-Based Image Retrieval of Chest CT with Convolutional Neural Network for Diffuse Interstitial Lung Disease: Performance Assessment in Three Major Idiopathic Interstitial Pneumonias

Objective

To assess the performance of content-based image retrieval (CBIR) of chest CT for diffuse interstitial lung disease (DILD).

Materials and Methods

The database was comprised by 246 pairs of chest CTs (initial and follow-up CTs within two years) from 246 patients with usual interstitial pneumonia (UIP, n = 100), nonspecific interstitial pneumonia (NSIP, n = 101), and cryptogenic organic pneumonia (COP, n = 45). Sixty cases (30-UIP, 20-NSIP, and 10-COP) were selected as the queries. The CBIR retrieved five similar CTs as a query from the database by comparing six image patterns (honeycombing, reticular opacity, emphysema, ground-glass opacity, consolidation and normal lung) of DILD, which were automatically quantified and classified by a convolutional neural network. We assessed the rates of retrieving the same pairs of query CTs, and the number of CTs with the same disease class as query CTs in top 1–5 retrievals. Chest radiologists evaluated the similarity between retrieved CTs and queries using a 5-scale grading system (5-almost identical; 4-same disease; 3-likelihood of same disease is half; 2-likely different; and 1-different disease).

Results

The rate of retrieving the same pairs of query CTs in top 1 retrieval was 61.7% (37/60) and in top 1–5 retrievals was 81.7% (49/60). The CBIR retrieved the same pairs of query CTs more in UIP compared to NSIP and COP (p = 0.008 and 0.002). On average, it retrieved 4.17 of five similar CTs from the same disease class. Radiologists rated 71.3% to 73.0% of the retrieved CTs with a similarity score of 4 or 5.

Conclusion

The proposed CBIR system showed good performance for retrieving chest CTs showing similar patterns for DILD.

An Efficient Content-Based Image Retrieval System for the Diagnosis of Lung Diseases

The main problem in content-based image retrieval (CBIR) systems is the semantic gap which needs to be reduced for efficient retrieval. The common imaging signs (CISs) which appear in the patient's lung CT scan play a significant role in the identification of cancerous lung nodules and many other lung diseases. In this paper, we propose a new combination of descriptors for the effective retrieval of these imaging signs. First, we construct a feature database by combining local ternary pattern (LTP), local phase quantization (LPQ), and discrete wavelet transform. Next, joint mutual information (JMI)-based feature selection is deployed to reduce the redundancy and to select an optimal feature set for CISs retrieval. To this end, similarity measurement is performed by combining visual and semantic information in equal proportion to construct a balanced graph and the shortest path is computed for learning contextual similarity to obtain final similarity between each query and database image. The proposed system is evaluated on a publicly available database of lung CT imaging signs (LISS), and results are retrieved based on visual feature similarity comparison and graph-based similarity comparison. The proposed system achieves a mean average precision (MAP) of 60% and 0.48 AUC of precision-recall (P-R) graph using only visual features similarity comparison. These results further improve on graph-based similarity measure with a MAP of 70% and 0.58 AUC which shows the superiority of our proposed scheme.

Classification and retrieval of thoracic diseases using patch-based visual words: a study on chest x-rays

This research work explores the Content-Based Medical Image Retrieval system (CBMIR) to categorization and retrieval of different types of common thoracic diseases such as Atelectasis, cardiomegaly, Effusion, Infiltration etc, based on local patch representation of 'Bag of Visual Words' approach, when performing patch-based image representation, the selected patch size has significant impact on image categorization and retrieval process. It is a challenging task in selecting the appropriate patch size to the current experimental dataset. Chest Xray8 medical image database is used, to analyze the impact of different patch size to categorize and retrieval of eight common thorax diseases. 1000 frontal view x-ray images is obtained (100 images from each category and 200 images combination of more than one disease) from the database. Different sizes of image patches (16 × 16 and 32 × 32) and different codebook sizes (500, 1000, 1500, 2000) created to identify best precision and recall values. From the excremental result, 32 × 32 patch size and 1500 codebook size gives the good precision and recall value using Radial Basis Function SVM kernel.

Using content-based image retrieval of dermoscopic images for interpretation and education: A pilot study

BACKGROUND

Dermoscopic content-based image retrieval (CBIR) systems provide a set of visually similar dermoscopic (magnified and illuminated) skin images with a pathology-confirmed diagnosis for a given dermoscopic query image of a skin lesion. Although recent advances in machine learning have spurred novel CBIR algorithms, we have few insights into how end users interact with CBIRs and to what extent CBIRs can be useful for education and image interpretation.

MATERIALS AND METHODS

We developed an interactive user interface for a CBIR system with dermoscopic images as a decision support tool and investigated users' interactions and decisions with the system. We performed a pilot experiment with 14 non-medically trained users for a given set of annotated dermoscopic images.

RESULTS

Our pilot showed that the number of correct classifications and users' confidence levels significantly increased with the CBIR interface compared with a non-CBIR interface, although the timing also increased significantly. The users found the CBIR interface of high educational value, engaging and easy to use.

CONCLUSION

Overall, users became more accurate, found the CBIR approach provided a useful decision aid, and had educational value for learning about skin conditions.

Content-Based Image Retrieval System for Pulmonary Nodules Using Optimal Feature Sets and Class Membership-Based Retrieval

Lung cancer manifests itself in the form of lung nodules, the diagnosis of which is essential to plan the treatment. Automated retrieval of nodule cases will assist the budding radiologists in self-learning and differential diagnosis. This paper presents a content-based image retrieval (CBIR) system for lung nodules using optimal feature sets and learning to enhance the performance of retrieval. The classifiers with more features suffer from the curse of dimensionality. Like classification schemes, we found that the optimal feature set selected using the minimal-redundancy-maximal-relevance (mRMR) feature selection technique improves the precision performance of simple distance-based retrieval (SDR). The performance of the classifier is always superior to SDR, which leans researchers towards conventional classifier-based retrieval (CCBR). While CCBR improves the average precision and provides 100% precision for correct classification, it fails for misclassification leading to zero retrieval precision. The class membership-based retrieval (CMR) is found to bridge this gap for texture-based retrieval. Here, CMR is proposed for nodule retrieval using shape-, margin-, and texture-based features. It is found again that optimal feature set is important for the classifier used in CMR as well as for the feature set used for retrieval, which may lead to different feature sets. The proposed system is evaluated using two independent databases from two continents: a public database LIDC/IDRI and a private database PGIMER-IITKGP, using three distance metrics, i.e., Canberra, City block, and Euclidean. The proposed CMR-based retrieval system with optimal feature sets performs better than CCBR and SDR with optimal features in terms of average precision. Apart from average precision and standard deviation of precision, the fraction of queries with zero precision retrieval is also measured.

Challenges Related to Artificial Intelligence Research in Medical Imaging and the Importance of Image Analysis Competitions

In recent years, there has been enormous interest in applying artificial intelligence (AI) to radiology. Although some of this interest may have been driven by exaggerated expectations that the technology can outperform radiologists in some tasks, there is a growing body of evidence that illustrates its limitations in medical imaging. The true potential of the technique probably lies somewhere in the middle, and AI will ultimately play a key role in medical imaging in the future. The limitless power of computers makes AI an ideal candidate to provide the standardization, consistency, and dependability needed to support radiologists in their mission to provide excellent patient care. However, important roadblocks currently limit the expansion of this field in medical imaging. This article reviews some of the challenges and potential solutions to advance the field forward, with focus on the experience gained by hosting image-based competitions.

Big Data and medicine: a big deal?

Big Data promises huge benefits for medical research. Looking beyond superficial increases in the amount of data collected, we identify three key areas where Big Data differs from conventional analyses of data samples: (i) data are captured more comprehensively relative to the phenomenon under study; this reduces some bias but surfaces important trade-offs, such as between data quantity and data quality; (ii) data are often analysed using machine learning tools, such as neural networks rather than conventional statistical methods resulting in systems that over time capture insights implicit in data, but remain black boxes, rarely revealing causal connections; and (iii) the purpose of the analyses of data is no longer simply answering existing questions, but hinting at novel ones and generating promising new hypotheses. As a consequence, when performed right, Big Data analyses can accelerate research. Because Big Data approaches differ so fundamentally from small data ones, research structures, processes and mindsets need to adjust. The latent value of data is being reaped through repeated reuse of data, which runs counter to existing practices not only regarding data privacy, but data management more generally. Consequently, we suggest a number of adjustments such as boards reviewing responsible data use, and incentives to facilitate comprehensive data sharing. As data's role changes to a resource of insight, we also need to acknowledge the importance of collecting and making data available as a crucial part of our research endeavours, and reassess our formal processes from career advancement to treatment approval.

Content Based Image Retrieval by Using Color Descriptor and Discrete Wavelet Transform

Due to recent development in technology, the complexity of multimedia is significantly increased and the retrieval of similar multimedia content is a open research problem. Content-Based Image Retrieval (CBIR) is a process that provides a framework for image search and low-level visual features are commonly used to retrieve the images from the image database. The basic requirement in any image retrieval process is to sort the images with a close similarity in term of visually appearance. The color, shape and texture are the examples of low-level image features. The feature plays a significant role in image processing. The powerful representation of an image is known as feature vector and feature extraction techniques are applied to get features that will be useful in classifying and recognition of images. As features define the behavior of an image, they show its place in terms of storage taken, efficiency in classification and obviously in time consumption also. In this paper, we are going to discuss various types of features, feature extraction techniques and explaining in what scenario, which features extraction technique will be better. The effectiveness of the CBIR approach is fundamentally based on feature extraction. In image processing errands like object recognition and image retrieval feature descriptor is an immense among the most essential step. The main idea of CBIR is that it can search related images to an image passed as query from a dataset got by using distance metrics. The proposed method is explained for image retrieval constructed on YCbCr color with canny edge histogram and discrete wavelet transform. The combination of edge of histogram and discrete wavelet transform increase the performance of image retrieval framework for content based search. The execution of different wavelets is additionally contrasted with discover the suitability of specific wavelet work for image retrieval. The proposed algorithm is prepared and tried to implement for Wang image database. For Image Retrieval Purpose, Artificial Neural Networks (ANN) is used and applied on standard dataset in CBIR domain. The execution of the recommended descriptors is assessed by computing both Precision and Recall values and compared with different other proposed methods with demonstrate the predominance of our method. The efficiency and effectiveness of the proposed approach outperforms the existing research in term of average precision and recall values.

Medical Image Retrieval Using Multi-Texton Assignment

In this paper, we present a multi-texton representation method for medical image retrieval, which utilizes the locality constraint to encode each filter bank response within its local-coordinate system consisting of the k nearest neighbors in texton dictionary and subsequently employs spatial pyramid matching technique to implement feature vector representation. Comparison with the traditional nearest neighbor assignment followed by texton histogram statistics method, our strategies reduce the quantization errors in mapping process and add information about the spatial layout of texton distributions and, thus, increase the descriptive power of the image representation. We investigate the effects of different parameters on system performance in order to choose the appropriate ones for our datasets and carry out experiments on the IRMA-2009 medical collection and the mammographic patch dataset. The extensive experimental results demonstrate that the proposed method has superior performance.