A Discriminative Distance Learning–Based CBIR Framework for Characterization of Indeterminate Liver Lesions. In: Müller H, Greenspan H, Syeda-mahmood T, editors. Medical Content-Based Retrieval for Clinical Decision Support. Berlin: Springer Berlin Heidelberg; 2012. pp. 92-104. [DOI: 10.1007/978-3-642-28460-1_9]

Three-dimensional spatiotemporal features for fast content-based retrieval of focal liver lesions

Content-based image retrieval systems for 3-D medical datasets still largely rely on 2-D image-based features extracted from a few representative slices of the image stack. Most 2 -D features that are currently used in the literature not only model a 3-D tumor incompletely but are also highly expensive in terms of computation time, especially for high-resolution datasets. Radiologist-specified semantic labels are sometimes used along with image-based 2-D features to improve the retrieval performance. Since radiological labels show large interuser variability, are often unstructured, and require user interaction, their use as lesion characterizing features is highly subjective, tedious, and slow. In this paper, we propose a 3-D image-based spatiotemporal feature extraction framework for fast content-based retrieval of focal liver lesions. All the features are computer generated and are extracted from four-phase abdominal CT images. Retrieval performance and query processing times for the proposed framework is evaluated on a database of 44 hepatic lesions comprising of five pathological types. Bull's eye percentage score above 85% is achieved for three out of the five lesion pathologies and for 98% of query lesions, at least one same type of lesion is ranked among the top two retrieved results. Experiments show that the proposed system's query processing is more than 20 times faster than other already published systems that use 2-D features. With fast computation time and high retrieval accuracy, the proposed system has the potential to be used as an assistant to radiologists for routine hepatic tumor diagnosis.

Content-based image retrieval of multiphase CT images for focal liver lesion characterization

PURPOSE

Characterization of focal liver lesions with various imaging modalities can be very challenging in the clinical practice and is experience-dependent. The authors' aim is to develop an automatic method to facilitate the characterization of focal liver lesions (FLLs) using multiphase computed tomography (CT) images by radiologists.

METHODS

A multiphase-image retrieval system is proposed to retrieve a preconstructed database of FLLs with confirmed diagnoses, which can assist radiologists' decision-making in FLL characterization. It first localizes the FLL on multiphase CT scans using a hybrid generative-discriminative FLL detection method and a nonrigid B-spline registration method. Then, it extracts the multiphase density and texture features to numerically represent the FLL. Next, it compares the query FLL with the model FLLs in the database in terms of the feature and measures their similarities using the L1-norm based similarity scores. The model FLLs are ranked by similarities and the top results are finally provided to the users for their evidence studies.

RESULTS

The system was tested on a database of 69 four-phase contrast-enhanced CT scans, consisting of six classes of liver lesions, and evaluated in terms of the precision-recall curve and the Bull's Eye Percentage Score (BEP). It obtained a BEP score of 78%. Compared with any single-phase based representation, the multiphase-based representation increased the BEP scores of the system, from 63%-65% to 78%. In a pilot study, two radiologists performed characterization of FLLs without and with the knowledge of the top five retrieved results. The results were evaluated in terms of the diagnostic accuracy, the receiver operating characteristic (ROC) curve and the mean diagnostic confidence. One radiologist's accuracy improved from 75% to 92%, the area under ROC curves (AUC) from 0.85 to 0.95 (p = 0.081), and the mean diagnostic confidence from 4.6 to 7.3 (p = 0.039). The second radiologist's accuracy did not change, at 75%, with AUC increasing from 0.72 to 0.75 (p = 0.709), and the mean confidence from 4.5 to 4.9 (p = 0.607).

CONCLUSIONS

Multiphase CT images can be used in content-based image retrieval for FLL's categorization and result in good performance in comparison with single-phase CT images. The proposed method has the potential to improve the radiologists' diagnostic accuracy and confidence by providing visually similar lesions with confirmed diagnoses for their interpretation of clinical studies.

A retrieval-based computer-aided diagnosis system for the characterization of liver lesions in CT scans

RATIONALE AND OBJECTIVES

To evaluate a computer-aided diagnosis (CADx) system for the characterization of liver lesions in computed tomography (CT) scans. The stand-alone predictive performance of the CADx system was assessed and compared to that of three radiologists who were provided with the same amount of image information to which the CADx system had access.

MATERIALS AND METHODS

The CADx system operates as an image search engine exploiting texture analysis of liver lesion image data for the lesion in question and lesions from a database. A region of interest drawn around an indeterminate liver lesion is used as input query. The CADx system retrieves lesions of similar histology (benign/malignant), density (hypodense/hyperdense), or type (cyst/hemangioma/metastasis). The system's performance was evaluated with leave-one-patient-out receiver operating characteristic area under the curve on 685 CT scans from 372 patients that contained 2325 liver lesions (193 <1 cm(3)). Sensitivity, specificity, and positive and negative predictive values were evaluated separately for subcentimeter lesions. Results were compared to those of three radiologists who rated 83 liver lesions (20 hemangiomas, 20 metastases, 20 cysts, 20 hepatocellular carcinomas, and 3 focal nodular hyperplasias) displaying only the liver.

RESULTS

The CADx system's leave-one-patient-out receiver operating characteristic area under the curve was 97.1% for density, 91.4% for histology, and 95.5% for lesion type. For subcentimeter lesions, input of additional semantic information improved the system's performance. The CADx system has been proved to significantly outperform radiologists in discriminating lesion histology and type, provided the radiologists have no access to information other than the image. The radiologists were most reliable in diagnosing hemangioma given the limited image data.

CONCLUSIONS

The CADx system under study discriminated reliably between various liver lesions, even outperforming radiologists when accessing the same image information and demonstrated promising performance in classifying subcentimeter lesions in particular.