A Robust and Fast System for CTC Computer-Aided Detection of Colorectal Lesions

3D-GLCM CNN: A 3-Dimensional Gray-Level Co-Occurrence Matrix-Based CNN Model for Polyp Classification via CT Colonography

Accurately classifying colorectal polyps, or differentiating malignant from benign ones, has a significant clinical impact on early detection and identifying optimal treatment of colorectal cancer. Convolution neural network (CNN) has shown great potential in recognizing different objects (e.g. human faces) from multiple slice (or color) images, a task similar to the polyp differentiation, given a large learning database. This study explores the potential of CNN learning from multiple slice (or feature) images to differentiate malignant from benign polyps from a relatively small database with pathological ground truth, including 32 malignant and 31 benign polyps represented by volumetric computed tomographic (CT) images. The feature image in this investigation is the gray-level co-occurrence matrix (GLCM). For each volumetric polyp, there are 13 GLCMs, computed from each of the 13 directions through the polyp volume. For comparison purpose, the CNN learning is also applied to the multi-slice CT images of the volumetric polyps. The comparison study is further extended to include Random Forest (RF) classification of the Haralick texture features (derived from the GLCMs). From the relatively small database, this study achieved scores of 0.91/0.93 (two-fold/leave-one-out evaluations) AUC (area under curve of the receiver operating characteristics) by using the CNN on the GLCMs, while the RF reached 0.84/0.86 AUC on the Haralick features and the CNN rendered 0.79/0.80 AUC on the multiple-slice CT images. The presented CNN learning from the GLCMs can relieve the challenge associated with relatively small database, improve the classification performance over the CNN on the raw CT images and the RF on the Haralick features, and have the potential to perform the clinical task of differentiating malignant from benign polyps with pathological ground truth.

A comparison of computer-assisted detection (CAD) programs for the identification of colorectal polyps: performance and sensitivity analysis, current limitations and practical tips for radiologists

AIM

To directly compare the accuracy and speed of analysis of two commercially available computer-assisted detection (CAD) programs in detecting colorectal polyps.

MATERIALS AND METHOD

In this retrospective single-centre study, patients who had colorectal polyps identified on computed tomography colonography (CTC) and subsequent lower gastrointestinal endoscopy, were analysed using two commercially available CAD programs (CAD1 and CAD2). Results were compared against endoscopy to ascertain sensitivity and positive predictive value (PPV) for colorectal polyps. Time taken for CAD analysis was also calculated.

RESULTS

CAD1 demonstrated a sensitivity of 89.8%, PPV of 17.6% and mean analysis time of 125.8 seconds. CAD2 demonstrated a sensitivity of 75.5%, PPV of 44.0% and mean analysis time of 84.6 seconds.

CONCLUSION

The sensitivity and PPV for colorectal polyps and CAD analysis times can vary widely between current commercially available CAD programs. There is still room for improvement. Generally, there is a trade-off between sensitivity and PPV, and so further developments should aim to optimise both. Information on these factors should be made routinely available, so that an informed choice on their use can be made. This information could also potentially influence the radiologist's use of CAD results.

Improving Computer-Aided Detection Using Convolutional Neural Networks and Random View Aggregation

Automated computer-aided detection (CADe) has been an important tool in clinical practice and research. State-of-the-art methods often show high sensitivities at the cost of high false-positives (FP) per patient rates. We design a two-tiered coarse-to-fine cascade framework that first operates a candidate generation system at sensitivities  ∼ 100% of but at high FP levels. By leveraging existing CADe systems, coordinates of regions or volumes of interest (ROI or VOI) are generated and function as input for a second tier, which is our focus in this study. In this second stage, we generate 2D (two-dimensional) or 2.5D views via sampling through scale transformations, random translations and rotations. These random views are used to train deep convolutional neural network (ConvNet) classifiers. In testing, the ConvNets assign class (e.g., lesion, pathology) probabilities for a new set of random views that are then averaged to compute a final per-candidate classification probability. This second tier behaves as a highly selective process to reject difficult false positives while preserving high sensitivities. The methods are evaluated on three data sets: 59 patients for sclerotic metastasis detection, 176 patients for lymph node detection, and 1,186 patients for colonic polyp detection. Experimental results show the ability of ConvNets to generalize well to different medical imaging CADe applications and scale elegantly to various data sets. Our proposed methods improve performance markedly in all cases. Sensitivities improved from 57% to 70%, 43% to 77%, and 58% to 75% at 3 FPs per patient for sclerotic metastases, lymph nodes and colonic polyps, respectively.

A COMPLETE SYSTEM FOR CANDIDATE POLYPS DETECTION IN VIRTUAL COLONOSCOPY

We present a computer-aided detection pipeline for polyp detection in Computer tomographic colonography. The first stage of the pipeline consists of a simple colon segmentation technique that enhances polyps, which is followed by an adaptive-scale candidate polyp delineation, in order to capture the appropriate polyp size. In the last step, candidates are classified based on new texture and geometric features that consider both the information in the candidate polyp location and its immediate surrounding area. The system is tested with ground truth data, including flat and small polyps which are hard to detect even with optical colonoscopy. We achieve 100% sensitivity for polyps larger than 6 mm in size with just 0.9 false positives per case, and 93% sensitivity with 2.8 false positives per case for polyps larger than 3 mm in size.

Automatic rectum limit detection by anatomical markers correlation

Several diseases take place at the end of the digestive system. Many of them can be diagnosed by means of different medical imaging modalities together with computer aided detection (CAD) systems. These CAD systems mainly focus on the complete segmentation of the digestive tube. However, the detection of limits between different sections could provide important information to these systems. In this paper we present an automatic method for detecting the rectum and sigmoid colon limit using a novel global curvature analysis over the centerline of the segmented digestive tube in different imaging modalities. The results are compared with the gold standard rectum upper limit through a validation scheme comprising two different anatomical markers: the third sacral vertebra and the average rectum length. Experimental results in both magnetic resonance imaging (MRI) and computed tomography colonography (CTC) acquisitions show the efficacy of the proposed strategy in automatic detection of rectum limits. The method is intended for application to the rectum segmentation in MRI for geometrical modeling and as contextual information source in virtual colonoscopies and CAD systems.

Establishing spatial correspondence for the analysis of images from highly deforming anatomy

This invited presentation summarizes recent advances in the incorporation of knowledge of the geometry, tissue mechanical properties and imaging characteristics in establishing spatial correspondence between multiple images of highly deforming, soft tissue structures. Spatial correspondence is used to aid diagnosis and in the extraction of quantitative parameters for disease detection, monitoring disease progression and assessing therapeutic response. The work is illustrated through clinical examples of multi-modal imaging of the breast, assessment of small bowel motility and polyp detection in the large bowel.

Seeing is believing: video classification for computed tomographic colonography using multiple-instance learning

In this paper, we present development and testing results for a novel colonic polyp classification method for use as part of a computed tomographic colonography (CTC) computer-aided detection (CAD) system. Inspired by the interpretative methodology of radiologists using 3-D fly-through mode in CTC reading, we have developed an algorithm which utilizes sequences of images (referred to here as videos) for classification of CAD marks. For each CAD mark, we created a video composed of a series of intraluminal, volume-rendered images visualizing the detection from multiple viewpoints. We then framed the video classification question as a multiple-instance learning (MIL) problem. Since a positive (negative) bag may contain negative (positive) instances, which in our case depends on the viewing angles and camera distance to the target, we developed a novel MIL paradigm to accommodate this class of problems. We solved the new MIL problem by maximizing a L2-norm soft margin using semidefinite programming, which can optimize relevant parameters automatically. We tested our method by analyzing a CTC data set obtained from 50 patients from three medical centers. Our proposed method showed significantly better performance compared with several traditional MIL methods.

Automated image-based colon cleansing for laxative-free CT colonography computer-aided polyp detection

PURPOSE

To evaluate the performance of a computer-aided detection (CAD) system for detecting colonic polyps at noncathartic computed tomography colonography (CTC) in conjunction with an automated image-based colon cleansing algorithm.

METHODS

An automated colon cleansing algorithm was designed to detect and subtract tagged-stool, accounting for heterogeneity and poor tagging, to be used in conjunction with a colon CAD system. The method is locally adaptive and combines intensity, shape, and texture analysis with probabilistic optimization. CTC data from cathartic-free bowel preparation were acquired for testing and training the parameters. Patients underwent various colonic preparations with barium or Gastroview in divided doses over 48 h before scanning. No laxatives were administered and no dietary modifications were required. Cases were selected from a polyp-enriched cohort and included scans in which at least 90% of the solid stool was visually estimated to be tagged and each colonic segment was distended in either the prone or supine view. The CAD system was run comparatively with and without the stool subtraction algorithm.

RESULTS

The dataset comprised 38 CTC scans from prone and/or supine scans of 19 patients containing 44 polyps larger than 10 mm (22 unique polyps, if matched between prone and supine scans). The results are robust on fine details around folds, thin-stool linings on the colonic wall, near polyps and in large fluid/stool pools. The sensitivity of the CAD system is 70.5% per polyp at a rate of 5.75 false positives/scan without using the stool subtraction module. This detection improved significantly (p = 0.009) after automated colon cleansing on cathartic-free data to 86.4% true positive rate at 5.75 false positives/scan.

CONCLUSIONS

An automated image-based colon cleansing algorithm designed to overcome the challenges of the noncathartic colon significantly improves the sensitivity of colon CAD by approximately 15%.

A robust and efficient approach to detect 3D rectal tubes from CT colonography

PURPOSE

The rectal tube (RT) is a common source of false positives (FPs) in computer-aided detection (CAD) systems for CT colonography. A robust and efficient detection of RT can improve CAD performance by eliminating such "obvious" FPs and increase radiologists' confidence in CAD.

METHODS

In this paper, we present a novel and robust bottom-up approach to detect the RT. Probabilistic models, trained using kernel density estimation on simple low-level features, are employed to rank and select the most likely RT tube candidate on each axial slice. Then, a shape model, robustly estimated using random sample consensus (RANSAC), infers the global RT path from the selected local detections. Subimages around the RT path are projected into a subspace formed from training subimages of the RT. A quadratic discriminant analysis (QDA) provides a classification of a subimage as RT or non-RT based on the projection. Finally, a bottom-top clustering method is proposed to merge the classification predictions together to locate the tip position of the RT.

RESULTS

Our method is validated using a diverse database, including data from five hospitals. On a testing data with 21 patients (42 volumes), 99.5% of annotated RT paths have been successfully detected. Evaluated with CAD, 98.4% of FPs caused by the RT have been detected and removed without any loss of sensitivity.

CONCLUSIONS

The proposed method demonstrates a high detection rate of the RT path, and when tested in a CAD system, reduces FPs caused by the RT without the loss of sensitivity.

Registration of the endoluminal surfaces of the colon derived from prone and supine CT colonography

PURPOSE

Computed tomographic (CT) colonography is a relatively new technique for detecting bowel cancer or potentially precancerous polyps. CT scanning is combined with three-dimensional (3D) image reconstruction to produce a virtual endoluminal representation similar to optical colonoscopy. Because retained fluid and stool can mimic pathology, CT data are acquired with the bowel cleansed and insufflated with gas and patient in both prone and supine positions. Radiologists then match visually endoluminal locations between the two acquisitions in order to determine whether apparent pathology is real or not. This process is hindered by the fact that the colon, essentially a long tube, can undergo considerable deformation between acquisitions. The authors present a novel approach to automatically establish spatial correspondence between prone and supine endoluminal colonic surfaces after surface parameterization, even in the case of local colon collapse.

METHODS

The complexity of the registration task was reduced from a 3D to a 2D problem by mapping the surfaces extracted from prone and supine CT colonography onto a cylindrical parameterization. A nonrigid cylindrical registration was then performed to align the full colonic surfaces. The curvature information from the original 3D surfaces was used to determine correspondence. The method can also be applied to cases with regions of local colonic collapse by ignoring the collapsed regions during the registration.

RESULTS

Using a development set, suitable parameters were found to constrain the cylindrical registration method. Then, the same registration parameters were applied to a different set of 13 validation cases, consisting of 8 fully distended cases and 5 cases exhibiting multiple colonic collapses. All polyps present were well aligned, with a mean (+/- std. dev.) registration error of 5.7 (+/- 3.4) mm. An additional set of 1175 reference points on haustral folds spread over the full endoluminal colon surfaces resulted in an error of 7.7 (+/- 7.4) mm. Here, 82% of folds were aligned correctly after registration with a further 15% misregistered by just onefold.

CONCLUSIONS

The proposed method reduces the 3D registration task to a cylindrical registration representing the endoluminal surface of the colon. Our algorithm uses surface curvature information as a similarity measure to drive registration to compensate for the large colorectal deformations that occur between prone and supine data acquisitions. The method has the potential to both enhance polyp detection and decrease the radiologist's interpretation time.

Establishing spatial correspondence between the inner colon surfaces from prone and supine CT colonography

Colonography is an important screening tool for colorectal lesions. This paper presents a method for establishing spatial correspondence between prone and supine inner colon surfaces reconstructed from CT colonography. The method is able to account for the large deformations and torsions of the colon occurring through movement between the two positions. Therefore, we parameterised the two surfaces in order to provide a 2D indexing system over the full length of the colon using the Ricci flow method. This provides the input to a non-rigid B-spline registration in 2D space which establishes a correspondence for each surface point of the colon in prone and supine position. The method was validated on twelve clinical cases and demonstrated promising registration results over the majority of the colon surface.

Colorectal polyps: stand-alone performance of computer-aided detection in a large asymptomatic screening population

PURPOSE

To evaluate stand-alone performance of computer-aided detection (CAD) for colorectal polyps of 6 mm or larger at computed tomographic (CT) colonography in a large asymptomatic screening cohort.

MATERIALS AND METHODS

In this retrospective, institutional review board-approved, HIPAA-compliant study, a CAD software system was applied to screening CT colonography in 1638 women and 1408 men (mean age, 56.9 years) evaluated at a single medical center between March 2006 and December 2008. All participants underwent cathartic preparation with stool tagging; electronic cleansing was not used. The reference standard consisted of interpretation by experienced radiologists in all cases. This interpretation was further refined for the subset of cases with positive findings by using subsequent colonoscopic or CT colonographic confirmation, as well as retrospective expert localization of polyps with CT colonography. This test set was not involved in training the CAD system. The Fisher exact test was used to evaluate significance; 95% confidence intervals (CIs) were obtained by using the exact method.

RESULTS

Per-patient CAD sensitivities were 93.8% (350 of 373; 95% CI: 90.9%, 96.1%) and 96.5% (137 of 142; 95% CI: 92.0%, 98.8%) at 6- and 10-mm threshold sizes, respectively. Per-polyp CAD sensitivities for all polyps, regardless of histologic features, were 90.1% (547 of 607; 95% CI: 88.0%, 92.8%) and 96.0% (168 of 175; 95% CI: 91.9%, 98.4%) at 6- and 10-mm threshold sizes, respectively; CAD sensitivities for advanced neoplasia and cancer were 97.0% (128 of 132; 95% CI: 92.4%, 99.2%) and 100% (13 of 13; 95% CI: 79.4%, 100%), respectively. The mean and median false-positive rates were 4.7 and 3 per series, respectively (9.4 and 6 per patient). Among 373 patients with a positive finding at CT colonography, CAD marked an additional 15 polyps of 6 mm or larger, including four large polyps, that were missed at the prospective three-dimensional reading by an expert but were found at subsequent colonoscopy.

CONCLUSION

Stand-alone CAD demonstrated excellent performance for polyp detection in a large screening population, with high sensitivity and an acceptable number of false-positive results.