NCCT-CECT image synthesizers and their application to pulmonary vessel segmentation

BACKGROUND AND OBJECTIVES

Non-contrast CT (NCCT) and contrast-enhanced CT (CECT) are important diagnostic tools with distinct features and applications for chest diseases. We developed two synthesizers for the mutual synthesis of NCCT and CECT and evaluated their applications.

METHODS

Two synthesizers (S₁ and S₂) were proposed based on a generative adversarial network. S₁ generated synthetic CECT (SynCECT) from NCCT and S₂ generated synthetic NCCT (SynNCCT) from CECT. A new training procedure for synthesizers was proposed. Initially, the synthesizers were pretrained using self-supervised learning (SSL) and dual-energy CT (DECT) and then fine-tuned using the registered NCCT and CECT images. Pulmonary vessel segmentation from NCCT was used as an example to demonstrate the effectiveness of the synthesizers. Two strategies (ST₁ and ST₂) were proposed for pulmonary vessel segmentation. In ST₁, CECT images were used to train a segmentation model (Model-CECT), NCCT images were converted to SynCECT through S₁, and SynCECT was input to Model-CECT for testing. In ST₂, CECT data were converted to SynNCCT through S₂. SynNCCT and CECT-based annotations were used to train an additional model (Model-NCCT), and NCCT was input to Model-NCCT for testing. Three datasets, D1 (40 paired CTs), D2 (14 NCCTs and 14 CECTs), and D3 (49 paired DECTs), were used to evaluate the synthesizers and strategies.

RESULTS

For S₁, the mean absolute error (MAE), mean squared error (MSE), peak signal-to-noise ratio (PSNR), and structural similarity index (SSIM) were 14.60± 2.19, 1644± 890, 34.34± 1.91, and 0.94± 0.02, respectively. For S₂, they were 12.52± 2.59, 1460± 922, 35.08± 2.35, and 0.95± 0.02, respectively. Our synthesizers outperformed the counterparts of CycleGAN, Pix2Pix, and Pix2PixHD. The results of ablation studies on SSL pretraining, DECT pretraining, and fine-tuning showed that performance worsened (for example, for S₁, MAE increased to 16.53± 3.10, 17.98± 3.10, and 20.57± 3.75, respectively). Model-NCCT and Model-CECT achieved dice similarity coefficients (DSC) of 0.77 and 0.86 on D1 and 0.77 and 0.72 on D2, respectively.

CONCLUSIONS

The proposed synthesizers realized mutual and high-quality synthesis between NCCT and CECT images; the training procedures, including SSL pretraining, DECT pretraining, and fine-tuning, were critical to their effectiveness. The results demonstrated the usefulness of synthesizers for pulmonary vessel segmentation from NCCT images.

COVID-view: Diagnosis of COVID-19 using Chest CT

Significant work has been done towards deep learning (DL) models for automatic lung and lesion segmentation and classification of COVID-19 on chest CT data. However, comprehensive visualization systems focused on supporting the dual visual+DL diagnosis of COVID-19 are non-existent. We present COVID-view, a visualization application specially tailored for radiologists to diagnose COVID-19 from chest CT data. The system incorporates a complete pipeline of automatic lungs segmentation, localization/isolation of lung abnormalities, followed by visualization, visual and DL analysis, and measurement/quantification tools. Our system combines the traditional 2D workflow of radiologists with newer 2D and 3D visualization techniques with DL support for a more comprehensive diagnosis. COVID-view incorporates a novel DL model for classifying the patients into positive/negative COVID-19 cases, which acts as a reading aid for the radiologist using COVID-view and provides the attention heatmap as an explainable DL for the model output. We designed and evaluated COVID-view through suggestions, close feedback and conducting case studies of real-world patient data by expert radiologists who have substantial experience diagnosing chest CT scans for COVID-19, pulmonary embolism, and other forms of lung infections. We present requirements and task analysis for the diagnosis of COVID-19 that motivate our design choices and results in a practical system which is capable of handling real-world patient cases.

A robust and efficient framework for tubular structure segmentation in chest CT images

BACKGROUND

Tubular structure segmentation in chest CT images can reduce false positives (FPs) dramatically and improve the performance of nodules malignancy levels classification.

OBJECTIVE

In this study, we present a framework that can segment the pulmonary tubular structure regions robustly and efficiently.

METHODS

Firstly, we formulate a global tubular structure identification model based on Frangi filter. The model can recognize irregular vascular structures including bifurcation, small vessel, and junction, robustly and sensitively in 2D images. In addition, to segment the vessels from JVN, we design a local tubular structure identification model with a sliding window. Finally, we propose a multi-view voxel discriminating scheme on the basis of the previous two models. This scheme reduces the computational complexity of obtaining high entropy spatial tubular structure information.

RESULTS

Experimental results have shown that the proposed framework achieves TPR of 85.79%, FPR of 24.83%, and ACC of 84.47% with the average elapsed time of 162.9 seconds.

CONCLUSIONS

The framework provides an automated approach for effectively segmenting tubular structure from the chest CT images.

An Approach for Pulmonary Vascular Extraction from Chest CT Images

Pulmonary vascular extraction from chest CT images plays an important role in the diagnosis of lung disease. To improve the accuracy rate of pulmonary vascular segmentation, a new pulmonary vascular extraction approach is proposed in this study. First, the lung tissue is extracted from chest CT images by region-growing and maximum between-class variance methods. Then the holes of the extracted region are filled by morphological operations to obtain complete lung region. Second, the points of the pulmonary vascular of the middle slice of the chest CT images are extracted as the original seed points. Finally, the seed points are spread throughout the lung region based on the fast marching method to extract the pulmonary vascular in the gradient image. Results of pulmonary vascular extraction from chest CT image datasets provided by the introduced approach are presented and discussed. Based on the ground truth pixels and the resulting quality measures, it can be concluded that the average accuracy of this approach is about 90%. Extensive experiments demonstrate that the proposed method has achieved the best performance in pulmonary vascular extraction compared with other two widely used methods.

Discrete Heat Kernel Smoothing in Irregular Image Domains

We present the discrete version of heat kernel smoothing on graph data structure. The method is used to smooth data in an irregularly shaped domains in 3D images. New statistical properties of heat kernel smoothing are derived. As an application, we show how to filter out noisy data in the lung blood vessel trees obtained from computed tomography. The method can be further used in representing the complex vessel trees parametrically as a linear combination of basis functions and extracting the skeleton representation of the trees.

Novel and powerful 3D adaptive crisp active contour method applied in the segmentation of CT lung images

The World Health Organization estimates that 300 million people have asthma, 210 million people have Chronic Obstructive Pulmonary Disease (COPD), and, according to WHO, COPD will become the third major cause of death worldwide in 2030. Computational Vision systems are commonly used in pulmonology to address the task of image segmentation, which is essential for accurate medical diagnoses. Segmentation defines the regions of the lungs in CT images of the thorax that must be further analyzed by the system or by a specialist physician. This work proposes a novel and powerful technique named 3D Adaptive Crisp Active Contour Method (3D ACACM) for the segmentation of CT lung images. The method starts with a sphere within the lung to be segmented that is deformed by forces acting on it towards the lung borders. This process is performed iteratively in order to minimize an energy function associated with the 3D deformable model used. In the experimental assessment, the 3D ACACM is compared against three approaches commonly used in this field: the automatic 3D Region Growing, the level-set algorithm based on coherent propagation and the semi-automatic segmentation by an expert using the 3D OsiriX toolbox. When applied to 40 CT scans of the chest the 3D ACACM had an average F-measure of 99.22%, revealing its superiority and competency to segment lungs in CT images.

Automated 3D ιnterstitial lung disease εxtent quantification: performance evaluation and correlation to PFTs

In this study, the performance of a recently proposed computer-aided diagnosis (CAD) scheme in detection and 3D quantification of reticular and ground glass pattern extent in chest computed tomography of interstitial lung disease (ILD) patients is evaluated. CAD scheme performance was evaluated on a dataset of 37 volumetric chest scans, considering five representative axial anatomical levels per scan. CAD scheme reliability analysis was performed by estimating agreement (intraclass correlation coefficient, ICC) of automatically derived ILD pattern extent to semi-quantitative disease extent assessment in terms of 29-point rating scale provided by two expert radiologists. Receiver operating characteristic (ROC) analysis was employed to assess CAD scheme accuracy in ILD pattern detection in terms of area under ROC curve (A z ). Correlation of reticular and ground glass volumetric pattern extent to pulmonary function tests (PFTs) was also investigated. CAD scheme reliability was substantial for ILD extent (ICC = 0.809) and distinct reticular pattern extent (0.806) and moderate for distinct ground glass pattern extent (0.543), performing within inter-observer agreement. CAD scheme demonstrated high accuracy in detecting total ILD (A z  = 0.950 ± 0.018), while accuracy in detecting distinct reticular and ground glass patterns was 0.920 ± 0.023 and 0.883 ± 0.024, respectively. Moderate and statistically significant negative correlation was found between reticular volumetric pattern extent and diffusing capacity, forced expiratory volume in 1 s, forced vital capacity, and total lung capacity (R = -0.581, -0.513, -0.494, and -0.446, respectively), similar to correlations found between radiologists' semi-quantitative ratings with PFTs. CAD-based quantification of disease extent is in agreement with radiologists' semi-quantitative assessment and correlates to specific PFTs, suggesting a potential imaging biomarker for ILD staging and management.

Characterization and quantification of angiogenesis in rheumatoid arthritis in a mouse model using μCT

BACKGROUND

Angiogenesis is an important pathophysiological process of chronic inflammation, especially in inflammatory arthritis. Quantitative measurement of changes in vascularization may improve the diagnosis and monitoring of arthritis. The aim of this work is the development of a 3D imaging and analysis framework for quantification of vascularization in experimental arthritis.

METHODS

High-resolution micro-computed tomography (μCT) was used to scan knee joints of arthritic human tumor necrosis factor transgenic (hTNFtg) mice and non-arthritic wild-type controls previously perfused with lead-containing contrast agent Microfil MV-122. Vessel segmentation was performed by combination of intensity-based (local adaptive thresholding) and form-based (multi-scale method) segmentation techniques. Four anatomically defined concentric spherical shells centered in the knee joint were used as analysis volumes of interest. Vessel density, density distribution as well as vessel thickness, surface, spacing and number were measured. Simulated digital vessel tree models were used for validation of the algorithms.

RESULTS

High-resolution μCT allows the quantitative assessment of the vascular tree in the knee joint during arthritis. Segmentation and analysis were highly automated but occasionally required manual corrections of the vessel segmentation close to the bone surfaces. Vascularization was significantly increased in arthritic hTNFtg mice compared to wild type controls. Precision errors for the morphologic parameters were smaller than 3% and 6% for intra- and interoperator analysis, respectively. Accuracy errors for vessel thickness were around 20% for vessels larger than twice the resolution of the scanner.

CONCLUSIONS

Arthritis-induced changes of the vascular tree, including detailed and quantitative description of the number of vessel branches, length of vessel segments and the bifurcation angle, can be detected by contrast-enhanced high-resolution μCT.

Comparing algorithms for automated vessel segmentation in computed tomography scans of the lung: the VESSEL12 study

The VESSEL12 (VESsel SEgmentation in the Lung) challenge objectively compares the performance of different algorithms to identify vessels in thoracic computed tomography (CT) scans. Vessel segmentation is fundamental in computer aided processing of data generated by 3D imaging modalities. As manual vessel segmentation is prohibitively time consuming, any real world application requires some form of automation. Several approaches exist for automated vessel segmentation, but judging their relative merits is difficult due to a lack of standardized evaluation. We present an annotated reference dataset containing 20 CT scans and propose nine categories to perform a comprehensive evaluation of vessel segmentation algorithms from both academia and industry. Twenty algorithms participated in the VESSEL12 challenge, held at International Symposium on Biomedical Imaging (ISBI) 2012. All results have been published at the VESSEL12 website http://vessel12.grand-challenge.org. The challenge remains ongoing and open to new participants. Our three contributions are: (1) an annotated reference dataset available online for evaluation of new algorithms; (2) a quantitative scoring system for objective comparison of algorithms; and (3) performance analysis of the strengths and weaknesses of the various vessel segmentation methods in the presence of various lung diseases.

Automated segmentation of pulmonary structures in thoracic computed tomography scans: a review

Computed tomography (CT) is the modality of choice for imaging the lungs in vivo. Sub-millimeter isotropic images of the lungs can be obtained within seconds, allowing the detection of small lesions and detailed analysis of disease processes. The high resolution of thoracic CT and the high prevalence of lung diseases require a high degree of automation in the analysis pipeline. The automated segmentation of pulmonary structures in thoracic CT has been an important research topic for over a decade now. This systematic review provides an overview of current literature. We discuss segmentation methods for the lungs, the pulmonary vasculature, the airways, including airway tree construction and airway wall segmentation, the fissures, the lobes and the pulmonary segments. For each topic, the current state of the art is summarized, and topics for future research are identified.

Three-dimensional solid texture analysis in biomedical imaging: review and opportunities

Three-dimensional computerized characterization of biomedical solid textures is key to large-scale and high-throughput screening of imaging data. Such data increasingly become available in the clinical and research environments with an ever increasing spatial resolution. In this text we exhaustively analyze the state-of-the-art in 3-D biomedical texture analysis to identify the specific needs of the application domains and extract promising trends in image processing algorithms. The geometrical properties of biomedical textures are studied both in their natural space and on digitized lattices. It is found that most of the tissue types have strong multi-scale directional properties, that are well captured by imaging protocols with high resolutions and spherical spatial transfer functions. The information modeled by the various image processing techniques is analyzed and visualized by displaying their 3-D texture primitives. We demonstrate that non-convolutional approaches are expected to provide best results when the size of structures are inferior to five voxels. For larger structures, it is shown that only multi-scale directional convolutional approaches that are non-separable allow for an unbiased modeling of 3-D biomedical textures. With the increase of high-resolution isotropic imaging protocols in clinical routine and research, these models are expected to best leverage the wealth of 3-D biomedical texture analysis in the future. Future research directions and opportunities are proposed to efficiently model personalized image-based phenotypes of normal biomedical tissue and its alterations. The integration of the clinical and genomic context is expected to better explain the intra class variation of healthy biomedical textures. Using texture synthesis, this provides the exciting opportunity to simulate and visualize texture atlases of normal ageing process and disease progression for enhanced treatment planning and clinical care management.

AUTOMATIC MULTI-SCALE SEGMENTATION OF INTRAHEPATIC VESSEL IN CT IMAGES FOR LIVER SURGERY PLANNING

The processing of blood vessels is an indispensable part in complicated surgeries of livers and hearts as the development of medical image technologies, which requires an automatic segmentation system over CT images of organs. However, the vascular pattern of livers in CT images suffers from low contrast to background so that the existing segmentation technologies are not able to extract the blood vessels completely. In the paper, we propose a new algorithm to extract the blood vessels of livers based on the adaptive multi-scale segmentation. First, we prove that the background histogram of normal scale blood vessels obeys the Gaussian distribution in CT images, and obtain the vascular distribution function from the vascular signal segmented from the background with a local optimal threshold. Second, Hessian matrix is employed to enhance the thin blood vessels before the extraction, and a complete and clear segmentation system for blood vessels is constructed by combining the major and thin blood vessels via filtering. Experimental results show the effectiveness of the proposed method, which is able to extract more complete blood vessels for 3D system, and assist the clinical liver surgeries efficiently.

Detection of microcalcification clusters using Hessian matrix and foveal segmentation method on multiscale analysis in digital mammograms

Mammography is the most efficient technique for detecting and diagnosing breast cancer. Clusters of microcalcifications have been mainly targeted as a reliable early sign of breast cancer and their earliest detection is essential to reduce the probability of mortality rate. Since the size of microcalcifications is very tiny and may be overlooked by the observing radiologist, we have developed a Computer Aided Diagnosis system for automatic and accurate cluster detection. A three-phased novel approach is presented in this paper. Firstly, regions of interest that corresponds to microcalcifications are identified. This can be achieved by analyzing the bandpass coefficients of the mammogram image. The suspicious regions are passed to the second phase, in which the nodular structured microcalcifications are detected based on eigenvalues of second order partial derivatives of the image and microcalcification pixels are segmented out by exploiting the foveal segmentation in multiscale analysis. Finally, by combining the responses coming out from the second order partial derivatives and the foveal method, potential microcalcifications are detected. The detection performance of the proposed method has been evaluated by using 370 mammograms. The detection method has a TP ratio of 97.76 % with 0.68 false positives per image. We have examined the performance of our computerized scheme using free-response operating characteristics curve.