Segmentation of the pulmonary vascular trees in 3D CT images using variational region-growing

An end-to-end multi-scale airway segmentation framework based on pulmonary CT image

Objective. Automatic and accurate airway segmentation is necessary for lung disease diagnosis. The complex tree-like structures leads to gaps in the different generations of the airway tree, and thus airway segmentation is also considered to be a multi-scale problem. In recent years, convolutional neural networks have facilitated the development of medical image segmentation. In particular, 2D CNNs and 3D CNNs can extract different scale features. Hence, we propose a two-stage and 2D + 3D framework for multi-scale airway tree segmentation.Approach. In stage 1, we use a 2D full airway SegNet(2D FA-SegNet) to segment the complete airway tree. Multi-scale atros spatial pyramid and Atros Residual Skip connection modules are inserted to extract different scales feature. We designed a hard sample selection strategy to increase the proportion of intrapulmonary airway samples in stage 2. 3D airway RefineNet (3D ARNet) as stage 2 takes the results of stage 1 asa prioriinformation. Spatial information extracted by 3D convolutional kernel compensates for the loss of in 2D FA-SegNet. Furthermore, we added false positive losses and false negative losses to improve the segmentation performance of airway branches within the lungs.Main results. We performed data enhancement on the publicly available dataset of ISICDM 2020 Challenge 3, and on which evaluated our method. Comprehensive experiments show that the proposed method has the highest dice similarity coefficient (DSC) of 0.931, and IoU of 0.871 for the whole airway tree and DSC of 0.699, and IoU of 0.543 for the intrapulmonary bronchi tree. In addition, 3D ARNet proposed in this paper cascaded with other state-of-the-art methods to increase detected tree length rate by up to 46.33% and detected tree branch rate by up to 42.97%.Significance. The quantitative and qualitative evaluation results show that our proposed method performs well in segmenting the airway at different scales.

Study on high-precision three-dimensional reconstruction of pulmonary lesions and surrounding blood vessels based on CT images

The adoption of computerized tomography (CT) technology has significantly elevated the role of pulmonary CT imaging in diagnosing and treating pulmonary diseases. However, challenges persist due to the complex relationship between lesions within pulmonary tissue and the surrounding blood vessels. These challenges involve achieving precise three-dimensional reconstruction while maintaining accurate relative positioning of these elements. To effectively address this issue, this study employs a semi-automatic precise labeling process for the target region. This procedure ensures a high level of consistency in the relative positions of lesions and the surrounding blood vessels. Additionally, a morphological gradient interpolation algorithm, combined with Gaussian filtering, is applied to facilitate high-precision three-dimensional reconstruction of both lesions and blood vessels. Furthermore, this technique enables post-reconstruction slicing at any layer, facilitating intuitive exploration of the correlation between blood vessels and lesion layers. Moreover, the study utilizes physiological knowledge to simulate real-world blood vessel intersections, determining the range of blood vessel branch angles and achieving seamless continuity at internal blood vessel branch points. The experimental results achieved a satisfactory reconstruction with an average Hausdorff distance of 1.5 mm and an average Dice coefficient of 92%, obtained by comparing the reconstructed shape with the original shape,the approach also achieves a high level of accuracy in three-dimensional reconstruction and visualization. In conclusion, this study is a valuable source of technical support for the diagnosis and treatment of pulmonary diseases and holds promising potential for widespread adoption in clinical practice.

Harmonization Strategies in Multicenter MRI-Based Radiomics

Radiomics analysis is a powerful tool aiming to provide diagnostic and prognostic patient information directly from images that are decoded into handcrafted features, comprising descriptors of shape, size and textural patterns. Although radiomics is gaining momentum since it holds great promise for accelerating digital diagnostics, it is susceptible to bias and variation due to numerous inter-patient factors (e.g., patient age and gender) as well as inter-scanner ones (different protocol acquisition depending on the scanner center). A variety of image and feature based harmonization methods has been developed to compensate for these effects; however, to the best of our knowledge, none of these techniques has been established as the most effective in the analysis pipeline so far. To this end, this review provides an overview of the challenges in optimizing radiomics analysis, and a concise summary of the most relevant harmonization techniques, aiming to provide a thorough guide to the radiomics harmonization process.

Simultaneous vessel segmentation and unenhanced prediction using self-supervised dual-task learning in 3D CTA (SVSUP)

BACKGROUND AND OBJECTIVE

The vessel segmentation in CT angiography (CTA) provides an important basis for automatic diagnosis and hemodynamics analysis. Virtual unenhanced (VU) CT images obtained by dual-energy CT can assist clinical diagnosis and reduce radiation dose by obviating true unenhanced imaging (UECT). However, accurate segmentation of all vessels in the head-neck CTA (HNCTA) remains a challenge, and VU images are currently not available from conventional single-energy CT imaging.

METHODS

In this paper, we proposed a self-supervised dual-task deep learning strategy to fully automatically segment all vessels and predict unenhanced CT images from single-energy HNCTA based on a developed iterative residual-sharing scheme. The underlying idea was to use the correlation between the two tasks to improve task performance while avoiding manual annotation for model training.

RESULTS

The feasibility of the strategy was verified using the data of 24 patients. For vessel segmentation task, the proposed model achieves a significantly higher average Dice coefficient (84.83%, P-values 10^-3 in paired t-test) than the state-of-the-art segmentation model, vanilla VNet (78.94%), and several popular 3D vessel segmentation models, including Hessian-matrix based filter (62.59%), optically-oriented flux (66.33%), spherical flux model (66.91%), and deep vessel net (66.47%). For the unenhanced prediction task, the average ROI-based error compared to the UECT in the artery tissue is 6.1±4.5 HU, similar to previously reported 6.4±5.1 HU for VU reconstruction.

CONCLUSIONS

Results show that the proposed dual-task framework can effectively improve the accuracy of vessel segmentation in HNCTA, and it is feasible to predict the unenhanced image from single-energy CTA, providing a potential new approach for radiation dose saving. Moreover, to our best knowledge, this is the first reported annotation-free deep learning-based full-image vessel segmentation for HNCTA.

Algorithm of Pulmonary Vascular Segment and Centerline Extraction

Because pulmonary vascular lesions are harmful to the human body and difficult to detect, computer-assisted diagnosis of pulmonary blood vessels has become the focus and difficulty of the current research. An algorithm of pulmonary vascular segment and centerline extraction which is consistent with the physician's diagnosis process is proposed for the first time. We construct the projection of maximum density, restore the vascular space information, and correct random walk algorithm to satisfy automatic and accurate segmentation of blood vessels. Construct a local 3D model to restrain Hessian matrix when extracting centerline. In order to assist the physician to make a correct diagnosis and verify the effectiveness of the algorithm, we proposed a visual expansion model. According to the 420 high-resolution CT data of lung blood vessels labeled by physicians, the accuracy of segmentation algorithm AOM reached 93%, and the processing speed was 0.05 s/frame, which achieved the clinical application standards.

Automated vessel segmentation in lung CT and CTA images via deep neural networks

BACKGROUND

The distribution of pulmonary vessels in computed tomography (CT) and computed tomography angiography (CTA) images of lung is important for diagnosing disease, formulating surgical plans and pulmonary research.

PURPOSE

Based on the pulmonary vascular segmentation task of International Symposium on Image Computing and Digital Medicine 2020 challenge, this paper reviews 12 different pulmonary vascular segmentation algorithms of lung CT and CTA images and then objectively evaluates and compares their performances.

METHODS

First, we present the annotated reference dataset of lung CT and CTA images. A subset of the dataset consisting 7,307 slices for training and 3,888 slices for testing was made available for participants. Second, by analyzing the performance comparison of different convolutional neural networks from 12 different institutions for pulmonary vascular segmentation, the reasons for some defects and improvements are summarized. The models are mainly based on U-Net, Attention, GAN, and multi-scale fusion network. The performance is measured in terms of Dice coefficient, over segmentation rate and under segmentation rate. Finally, we discuss several proposed methods to improve the pulmonary vessel segmentation results using deep neural networks.

RESULTS

By comparing with the annotated ground truth from both lung CT and CTA images, most of 12 deep neural network algorithms do an admirable job in pulmonary vascular extraction and segmentation with the dice coefficients ranging from 0.70 to 0.85. The dice coefficients for the top three algorithms are about 0.80.

CONCLUSIONS

Study results show that integrating methods that consider spatial information, fuse multi-scale feature map, or have an excellent post-processing to deep neural network training and optimization process are significant for further improving the accuracy of pulmonary vascular segmentation.

Quantification of the bone lacunocanalicular network from 3D X-ray phase nanotomography images

There is a growing interest in developing 3D microscopy for the exploration of thick biological tissues. Recently, 3D X-ray nanocomputerised tomography has proven to be a suitable technique for imaging the bone lacunocanalicular network. This interconnected structure is hosting the osteocytes which play a major role in maintaining bone quality through remodelling processes. 3D images have the potential to reveal the architecture of cellular networks, but their quantitative analysis remains a challenge due to the density and complexity of nanometre sized structures and the need to handle and process large datasets, for example, 2048³ voxels corresponding to 32 GB per individual image in our case. In this work, we propose an efficient image processing approach for the segmentation of the network and the extraction of characteristic parameters describing the 3D structure. These parameters include the density of lacunae, the porosity of lacunae and canaliculi, and morphological features of lacunae (volume, surface area, lengths, anisotropy etc.). We also introduce additional parameters describing the local environment of each lacuna and its canaliculi. The method is applied to analyse eight human femoral cortical bone samples imaged by magnified X-ray phase nanotomography with a voxel size of 120 nm, which was found to be a good compromise to resolve canaliculi while keeping a sufficiently large field of view of 246 μm in 3D. The analysis was performed on a total of 2077 lacunae showing an average length, width and depth of 17.1 μm × 9.2 μm × 4.4 μm, with an average number of 58.2 canaliculi per lacuna and a total lacuno-canalicular porosity of 1.12%. The reported descriptive parameters provide information on the 3D organisation of the lacuno-canalicular network in human bones.

Characterization of 3D bifurcations in micro-scan and MRA-TOF images of cerebral vasculature for prediction of intra-cranial aneurysms

An aneurysm is a vascular disorder where ballooning may form in a weakened section of the wall in the blood vessel. The swelling of the aneurysm may lead to its rupture. Intra-cranial aneurysms are the ones presenting the higher risks. If ruptured, the aneurysm may induce a subarachnoid haemorrhage which could lead to premature death or permanent disability. In this study, we are interested in locating and characterizing the bifurcations of the cerebral vascular tree. We use a 3D skeletonization combined with a graph-based approach to detect the bifurcations. In this work, we thus propose a full geometric characterisation of the bifurcations and related arteries. Aside from any genetic predisposition and environmental risk factors, the geometry of the brain vasculature may influence the chance of aneurysm formation. Among the main achievements, in this paper, we propose accurate, predictive 3D measurements of the bifurcations and we furthermore estimate the risk of occurrence of an aneurysm on a given bifurcation.

Quantitative CT Analysis of Diffuse Lung Disease

Quantitative analysis of thin-section CT of the chest has a growing role in the clinical evaluation and management of diffuse lung diseases. This heterogeneous group includes diseases with markedly different prognoses and treatment options. Quantitative tools can assist in both accurate diagnosis and longitudinal management by improving characterization and quantification of disease and increasing the reproducibility of disease severity assessment. Furthermore, a quantitative index of disease severity may serve as a useful tool or surrogate endpoint in evaluating treatment efficacy. The authors explore the role of quantitative imaging tools in the evaluation and management of diffuse lung diseases. Lung parenchymal features can be classified with threshold, histogram, morphologic, and texture-analysis-based methods. Quantitative CT analysis has been applied in obstructive, infiltrative, and restrictive pulmonary diseases including emphysema, cystic fibrosis, asthma, idiopathic pulmonary fibrosis, hypersensitivity pneumonitis, connective tissue-related interstitial lung disease, and combined pulmonary fibrosis and emphysema. Some challenges limiting the development and practical application of current quantitative analysis tools include the quality of training data, lack of standard criteria to validate the accuracy of the results, and lack of real-world assessments of the impact on outcomes. Artifacts such as patient motion or metallic beam hardening, variation in inspiratory effort, differences in image acquisition and reconstruction techniques, or inaccurate preprocessing steps such as segmentation of anatomic structures may lead to inaccurate classification. Despite these challenges, as new techniques emerge, quantitative analysis is developing into a viable tool to supplement the traditional visual assessment of diffuse lung diseases and to provide decision support regarding diagnosis, prognosis, and longitudinal evaluation of disease. ^©RSNA, 2019.

Automatic Detection and Staging of Lung Tumors using Locational Features and Double-Staged Classifications

Lung cancer is a life-threatening disease with the highest morbidity and mortality rates of any cancer worldwide. Clinical staging of lung cancer can significantly reduce the mortality rate, because effective treatment options strongly depend on the specific stage of cancer. Unfortunately, manual staging remains a challenge due to the intensive effort required. This paper presents a computer-aided diagnosis (CAD) method for detecting and staging lung cancer from computed tomography (CT) images. This CAD works in three fundamental phases: segmentation, detection, and staging. In the first phase, lung anatomical structures from the input tomography scans are segmented using gray-level thresholding. In the second, the tumor nodules inside the lungs are detected using some extracted features from the segmented tumor candidates. In the last phase, the clinical stages of the detected tumors are defined by extracting locational features. For accurate and robust predictions, our CAD applies a double-staged classification: the first is for the detection of tumors and the second is for staging. In both classification stages, five alternative classifiers, namely the Decision Tree (DT), K-nearest neighbor (KNN), Support Vector Machine (SVM), Ensemble Tree (ET), and Back Propagation Neural Network (BPNN), are applied and compared to ensure high classification performance. The average accuracy levels of 92.8% for detection and 90.6% for staging are achieved using BPNN. Experimental findings reveal that the proposed CAD method provides preferable results compared to previous methods; thus, it is applicable as a clinical diagnostic tool for lung cancer.

An Approach for Pulmonary Vascular Extraction from Chest CT Images

Pulmonary vascular extraction from chest CT images plays an important role in the diagnosis of lung disease. To improve the accuracy rate of pulmonary vascular segmentation, a new pulmonary vascular extraction approach is proposed in this study. First, the lung tissue is extracted from chest CT images by region-growing and maximum between-class variance methods. Then the holes of the extracted region are filled by morphological operations to obtain complete lung region. Second, the points of the pulmonary vascular of the middle slice of the chest CT images are extracted as the original seed points. Finally, the seed points are spread throughout the lung region based on the fast marching method to extract the pulmonary vascular in the gradient image. Results of pulmonary vascular extraction from chest CT image datasets provided by the introduced approach are presented and discussed. Based on the ground truth pixels and the resulting quality measures, it can be concluded that the average accuracy of this approach is about 90%. Extensive experiments demonstrate that the proposed method has achieved the best performance in pulmonary vascular extraction compared with other two widely used methods.

Segmentation of pulmonary vascular tree by incorporating vessel enhancement filter and variational region-growing

BACKGROUND

Automatic segmentation of pulmonary vascular tree in the thoracic computed tomography (CT) image is a promising but challenging task with great clinical potential values. It is difficult to segment the whole vascular tree in reasonable time and acceptable accuracy.

OBJECTIVE

To develop a novel pulmonary vessel segmentation approach by incorporating vessel enhancement filters and the anisotropic diffusion filter with the variational region growing.

METHODS

First, the airway wall from the lung lobes is eliminated from CT images by using multi-scale morphological operations. Second, a Hessian-based multi-scale vesselness filter and medialness filter are applied to detect and enhance the potential vessel. Third, an anisotropic diffusion filter is used to remove noise and enhance the tube-like structures in CT images. Last, the vascular tree is segmented by applying variational region growing algorithm.

RESULTS

Applying to the CT images collected from the entire dataset of VESSEL12 challenge, we achieved an average sensitivity of 92.9%, specificity of 91.6% and the area under the ROC curve of AUC = 0.972.

CONCLUSIONS

This study demonstrated feasibility of segmenting the pulmonary vessel effectively by incorporating vessel enhancement filters and the anisotropic diffusion filter with the variational region growing algorithm. Our method cannot only segment both large and peripheral vessels, but also distinguish the vessels from the adjacent tissues, especially the airway walls.

Review. Automatic Segmentation Techniques of the Coronary Artery Using CT Images in Acute Coronary Syndromes

Coronary artery disease represents one of the leading reasons of death worldwide, and acute coronary syndromes are their most devastating consequences. It is extremely important to identify the patients at risk for developing an acute myocardial infarction, and this goal can be achieved using noninvasive imaging techniques. Coronary computed tomography angiography (CCTA) is currently one of the most reliable methods used for assessing the coronary arteries; however, its use in emergency settings is sometimes limited due to time constraints. This paper presents the main characteristics of plaque vulnerability, the role of CCTA in the assessment of vulnerable plaques, and automatic segmentation techniques of the coronary artery tree based on CT angiography images. A detailed inventory of existing methods is given, representing the state-of-the-art of computational methods applied in vascular system segmentation, focusing on the current applications in acute coronary syndromes.

Technical Note: Contrast free angiography of the pulmonary vasculature in live mice using a laboratory x-ray source

Purpose:

In vivo imaging of the pulmonary vasculature in small animals is difficult yet highly desirable in order to allow study of the effects of a host of dynamic biological processes such as hypoxic pulmonary vasoconstriction. Here the authors present an approach for the quantification of changes in the vasculature.

Methods:

A contrast free angiography technique is validated in silico through the use of computer-generated images and in vivo through microcomputed tomography (μCT) of live mice conducted using a laboratory-based x-ray source. Subsequent image processing on μCT data allowed for the quantification of the caliber of pulmonary vasculature without the need for external contrast agents. These measures were validated by comparing with quantitative contrast microangiography in the same mice.

Results:

Quantification of arterial diameters from the method proposed in this study is validated against laboratory-based x-ray contrast microangiography. The authors find that there is a high degree of correlation (R = 0.91) between measures from microangiography and their contrast free method.

Conclusions:

A technique for quantification of murine pulmonary vasculature without the need for contrast is presented. As such, this technique could be applied for longitudinal studies of animals to study changes to vasculature without the risk of premature death in sensitive mouse models of disease. This approach may also be of value in the clinical setting.

Comparing algorithms for automated vessel segmentation in computed tomography scans of the lung: the VESSEL12 study

The VESSEL12 (VESsel SEgmentation in the Lung) challenge objectively compares the performance of different algorithms to identify vessels in thoracic computed tomography (CT) scans. Vessel segmentation is fundamental in computer aided processing of data generated by 3D imaging modalities. As manual vessel segmentation is prohibitively time consuming, any real world application requires some form of automation. Several approaches exist for automated vessel segmentation, but judging their relative merits is difficult due to a lack of standardized evaluation. We present an annotated reference dataset containing 20 CT scans and propose nine categories to perform a comprehensive evaluation of vessel segmentation algorithms from both academia and industry. Twenty algorithms participated in the VESSEL12 challenge, held at International Symposium on Biomedical Imaging (ISBI) 2012. All results have been published at the VESSEL12 website http://vessel12.grand-challenge.org. The challenge remains ongoing and open to new participants. Our three contributions are: (1) an annotated reference dataset available online for evaluation of new algorithms; (2) a quantitative scoring system for objective comparison of algorithms; and (3) performance analysis of the strengths and weaknesses of the various vessel segmentation methods in the presence of various lung diseases.