Automated lobe-based airway labeling

Deep learning-based bronchial tree-guided semi-automatic segmentation of pulmonary segments in computed tomography images

Background

Pulmonary segments are valuable because they can provide more precise localization and intricate details of lung cancer than lung lobes. With advances in precision therapy, there is an increasing demand for the identification and visualization of pulmonary segments in computed tomography (CT) images to aid in the precise treatment of lung cancer. This study aimed to integrate multiple deep-learning models to accurately segment pulmonary segments in CT images using a bronchial tree (BT)-based approach.

Methods

The proposed segmentation method for pulmonary segments using the BT-based approach comprised the following five essential steps: (I) segmentation of the lung using a U-Net (R231) (public access) model; (II) segmentation of the lobes using a V-Net (self-developed) model; (III) segmentation of the airway using a combination of a differential geometric approach method and a BronchiNet (public access) model; (IV) labeling of the BT branches based on anatomical position; and (V) segmentation of the pulmonary segments based on the distance of each voxel to the labeled BT branches. This five-step process was applied to 14 high-resolution breath-hold CT images and compared against manual segmentations for evaluation.

Results

For the lung segmentation, the lung mask had a mean dice similarity coefficient (DSC) of 0.98±0.03. For the lobe segmentation, the V-Net model had a mean DSC of 0.94±0.06. For the airway segmentation, the average total length of the segmented airway trees per image scan was 1,902.8±502.1 mm, and the average number of the maximum airway tree generations was 8.5±1.3. For the segmentation of the pulmonary segments, the proposed method had a DSC of 0.73±0.11 and a mean surface distance of 6.1±2.9 mm.

Conclusions

This study demonstrated the feasibility of combining multiple deep-learning models for the auxiliary segmentation of pulmonary segments on CT images using a BT-based approach. The results highlighted the potential of the BT-based method for the semi-automatic segmentation of the pulmonary segment.

AGMN: Association Graph-based Graph Matching Network for Coronary Artery Semantic Labeling on Invasive Coronary Angiograms

Semantic labeling of coronary arterial segments in invasive coronary angiography (ICA) is important for automated assessment and report generation of coronary artery stenosis in computer-aided coronary artery disease (CAD) diagnosis. However, separating and identifying individual coronary arterial segments is challenging because morphological similarities of different branches on the coronary arterial tree and human-to-human variabilities exist. Inspired by the training procedure of interventional cardiologists for interpreting the structure of coronary arteries, we propose an association graph-based graph matching network (AGMN) for coronary arterial semantic labeling. We first extract the vascular tree from invasive coronary angiography (ICA) and convert it into multiple individual graphs. Then, an association graph is constructed from two individual graphs where each vertex represents the relationship between two arterial segments. Thus, we convert the arterial segment labeling task into a vertex classification task; ultimately, the semantic artery labeling becomes equivalent to identifying the artery-to-artery correspondence on graphs. More specifically, the AGMN extracts the vertex features by the embedding module using the association graph, aggregates the features from adjacent vertices and edges by graph convolution network, and decodes the features to generate the semantic mappings between arteries. By learning the mapping of arterial branches between two individual graphs, the unlabeled arterial segments are classified by the labeled segments to achieve semantic labeling. A dataset containing 263 ICAs was employed to train and validate the proposed model, and a five-fold cross-validation scheme was performed. Our AGMN model achieved an average accuracy of 0.8264, an average precision of 0.8276, an average recall of 0.8264, and an average F1-score of 0.8262, which significantly outperformed existing coronary artery semantic labeling methods. In conclusion, we have developed and validated a new algorithm with high accuracy, interpretability, and robustness for coronary artery semantic labeling on ICAs.

TTN: Topological Transformer Network for Automated Coronary Artery Branch Labeling in Cardiac CT Angiography

OBJECTIVE

Existing methods for automated coronary artery branch labeling in cardiac CT angiography face two limitations: 1) inability to model overall correlation of branches, since differences between branches cannot be captured directly. 2) a serious class imbalance between main and side branches.

METHODS AND PROCEDURES

Inspired by the application of Transformer in sequence data, we propose a topological Transformer network (TTN), which solves the vessel branch labeling from a novel perspective of sequence labeling learning. TTN detects differences between branches by establishing their overall correlation. A topological encoding that represents the positions of vessel segments in the artery tree, is proposed to assist the model in classifying branches. Also, a segment-depth loss is introduced to solve the class imbalance between main and side branches.

RESULTS

On a dataset with 325 CCTA, our method obtains the best overall result on all branches, the best result on side branches, and a competitive result on main branches.

CONCLUSION

TTN solves two limitations in existing methods perfectly, thus achieving the best result in coronary artery branch labeling task. It is the first Transformer based vessel branch labeling method and is notably different from previous methods.

CLINICAL IMPACT

This Pre-Clinical Research can be integrated into a computer-aided diagnosis system to generate cardiovascular disease diagnosis report, assisting clinicians in locating the atherosclerotic plaques.

Influence of Monoenergetic Images at Different Energy Levels in Dual-Energy Spectral CT on the Accuracy of Computer-Aided Detection for Pulmonary Embolism

PURPOSE

To investigate the influence of monoenergetic images of different energy levels in spectral computed tomography (CT) on the accuracy of computer aided detection (CAD) for pulmonary embolism (PE).

MATERIALS AND METHODS

CT images of 20 PE patients who underwent spectral CT pulmonary angiography were retrospectively analyzed. Nine sets of monochromatic images from 40 to 80 keV at 5 keV interval were reconstructed and then independently analyzed for detecting PE using a commercially available CAD software. Two experienced radiologists reviewed all images and recorded the number of emboli manually, which was used as the reference standard. The CAD findings for the number of PE at different energies were compared with the reference standard to determine the number of true positives and false positives with CAD and to calculate the sensitivity and false positive rate at different energies.

RESULT

There were 120 true emboli. The total numbers of CAD-detected PE at 40-80 keV were 48, 67, 63, 87, 106, 115, 138, 157, and 226. Images at low energies had low sensitivities and low false positive rates; images at high energies had high sensitivities and high false positive rates. At 60 keV and 65 keV, CAD achieved sensitivity at 81.67% and 84.17%, respectively and false positive rate at 7.55% and 12.17%, respectively to provide the optimum combination of high sensitivity and low false positive rate.

CONCLUSION

Monochromatic images of different energies in dual-energy spectral CT affect the accuracy of CAD for PE. The combination of CAD with images at 60-65 keV provides the optimum combination of high sensitivity and low false positive rate in detecting PE.

Validation of automated lobe segmentation on paired inspiratory-expiratory chest CT in 8-14 year-old children with cystic fibrosis

Objectives

Densitometry on paired inspiratory and expiratory multidetector computed tomography (MDCT) for the quantification of air trapping is an important approach to assess functional changes in airways diseases such as cystic fibrosis (CF). For a regional analysis of functional deficits, an accurate lobe segmentation algorithm applicable to inspiratory and expiratory scans is beneficial.

Materials and methods

We developed a fully automated lobe segmentation algorithm, and subsequently validated automatically generated lobe masks (ALM) against manually corrected lobe masks (MLM). Paired inspiratory and expiratory CTs from 16 children with CF (mean age 11.1±2.4) acquired at 4 time-points (baseline, 3mon, 12mon, 24mon) with 2 kernels (B30f, B60f) were segmented, resulting in 256 ALM. After manual correction spatial overlap (Dice index) and mean differences in lung volume and air trapping were calculated for ALM vs. MLM.

Results

The mean overlap calculated with Dice index between ALM and MLM was 0.98±0.02 on inspiratory, and 0.86±0.07 on expiratory CT. If 6 lobes were segmented (lingula treated as separate lobe), the mean overlap was 0.97±0.02 on inspiratory, and 0.83±0.08 on expiratory CT. The mean differences in lobar volumes calculated in accordance with the approach of Bland and Altman were generally low, ranging on inspiratory CT from 5.7±52.23cm³ for the right upper lobe to 17.41±14.92cm³ for the right lower lobe. Higher differences were noted on expiratory CT. The mean differences for air trapping were even lower, ranging from 0±0.01 for the right upper lobe to 0.03±0.03 for the left lower lobe.

Conclusions

Automatic lobe segmentation delivers excellent results for inspiratory and good results for expiratory CT. It may become an important component for lobe-based quantification of functional deficits in cystic fibrosis lung disease, reducing necessity for user-interaction in CT post-processing.

CT Radiomics in Thoracic Oncology: Technique and Clinical Applications

Precision medicine offers better treatment options and improved survival for cancer patients based on individual variability. As the success of precision medicine depends on robust biomarkers, the requirement for improved imaging biomarkers that reflect tumor biology has grown exponentially. Radiomics, the field of study in which high-throughput data are generated and large amounts of advanced quantitative features are extracted from medical images, has shown great potential as a source of quantitative biomarkers in the field of oncology. Radiomics provides quantitative information about the morphology, texture, and intratumoral heterogeneity of the tumor itself as well as features related to pulmonary function. Hence, radiomics data can be used to build descriptive and predictive clinical models that relate imaging characteristics to tumor biology phenotypes. In this review, we describe the workflow of CT radiomics, types of CT radiomics, and its clinical application in thoracic oncology.

Airway tree reconstruction in expiration chest CT scans facilitated by information transfer from corresponding inspiration scans

PURPOSE

Analysis and comparison of airways imaged in pairs of inspiration and expiration lung CT scans provides important information for quantitative assessment of lung diseases like chronic obstructive pulmonary disease. However, airway tree reconstruction in expiration CT scans is a challenging problem. Typically, only a low number of airway branches are found in expiration scans, compared to inspiration scans. To detect more airways in expiration CT scans, the authors introduce a novel airway reconstruction approach and assess its performance.

METHODS

The method requires a pair of inspiration and expiration CT scans and utilizes information from the inspiration scan to facilitate reconstructing the airway tree in the expiration lung CT scan. First, an initial airway tree (high confidence) and airway candidates (limited confidence) are reconstructed in the expiration scan by utilizing a 3D graph-based reconstruction method. Then, the 3D airway tree is reconstructed in the inspiration scan. Second, correspondences between expiration and inspiration tree structures are identified by utilizing a novel hierarchical tree matching algorithm that utilizes a local CT image-based similarity criterion. Third, the tree information from the inspiration airway tree is used to select expiration candidates, resulting in the final expiration tree structure. The approach was evaluated on a diverse set of 40 scan pairs and compared to the baseline method, which utilizes only the expiration CT scan.

RESULTS

The proposed method produced a significant (p < 0.05) increase in airway tree length by 13.35 cm, on average, which represents an 11.21% increase relative to the baseline result using only the expiration CT scan. A detailed analysis of all additionally identified airways resulted in a true and false positive rate of 94.8% and 5.2%, respectively. The true positive rate was found to be significantly higher than the false positive rate (p < 0.05).

CONCLUSIONS

The proposed method allowed increasing the number of found airways in expiration scans significantly. In addition, the algorithm establishes correspondence between inspiration and expiration airway trees, which can facilitate label transfer between airway trees and quantitative assessment of change in airways. The approach can be adapted to facilitate airway reconstruction in several longitudinal lung CT scans by means of mutual information transfer.

Geodesic Atlas-Based Labeling of Anatomical Trees: Application and Evaluation on Airways Extracted From CT

We present a fast and robust atlas-based algorithm for labeling airway trees, using geodesic distances in a geometric tree-space. Possible branch label configurations for an unlabeled airway tree are evaluated using distances to a training set of labeled airway trees. In tree-space, airway tree topology and geometry change continuously, giving a natural automatic handling of anatomical differences and noise. A hierarchical approach makes the algorithm efficient, assigning labels from the trachea and downwards. Only the airway centerline tree is used, which is relatively unaffected by pathology. The algorithm is evaluated on 80 segmented airway trees from 40 subjects at two time points, labeled by three medical experts each, testing accuracy, reproducibility and robustness in patients with chronic obstructive pulmonary disease (COPD). The accuracy of the algorithm is statistically similar to that of the experts and not significantly correlated with COPD severity. The reproducibility of the algorithm is significantly better than that of the experts, and negatively correlated with COPD severity. Evaluation of the algorithm on a longitudinal set of 8724 trees from a lung cancer screening trial shows that the algorithm can be used in large scale studies with high reproducibility, and that the negative correlation of reproducibility with COPD severity can be explained by missing branches, for instance due to segmentation problems in COPD patients. We conclude that the algorithm is robust to COPD severity given equally complete airway trees, and comparable in performance to that of experts in pulmonary medicine, emphasizing the suitability of the labeling algorithm for clinical use.