Geodesic Atlas-Based Labeling of Anatomical Trees: Application and Evaluation on Airways Extracted From CT

Structure and position-aware graph neural network for airway labeling

We present a novel graph-based approach for labeling the anatomical branches of a given airway tree segmentation. The proposed method formulates airway labeling as a branch classification problem in the airway tree graph, where branch features are extracted using convolutional neural networks and enriched using graph neural networks. Our graph neural network is structure-aware by having each node aggregate information from its local neighbors and position-aware by encoding node positions in the graph. We evaluated the proposed method on 220 airway trees from subjects with various severity stages of Chronic Obstructive Pulmonary Disease (COPD). The results demonstrate that our approach is computationally efficient and significantly improves branch classification performance than the baseline method. The overall average accuracy of our method reaches 91.18% for labeling 18 segmental airway branches, compared to 83.83% obtained by the standard CNN method and 87.37% obtained by the existing method. Furthermore, the reader study done on an additional set of 40 subjects shows that our algorithm performs comparably to human experts in labeling segmental-airways. We published our source code at https://github.com/DIAGNijmegen/spgnn. The proposed algorithm is also publicly available at https://grand-challenge.org/algorithms/airway-anatomical-labeling/.

BranchLabelNet: Anatomical Human Airway Labeling Approach using a Dividing-and-Grouping Multi-Label Classification

Anatomical airway labeling is crucial for precisely identifying airways displaying symptoms such as constriction, increased wall thickness, and modified branching patterns, facilitating the diagnosis and treatment of pulmonary ailments. This study introduces an innovative airway labeling methodology, BranchLabelNet, which accounts for the fractal nature of airways and inherent hierarchical branch nomenclature. In developing this methodology, branch-related parameters, including position vectors, generation levels, branch lengths, areas, perimeters, and more, are extracted from a dataset of 1000 chest computed tomography (CT) images. To effectively manage this intricate branch data, we employ an n-ary tree structure that captures the complicated relationships within the airway tree. Subsequently, we employ a divide-and-group deep learning approach for multi-label classification, streamlining the anatomical airway branch labeling process. Additionally, we address the challenge of class imbalance in the dataset by incorporating the Tomek Links algorithm to maintain model reliability and accuracy. Our proposed airway labeling method provides robust branch designations and achieves an impressive average classification accuracy of 95.94% across fivefold cross-validation. This approach is adaptable for addressing similar complexities in general multi-label classification problems within biomedical systems.

TNN: Tree Neural Network for Airway Anatomical Labeling

Detailed anatomical labeling of bronchial trees extracted from CT images can be used as fine-grained maps for intra-operative navigation. To cater to the sparse distribution of airway voxels and large class imbalance in 3D image space, a graph-neural-network-based method is proposed to map branches to nodes in a graph space and assign anatomical labels down to subsegmental level. To address the inherent problem of overlapping distribution of positional and morphological features, especially for subsegmental categories, the proposed method focuses on the relative position between sibling subsegments which is fixed in most cases. The hierarchical nomenclature is represented by multi-level labeling and each category is associated with one or two subtrees in the graph. Hyperedges are used to extract the representation of subtrees while a hypergraph neural network is developed to encode their intrinsic relationship through hyperedge interaction. A filter module is further designed to guide feature aggregation between nodes and hyperedges. With the proposed method, the final accuracies for segmental and subsegmental node classification can achieve 93.6% and 82.0% respectively. The corresponding code is publicly available at https://github.com/haozheng-sjtu/airway-labeling.

Automated anatomical labeling of a topologically variant abdominal arterial system via probabilistic hypergraph matching

Automated anatomical vessel labeling of the abdominal arterial system is a crucial topic in medical image processing. One reason for this is the importance of the abdominal arterial system in the human body, and another is that such labeling is necessary for the related disease diagnoses, treatments and epidemiological population analyses. We define a hypergraph representation of the abdominal arterial system as a family tree model with a probabilistic hypergraph matching framework for automated vessel labeling. Then we treat the labelling problem as the convex optimization problem and solve it with the maximum a posteriori(MAP) combined the likelihood obtained by geometric labelling with the family tree topology-based knowledge. Geometrically, we utilize XGBoost ensemble learning with an intrinsic geometric feature importance analysis for branch-level labeling. In topology, the defined family tree model of the abdominal arterial system is transferred as a Markov chain model using a constrained traversal order method and further the Markov chain model is optimized by a hidden Markov model (HMM). The probability distribution of the target branches for each candidate anatomical name is predicted and effectively embedded in the HMM model. This approach is evaluated with the leave-one-out method on 37 clinical patients' abdominal arteries, and the average accuracy is 91.94%. The obtained results are better than those of the state-of-art method with an F1 score of 93.00% and a recall of 93.00%, as the proposed method simultaneously handles the anatomical structural variability and discriminates between the symmetric branches. It is demonstrated to be suitable for labelling branches of the abdominal arterial system and can also be extended to similar tubular organ networks, such as arterial or airway networks.

Automated labeling of the airway tree in terms of lobes based on deep learning of bifurcation point detection

This paper presents an automatic lobe-based labeling of airway tree method, which can detect the bifurcation points for reconstructing and labeling the airway tree from a computed tomography image. A deep learning-based network structure is designed to identify the four key bifurcation points. Then, based on the detected bifurcation points, the entire airway tree is reconstructed by a new region-growing method. Finally, with the basic airway tree anatomy and topology knowledge, individual branches of the airway tree are classified into different categories in terms of pulmonary lobes. There are several advantages in our method such as the detection of the bifurcation points does not depend on the segmentation of airway tree and only four bifurcation points need to be manually labeled for each sample to prepare the training dataset. The segmentation of airway tree is guided by the detected points, which overcomes the difficulty of manual seed selection of conventional region-growing algorithm. In addition, the bifurcation points can help analyze the tree structure, which provides a basis for effective airway tree labeling. Experimental results show that our method is fast, stable, and the accuracy of our method is 97.85%, which is higher than that of the traditional skeleton-based method. Graphical Abstract The pipeline of our proposed lobe-based airway tree labeling method. Given a raw CT volume, a neural network structure is designed to predict major bifurcation points of airway tree. Based on the detected points, airway tree is reconstructed and labeled in terms of lobes.

Anatomical Labeling of Human Airway Branches using a Novel Two-Step Machine Learning and Hierarchical Features

Chronic obstructive pulmonary disease (COPD) is a common inflammatory disease associated with restricted lung airflow. Quantitative computed tomography (CT)-based bronchial measures are popularly used in COPD-related studies, which require both airway segmentation and anatomical branch labeling. This paper presents an algorithm for anatomical labeling of human airway tree branches using a novel two-step machine learning and hierarchical features. Anatomical labeling of airway branches allows standardized spatial referencing of airway phenotypes in large population-based studies. State-of-the-art anatomical labeling methods are associated with mandatory manual reviewing and correction for mislabeled branches-a time-consuming process susceptible to inter-observer variability. The new method is fully automated, and it uses hierarchical branch-level features from the current as well as ancestral and descendant branches. During the first machine learning step, it differentiates candidate anatomical branches from insignificant topological branches, often, responsible for variations in airway branching patterns. The second step is designed for lung lobe-based classification of anatomical labels for valid candidate branches. The machine learning classifiers has been designed, trained, and validated using total lung capacity (TLC) CT scans (n = 350) from the Iowa cohort of the nationwide COPDGene study during their baseline visits. One hundred TLC CT scans were used for training and validation, and a different set of 250 scans were used for testing and evaluative experiments. The new method achieved labeling accuracies of 98.4, 97.2, 92.3, 93.4, and 94.1% in the right upper, right middle, right lower, left upper, and left lower lobe, respectively, and an overall accuracy of 95.9%. For five clinically significant segmental branches, the method has achieved an accuracy of 95.2%.

Nilpotent Approximations of Sub-Riemannian Distances for Fast Perceptual Grouping of Blood Vessels in 2D and 3D

We propose an efficient approach for the grouping of local orientations (points on vessels) via nilpotent approximations of sub-Riemannian distances in the 2D and 3D roto-translation groups SE(2) and SE(3). In our distance approximations we consider homogeneous norms on nilpotent groups that locally approximate SE(n), and which are obtained via the exponential and logarithmic map on SE(n). In a qualitative validation we show that the norms provide accurate approximations of the true sub-Riemannian distances, and we discuss their relations to the fundamental solution of the sub-Laplacian on SE(n). The quantitative experiments further confirm the accuracy of the approximations. Quantitative results are obtained by evaluating perceptual grouping performance of retinal blood vessels in 2D images and curves in challenging 3D synthetic volumes. The results show that (1) sub-Riemannian geometry is essential in achieving top performance and (2) grouping via the fast analytic approximations performs almost equally, or better, than data-adaptive fast marching approaches on R n and SE(n).

A tree-matching algorithm: Application to airways in CT images of subjects with the acute respiratory distress syndrome

To match anatomical trees such as airways, we propose a graph-based strategy combined with an appropriate distance function. The strategy was devised to cope with topological and geometrical differences that may arise between trees corresponding to the same subject, but extracted from images acquired in different conditions. The proposed distance function, called father/family distance, combines topological and geometrical information in a single measure, by calculating a sum of path-to-path distances between sub-trees of limited extent. To use it successfully, the branches of these sub-trees need to be brought closer, which is obtained by successively translating the roots of these sub-trees prior to their actual matching. The work herein presented contributes to a study of the acute respiratory distress syndrome, where a series of pulmonary CT images from the same subject is acquired at varying settings (pressure and volume) of the mechanical ventilation. The method was evaluated on 45 combinations of synthetic trees, as well as on 15 pairs of real airway trees: nine corresponding to end-expiration and end-inspiration with the same pressure, and six corresponding to end-inspiration with significantly different pressures. It achieved a high rate of successful matches with respect to a hand-made reference containing a total of 2391 matches in real data: sensitivity of 94.3% and precision of 92.8%, when using the basic parameter settings of the algorithm.