Automated anatomical labeling of abdominal arteries and hepatic portal system extracted from abdominal CT volumes

Multi-task global optimization-based method for vascular landmark detection

Vascular landmark detection plays an important role in medical analysis and clinical treatment. However, due to the complex topology and similar local appearance around landmarks, the popular heatmap regression based methods always suffer from the landmark confusion problem. Vascular landmarks are connected by vascular segments and have special spatial correlations, which can be utilized for performance improvement. In this paper, we propose a multi-task global optimization-based framework for accurate and automatic vascular landmark detection. A multi-task deep learning network is exploited to accomplish landmark heatmap regression, vascular semantic segmentation, and orientation field regression simultaneously. The two auxiliary objectives are highly correlated with the heatmap regression task and help the network incorporate the structural prior knowledge. During inference, instead of performing a max-voting strategy, we propose a global optimization-based post-processing method for final landmark decision. The spatial relationships between neighboring landmarks are utilized explicitly to tackle the landmark confusion problem. We evaluated our method on a cerebral MRA dataset with 564 volumes, a cerebral CTA dataset with 510 volumes, and an aorta CTA dataset with 50 volumes. The experiments demonstrate that the proposed method is effective for vascular landmark localization and achieves state-of-the-art performance.

Automated peripancreatic vessel segmentation and labeling based on iterative trunk growth and weakly supervised mechanism

Peripancreatic vessel segmentation and anatomical labeling are pivotal aspects in aiding surgical planning and prognosis for patients with pancreatic tumors. Nevertheless, prevailing techniques often fall short in achieving satisfactory segmentation performance for the peripancreatic vein (PPV), leading to predictions characterized by poor integrity and connectivity. Besides, unsupervised labeling algorithms usually cannot deal with complex anatomical variation while fully supervised methods require a large number of voxel-wise annotations for training, which is very labor-intensive and time-consuming. To address these two problems, we propose an Automated Peripancreatic vEssel Segmentation and lAbeling (APESA) framework, to not only highly improve the segmentation performance for PPV, but also efficiently identify the peripancreatic artery (PPA) branches. There are two core modules in our proposed APESA framework: iterative trunk growth module (ITGM) for vein segmentation and weakly supervised labeling mechanism (WSLM) for artery labeling. The ITGM is composed of a series of iterative submodules, each of which chooses the largest connected component of the previous PPV segmentation as the trunk of a tree structure, seeks for the potential missing branches around the trunk by our designed branch proposal network, and facilitates trunk growth under the connectivity constraint. The WSLM incorporates the rule-based pseudo label generation with less expert participation, an anatomical labeling network to learn the branch distribution voxel by voxel, and adaptive radius-based postprocessing to refine the branch structures of the labeling predictions. Our achieved Dice of 94.01% for PPV segmentation on our collected dataset represents an approximately 10% accuracy improvement compared to state-of-the-art methods. Additionally, we attained a Dice of 97.01% for PPA segmentation and competitive labeling performance for PPA labeling compared to prior works. Our source codes will be publicly available at https://github.com/ZouLiwen-1999/APESA.

TTN: Topological Transformer Network for Automated Coronary Artery Branch Labeling in Cardiac CT Angiography

OBJECTIVE

Existing methods for automated coronary artery branch labeling in cardiac CT angiography face two limitations: 1) inability to model overall correlation of branches, since differences between branches cannot be captured directly. 2) a serious class imbalance between main and side branches.

METHODS AND PROCEDURES

Inspired by the application of Transformer in sequence data, we propose a topological Transformer network (TTN), which solves the vessel branch labeling from a novel perspective of sequence labeling learning. TTN detects differences between branches by establishing their overall correlation. A topological encoding that represents the positions of vessel segments in the artery tree, is proposed to assist the model in classifying branches. Also, a segment-depth loss is introduced to solve the class imbalance between main and side branches.

RESULTS

On a dataset with 325 CCTA, our method obtains the best overall result on all branches, the best result on side branches, and a competitive result on main branches.

CONCLUSION

TTN solves two limitations in existing methods perfectly, thus achieving the best result in coronary artery branch labeling task. It is the first Transformer based vessel branch labeling method and is notably different from previous methods.

CLINICAL IMPACT

This Pre-Clinical Research can be integrated into a computer-aided diagnosis system to generate cardiovascular disease diagnosis report, assisting clinicians in locating the atherosclerotic plaques.

Anatomical labeling of intracranial arteries with deep learning in patients with cerebrovascular disease

Brain arteries are routinely imaged in the clinical setting by various modalities, e.g., time-of-flight magnetic resonance angiography (TOF-MRA). These imaging techniques have great potential for the diagnosis of cerebrovascular disease, disease progression, and response to treatment. Currently, however, only qualitative assessment is implemented in clinical applications, relying on visual inspection. While manual or semi-automated approaches for quantification exist, such solutions are impractical in the clinical setting as they are time-consuming, involve too many processing steps, and/or neglect image intensity information. In this study, we present a deep learning-based solution for the anatomical labeling of intracranial arteries that utilizes complete information from 3D TOF-MRA images. We adapted and trained a state-of-the-art multi-scale Unet architecture using imaging data of 242 patients with cerebrovascular disease to distinguish 24 arterial segments. The proposed model utilizes vessel-specific information as well as raw image intensity information, and can thus take tissue characteristics into account. Our method yielded a performance of 0.89 macro F1 and 0.90 balanced class accuracy (bAcc) in labeling aggregated segments and 0.80 macro F1 and 0.83 bAcc in labeling detailed arterial segments on average. In particular, a higher F1 score than 0.75 for most arteries of clinical interest for cerebrovascular disease was achieved, with higher than 0.90 F1 scores in the larger, main arteries. Due to minimal pre-processing, simple usability, and fast predictions, our method could be highly applicable in the clinical setting.

Automated anatomical labeling of a topologically variant abdominal arterial system via probabilistic hypergraph matching

Automated anatomical vessel labeling of the abdominal arterial system is a crucial topic in medical image processing. One reason for this is the importance of the abdominal arterial system in the human body, and another is that such labeling is necessary for the related disease diagnoses, treatments and epidemiological population analyses. We define a hypergraph representation of the abdominal arterial system as a family tree model with a probabilistic hypergraph matching framework for automated vessel labeling. Then we treat the labelling problem as the convex optimization problem and solve it with the maximum a posteriori(MAP) combined the likelihood obtained by geometric labelling with the family tree topology-based knowledge. Geometrically, we utilize XGBoost ensemble learning with an intrinsic geometric feature importance analysis for branch-level labeling. In topology, the defined family tree model of the abdominal arterial system is transferred as a Markov chain model using a constrained traversal order method and further the Markov chain model is optimized by a hidden Markov model (HMM). The probability distribution of the target branches for each candidate anatomical name is predicted and effectively embedded in the HMM model. This approach is evaluated with the leave-one-out method on 37 clinical patients' abdominal arteries, and the average accuracy is 91.94%. The obtained results are better than those of the state-of-art method with an F1 score of 93.00% and a recall of 93.00%, as the proposed method simultaneously handles the anatomical structural variability and discriminates between the symmetric branches. It is demonstrated to be suitable for labelling branches of the abdominal arterial system and can also be extended to similar tubular organ networks, such as arterial or airway networks.

Perspective for Future Medicine: Multidisciplinary Computational Anatomy-Based Medicine with Artificial Intelligence

Multidisciplinary computational anatomy (MCA) is a new frontier of science that provides a mathematical analysis basis for the comprehensive and useful understanding of "dynamic living human anatomy." It defines a new mathematical modeling method for the early detection and highly intelligent diagnosis and treatment of incurable or intractable diseases. The MCA is a method of scientific research on innovative areas based on the medical images that are integrated with the information related to: (1) the spatial axis, extending from a cell size to an organ size; (2) the time series axis, extending from an embryo to post mortem body; (3) the functional axis on physiology or metabolism which is reflected in a variety of medical image modalities; and (4) the pathological axis, extending from a healthy physical condition to a diseased condition. It aims to integrate multiple prediction models such as multiscale prediction model, temporal prediction model, anatomy function prediction model, and anatomy-pathology prediction model. Artificial intelligence has been introduced to accelerate the calculation of statistic mathematical analysis. The future perspective is expected to promote the development of human resources as well as a new MCA-based scientific interdisciplinary field composed of mathematical statistics, information sciences, computing data science, robotics, and biomedical engineering and clinical applications. The MCA-based medicine might be one of the solutions to overcome the difficulties in the current medicine.

Artificial intelligence applications for pediatric oncology imaging

Machine learning algorithms can help to improve the accuracy and efficiency of cancer diagnosis, selection of personalized therapies and prediction of long-term outcomes. Artificial intelligence (AI) describes a subset of machine learning that can identify patterns in data and take actions to reach pre-set goals without specific programming. Machine learning tools can help to identify high-risk populations, prescribe personalized screening tests and enrich patient populations that are most likely to benefit from advanced imaging tests. AI algorithms can also help to plan personalized therapies and predict the impact of genomic variations on the sensitivity of normal and tumor tissue to chemotherapy or radiation therapy. The two main bottlenecks for successful AI applications in pediatric oncology imaging to date are the needs for large data sets and appropriate computer and memory power. With appropriate data entry and processing power, deep convolutional neural networks (CNNs) can process large amounts of imaging data, clinical data and medical literature in very short periods of time and thereby accelerate literature reviews, correct diagnoses and personalized treatments. This article provides a focused review of emerging AI applications that are relevant for the pediatric oncology imaging community.

Automatic anatomical labeling of arteries and veins using conditional random fields

PURPOSE

For safe and reliable laparoscopic surgery, it is important to determine individual differences of blood vessels such as the position, shape, and branching structures. Consequently, a computer-assisted laparoscopy that displays blood vessel structures with anatomical labels would be extremely beneficial. This paper details an automated anatomical labeling method for abdominal arteries and veins extracted from 3D CT volumes.

METHODS

The proposed method represents a blood vessel tree as a probabilistic graphical model by conditional random fields (CRFs). An adaptive gradient algorithm is adopted for structure learning. The anatomical labeling of blood vessel branches is performed by maximum a posteriori estimation.

RESULTS

We applied the proposed method to 50 cases of arterial and portal phase abdominal X-ray CT volumes. The experimental results showed that the F-measure of the proposed method for abdominal arteries and veins was 94.4 and 86.9%, respectively.

CONCLUSION

We developed an automated anatomical labeling method to annotate each blood vessel branches of abdominal arteries and veins using CRF. The proposed method outperformed a state-of-the-art method.

From macro-scale to micro-scale computational anatomy: a perspective on the next 20 years

This paper gives our perspective on the next two decades of computational anatomy, which has made great strides in the recognition and understanding of human anatomy from conventional clinical images. The results from this field are now used in a variety of medical applications, including quantitative analysis of organ shapes, interventional assistance, surgical navigation, and population analysis. Several anatomical models have also been used in computational anatomy, and these mainly target millimeter-scale shapes. For example, liver-shape models are almost completely modeled at the millimeter scale, and shape variations are described at such scales. Most clinical 3D scanning devices have had just under 1 or 0.5 mm per voxel resolution for over 25 years, and this resolution has not changed drastically in that time. Although Z-axis (head-to-tail direction) resolution has been drastically improved by the introduction of multi-detector CT scanning devices, in-plane resolutions have not changed very much either. When we look at human anatomy, we can see different anatomical structures at different scales. For example, pulmonary blood vessels and lung lobes can be observed in millimeter-scale images. If we take 10-µm-scale images of a lung specimen, the alveoli and bronchiole regions can be located in them. Most work in millimeter-scale computational anatomy has been done by the medical-image analysis community. In the next two decades, we encourage our community to focus on micro-scale computational anatomy. In this perspective paper, we briefly review the achievements of computational anatomy and its impacts on clinical applications; furthermore, we show several possibilities from the viewpoint of microscopic computational anatomy by discussing experimental results from our recent research activities.

Progress in Fully Automated Abdominal CT Interpretation

OBJECTIVE

Automated analysis of abdominal CT has advanced markedly over just the last few years. Fully automated assessment of organs, lymph nodes, adipose tissue, muscle, bowel, spine, and tumors are some examples where tremendous progress has been made. Computer-aided detection of lesions has also improved dramatically.

CONCLUSION

This article reviews the progress and provides insights into what is in store in the near future for automated analysis for abdominal CT, ultimately leading to fully automated interpretation.