A Deep Learning Pipeline to Automate High-Resolution Arterial Segmentation With or Without Intravenous Contrast

An artificial intelligence-based nerve recognition model is useful as surgical support technology and as an educational tool in laparoscopic and robot-assisted rectal cancer surgery

BACKGROUND

Artificial intelligence (AI) has the potential to enhance surgical practice by predicting anatomical structures within the surgical field, thereby supporting surgeons' experiences and cognitive skills. Preserving and utilising nerves as critical guiding structures is paramount in rectal cancer surgery. Hence, we developed a deep learning model based on U-Net to automatically segment nerves.

METHODS

The model performance was evaluated using 60 randomly selected frames, and the Dice and Intersection over Union (IoU) scores were quantitatively assessed by comparing them with ground truth data. Additionally, a questionnaire was administered to five colorectal surgeons to gauge the extent of underdetection, overdetection, and the practical utility of the model in rectal cancer surgery. Furthermore, we conducted an educational assessment of non-colorectal surgeons, trainees, physicians, and medical students. We evaluated their ability to recognise nerves in mesorectal dissection scenes, scored them on a 12-point scale, and examined the score changes before and after exposure to the AI analysis videos.

RESULTS

The mean Dice and IoU scores for the 60 test frames were 0.442 (range 0.0465-0.639) and 0.292 (range 0.0238-0.469), respectively. The colorectal surgeons revealed an under-detection score of 0.80 (± 0.47), an over-detection score of 0.58 (± 0.41), and a usefulness evaluation score of 3.38 (± 0.43). The nerve recognition scores of non-colorectal surgeons, rotating residents, and medical students significantly improved by simply watching the AI nerve recognition videos for 1 min. Notably, medical students showed a more substantial increase in nerve recognition scores when exposed to AI nerve analysis videos than when exposed to traditional lectures on nerves.

CONCLUSIONS

In laparoscopic and robot-assisted rectal cancer surgeries, the AI-based nerve recognition model achieved satisfactory recognition levels for expert surgeons and demonstrated effectiveness in educating junior surgeons and medical students on nerve recognition.

Current Applications and Future Perspectives of Artificial and Biomimetic Intelligence in Vascular Surgery and Peripheral Artery Disease

Artificial Intelligence (AI) made its first appearance in 1956, and since then it has progressively introduced itself in healthcare systems and patients' information and care. AI functions can be grouped under the following headings: Machine Learning (ML), Deep Learning (DL), Artificial Neural Network (ANN), Convolutional Neural Network (CNN), Computer Vision (CV). Biomimetic intelligence (BI) applies the principles of systems of nature to create biological algorithms, such as genetic and neural network, to be used in different scenarios. Chronic limb-threatening ischemia (CLTI) represents the last stage of peripheral artery disease (PAD) and has increased over recent years, together with the rise in prevalence of diabetes and population ageing. Nowadays, AI and BI grant the possibility of developing new diagnostic and treatment solutions in the vascular field, given the possibility of accessing clinical, biological, and imaging data. By assessing the vascular anatomy in every patient, as well as the burden of atherosclerosis, and classifying the level and degree of disease, sizing and planning the best endovascular treatment, defining the perioperative complications risk, integrating experiences and resources between different specialties, identifying latent PAD, thus offering evidence-based solutions and guiding surgeons in the choice of the best surgical technique, AI and BI challenge the role of the physician's experience in PAD treatment.

Automatic segmentation of thrombosed aortic dissection in post-operative CT-angiography images

PURPOSE

The thrombus in the false lumen (FL) of aortic dissection (AD) patients is a meaningful indicator to determine aortic remodeling but difficult to measure in clinic. In this study, a novel segmentation strategy based on deep learning was proposed to automatically extract the thrombus in the FL in post-operative computed tomography angiography (CTA) images of AD patients, which provided an efficient and convenient segmentation method with high accuracy.

METHODS

A two-step segmentation strategy was proposed. Each step contained a convolutional neural network (CNN) to segment the aorta and the thrombus, respectively. In the first step, a CNN was used to obtain the binary segmentation mask of the whole aorta. In the second step, another CNN was introduced to segment the thrombus. The results of the first step were used as additional input to the second step to highlight the aorta in the complex background. Moreover, skip connection attention refinement (SAR) modules were designed and added in the second step to improve the segmentation accuracy of the thrombus details by efficiently using the low-level features.

RESULTS

The proposed method provided accurate thrombus segmentation results (0.903 ± 0.062 in dice score, 0.828 ± 0.092 in Jaccard index, and 2.209 ± 2.945 in 95% Hausdorff distance), which showed improvement compared to the methods without prior information (0.846 ± 0.085 in dice score) and the method without SAR (0.899 ± 0.060 in dice score). Moreover, the proposed method achieved 0.967 ± 0.029 and 0.948 ± 0.041 in dice score of true lumen (TL) and patent FL (PFL) segmentation, respectively, indicating the excellence of the proposed method in the segmentation task of the overall aorta.

CONCLUSIONS

A novel CNN-based segmentation framework was proposed to automatically obtain thrombus segmentation for thrombosed AD in post-operative CTA images, which provided a useful tool for further application of thrombus-related indicators in clinical and research application.

Automated segmentation by deep learning of loose connective tissue fibers to define safe dissection planes in robot-assisted gastrectomy

The prediction of anatomical structures within the surgical field by artificial intelligence (AI) is expected to support surgeons’ experience and cognitive skills. We aimed to develop a deep-learning model to automatically segment loose connective tissue fibers (LCTFs) that define a safe dissection plane. The annotation was performed on video frames capturing a robot-assisted gastrectomy performed by trained surgeons. A deep-learning model based on U-net was developed to output segmentation results. Twenty randomly sampled frames were provided to evaluate model performance by comparing Recall and F1/Dice scores with a ground truth and with a two-item questionnaire on sensitivity and misrecognition that was completed by 20 surgeons. The model produced high Recall scores (mean 0.606, maximum 0.861). Mean F1/Dice scores reached 0.549 (range 0.335–0.691), showing acceptable spatial overlap of the objects. Surgeon evaluators gave a mean sensitivity score of 3.52 (with 88.0% assigning the highest score of 4; range 2.45–3.95). The mean misrecognition score was a low 0.14 (range 0–0.7), indicating very few acknowledged over-detection failures. Thus, AI can be trained to predict fine, difficult-to-discern anatomical structures at a level convincing to expert surgeons. This technology may help reduce adverse events by determining safe dissection planes.

A review of medical image data augmentation techniques for deep learning applications

Research in artificial intelligence for radiology and radiotherapy has recently become increasingly reliant on the use of deep learning-based algorithms. While the performance of the models which these algorithms produce can significantly outperform more traditional machine learning methods, they do rely on larger datasets being available for training. To address this issue, data augmentation has become a popular method for increasing the size of a training dataset, particularly in fields where large datasets aren't typically available, which is often the case when working with medical images. Data augmentation aims to generate additional data which is used to train the model and has been shown to improve performance when validated on a separate unseen dataset. This approach has become commonplace so to help understand the types of data augmentation techniques used in state-of-the-art deep learning models, we conducted a systematic review of the literature where data augmentation was utilised on medical images (limited to CT and MRI) to train a deep learning model. Articles were categorised into basic, deformable, deep learning or other data augmentation techniques. As artificial intelligence models trained using augmented data make their way into the clinic, this review aims to give an insight to these techniques and confidence in the validity of the models produced.

Leveraging Machine Learning and Artificial Intelligence to Improve Peripheral Artery Disease Detection, Treatment, and Outcomes

Peripheral artery disease is an atherosclerotic disorder which, when present, portends poor patient outcomes. Low diagnosis rates perpetuate poor management, leading to limb loss and excess rates of cardiovascular morbidity and death. Machine learning algorithms and artificially intelligent systems have shown great promise in application to many areas in health care, such as accurately detecting disease, predicting patient outcomes, and automating image interpretation. Although the application of these technologies to peripheral artery disease are in their infancy, their promises are tremendous. In this review, we provide an introduction to important concepts in the fields of machine learning and artificial intelligence, detail the current state of how these technologies have been applied to peripheral artery disease, and discuss potential areas for future care enhancement with advanced analytics.

Imaging Biological Pathways in Abdominal Aortic Aneurysms Using Positron Emission Tomography

[Figure: see text].