Machine learning-based operation skills assessment with vascular difficulty index for vascular intervention surgery

Predicting future occlusion or stenosis of lower extremity bypass grafts using artificial intelligence to simultaneously analyze all flow velocities collected in current and previous ultrasound examinations

Objective

Routine surveillance with duplex ultrasound (DUS) examination is recommended after femoral-popliteal and femoral-tibial-pedal vein bypass grafts with various intervals postoperatively. The presently used methodology to analyze bypass graft DUS examination does not use all the available data and has been shown to have a significant rate for missing impending bypass graft failure. The objective of this research is to investigate recurrent neural networks (RNNs) to predict future bypass graft occlusion or stenosis.

Methods

This study includes DUS examinations of 663 patients who had bypass graft operations done between January 2009 and June 2022. Only examinations without missing values were included. We developed two RNNs (a bidirectional long short-term memory unit and a bidirectional gated recurrent unit) to predict bypass graft occlusion and stenosis based on peak systolic velocities collected in the 2 to 5 previous DUS examinations. We excluded the examinations with missing values and split our data into training and test sets. Then, we applied 10-fold cross-validation on training to optimize the hyperparameters and compared models using the test data.

Results

The bidirectional long short-term memory unit model can gain an overall sensitivity of 0.939, specificity of 0.963, and area under the curve of 0.950 on the prediction of bypass graft occlusion, and an overall sensitivity of 0.915, specificity of 0.909, and area under the curve of 0.912 predicting the development of a future critical stenosis. The results on different bypass types show that the system performs differently on different types. The results on subcohorts based on gender, smoking status, and comorbidities show that the performance on current smokers is lower than the never smoker.

Conclusions

We found that RNNs can gain good sensitivity, specificity, and accuracy for the detection of impending bypass graft occlusion or the future development of a critical bypass graft stenosis using all the available peak systolic velocity data in the present and previous bypass graft DUS examinations. Integrating clinical data, including demographics, social determinants, medication, and other risk factors, together with the DUS examination may result in further improvements.

Clinical Relevance

Detecting bypass graft failure before it occurs is important clinically to prevent amputations, salvage limbs, and save lives. Current methods evaluating screening duplex ultrasound examinations have a significant failure rate for detecting a bypass graft at risk for failure. Artificial intelligence using recurrent neural networks has the potential to improve the detection of at-risk bypass graft before they fail. Additionally, artificial intelligence is in the news and is being applied to many fields. Vascular surgeons need to know its potential to improve vascular outcomes.

Enhancing percutaneous coronary intervention with heuristic path planning and deep-learning-based vascular segmentation

Percutaneous coronary intervention (PCI) is a minimally invasive technique for treating vascular diseases. PCI requires precise and real-time visualization and guidance to ensure surgical safety and efficiency. Existing mainstream guiding methods rely on hemodynamic parameters. However, these methods are less intuitive than images and pose some challenges to the decision-making of cardiologists. This paper proposes a novel PCI guiding assistance system by combining a novel vascular segmentation network and a heuristic intervention path planning algorithm, providing cardiologists with clear and visualized information. A dataset of 1077 DSA images from 288 patients is also collected in clinical practice. A Likert Scale is also designed to evaluate system performance in user experiments. Results of user experiments demonstrate that the system can generate satisfactory and reasonable paths for PCI. Our proposed method outperformed the state-of-the-art baselines based on three metrics (Jaccard: 0.4091, F1: 0.5626, Accuracy: 0.9583). The proposed system can effectively assist cardiologists in PCI by providing a clear segmentation of vascular structures and optimal real-time intervention paths, thus demonstrating great potential for robotic PCI autonomy.

Toward Autonomous Pulmonary Artery Catheterization: A Learning-based Robotic Navigation System

Providing imaging during interventional treatments of cardiovascular diseases is challenging. Magnetic Resonance Imaging (MRI) has gained popularity as it is radiation-free and returns high resolution of soft tissue. However, the clinician has limited access to the patient, e.g., to their femoral artery, within the MRI scanner to accurately guide and manipulate an MR-compatible catheter. At the same time, communication will need to be maintained with a clinician, located in a separate control room, to provide the most appropriate image to the screen inside the MRI room. Hence, there is scope to explore the feasibility of how autonomous catheterization robots could support the steering of catheters along trajectories inside complex vessel anatomies.In this paper, we present a Learning from Demonstration based Gaussian Mixture Model for a robot trajectory optimisation during pulmonary artery catheterization. The optimisation algorithm is integrated into a 2 Degree-of-Freedom MR-compatible interventional robot allowing for continuous and simultaneous translation and rotation. Our methodology achieves autonomous navigation of the catheter tip from the inferior vena cava, through the right atrium and the right ventricle into the pulmonary artery where an interventions is performed. Our results show that our MR-compatible robot can follow an advancement trajectory generated by our Learning from Demonstration algorithm. Looking at the overall duration of the intervention, it can be concluded that procedures performed by the robot (teleoperated or autonomously) required significantly less time compared to manual hand-held procedures.

An Image Information-Based Objective Assessment Method of Technical Manipulation Skills for Intravascular Interventions

The clinical success of vascular interventional surgery relies heavily on a surgeon's catheter/guidewire manipulation skills and strategies. An objective and accurate assessment method plays a critical role in evaluating the surgeon's technical manipulation skill level. Most of the existing evaluation methods incorporate the use of information technology to find more objective assessment models based on various metrics. However, in these models, sensors are often attached to the surgeon's hands or to interventional devices for data collection, which constrains the surgeon's operational movements or exerts an influence on the motion trajectory of interventional devices. In this paper, an image information-based assessment method is proposed for the evaluation of the surgeon's manipulation skills without the requirement of attaching sensors to the surgeon or catheters/guidewires. Surgeons are allowed to use their natural bedside manipulation skills during the data collection process. Their manipulation features during different catheterization tasks are derived from the motion analysis of the catheter/guidewire in video sequences. Notably, data relating to the number of speed peaks, slope variations, and the number of collisions are included in the assessment. Furthermore, the contact forces, resulting from interactions between the catheter/guidewire and the vascular model, are sensed by a 6-DoF F/T sensor. A support vector machine (SVM) classification framework is developed to discriminate the surgeon's catheterization skill levels. The experimental results demonstrate that the proposed SVM-based assessment method can obtain an accuracy of 97.02% to distinguish between the expert and novice manipulations, which is higher than that of other existing research achievements. The proposed method has great potential to facilitate skill assessment and training of novice surgeons in vascular interventional surgery.

Modelling the relationships between the barriers to implementing machine learning for accident analysis: the Indian petroleum industry

Purpose

This paper aims to identify, prioritise and explore the relationships between the various barriers that are hindering the machine learning (ML) adaptation for analysing accident data information in the Indian petroleum industry.

Design/methodology/approach

The preferred reporting items for systematic reviews and meta-analysis (PRISMA) is initially used to identify key barriers as reported in extant literature. The decision-making trial and evaluation laboratory (DEMATEL) technique is then used to discover the interrelationships between the barriers, which are then prioritised, based on three criteria (time, cost and relative importance) using complex proportional assessment (COPRAS) and multi-objective optimisation method by ratio analysis (MOORA). The Delphi method is used to obtain and analyse data from 10 petroleum experts who work at various petroleum facilities in India.

Findings

The findings provide practical insights for management and accident data analysts to use ML techniques when analysing large amounts of data. The analysis of barriers will help organisations focus resources on the most significant obstacles to overcome barriers to adopt ML as the primary tool for accident data analysis, which can save time, money and enable the exploration of valuable insights from the data.

Originality/value

This is the first study to use a hybrid three-phase methodology and consult with domain experts in the petroleum industry to rank and analyse the relationship between these barriers.

Kinetics Analysis and ADRC-Based Controller for a String-Driven Vascular Intervention Surgical Robotic System

Vascular interventional surgery is a typical method for diagnosing and treating cardio-cerebrovascular diseases. However, a surgeon is exposed to significant X-radiation exposure when the operation is conducted for a long period of time. A vascular intervention surgical robotic system for assisting the surgeon is a promising approach to address the aforementioned issue. When developing the robotic system, a high displacement accuracy is crucial, and this can aid in enhancing operating efficiency and safety. In this study, a novel kinetics analysis and active disturbance rejection control (ADRC)-based controller is proposed to provide high accuracy for a string-driven robotic system. In this controller, kinetics analysis is initially used to improve the accuracy affected by the inner factors of the slave manipulator. Then, the ADRC controller is used to further improve the operating accuracy of the robotic system. Finally, the proposed controller is evaluated by conducting experiments on a vascular model. The results indicate maximum steady errors of 0.45 mm and 6.67°. The experimental results demonstrate that the proposed controller can satisfy the safety requirements of the string-driven robotic system.

Artificial Intelligence and Surgical Education: A Systematic Scoping Review of Interventions

OBJECTIVE

To synthesize peer-reviewed evidence related to the use of artificial intelligence (AI) in surgical education DESIGN: We conducted and reported a scoping review according to the standards outlined in the Preferred Reporting Items for Systematic Reviews and Meta-Analysis with extension for Scoping Reviews guideline and the fourth edition of the Joanna Briggs Institute Reviewer's Manual. We systematically searched eight interdisciplinary databases including MEDLINE-Ovid, ERIC, EMBASE, CINAHL, Web of Science: Core Collection, Compendex, Scopus, and IEEE Xplore. Databases were searched from inception until the date of search on April 13, 2021.

SETTING/PARTICIPANTS

We only examined original, peer-reviewed interventional studies that self-described as AI interventions, focused on medical education, and were relevant to surgical trainees (defined as medical or dental students, postgraduate residents, or surgical fellows) within the title and abstract (see Table 2). Animal, cadaveric, and in vivo studies were not eligible for inclusion.

RESULTS

After systematically searching eight databases and 4255 citations, our scoping review identified 49 studies relevant to artificial intelligence in surgical education. We found diverse interventions related to the evaluation of surgical competency, personalization of surgical education, and improvement of surgical education materials across surgical specialties. Many studies used existing surgical education materials, such as the Objective Structured Assessment of Technical Skills framework or the JHU-ISI Gesture and Skill Assessment Working Set database. Though most studies did not provide outcomes related to the implementation in medical schools (such as cost-effective analyses or trainee feedback), there are numerous promising interventions. In particular, many studies noted high accuracy in the objective characterization of surgical skill sets. These interventions could be further used to identify at-risk surgical trainees or evaluate teaching methods.

CONCLUSIONS

There are promising applications for AI in surgical education, particularly for the assessment of surgical competencies, though further evidence is needed regarding implementation and applicability.

ADRC-Based Control Method for the Vascular Intervention Master-Slave Surgical Robotic System

In vascular interventional surgery, surgeons operate guidewires and catheters to diagnose and treat patients with the assistance of the digital subtraction angiography (DSA). Therefore, the surgeon will be exposed to X-rays for extended periods. To protect the surgeon, the development of a robot-assisted surgical system is of great significance. The displacement tracking accuracy is the most important issue to be considered in the development of the system. In this study, the active disturbance rejection control (ADRC) method is applied to guarantee displacement tracking accuracy. First, the core contents of the proportional–integral–derivative (PID) and ADRC methods are analyzed. Second, comparative evaluation experiments for incremental PID and ADRC methods are presented. The results show that the ADRC method has better performance of than that of the incremental PID method. Finally, the calibration experiments for the ADRC control method are implemented using the master–slave robotic system. These experiments demonstrate that the maximum tracking error is 0.87 mm using the ADRC method, effectively guaranteeing surgical safety.