First-In-Human Use of a Mixed Reality Display During Cardiac Ablation Procedures

The potential of artificial intelligence to revolutionize health care delivery, research, and education in cardiac electrophysiology

The field of electrophysiology (EP) has benefited from numerous seminal innovations and discoveries that have enabled clinicians to deliver therapies and interventions that save lives and promote quality of life. The rapid pace of innovation in EP may be hindered by several challenges including the aging population with increasing morbidity, the availability of multiple costly therapies that, in many instances, confer minor incremental benefit, the limitations of healthcare reimbursement, the lack of response to therapies by some patients, and the complications of the invasive procedures performed. To overcome these challenges and continue on a steadfast path of transformative innovation, the EP community must comprehensively explore how artificial intelligence (AI) can be applied to healthcare delivery, research, and education and consider all opportunities in which AI can catalyze innovation; create workflow, research, and education efficiencies; and improve patient outcomes at a lower cost. In this white paper, we define AI and discuss the potential of AI to revolutionize the EP field. We also address the requirements for implementing, maintaining, and enhancing quality when using AI and consider ethical, operational, and regulatory aspects of AI implementation. This manuscript will be followed by several perspective papers that will expand on some of these topics.

Merging virtual and physical experiences: extended realities in cardiovascular medicine

Technological advancement and the COVID-19 pandemic have brought virtual learning and working into our daily lives. Extended realities (XR), an umbrella term for all the immersive technologies that merge virtual and physical experiences, will undoubtedly be an indispensable part of future clinical practice. The intuitive and three-dimensional nature of XR has great potential to benefit healthcare providers and empower patients and physicians. In the past decade, the implementation of XR into cardiovascular medicine has flourished such that it is now integrated into medical training, patient education, pre-procedural planning, intra-procedural visualization, and post-procedural care. This review article discussed how XR could provide innovative care and complement traditional practice, as well as addressing its limitations and considering its future perspectives.

Use of a mixed reality system for navigational mapping during cardiac electrophysiological testing does not prolong case duration: A subanalysis from the Cardiac Augmented REality study

Background

CommandEP™ is a mixed reality (MXR) system for cardiac electrophysiological (EP) procedures that provides a real-time 3-dimensional digital image of cardiac geometry and catheter locations. In a previous study, physicians using the system demonstrated improved navigational accuracy. This study investigated the impact of the CommandEP system on EP procedural times compared to the standard-of-care electroanatomic mapping system (EAMS) display.

Objective

The purpose of this retrospective case-controlled analysis was to evaluate the impact of a novel MXR interface on EP procedural times compared to a case-matched cohort.

Methods

Cases from the Cardiac Augmented REality (CARE) study were matched for diagnosis and weight using a contemporary cohort. Procedural time was compared from the roll-in and full implementation cohort. During routine EP procedures, operators performed tasks during the postablation waiting phase, including creation of cardiac geometry and 5-point navigation under 2 conditions: (1) EAMS first; and (2) CommandEP.

Results

From a total of 16 CARE study patients, the 10 full implementation patients were matched to a cohort of 20 control patients (2 controls:1 CARE, matched according to pathology and age/weight). No statistical difference in total case times between CARE study patients vs control group (118 ± 29 minutes vs 97 ± 20 minutes; P = .07) or fluoroscopy times (6 ± 4 minutes vs 7 ± 6 minutes; P = .9). No significant difference in case duration for CARE study patients comparing roll-in vs full-implementation cohort (121 ± 26 minutes vs 118 ± 29 minutes; P = .96). CommandEP wear time during cases was significantly longer in full implementation cases (53 ± 24 minutes vs 24 ± 5 minutes; P = .0009). During creation of a single cardiac geometry, no significant time difference was noted between CommandEP vs EAMS (284 ± 45 seconds vs 268 ± 43 seconds; P = .1) or fluoroscopy use (9 ± 19 seconds vs 6 ± 18 seconds; P = .25). During point navigation tasks, there was no difference in total time (CommandEP 31 ± 14 seconds vs EAMS 28 ± 15 seconds; P = .16) or fluoroscopy time (CommandEP 0 second vs EAMS 0 second).

Conclusion

MXR did not prolong overall procedural time compared to a matched cohort. There was no prolongation in study task completion time. Future studies with experienced CommandEP users directly assessing procedural time and task completion time in a randomized study population would be of interest.

Extended reality for biomedicine

Extended reality (XR) refers to an umbrella of methods that allows users to be immersed in a three-dimensional (3D) or a 4D (spatial + temporal) virtual environment to different extents, including virtual reality (VR), augmented reality (AR), and mixed reality (MR). While VR allows a user to be fully immersed in a virtual environment, AR and MR overlay virtual objects over the real physical world. The immersion and interaction of XR provide unparalleled opportunities to extend our world beyond conventional lifestyles. While XR has extensive applications in fields such as entertainment and education, its numerous applications in biomedicine create transformative opportunities in both fundamental research and healthcare. This Primer outlines XR technology from instrumentation to software computation methods, delineating the biomedical applications that have been advanced by state-of-the-art techniques. We further describe the technical advances overcoming current limitations in XR and its applications, providing an entry point for professionals and trainees to thrive in this emerging field.

The Expanding Uses of Medical Extended Reality in the Cardiac Catheterization Laboratory: Pre-procedural Planning, Intraprocedural Guidance, and Intraprocedural Navigation

The use of innovative imaging practices in the field of interventional cardiology and electrophysiology has led to significant progress in both diagnostic and therapeutic capabilities. 3D reconstructions of 2D images allows a proceduralist to develop a superior understanding of patient anatomy. Medical extended reality (MXR) technologies employ 3D interactive images for the user to improve depth perception and spatial awareness. Although MXR procedural navigation is a relatively new concept, the potential for use within interventional cardiology and EP is significant with the eventual goal of improving patient outcomes and reducing patient harm. This review article will discuss the current landscape of MXR use in the catheterization lab including pre-procedural planning, intraprocedural planning and intraprocedural guidance in diagnostic cardiac catheterization, valvar and coronary interventions, electrophysiology studies, and device implants.

A systematic review of the use of 3D printing in left atrial appendage occlusion procedures

The placement of a left atrial appendage occlusion (LAAO) device can be a technically challenging transcatheter-based procedure. Key challenges include accurate pre-procedural device sizing and proper device positioning at the LAA ostium to ensure sufficient device anchoring and avoid peri-device leaks. To address these challenges, 3D printing (3DP) of LAA models has recently emerged in the literature, first being described in 2015. We present a review of the benefits and drawbacks of employing this technology for LAAO procedures. Pre-procedurally the use of 3DP can consistently and accurately determine LAAO device size over standard of care approaches. Intra-procedurally 3DP's impact entailed a statistically significant decrease in the number of devices used per procedure, as well as in the fluoroscopic time and dose. Post-procedurally, there is some evidence that 3DP could reduce the rate of peri-device leaks, with limited data on its effect on complication rates. Based on existing evidence, we recommend the focused application of 3DP to cases of complex LAA anatomy and for the training of proceduralists. Lastly, we address the emergence of next generation LAAO devices and AR/VR systems that could limit even this narrow window of clinical benefit afforded by 3DP. This article is protected by copyright. All rights reserved.

Early preclinical experience of a mixed reality ultrasound system with active GUIDance for NEedle-based interventions: The GUIDE study

Background

Use of ultrasound (US) to facilitate vascular access has increased compared to landmark-based procedures despite ergonomic challenges and need for extrapolation of 2-dimensional images to understand needle position. The MantUS™ system (Sentiar, Inc.,) uses a mixed reality (MxR) interface to display US images and integrate real-time needle tracking.

Objective

The purpose of this prospective preclinical study was to evaluate the feasibility and usability of MantUS in a simulated environment.

Methods

Participants were recruited from pediatric cardiology and critical care. Access was obtained in 2 vascular access training models: a femoral access model and a head and neck model for a total of 4 vascular access sites under 2 conditions—conventional US and MantUS. Participants were randomized for order of completion. Videos were obtained, and quality of access including time required, repositions, number of attempts, and angle of approach were quantified.

Results

Use of MantUS resulted in an overall reduction in number of needle repositions (P = .03) and improvement in quality of access as measured by distance (P <.0001) and angle of elevation (P = .006). These findings were even more evident in the right femoral vein (RFV) access site, which was a simulated anatomic variant with a deeper more oblique vascular course. Use of MantUS resulted in faster time to access (P = .04), fewer number of both access attempts (P = .02), and number of needle repositions (P <.0001) compared to conventional US. Postparticipant survey showed high levels of usability (87%) and a belief that MantUS may decrease adverse outcomes (73%) and failed access attempts (83%).

Conclusion

Use of MantUS improved vascular access among all comers, including the quality of access. This improvement was even more notable in the vascular variant (RFV). MantUS readily benefited users by providing improved spatial understanding. Further development of MantUS will focus on improving user interface and experience, with larger clinical usage and in-human studies.

Incorporation of the CardioMEMS™ System During an Exercise Physiology Test in a Pediatric Congenital Heart Disease Patient Contributing to Medical Decision-Making

Exercise testing among the pediatric congenital heart disease population continues to transform and expand the way patients are evaluated and managed. We describe a case where a stress echocardiogram was performed while successfully collecting data from a previously implanted CardioMEMS™ HF system which helped guide decision-making.

Design Considerations for Interacting and Navigating with 2 Dimensional and 3 Dimensional Medical Images in Virtual, Augmented and Mixed Reality Medical Applications

The extended realities, including virtual, augmented, and mixed realities (VAMR) have recently experienced significant hardware improvement resulting in an expansion in medical applications. These applications can be classified by the target end user (for instance, classifying applications as patient-centric, physician-centric, or both) or by use case (for instance educational, diagnostic tools, therapeutic tools, or some combination). When developing medical applications in VAMR, careful consideration of both the target end user and use case must heavily influence design considerations, particularly methods and tools for interaction and navigation. Medical imaging consists of both 2-dimensional and 3-dimensional medical imaging which impacts design, interaction, and navigation. Additionally, medical applications need to comply with regulatory considerations which will also influence interaction and design considerations. In this manuscript, the authors explore these considerations using three VAMR tools being developed for cardiac electrophysiology procedures.

Impact of augmented-reality improvement in ablation catheter navigation as assessed by virtual-heart simulations of ventricular tachycardia ablation

BACKGROUND

Recently, an augmented reality (AR) solution allows the physician to place the ablation catheter at the designated lesion site more accurately during cardiac electrophysiology studies. The improvement in navigation accuracy may positively affect ventricular tachycardia (VT) ablation termination, however assessment of this in the clinic would be difficult. Novel personalized virtual heart technology enables non-invasive identification of optimal lesion targets for infarct-related VT. This study aims to evaluate the potential impact of such catheter navigation accuracy improvement in virtual VT ablations.

METHODS

2 MRI-based virtual hearts with 2 in silico induced VTs (VT 1, VT 2) were included. VTs were terminated with virtual "ground truth" endocardial ablation lesions. 106 navigation error values that were previously assessed in a clinical study evaluating the improvement of ablation catheter navigation accuracy guided with AR (53 with, 53 without) were used to displace the "ground truth" ablation targets. The corresponding ablations were simulated based on these errors and VT termination for each simulation was assessed.

RESULTS

In 54 VT 1 ablation simulations, smaller error with AR significantly resulted in more VT termination (25) compared to the error without AR (16) (P < 0.01). In 52 VT 2 ablation simulations, no significant difference was observed from error with (11) and without AR (13) (P = 0.58). The substrate characteristic may impact the effect of improved accuracy to an improved VT termination.

CONCLUSION

Virtual heart shows that the increased catheter navigation accuracy provided by AR guidance can affect the VT termination.

Registration Techniques for Clinical Applications of Three-Dimensional Augmented Reality Devices

Many clinical procedures would benefit from direct and intuitive real-time visualization of anatomy, surgical plans, or other information crucial to the procedure. Three-dimensional augmented reality (3D-AR) is an emerging technology that has the potential to assist physicians with spatial reasoning during clinical interventions. The most intriguing applications of 3D-AR involve visualizations of anatomy or surgical plans that appear directly on the patient. However, commercially available 3D-AR devices have spatial localization errors that are too large for many clinical procedures. For this reason, a variety of approaches for improving 3D-AR registration accuracy have been explored. The focus of this review is on the methods, accuracy, and clinical applications of registering 3D-AR devices with the clinical environment. The works cited represent a variety of approaches for registering holograms to patients, including manual registration, computer vision-based registration, and registrations that incorporate external tracking systems. Evaluations of user accuracy when performing clinically relevant tasks suggest that accuracies of approximately 2 mm are feasible. 3D-AR device limitations due to the vergence-accommodation conflict or other factors attributable to the headset hardware add on the order of 1.5 mm of error compared to conventional guidance. Continued improvements to 3D-AR hardware will decrease these sources of error.