Video display during laparoscopy - where should it be placed?

The value of Augmented Reality in surgery - A usability study on laparoscopic liver surgery

Augmented Reality (AR) is considered to be a promising technology for the guidance of laparoscopic liver surgery. By overlaying pre-operative 3D information of the liver and internal blood vessels on the laparoscopic view, surgeons can better understand the location of critical structures. In an effort to enable AR, several authors have focused on the development of methods to obtain an accurate alignment between the laparoscopic video image and the pre-operative 3D data of the liver, without assessing the benefit that the resulting overlay can provide during surgery. In this paper, we present a study that aims to assess quantitatively and qualitatively the value of an AR overlay in laparoscopic surgery during a simulated surgical task on a phantom setup. We design a study where participants are asked to physically localise pre-operative tumours in a liver phantom using three image guidance conditions - a baseline condition without any image guidance, a condition where the 3D surfaces of the liver are aligned to the video and displayed on a black background, and a condition where video see-through AR is displayed on the laparoscopic video. Using data collected from a cohort of 24 participants which include 12 surgeons, we observe that compared to the baseline, AR decreases the median localisation error of surgeons on non-peripheral targets from 25.8 mm to 9.2 mm. Using subjective feedback, we also identify that AR introduces usability improvements in the surgical task and increases the perceived confidence of the users. Between the two tested displays, the majority of participants preferred to use the AR overlay instead of navigated view of the 3D surfaces on a separate screen. We conclude that AR has the potential to improve performance and decision making in laparoscopic surgery, and that improvements in overlay alignment accuracy and depth perception should be pursued in the future.

Laparoscopy with augmented reality adaptations

One of the most promising applications of Optical See-Through Augmented Reality is minimally laparoscopic surgery, which currently suffers from problems such as surgeon discomfort and fatigue caused by looking at a display positioned outside the surgeon's visual field, made worse by the length of the procedure. This fatigue is especially felt on the surgeon's neck, as it is strained from adopting unnatural postures in order to visualise the laparoscopic video feed. Throughout this paper, we will present work in Augmented Reality, as well as developments in surgery and Augmented Reality applied to both surgery in general and laparoscopy in particular to address these issues. We applied user and task analysis methods to learn about practices performed in the operating room by observing surgeons in their working environment in order to understand, in detail, how they performed their tasks and achieved their intended goals. Drawing on observations and analysis of video recordings of laparoscopic surgeries, we identified relevant constraints and design requirements. Besides proposals to approach the ergonomic issues, we present a design and implementation of a multimodal interface to enhance the laparoscopic procedure. Our method makes it more comfortable for surgeons by allowing them to keep the laparoscopic video in their viewing area regardless of neck posture. Also, our interface makes it possible to access patient imaging data without interrupting the operation. It also makes it possible to communicate with team members through a pointing reticle. We evaluated how surgeons perceived the implemented prototype, in terms of usefulness and usability, via a think-aloud protocol to conduct qualitative evaluation sessions which we describe in detail in this paper. In addition to checking the advantages of the prototype as compared to traditional laparoscopic settings, we also conducted a System Usability Scale questionnaire for measuring its usability, and a NASA Task Load Index questionnaire to rate perceived workload and to assess the prototype effectiveness. Our results show that surgeons consider that our prototype can improve surgeon-to-surgeon communication using head pose as a means of pointing. Also, surgeons believe that our approach can afford a more comfortable posture throughout the surgery and enhance hand-eye coordination, as physicians no longer need to twist their necks to look at screens placed outside the field of operation.

Muscular workload of veterinary students during simulated open and laparoscopic surgery: A pilot study

OBJECTIVE

To compare upper extremity muscle activity and workload between simulated open surgery, multiple port laparoscopic surgery (MLS), and single incision laparoscopic surgery (SLS) techniques in veterinary students.

STUDY DESIGN

Pilot study.

POPULATION

Veterinary students (n = 10) from years 1 to 4.

METHODS

Bipolar skin surface electrodes were fixed bilaterally to the forearm flexor, forearm extensor, biceps brachii, triceps brachii, and upper trapezius muscles. Electromyography data were recorded during one repetition of 2 simulated surgical exercises via open surgery, MLS, and SLS. Participants completed a validated workload survey after each simulated surgical technique. Muscle activity and perceived workload were compared between surgical techniques with 1-way ANOVAs and Fisher's LSD post hoc tests.

RESULTS

Muscle activity during peg transfer was higher with MLS and SLS compared to simulated open surgery in the right and left forearm extensors (both P < .0001), right (P < .0001) and left biceps (P = .0005), right triceps (P = .0004), and right upper trapezius muscles (P = .0211). Similar results were found for the right and left forearm extensors (both P < .0001), right (P = .0381) and left (P = .0147) forearm flexors, right biceps (P < .0001), and right triceps (P = .0004) during a simulated suture task. Participants found laparoscopic techniques more mentally demanding, physically demanding, complex, and stressful compared to a simulated open surgical technique.

CONCLUSION

In veterinary students, average muscle activity and perceived workload were highest using MLS and SLS compared to an open surgical technique when performing simulated surgical exercises in a laparoscopic box trainer.