iPad Annotation of 3D Surgical Models Using Procreate®: Novel Documentation of Supplemental Margins

We present a novel, efficient approach to demonstrating supplemental margins during oncologic resection. Surgeons and pathologists annotated 10 virtual models of surgical defects and resection specimens in 3D using an iPad-based application, Procreate®. Incorporating this method into the surgical workflow can improve interdepartmental communication and provide visual documentation of surgical steps taken to address at-risk margins. Laryngoscope, 134:2783-2786, 2024.

Using virtual reality for anatomical landmark annotation in geometric morphometrics

To study the shape of objects using geometric morphometrics, landmarks are oftentimes collected digitally from a 3D scanned model. The expert may annotate landmarks using software that visualizes the 3D model on a flat screen, and interaction is achieved with a mouse and a keyboard. However, landmark annotation of a 3D model on a 2D display is a tedious process and potentially introduces error due to the perception and interaction limitations of the flat interface. In addition, digital landmark placement can be more time-consuming than direct annotation on the physical object using a tactile digitizer arm. Since virtual reality (VR) is designed to more closely resemble the real world, we present a VR prototype for annotating landmarks on 3D models. We study the impact of VR on annotation performance by comparing our VR prototype to Stratovan Checkpoint, a commonly used commercial desktop software. We use an experimental setup, where four operators placed six landmarks on six grey seal (Halichoerus grypus) skulls in six trials for both systems. This enables us to investigate multiple sources of measurement error. We analyse both for the configuration and for single landmarks. Our analysis shows that annotation in VR is a promising alternative to desktop annotation. We find that annotation precision is comparable between the two systems, with VR being significantly more precise for one of the landmarks. We do not find evidence that annotation in VR is faster than on the desktop, but it is accurate.