Mixed Reality and 3D Printed Models for Planning and Execution of Face Transplantation

3D printing materials and 3D printed surgical devices in oral and maxillofacial surgery: design, workflow and effectiveness

Oral and maxillofacial surgery is a specialized surgical field devoted to diagnosing and managing conditions affecting the oral cavity, jaws, face and related structures. In recent years, the integration of 3D printing technology has revolutionized this field, offering a range of innovative surgical devices such as patient-specific implants, surgical guides, splints, bone models and regenerative scaffolds. In this comprehensive review, we primarily focus on examining the utility of 3D-printed surgical devices in the context of oral and maxillofacial surgery and evaluating their efficiency. Initially, we provide an insightful overview of commonly utilized 3D-printed surgical devices, discussing their innovations and clinical applications. Recognizing the pivotal role of materials, we give consideration to suitable biomaterials and printing technology of each device, while also introducing the emerging fields of regenerative scaffolds and bioprinting. Furthermore, we delve into the transformative impact of 3D-printed surgical devices within specific subdivisions of oral and maxillofacial surgery, placing particular emphasis on their rejuvenating effects in bone reconstruction, orthognathic surgery, temporomandibular joint treatment and other applications. Additionally, we elucidate how the integration of 3D printing technology has reshaped clinical workflows and influenced treatment outcomes in oral and maxillofacial surgery, providing updates on advancements in ensuring accuracy and cost-effectiveness in 3D printing-based procedures.

Beyond the visible: preliminary evaluation of the first wearable augmented reality assistance system for pancreatic surgery

PURPOSE

The retroperitoneal nature of the pancreas, marked by minimal intraoperative organ shifts and deformations, makes augmented reality (AR)-based systems highly promising for pancreatic surgery. This study presents preliminary data from a prospective study aiming to develop the first wearable AR assistance system, ARAS, for pancreatic surgery and evaluating its usability, accuracy, and effectiveness in enhancing the perioperative outcomes of patients.

METHODS

We developed ARAS as a two-phase system for a wearable AR device to aid surgeons in planning and operation. This system was used to visualize and register patient-specific 3D anatomical models during the surgery. The location and precision of the registered 3D anatomy were evaluated by assessing the arterial pulse and employing Doppler and duplex ultrasonography. The usability, accuracy, and effectiveness of ARAS were assessed using a five-point Likert scale questionnaire.

RESULTS

Perioperative outcomes of five patients underwent various pancreatic resections with ARAS are presented. Surgeons rated ARAS as excellent for preoperative planning. All structures were accurately identified without any noteworthy errors. Only tumor identification decreased after the preparation phase, especially in patients who underwent pancreaticoduodenectomy because of the extensive mobilization of peripancreatic structures. No perioperative complications related to ARAS were observed.

CONCLUSIONS

ARAS shows promise in enhancing surgical precision during pancreatic procedures. Its efficacy in preoperative planning and intraoperative vascular identification positions it as a valuable tool for pancreatic surgery and a potential educational resource for future surgical residents.

An Oncoplastic Approach to Primary Pediatric Pterygomaxillary Osteosarcoma

Osteosarcomas arising within the pterygomaxillary/infratemporal fossa region are rare among the pediatric population. Survival rates are most influenced by tumor resection with negative margins, which can be dependent on surgical accessibility of the tumor site. The pterygomaxillary/infratemporal fossa location poses several challenges to safe and adequate tumor resection, including proximity of the facial nerve and great vessels and scarring associated with traditional transfacial approaches. In this article, we present the case of a 6-year-old boy with an osteosarcoma of the left pterygomaxillary/infratemporal fossa region successfully managed with an "oncoplastic" approach, incorporating the use of CAD/CAM and mixed reality technologies.

From Augmented to Virtual Reality in Plastic Surgery: Blazing the Trail to a New Frontier

BACKGROUND

 Augmented reality (AR) and virtual reality (VR)-termed mixed reality-have shown promise in the care of operative patients. Currently, AR and VR have well-known applications for craniofacial surgery, specifically in preoperative planning. However, the application of AR/VR technology to other reconstructive challenges has not been widely adopted. Thus, the purpose of this investigation is to outline the current applications of AR and VR in the operative setting.

METHODS

 The literature pertaining to the use of AR/VR technology in the operative setting was examined. Emphasis was placed on the use of mixed reality technology in surgical subspecialities, including plastic surgery, oral and maxillofacial surgery, colorectal surgery, neurosurgery, otolaryngology, neurosurgery, and orthopaedic surgery.

RESULTS

 Presently, mixed reality is widely used in the care of patients requiring complex reconstruction of the craniomaxillofacial skeleton for pre- and intraoperative planning. For upper extremity amputees, there is evidence that VR may be efficacious in the treatment of phantom limb pain. Furthermore, VR has untapped potential as a cost-effective tool for microsurgical education and for training residents on techniques in surgical and nonsurgical aesthetic treatment. There is utility for mixed reality in breast reconstruction for preoperative planning, mapping perforators, and decreasing operative time. VR has well- documented applications in the planning of deep inferior epigastric perforator flaps by creating three-dimensional immersive simulations based on a patient's preoperative computed tomography angiogram.

CONCLUSION

 The benefits of AR and VR are numerous for both patients and surgeons. VR has been shown to increase surgical precision and decrease operative time. Furthermore, it is effective for patient-specific rehearsal which uses the patient's exact anatomical data to rehearse the procedure before performing it on the actual patient. Taken together, AR/VR technology can improve patient outcomes, decrease operative times, and lower the burden of care on both patients and health care institutions.

Augmented and Virtual Reality Applications in Facial Plastic Surgery: A Scoping Review

OBJECTIVES

Augmented reality (AR) and virtual reality (VR) are emerging technologies with wide potential applications in health care. We performed a scoping review of the current literature on the application of augmented and VR in the field of facial plastic and reconstructive surgery (FPRS).

DATA SOURCES

PubMed and Web of Science.

REVIEW METHODS

According to PRISMA guidelines, PubMed and Web of Science were used to perform a scoping review of literature regarding the utilization of AR and/or VR relevant to FPRS.

RESULTS

Fifty-eight articles spanning 1997-2023 met the criteria for review. Five overarching categories of AR and/or VR applications were identified across the articles: preoperative, intraoperative, training/education, feasibility, and technical. The following clinical areas were identified: burn, craniomaxillofacial surgery (CMF), face transplant, face lift, facial analysis, facial palsy, free flaps, head and neck surgery, injectables, locoregional flaps, mandible reconstruction, mandibuloplasty, microtia, skin cancer, oculoplastic surgery, rhinology, rhinoplasty, and trauma.

CONCLUSION

AR and VR have broad applications in FPRS. AR for surgical navigation may have the most emerging potential in CMF surgery and free flap harvest. VR is useful as distraction analgesia for patients and as an immersive training tool for surgeons. More data on these technologies' direct impact on objective clinical outcomes are still needed.

LEVEL OF EVIDENCE

N/A Laryngoscope, 134:2568-2577, 2024.

3D Printing Applications for Craniomaxillofacial Reconstruction: A Sweeping Review

The field of craniomaxillofacial (CMF) surgery is rich in pathological diversity and broad in the ages that it treats. Moreover, the CMF skeleton is a complex confluence of sensory organs and hard and soft tissue with load-bearing demands that can change within millimeters. Computer-aided design (CAD) and additive manufacturing (AM) create extraordinary opportunities to repair the infinite array of craniomaxillofacial defects that exist because of the aforementioned circumstances. 3D printed scaffolds have the potential to serve as a comparable if not superior alternative to the "gold standard" autologous graft. In vitro and in vivo studies continue to investigate the optimal 3D printed scaffold design and composition to foster bone regeneration that is suited to the unique biological and mechanical environment of each CMF defect. Furthermore, 3D printed fixation devices serve as a patient-specific alternative to those that are available off-the-shelf with an opportunity to reduce operative time and optimize fit. Similar benefits have been found to apply to 3D printed anatomical models and surgical guides for preoperative or intraoperative use. Creation and implementation of these devices requires extensive preclinical and clinical research, novel manufacturing capabilities, and strict regulatory oversight. Researchers, manufacturers, CMF surgeons, and the United States Food and Drug Administration (FDA) are working in tandem to further the development of such technology within their respective domains, all with a mutual goal to deliver safe, effective, cost-efficient, and patient-specific CMF care. This manuscript reviews FDA regulatory status, 3D printing techniques, biomaterials, and sterilization procedures suitable for 3D printed devices of the craniomaxillofacial skeleton. It also seeks to discuss recent clinical applications, economic feasibility, and future directions of this novel technology. By reviewing the current state of 3D printing in CMF surgery, we hope to gain a better understanding of its impact and in turn identify opportunities to further the development of patient-specific surgical care.

Virtual Reality and Augmented Reality in Plastic and Craniomaxillofacial Surgery: A Scoping Review

Virtual reality (VR) and augmented reality (AR) have evolved since their introduction to medicine in the 1990s. More powerful software, the miniaturization of hardware, and greater accessibility and affordability enabled novel applications of such virtual tools in surgical practice. This scoping review aims to conduct a comprehensive analysis of the literature by including all articles between 2018 and 2021 pertaining to VR and AR and their use by plastic and craniofacial surgeons in a clinician-as-user, patient-specific manner. From the initial 1637 articles, 10 were eligible for final review. These discussed a variety of clinical applications: perforator flaps reconstruction, mastectomy reconstruction, lymphovenous anastomosis, metopic craniosynostosis, dermal filler injection, auricular reconstruction, facial vascularized composite allotransplantation, and facial artery mapping. More than half (60%) involved VR/AR use intraoperatively with the remainder (40%) examining preoperative use. The hardware used predominantly comprised HoloLens (40%) and smartphones (40%). In total, 9/10 Studies utilized an AR platform. This review found consensus that VR/AR in plastic and craniomaxillofacial surgery has been used to enhance surgeons' knowledge of patient-specific anatomy and potentially facilitated decreased intraoperative time via preoperative planning. However, further outcome-focused research is required to better establish the usability of this technology in everyday practice.

Virtual Surgical Planning and 3D-Printed Surgical Guides in Facial Allotransplantation

The complex three-dimensional (3D) anatomy in facial allotransplantation creates a unique challenge for surgical reconstruction. Evolution of virtual surgical planning (VSP) through computer-aided design and computer-aided manufacturing has advanced reconstructive outcomes for many craniomaxillofacial indications. Surgeons use VSP, 3D models, and surgical guides to analyze and to trial surgical approaches even prior to entering the operating room. This workflow allows the surgeon to plan osteotomies and to anticipate challenges, which improves surgical precision and accuracy, optimizes outcomes, and should reduce operating room time. We present the development, evolution, and utilization of VSP and 3D-printed guides in facial allotransplantation at our institution, from guide conception to first clinical case.

Review and Future/Potential Application of Mixed Reality Technology in Orthopaedic Oncology

In orthopaedic oncology, surgical planning and intraoperative execution errors may result in positive tumor resection margins that increase the risk of local recurrence and adversely affect patients’ survival. Computer navigation and 3D-printed resection guides have been reported to address surgical inaccuracy by replicating the surgical plans in complex cases. However, limitations include surgeons’ attention shift from the operative field to view the navigation monitor and expensive navigation facilities in computer navigation surgery. Practical concerns are lacking real-time visual feedback of preoperative images and the lead-time in manufacturing 3D-printed objects. Mixed Reality (MR) is a technology of merging real and virtual worlds to produce new environments with enhanced visualizations, where physical and digital objects coexist and allow users to interact with both in real-time. The unique MR features of enhanced medical images visualization and interaction with holograms allow surgeons real-time and on-demand medical information and remote assistance in their immediate working environment. Early application of MR technology has been reported in surgical procedures. Its role is unclear in orthopaedic oncology. This review aims to provide orthopaedic tumor surgeons with up-to-date knowledge of the emerging MR technology. The paper presents its essential features and clinical workflow, reviews the current literature and potential clinical applications, and discusses the limitations and future development in orthopaedic oncology. The emerging MR technology adds a new dimension to digital assistive tools with a more accessible and less costly alternative in orthopaedic oncology. The MR head-mounted display and hand-free control may achieve clinical point-of-care inside or outside the operating room and improve service efficiency and patient safety. However, lacking an accurate hologram-to-patient matching, an MR platform dedicated to orthopaedic oncology, and clinical results may hinder its wide adoption. Industry-academic partnerships are essential to advance the technology with its clinical role determined through future clinical studies.

Point your SmartPhone at the code above. If you have a QR code reader the video abstract will appear. Or use:

https://youtu.be/t4hl_Anh_kM

The 2020 Facial Transplantation Update: A 15-Year Compendium

Over the past 15 years, landmark achievements have established facial transplantation (FT) as a feasible reconstructive option for otherwise irreparable craniofacial defects. However, as the field matures and long-term outcomes begin to emerge, FT teams around the world are now facing new challenges. Data for this review were identified by searches of the PubMed/MEDLINE database from inception through August 2020. All English-language articles pertaining to FT were included. Significant advances in candidate selection, technology, operative technique, posttransplant care, and immunosuppressive management have contributed to the tremendous expansion of the field, culminating in the execution in the past 3 years of 2 facial re-transplantations, and most recently the world’s first successful combined face and double hand transplant in August 2020. Despite these achievements, the allograft donor pool remains limited, with long wait times, requiring surgical experimentation with cross-sex FT. Immunosuppressive management has improved, but significant adverse events continue to be reported. Most recently, the COVID-19 pandemic has placed an unprecedented strain on the healthcare system, with various implications for the practice of reconstructive transplantation. In this article, we provide the most comprehensive and up-to-date FT review, highlighting fundamental lessons learned and recent advancements, while looking toward the challenges ahead. Over the past 15 years, extensive multidisciplinary efforts have been instrumental to the establishment of FT as a feasible reconstructive option. As novel challenges are beginning to emerge, continued collaborative and multispecialty research efforts are needed to further this field.

Maxillofacial Bony Considerations in Facial Transplantation

Alloplastic facial transplantation has become a new rung on the proverbial reconstructive ladder for severe facial wounds in the past couple of decades. Since the first transfer including bony components in 2006, numerous facial allotransplantations across many countries have been successfully performed, many incorporating multiple bony elements of the face. There are many unique considerations to facial transplantation of bone, however, beyond the considerations of simple soft tissue transfer. Herein, we review the current literature and considerations specific to bony facial transplantation focusing on the pertinent surgical anatomy, preoperative planning needs, intraoperative harvest and inset considerations, and postoperative protocols.

Augmented Reality Visualization for Image-Guided Surgery: A Validation Study Using a Three-Dimensional Printed Phantom

BACKGROUND

Oral and maxillofacial surgery currently relies on virtual surgery planning based on image data (CT, MRI). Three-dimensional (3D) visualizations are typically used to plan and predict the outcome of complex surgical procedures. To translate the virtual surgical plan to the operating room, it is either converted into physical 3D-printed guides or directly translated using real-time navigation systems.

PURPOSE

This study aims to improve the translation of the virtual surgery plan to a surgical procedure, such as oncologic or trauma surgery, in terms of accuracy and speed. Here we report an augmented reality visualization technique for image-guided surgery. It describes how surgeons can visualize and interact with the virtual surgery plan and navigation data while in the operating room. The user friendliness and usability is objectified by a formal user study that compared our augmented reality assisted technique to the gold standard setup of a perioperative navigation system (Brainlab). Moreover, accuracy of typical navigation tasks as reaching landmarks and following trajectories is compared.

RESULTS

Overall completion time of navigation tasks was 1.71 times faster using augmented reality (P = .034). Accuracy improved significantly using augmented reality (P < .001), for reaching physical landmarks a less strong correlation was found (P = .087). Although the participants were relatively unfamiliar with VR/AR (rated 2.25/5) and gesture-based interaction (rated 2/5), they reported that navigation tasks become easier to perform using augmented reality (difficulty Brainlab rated 3.25/5, HoloLens 2.4/5).

CONCLUSION

The proposed workflow can be used in a wide range of image-guided surgery procedures as an addition to existing verified image guidance systems. Results of this user study imply that our technique enables typical navigation tasks to be performed faster and more accurately compared to the current gold standard. In addition, qualitative feedback on our augmented reality assisted technique was more positive compared to the standard setup.?>.

Facial Transplantation

Facial transplantation represents a unique surgical solution for challenging facial injury patterns in which conservative reconstructive techniques fail to provide a satisfactory functional and aesthetic result. With advances in the field of vascularized composite allotransplantation over the past 15 years, more than 40 of these procedures have been performed worldwide with two recent reports of facial re-transplantation. In this article we discuss the multidisciplinary approach that is required for successful transplantation as well as the surgical techniques used and postoperative management. With ongoing research, recent technological innovation, and increased efforts to promote greater generalizability and transparency in this field, patients with these complex injuries will continue to see improvements in their treatment options, and thus quality of life.

Novel Multimodal, Multiscale Imaging System with Augmented Reality

A novel multimodal, multiscale imaging system with augmented reality capability were developed and characterized. The system offers 3D color reflectance imaging, 3D fluorescence imaging, and augmented reality in real time. Multiscale fluorescence imaging was enabled by developing and integrating an in vivo fiber-optic microscope. Real-time ultrasound-fluorescence multimodal imaging used optically tracked fiducial markers for registration. Tomographical data are also incorporated using optically tracked fiducial markers for registration. Furthermore, we characterized system performance and registration accuracy in a benchtop setting. The multiscale fluorescence imaging facilitated assessing the functional status of tissues, extending the minimal resolution of fluorescence imaging to ~17.5 µm. The system achieved a mean of Target Registration error of less than 2 mm for registering fluorescence images to ultrasound images and MRI-based 3D model, which is within clinically acceptable range. The low latency and high frame rate of the prototype system has shown the promise of applying the reported techniques in clinically relevant settings in the future.

Limitations and limits and of vascularized composite allotransplantations: can we reach the holy grail?

PURPOSE OF REVIEW

In recent times, vascularized composite allotransplantation (VCA) have been gaining more attention and applications. Currently, VCA are at the highest level of the reconstruction pyramid, and thus the effects expected after them are intended to outweigh what the 'classical' reconstructive surgery can offer us, including even the most advanced microsurgical techniques.

RECENT FINDINGS

Over 40 patients have received a partial or full-face transplant. Others have received penis, uterus, larynx, abdominal wall, and lower extremity transplants. Each type of VCA has its own problems and limitations. However, resolving the limits defined by immunosuppression and improved donor selection would revolutionize all of them.

SUMMARY

Defining the limits and limitations of given procedures will not only allow for better preparation of transplant teams but will also help in determining the direction of future research.