Combining Augmented Reality and 3D Printing to Improve Surgical Workflows in Orthopedic Oncology: Smartphone Application and Clinical Evaluation

Visual pathology reports for improved collaboration at multidisciplinary head and neck tumor board

PURPOSE

Multidisciplinary tumor boards (TB) are the standard for discussing complex head and neck cancer cases. During TB, imaging and microscopic pathology is reviewed, but there is typically no visualization of the resected cancer.

METHODS

A pilot study was conducted to investigate the utility of visual pathology reports at weekly TB for 10 consecutive weeks. Faculty-level participants completed a pre-survey and post-survey to assess understanding of resected cancer specimens.

RESULTS

Providers (n = 25) across seven medical specialties completed pre-survey and post-survey. Following intervention, providers reported significant improvement in understanding of anatomic orientation of the specimen and sites of margin sampling (mean 47.4-96.1, p < 0.001), ability to locate the site of a positive margin (mean 69.5-91.1, p < 0.001), and confidence in treatment plans created (mean 69.5-89.2, p < 0.001) with the addition of visual pathology reports.

CONCLUSIONS

Visual pathology reports improve provider understanding of resected cancer specimens at multidisciplinary TB.

More than meets the eye: Augmented reality in surgical oncology

BACKGROUND AND OBJECTIVES

In the field of surgical oncology, there has been a desire for innovative techniques to improve tumor visualization, resection, and patient outcomes. Augmented reality (AR) technology superimposes digital content onto the real-world environment, enhancing the user's experience by blending digital and physical elements. A thorough examination of AR technology in surgical oncology has yet to be performed.

METHODS

A scoping review of intraoperative AR in surgical oncology was conducted according to the guidelines and recommendations of The Preferred Reporting Items for Systematic Review and Meta-analyzes Extension for Scoping Reviews (PRISMA-ScR) framework. All original articles examining the use of intraoperative AR during surgical management of cancer were included. Exclusion criteria included virtual reality applications only, preoperative use only, fluorescence, AR not specific to surgical oncology, and study design (reviews, commentaries, abstracts).

RESULTS

A total of 2735 articles were identified of which 83 were included. Most studies (52) were performed on animals or phantom models, while the remaining included patients. A total of 1112 intraoperative AR surgical cases were performed across the studies. The most common anatomic site was brain (20 articles), followed by liver (16), renal (9), and head and neck (8). AR was most often used for intraoperative navigation or anatomic visualization of tumors or critical structures but was also used to identify osteotomy or craniotomy planes.

CONCLUSIONS

AR technology has been applied across the field of surgical oncology to aid in localization and resection of tumors.

Exploration of the application of augmented reality technology for teaching spinal tumor's anatomy and surgical techniques

Background

Augmented reality (AR) technology is gradually being applied in surgical teaching as an innovative teaching method. Developing innovative teaching methods to replicate clinical theory and practical teaching scenarios, simulate preoperative planning and training for bone tumor surgery, and offer enhanced training opportunities for young physicians to acquire and apply clinical knowledge is a crucial concern that impacts the advancement of the discipline and the educational standards for young orthopedic physicians.

Objective

This study explores the application effect of augmented reality technology in anatomy teaching and surgical clinical teaching for spinal tumor.

Methods

The method utilizes virtual reality and augmented reality technology to present a spinal tumor model and the surgical process of percutaneous vertebroplasty. We conducted a random selection of 12 students forming into the augmented reality teaching group and 13 students forming into the traditional teaching group among the 8-year medical students from Peking Union Medical College and Tsinghua University, ensuring that the age and learning stage of the students in both groups were similar. Two groups of students were taught using traditional teaching methods and augmented reality technology-assisted teaching methods, respectively. A questionnaire survey was conducted after class to assess the quality of course instruction, student motivation in learning, their proficiency in anatomical structures, their comprehension of spinal tumor growth and metastasis, and their understanding and proficiency in percutaneous vertebroplasty.

Results

This study was the first to apply augmented reality technology in teaching, using spinal tumors and percutaneous vertebroplasty as examples, a head-mounted augmented reality device was used to create learning scenarios, presenting the complex three-dimensional spatial structure intuitively. The two groups of students differ significantly in their rating of teaching quality, enthusiasm for learning, knowledge of anatomical features, understanding of spinal trabecular structure, and understanding of steps in percutaneous vertebroplasty. The augmented reality technology-assisted teaching system demonstrates outstanding advantages.

Conclusion

Augmented reality technology has great potential and broad prospects in teaching bone tumors, which can help improve the visualization, interactivity, and three-dimensional spatial sense of medical teaching in spinal tumor. The application and development prospects of using augmented reality technology for anatomy instruction, surgical teaching, and simulation training are extensive.

Tablet-based Augmented reality and 3D printed templates in fully guided Microtia Reconstruction: a clinical workflow

BACKGROUND

Microtia is a congenital malformation of the auricle that affects approximately 4 of every 10,000 live newborns. Radiographic film paper is traditionally employed to bidimensionally trace the structures of the contralateral healthy ear in a quasi-artistic manner. Anatomical points provide linear and angular measurements. However, this technique proves time-consuming, subjectivity-rich, and greatly dependent on surgeon expertise. Hence, it's susceptible to shape errors and misplacement.

METHODS

We present an innovative clinical workflow that combines 3D printing and augmented reality (AR) to increase objectivity and reproducibility of these procedures. Specifically, we introduce patient-specific 3D cutting templates and remodeling molds to carve and construct the cartilaginous framework that will conform the new ear. Moreover, we developed an in-house AR application compatible with any commercial Android tablet. It precisely guides the positioning of the new ear during surgery, ensuring symmetrical alignment with the healthy one and avoiding time-consuming intraoperative linear or angular measurements. Our solution was evaluated in one case, first with controlled experiments in a simulation scenario and finally during surgery.

RESULTS

Overall, the ears placed in the simulation scenario had a mean absolute deviation of 2.2 ± 1.7 mm with respect to the reference plan. During the surgical intervention, the reconstructed ear was 3.1 mm longer and 1.3 mm wider with respect to the ideal plan and had a positioning error of 2.7 ± 2.4 mm relative to the contralateral side. Note that in this case, additional morphometric variations were induced from inflammation and other issues intended to be addressed in a subsequent stage of surgery, which are independent of our proposed solution.

CONCLUSIONS

In this work we propose an innovative workflow that combines 3D printing and AR to improve ear reconstruction and positioning in microtia correction procedures. Our implementation in the surgical workflow showed good accuracy, empowering surgeons to attain consistent and objective outcomes.

Evaluation of the accuracy of an augmented reality-based tumor-targeting guide for breast-conserving surgery

BACKGROUND AND OBJECTIVES

Although magnetic resonance imaging (MRI) is commonly used for breast tumor detection, significant challenges remain in determining and presenting the three-dimensional (3D) morphology of tumors to guide breast-conserving surgery. To address this challenge, we have developed the augmented reality-breast surgery guide (AR-BSG) and compared its performance with that of a traditional 3D-printed breast surgical guide (3DP-BSG).

METHODS

Based on the MRI results of a breast cancer patient, a breast phantom made of skin, body, and tumor was fabricated through 3D printing and silicone-casting. AR-BSG and 3DP-BSG were executed using surgical plans based on the breast phantom's computed tomography scan images. Three operators independently inserted a catheter into the phantom using each guide. Their targeting accuracy was then evaluated using Bland-Altman analysis with limits of agreement (LoA). Differences between the users of each guide were evaluated using the intraclass correlation coefficient (ICC).

RESULTS

The entry and end point errors associated with AR-BSG were -0.34±0.68 mm (LoA: -1.71-1.01 mm) and 0.81±1.88 mm (LoA: -4.60-3.00 mm), respectively, whereas 3DP-BSG was associated with entry and end point errors of -0.28±0.70 mm (LoA: -1.69-1.11 mm) and -0.62±1.24 mm (LoA: -3.00-1.80 mm), respectively. The AR-BSG's entry and end point ICC values were 0.99 and 0.97, respectively, whereas 3DP-BSG was associated with entry and end point ICC values of 0.99 and 0.99, respectively.

CONCLUSIONS

AR-BSG can consistently and accurately localize tumor margins for surgeons without inferior guiding accuracy AR-BSG can consistently and accurately localize tumor margins for surgeons without inferior guiding accuracy compared to 3DP-BSG. Additionally, when compared with 3DP-BSG, AR-BSG can offer better spatial perception and visualization, lower costs, and a shorter setup time.

Clinical evaluation of augmented reality-based 3D navigation system for brachial plexus tumor surgery

BACKGROUND

Augmented reality (AR), a form of 3D imaging technology, has been preliminarily applied in tumor surgery of the head and spine, both are rigid bodies. However, there is a lack of research evaluating the clinical value of AR in tumor surgery of the brachial plexus, a non-rigid body, where the anatomical position varies with patient posture.

METHODS

Prior to surgery in 8 patients diagnosed with brachial plexus tumors, conventional MRI scans were performed to obtain conventional 2D MRI images. The MRI data were then differentiated automatically and converted into AR-based 3D models. After point-to-point relocation and registration, the 3D models were projected onto the patient's body using a head-mounted display for navigation. To evaluate the clinical value of AR-based 3D models compared to the conventional 2D MRI images, 2 senior hand surgeons completed questionnaires on the evaluation of anatomical structures (tumor, arteries, veins, nerves, bones, and muscles), ranging from 1 (strongly disagree) to 5 (strongly agree).

RESULTS

Surgeons rated AR-based 3D models as superior to conventional MRI images for all anatomical structures, including tumors. Furthermore, AR-based 3D models were preferred for preoperative planning and intraoperative navigation, demonstrating their added value. The mean positional error between the 3D models and intraoperative findings was approximately 1 cm.

CONCLUSIONS

This study evaluated, for the first time, the clinical value of an AR-based 3D navigation system in preoperative planning and intraoperative navigation for brachial plexus tumor surgery. By providing more direct spatial visualization, compared with conventional 2D MRI images, this 3D navigation system significantly improved the clinical accuracy and safety of tumor surgery in non-rigid bodies.

Real-time integration between Microsoft HoloLens 2 and 3D Slicer with demonstration in pedicle screw placement planning

PURPOSE

Up to date, there has been a lack of software infrastructure to connect 3D Slicer to any augmented reality (AR) device. This work describes a novel connection approach using Microsoft HoloLens 2 and OpenIGTLink, with a demonstration in pedicle screw placement planning.

METHODS

We developed an AR application in Unity that is wirelessly rendered onto Microsoft HoloLens 2 using Holographic Remoting. Simultaneously, Unity connects to 3D Slicer using the OpenIGTLink communication protocol. Geometrical transform and image messages are transferred between both platforms in real time. Through the AR glasses, a user visualizes a patient's computed tomography overlaid onto virtual 3D models showing anatomical structures. We technically evaluated the system by measuring message transference latency between the platforms. Its functionality was assessed in pedicle screw placement planning. Six volunteers planned pedicle screws' position and orientation with the AR system and on a 2D desktop planner. We compared the placement accuracy of each screw with both methods. Finally, we administered a questionnaire to all participants to assess their experience with the AR system.

RESULTS

The latency in message exchange is sufficiently low to enable real-time communication between the platforms. The AR method was non-inferior to the 2D desktop planner, with a mean error of 2.1 ± 1.4 mm. Moreover, 98% of the screw placements performed with the AR system were successful, according to the Gertzbein-Robbins scale. The average questionnaire outcomes were 4.5/5.

CONCLUSIONS

Real-time communication between Microsoft HoloLens 2 and 3D Slicer is feasible and supports accurate planning for pedicle screw placement.

Apps in Clinical Practice: Usage Behaviour of Trauma Surgeons and Radiologists in Northern Germany

Introduction

Apps, in general, are an integral part of our daily lives. To investigate the current usage behaviour of trauma surgeons and radiologists regarding medical apps in clinical practice and to find out if and how the current range of medical apps can be improved, we surveyed trauma surgeons and radiologists in northern Germany. Material and Methods. An online questionnaire was sent to 100 trauma surgeons and 100 radiologists in northern Germany. Participants were asked about the frequency of their use of medical apps in clinical practice, which apps were used most often, how useful participants thought apps were, and in which area they would like to see improvements. The most frequently mentioned apps were finally analyzed.

Results

The survey study showed that 87.4% of the trauma surgeons and 67.4% of the radiologists use medical apps on a regular basis at work. It also revealed that trauma surgeons used medical apps much more often than radiologists and that young doctors were more likely to rely on medical apps than chief physicians. 80.0% of the participants would pay at least 5 euros for a medical app. Trauma surgeons see the greatest need for support in their daily work from medical apps in the area of treatment, while radiologists seek more support in the area of classification.

Conclusion

The study underscored the broad acceptance of medical apps in everyday clinical practice. As the physicians are willing to spend money and stated a general interest and need for further developments, there is high potential for the future. This trial is registered with DRKS00026766.

Mobile Augmented Reality for Adding Detailed Multimedia Content to Historical Physicalizations

Combining augmented reality (AR) and physicalization offers both opportunities and challenges when representing detailed historical data. In this article, we describe a framework where mobile AR supplements views of 3-D prints of historical locations with interactive functionality and small visual details that the prints alone cannot display. Since seeing certain details requires bringing the camera close to the physical objects, the resulting camera frames may lack the visual information necessary to determine objects' positions and accurately superimpose the overlay. We address this by enhancing tracking of 3-D prints at close distances and employing visualization techniques that allow viewing small details in ways that do not interfere with tracking. To demonstrate these techniques, we apply our framework to the preservation of two heritage sites that represent large real-life areas containing smaller details of interest.

Clinical applications of augmented reality in orthopaedic surgery: a comprehensive narrative review

PURPOSE

The development of augmented reality (AR) technology allows orthopaedic surgeons to incorporate and visualize surgical data, assisting the execution of both routine and complex surgical operations. Uniquely, AR technology allows a surgeon to view the surgical field and superimpose peri-operative imaging, anatomical landmarks, navigation guidance, and more, all in one view without the need for conjugate gaze between multiple screens. The aim of this literature review was to introduce the fundamental requirements for an augmented reality system and to assess the current applications, outcomes, and potential limitations to this technology.

METHODS

A literature search was performed using MEDLINE and Embase databases, by two independent reviewers, who then collaboratively synthesized and collated the results of the literature search into a narrative review focused on the applications of augmented reality in major orthopaedic sub-specialties.

RESULTS

Current technology requires that pre-operative patient data be acquired, and AR-compatible models constructed. Intra-operatively, to produce manipulatable virtual images into the user's view in real time, four major components are required including a camera, computer image processing technology, tracking tools, and an output screen. The user is provided with a heads-up display, which is a transparent display, enabling the user to look at both their natural view and the computer-generated images. Currently, high-quality evidence for clinical implementation of AR technology in the orthopaedic surgery operating room is lacking; however, growing in vitro literature highlights a multitude of potential applications, including increasing operative accuracy, improved biomechanical angular and alignment parameters, and potentially reduced operative time.

CONCLUSION

While the application of AR systems in surgery is currently in its infancy, we anticipate rapid and widespread implementation of this technology in various orthopaedic sub-specialties.

The safety and feasibility of three-dimensional visualization planning system for CT-guided microwave ablation of stage I NSCLC (diameter ≤2.5 cm): A pilot study

Background

Microwave ablation (MWA) of lung tumors is a technique that is dependent on the ablationist's level of expertise. The selection of the optimum puncture path and determination of appropriate ablative parameters is the key to the success and safe of the procedure. The objective of this study was to describe the clinical use of a novel three-dimensional visualization ablation planning system (3D-VAPS) for aided MWA of stage I non-small cell lung cancer (NSCLC).

Methods

This was a single-arm, single-center, retrospective study. From May 2020 to July 2022, 113 consented patients with stage I NSCLC received MWA treatment in 120 MWA sessions. The 3D-VAPS was used to determine that: (1) the overlap between the gross tumor region and simulated ablation; (2) the proper posture and appropriate puncture site on the surface of the body; (3) the puncture path; and (4) presetting preliminarily ablative parameters. Patients were monitored with contrast-enhanced CT scans at 1, 3, and 6 months, as well as every 6 months following that. The primary endpoints were technical success and a complete ablation rate. Local progression-free survival (LPFS), overall survival (OS), and comorbidities were secondary study objectives.

Results

The mean diameter of tumors was 1.9 ± 0.4 cm (range 0.9-2.5 cm). The mean duration was 5.34 ± 1.28 min (range 3.0-10.0 min). The mean power output was 42.58 ± 4.23 (range 30.0-50.0W). The median follow-up time was 19.0 months (6.0-26.0 months). The technical success rate was 100%. Three-month after the procedure, the complete ablation rate was 97.35%. 6, 9, 12, and 24 months LPFS rates were 100%, 98.23%, 98.23%, and 96.46%, respectively. One-year and 2-year OS rates were 100% and 100%. There were no patients who died both during the procedure and after the MWA of 30 days. The complications after MWA included pneumothorax (38.33%), pleural effusion (26.67%), intrapulmonary hemorrhage (31.67%), and pulmonary infection (2.50%).

Conclusions

This research describes and confirms that 3D-VAPS is a feasibility and safe method for MWA of stage I NSCLC treatment. 3D-VAPS may be helpful to optimize the puncture path, assess reasonable ablative parameters, and minimize complications.

A Systematic Study to Compare the Precise Implantation of Hololens 2 Assisted with Acetabular Prosthesis for Total Hip Replacement

This study aims to evaluate the accuracy of the precise implantation of Hololens 2 assisted with acetabular prosthesis for total hip replacement. A total of 80 orthopaedic doctors from our hospital are enrolled in this systematic study and these doctors are divided into following four groups based on the experience of doctors treatment for orthopaedic patients and the Hololens 2 assisted:Rich experienced group with Hololens 2, rich experienced group without Hololens 2, inexperienced group with Hololens 2, inexperienced group without Hololens 2. The abduction angle, the anteversion angle, the offset degree in the abduction angle, the offset degree in the anteversion angle in four groups are presented and these result are used to evaluate the accuracy of precise implantation of Hololens 2 assisted with acetabular prosthesis for total hip replacement. Finally, all date in this study is collected and analyzed. The total of 80 physicians are included in this study. The results show that the outcomes between rich experienced group with Hololens 2 and rich experienced group without Hololens 2 are significant difference, and the outcomes between inexperienced group with Hololens 2 and inexperienced group without Hololens 2 are significant difference. The result between any other two groups is no significant difference. Hololens 2 assisted with acetabular prosthesis for total hip replacement can improve the accuracy.

Case report: Resection of a massive primary sacrococcygeal mature teratoma in an adult using 3-dimensional reconstruction and mixed reality technology

Introduction

Teratomas are rare neoplasms that arise from pluripotent germ cells. Sacrococcygeal teratomas are often diagnosed in infants but are rare in adults; a mature teratoma can contain hair, teeth, bony tissue, and other mature tissue types. Herein, we report for the first time a patient with a teratoma containing intact bones that formed a pseudoarthrosis.

Case report

A 49-year-old woman was admitted to hospital after a massive life-long sciatic tumor had begun to grow larger over the past year. A 16 cm × 25 cm solid mass with a clear boundary was palpable in the sacrococcygeal region. Radiography, computed tomography, and magnetic resonance imaging indicated a sacrococcygeal teratoma, although blood alpha-fetoprotein levels were normal. The teratoma was completely excised using 3-dimensional reconstruction mixed reality (MR) technology with no notable complications. Postoperative pathological examination of the excised lesion confirmed a mature teratoma. Interestingly, two intact irregular bones that formed a pseudoarthrosis were isolated; one was 11 cm and the other 6 cm. The patient is currently healthy and has experienced no recurrences.

Conclusion

Sacrococcygeal teratomas are rare, especially in adults, and often comprised lots of components, such as fat, bony tissue. However, it's first reported that formation of pseudoarthrosis in this case so far. It is difficult for surgeons to achieve complete excision without complications owing to the complex anatomic structure of the sacrum. The 3-dimensional reconstruction and mixed reality (MR) technology based on computed tomography can provide spatial visualization, which allows surgeons to examine the teratoma at different angles preoperatively. Combining 3-dimensional reconstruction and mixed reality (MR) technology in this case facilitated complete resection and prevented recurrence.

Evaluation of optical tracking and augmented reality for needle navigation in sacral nerve stimulation

BACKGROUND AND OBJECTIVE

Sacral nerve stimulation (SNS) is a minimally invasive procedure where an electrode lead is implanted through the sacral foramina to stimulate the nerve modulating colonic and urinary functions. One of the most crucial steps in SNS procedures is the placement of the tined lead close to the sacral nerve. However, needle insertion is very challenging for surgeons. Several x-ray projections are required to interpret the needle position correctly. In many cases, multiple punctures are needed, causing an increase in surgical time and patient's discomfort and pain. In this work we propose and evaluate two different navigation systems to guide electrode placement in SNS surgeries designed to reduce surgical time, minimize patient discomfort and improve surgical outcomes.

METHODS

We developed, for the first alternative, an open-source navigation software to guide electrode placement by real-time needle tracking with an optical tracking system (OTS). In the second method, we present a smartphone-based AR application that displays virtual guidance elements directly on the affected area, using a 3D printed reference marker placed on the patient. This guidance facilitates needle insertion with a predefined trajectory. Both techniques were evaluated to determine which one obtained better results than the current surgical procedure. To compare the proposals with the clinical method, we developed an x-ray software tool that calculates a digitally reconstructed radiograph, simulating the fluoroscopy acquisitions during the procedure. Twelve physicians (inexperienced and experienced users) performed needle insertions through several specific targets to evaluate the alternative SNS guidance methods on a realistic patient-based phantom.

RESULTS

With each navigation solution, we observed that users took less average time to complete each insertion (36.83 s and 44.43 s for the OTS and AR methods, respectively) and needed fewer average punctures to reach the target (1.23 and 1.96 for the OTS and AR methods respectively) than following the standard clinical method (189.28 s and 3.65 punctures).

CONCLUSIONS

To conclude, we have shown two navigation alternatives that could improve surgical outcome by significantly reducing needle insertions, surgical time and patient's pain in SNS procedures. We believe that these solutions are feasible to train surgeons and even replace current SNS clinical procedures.

HoloLens 1 vs. HoloLens 2: Improvements in the New Model for Orthopedic Oncological Interventions

This work analyzed the use of Microsoft HoloLens 2 in orthopedic oncological surgeries and compares it to its predecessor (Microsoft HoloLens 1). Specifically, we developed two equivalent applications, one for each device, and evaluated the augmented reality (AR) projection accuracy in an experimental scenario using phantoms based on two patients. We achieved automatic registration between virtual and real worlds using patient-specific surgical guides on each phantom. They contained a small adaptor for a 3D-printed AR marker, the characteristic patterns of which were easily recognized using both Microsoft HoloLens devices. The newest model improved the AR projection accuracy by almost 25%, and both of them yielded an RMSE below 3 mm. After ascertaining the enhancement of the second model in this aspect, we went a step further with Microsoft HoloLens 2 and tested it during the surgical intervention of one of the patients. During this experience, we collected the surgeons’ feedback in terms of comfortability, usability, and ergonomics. Our goal was to estimate whether the improved technical features of the newest model facilitate its implementation in actual surgical scenarios. All of the results point to Microsoft HoloLens 2 being better in all the aspects affecting surgical interventions and support its use in future experiences.

Manufacturing Polymer Model of Anatomical Structures with Increased Accuracy Using CAx and AM Systems for Planning Orthopedic Procedures

Currently, medicine uses typical industrial structure techniques, including reverse engineering, data processing, 3D-CAD modeling, 3D printing, and coordinate measurement techniques. Taking this into account, one can notice the applications of procedures used in the aviation or automotive industries based on the structure of Industry 4.0 in the planning of operations and the production of medical models with high geometric accuracy. The procedure presented in the publication shortens the processing time of tomographic data and increases the reconstruction accuracy within the hip and knee joints. The procedure allows for the partial removal of metallic artifacts from the diagnostic image. Additionally, numerical models of anatomical structures, implants, and bone cement were developed in more detail by averaging the values of local segmentation thresholds. Before the model manufacturing process, additional tests of the PLA material were conducted in terms of its strength and thermal properties. Their goal was to select the appropriate type of PLA material for manufacturing models of anatomical structures. The numerical models were divided into parts before being manufactured using the Fused Filament Fabrication technique. The use of the modifier made it possible to change the density, type of filling, number of counters, and the type of supporting structure. These treatments allowed us to reduce costs and production time and increase the accuracy of the printout. The accuracy of the manufactured model geometry was verified using the MCA-II measuring arm with the MMDx100 laser head and surface roughness using a 3D Talyscan 150 profilometer. Using the procedure, a decrease in geometric deviations and amplitude parameters of the surface roughness were noticed. The models based on the presented approach allowed for detailed and meticulous treatment planning.

Clinical applications and prospects of 3D printing guide templates in orthopaedics

Background

With increasing requirements for medical effects, and huge differences among individuals, traditional surgical instruments are difficult to meet the patients' growing medical demands. 3D printing is increasingly mature, which connects to medical services critically as well. The patient specific surgical guide plate provides the condition for precision medicine in orthopaedics.

Methods

In this paper, a systematic review of the orthopedic guide template is presented, where the history of 3D-printing-guided technology, the process of guides, and basic clinical applications of orthopedic guide templates are described. Finally, the limitations of the template and possible future directions are discussed.

Results

The technology of 3D printing surgical templates is increasingly mature, standard, and intelligent. With the help of guide templates, the surgeon can easily determine the direction and depth of the screw path, and choose the angle and range of osteotomy, increasing the precision, safety, and reliability of the procedure in various types of surgeries. It simplifies the difficult surgical steps and accelerates the growth of young and mid-career physicians. But some problems such as cost, materials, and equipment limit its development.

Conclusions

In different fields of orthopedics, the use of guide templates can significantly improve surgical accuracy, shorten the surgical time, and reduce intraoperative bleeding and radiation. With the development of 3D printing, the guide template will be standardized and simplified from design to production and use. 3D printing guides will be further sublimated in the application of orthopedics and better serve the patients.

The translational potential of this paper

Precision, intelligence, and individuation are the future development direction of orthopedics. It is more and more popular as the price of printers falls and materials are developed. In addition, the technology of meta-universe, digital twin, and artificial intelligence have made revolutionary effects on template guides. We aim to summarize recent developments and applications of 3D printing guide templates for engineers and surgeons to develop more accurate and efficient templates.

Augmented Reality: Mapping Methods and Tools for Enhancing the Human Role in Healthcare HMI

Background: Augmented Reality (AR) represents an innovative technology to improve data visualization and strengthen the human perception. Among Human–Machine Interaction (HMI), medicine can benefit most from the adoption of these digital technologies. In this perspective, the literature on orthopedic surgery techniques based on AR was evaluated, focusing on identifying the limitations and challenges of AR-based healthcare applications, to support the research and the development of further studies. Methods: Studies published from January 2018 to December 2021 were analyzed after a comprehensive search on PubMed, Google Scholar, Scopus, IEEE Xplore, Science Direct, and Wiley Online Library databases. In order to improve the review reporting, the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines were used. Results: Authors selected sixty-two articles meeting the inclusion criteria, which were categorized according to the purpose of the study (intraoperative, training, rehabilitation) and according to the surgical procedure used. Conclusions: AR has the potential to improve orthopedic training and practice by providing an increasingly human-centered clinical approach. Further research can be addressed by this review to cover problems related to hardware limitations, lack of accurate registration and tracking systems, and absence of security protocols.

Anatomical Engineering and 3D Printing for Surgery and Medical Devices: International Review and Future Exponential Innovations

Three-dimensional printing (3DP) has recently gained importance in the medical industry, especially in surgical specialties. It uses different techniques and materials based on patients' needs, which allows bioprofessionals to design and develop unique pieces using medical imaging provided by computed tomography (CT) and magnetic resonance imaging (MRI). Therefore, the Department of Biology and Medicine and the Department of Physics and Engineering, at the Bioastronautics and Space Mechatronics Research Group, have managed and supervised an international cooperation study, in order to present a general review of the innovative surgical applications, focused on anatomical systems, such as the nervous and craniofacial system, cardiovascular system, digestive system, genitourinary system, and musculoskeletal system. Finally, the integration with augmented, mixed, virtual reality is analyzed to show the advantages of personalized treatments, taking into account the improvements for preoperative, intraoperative planning, and medical training. Also, this article explores the creation of devices and tools for space surgery to get better outcomes under changing gravity conditions.

The use of 3D-printed models in patient communication: a scoping review

3D models have been used as an asset in many clinical applications and a variety of disciplines, and yet the available literature studying the use of 3D models in communication is limited. This scoping review has been conducted to draw conclusions on the current evidence and learn from previous studies, using this knowledge to inform future work. Our search strategy revealed 269 papers, 19 of which were selected for final inclusion and analysis. When assessing the use of 3D models in doctor-patient communication, there is a need for larger studies and studies including a long-term follow up. Furthermore, there are forms of communication that are yet to be researched and provide a niche that may be beneficial to explore.

A Multi-User Collaborative AR System for Industrial Applications

Augmented reality (AR) applications are increasingly being used in various fields (e.g., design, maintenance, assembly, repair, training, etc.), as AR techniques help improve efficiency and reduce costs. Moreover, collaborative AR systems extend applicability, allowing for collaborative environments for different roles. In this paper, we propose a multi-user collaborative AR system (aptly called the “multi-user collaborative system”, or MUCSys); it is composed of three ends—MUCStudio, MUCView, and MUCServer. MUCStudio aims to construct industrial content with CAD model transformation, simplification, database update, marker design, scene editing, and exportation, while MUCView contains sensor data analysis, real-time localization, scene loading, annotation editing, and virtual–real rendering. MUCServer—as the bridge between MUCStudio and MUCView—presents collaborative and database services. To achieve this, we implemented the algorithms of local map establishment, global map registration, optimization, and network synchronization. The system provides AR services for diverse industrial processes via three collaborative ways—remote support, collaborative annotation, and editing. According to the system, applications for cutting machines were presented to improve efficiency and reduce costs, covering cutting head designs, production line sales, and cutting machine inspections. Finally, a user study was performed to prove the usage experience of the system.

Surgical Navigation, Augmented Reality, and 3D Printing for Hard Palate Adenoid Cystic Carcinoma En-Bloc Resection: Case Report and Literature Review

Adenoid Cystic Carcinoma is a rare and aggressive tumor representing less than 1% of head and neck cancers. This malignancy often arises from the minor salivary glands, being the palate its most common location. Surgical en-bloc resection with clear margins is the primary treatment. However, this location presents a limited line of sight and a high risk of injuries, making the surgical procedure challenging. In this context, technologies such as intraoperative navigation can become an effective tool, reducing morbidity and improving the safety and accuracy of the procedure. Although their use is extended in fields such as neurosurgery, their application in maxillofacial surgery has not been widely evidenced. One reason is the need to rigidly fixate a navigation reference to the patient, which often entails an invasive setup. In this work, we studied three alternative and less invasive setups using optical tracking, 3D printing and augmented reality. We evaluated their precision in a patient-specific phantom, obtaining errors below 1 mm. The optimum setup was finally applied in a clinical case, where the navigation software was used to guide the tumor resection. Points were collected along the surgical margins after resection and compared with the real ones identified in the postoperative CT. Distances of less than 2 mm were obtained in 90% of the samples. Moreover, the navigation provided confidence to the surgeons, who could then undertake a less invasive and more conservative approach. The postoperative CT scans showed adequate resection margins and confirmed that the patient is free of disease after two years of follow-up.

Procedure Increasing the Accuracy of Modelling and the Manufacturing of Surgical Templates with the Use of 3D Printing Techniques, Applied in Planning the Procedures of Reconstruction of the Mandible

The application of anatomical models and surgical templates in maxillofacial surgery allows, among other benefits, the increase of precision and the shortening of the operation time. Insufficiently precise anastomosis of the broken parts of the mandible may adversely affect the functioning of this organ. Applying the modern mechanical engineering methods, including computer-aided design methods (CAD), reverse engineering (RE), and rapid prototyping (RP), a procedure used to shorten the data processing time and increase the accuracy of modelling anatomical structures and the surgical templates with the use of 3D printing techniques was developed. The basis for developing and testing this procedure was the medical imaging data DICOM of patients treated at the Maxillofacial Surgery Clinic of the Fryderyk Chopin Provincial Clinical Hospital in Rzeszów. The patients were operated on because of malignant tumours of the floor of the oral cavity and the necrosis of the mandibular corpus, requiring an extensive resection of the soft tissues and resection of the mandible. Familiarity with and the implementation of the developed procedure allowed doctors to plan the operation precisely and prepare the surgical templates and tools in terms of the expected accuracy of the procedures. The models obtained based on this procedure shortened the operation time and increased the accuracy of performance, which accelerated the patient’s rehabilitation in the further course of events.

Augmented Reality as a Tool to Guide PSI Placement in Pelvic Tumor Resections

Patient-specific instruments (PSIs) have become a valuable tool for osteotomy guidance in complex surgical scenarios such as pelvic tumor resection. They provide similar accuracy to surgical navigation systems but are generally more convenient and faster. However, their correct placement can become challenging in some anatomical regions, and it cannot be verified objectively during the intervention. Incorrect installations can result in high deviations from the planned osteotomy, increasing the risk of positive resection margins. In this work, we propose to use augmented reality (AR) to guide and verify PSIs placement. We designed an experiment to assess the accuracy provided by the system using a smartphone and the HoloLens 2 and compared the results with the conventional freehand method. The results showed significant differences, where AR guidance prevented high osteotomy deviations, reducing maximal deviation of 54.03 mm for freehand placements to less than 5 mm with AR guidance. The experiment was performed in two versions of a plastic three-dimensional (3D) printed phantom, one including a silicone layer to simulate tissue, providing more realism. We also studied how differences in shape and location of PSIs affect their accuracy, concluding that those with smaller sizes and a homogeneous target surface are more prone to errors. Our study presents promising results that prove AR's potential to overcome the present limitations of PSIs conveniently and effectively.

The Use of Mobile Applications for the Diagnosis and Treatment of Tumors in Orthopaedic Oncology - a Systematic Review

The use of smartphone apps is an essential part of everyday life. Mobile applications offer enormous opportunities for dealing with challenges in public health, and their number increases every day. This paper aims to review the existing literature on mobile applications in orthopaedic oncology and to summarize the current mobile applications for musculoskeletal tumors. A systematic literature review was conducted regarding articles on mobile applications in orthopaedic and trauma surgery. The focus was on identifying mobile applications that can be used in the treatment of patients with musculoskeletal tumors. Two reviewers independently assessed study eligibility, extracted data, and appraised methodological quality. In addition, the Apple App Store and Google Play Store were searched for suitable mobile applications. Ninety-one articles describing a mobile application in orthopaedic and trauma surgery were identified. Three articles focused on a mobile application for musculoskeletal tumors. Additionally, seven mobile applications were available in the App/Play Stores dealing with bone or soft tissue tumors in orthopaedic oncology without corresponding scientific articles. Increasing numbers of mobile applications are being developed in orthopaedic and trauma surgery. Currently, only three scientific articles on mobile applications in orthopaedic oncology are present, yet several more applications are available without scientific medical evaluation. Since mobile applications can facilitate the everyday life of orthopaedic and trauma surgeons, it is worthwhile to be aware of new developments in this field. A regular scientific evaluation of the subject is important in order to classify the significance of these applications.