An advanced simulator for orthopedic surgical training

Construction of a virtual reality platform for computer-aided navigation Lingnan bone setting technique

To establish a standard Traditional Chinese medicine (TCM) bone setting technique, standardize the operation and inherit the TCM bone setting technique. This project was based on the interactive tracking of bone setting techniques with a dedicated position tracker, the motion tracking of bone setting techniques based on RGBD (Red Green Blue Depth) cameras, the digital analysis of bone setting techniques, and the design of the virtual reality platform for bone setting techniques. These key technical researches were combined to construct an interactive bone setting technique. The virtual simulation system can reproduce the implementation process of the expert's bone setting technique. The user can observe the implementation of the manipulative technique from multiple angles; through human-computer interaction, the whole process of implementation of the bone setting technique can be simulated, and the movement and reduction of the affected bone can be observed at the same time. It can be used as a teaching and training system for assisting bone setting techniques. Students can use the system to carry out repeated self-training, and can instantly compare with the standard techniques of the expert database, breaking the traditional teaching mode of 'expected and unspeakable' and avoid directly using patients. Therefore, this research makes it possible to reduce teaching costs, reduce risks, improve teaching quality, and make up for the lack of teaching conditions. It is very positive for the inheritance of the traditional Chinese 'intangible culture' of bone setting techniques, and to promote the digitalization and standardization of bone setting techniques.

Adding Safety Rules to Surgeon-Authored Virtual Reality Training

INTRODUCTION

The Toolkit for Illustration of Procedures in Surgery (TIPS) is an open source virtual reality (VR) laparoscopic simulation-based training environment with force feedback. The TIPS-author is a content creation interface that allows a surgeon educator (SE) to assemble new laparoscopic training modules. New technology enables safety rules to be specified by the SE, automatically tracks specified safety errors, and summarizes and communicates achievements and errors to the surgical trainee.

METHODS

The TIPS-author combines and initializes building blocks of anatomy with their physical properties, as selected by the SE from a database. The SE can add any safety rule that can be tested in terms of location, proximity, separation, clip count, and force. Errors are then automatically monitored during simulation and recorded as visual snapshots for feedback to the trainee. The TIPS was field tested at 2 surgical conferences, one before and one after adding the error snapshot feature.

RESULTS

Sixty-four respondents at 2 surgical conferences assessed the utility of TIPS on a Likert scale. While other ratings remained unchanged for an overall score of 5.24 of 7 (7 = very useful), the rating of the statement "The TIPS interface helps learners understand the force necessary to explore the anatomy" improved from 5.04 to 5.35 of 7 after the snapshot mechanism was added.

CONCLUSIONS

The ratings indicate the viability of the TIPS open source SE-authored surgical training units with safety rules. Presenting SE-determined procedural missteps via the snapshot mechanism at the end of the training increases perceived utility.

Current status of virtual reality simulation education for orthopedic residents: the need for a change in focus

Introduction

Advances in technology are changing surgical education. Simulation provides an important adjunct to operative experience. This pedagogy has arguably become more important in light of the COVID-19 pandemic, with resultant reduction in operative exposure for trainees. Virtual reality (VR) simulators may provide significant contribution to experiential learning; however, much of the investigative focus to date has, correctly, been on establishing validity evidence for these constructs. The aim of this work was to perform a scoping review to assess the current status of VR simulation education to determine curricular development efforts for orthopedic residents.

Methods

With a trained medical librarian, searches of PubMed, EMBASE, and Web of Science were conducted for all articles in the last 10 years (September 2011-September 2021). Controlled vocabulary Medical Subject Headings (MeSH) terms and natural language developed with subject matter experts describing virtual reality or VR simulation and orthopedic training were used. Two trained reviewers evaluated all abstracts for inclusion. Exclusion criteria were all articles that did not assess VR simulation education involving orthopedic residents. Data were extracted from the included full-text articles including: study design, type of participants, type of VR simulation, simulated orthopedic skill, type of educational event, learner assessment including Kirkpatrick's level, assessment of quality using the Medical Education Research Study Quality Instrument (MERSQI), and level of effectiveness (LoE).

Results

Initial search identified 1,394 articles, of which 61 were included in the final qualitative synthesis. The majority (54%) were published in 2019- 2021, 49% in Europe. The commonest VR simulator was ArthroS (23%) and the commonest simulated skill was knee arthroscopy (33%). The majority of studies (70%) focused on simulator validation. Twenty-three studies described an educational module or curriculum, and of the 21 (34%) educational modules, 43% were one-off events. Most modules (18/21, 86%) assessed learners at Kirkpatrick level 2. With regard to methodological quality, 44% of studies had MERSQI 11.5-15 and 89% of studies had LoE of 2. Two studies had LoE of 3.

Conclusion

Current literature pertaining to VR training for orthopedic residents is focused on establishing validity and rarely forms part of a curriculum. Where the focus is education, the majority are discrete educational modules and do not teach a comprehensive amalgam of orthopedic skills. This suggests focus is needed to embed VR simulation training within formal curricula efforts guided by the work of Kern, and assess the efficacy of these against patient outcomes.

The impact of extended reality on surgery: a scoping review

PURPOSE

Extended reality (XR) is defined as a spectrum of technologies that range from purely virtual environments to enhanced real-world environments. In the past two decades, XR-assisted surgery has seen an increase in its use and also in research and development. This scoping review aims to map out the historical trends in these technologies and their future prospects, with an emphasis on the reported outcomes and ethical considerations on the use of these technologies.

METHODS

A systematic search of PubMed, Scopus, and Embase for literature related to XR-assisted surgery and telesurgery was performed using Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for scoping reviews (PRISMA-ScR) guidelines. Primary studies, peer-reviewed articles that described procedures performed by surgeons on human subjects and cadavers, as well as studies describing general surgical education, were included. Non-surgical procedures, bedside procedures, veterinary procedures, procedures performed by medical students, and review articles were excluded. Studies were classified into the following categories: impact on surgery (pre-operative planning and intra-operative navigation/guidance), impact on the patient (pain and anxiety), and impact on the surgeon (surgical training and surgeon confidence).

RESULTS

One hundred and sixty-eight studies were included for analysis. Thirty-one studies investigated the use of XR for pre-operative planning concluded that virtual reality (VR) enhanced the surgeon's spatial awareness of important anatomical landmarks. This leads to shorter operating sessions and decreases surgical insult. Forty-nine studies explored the use of XR for intra-operative planning. They noted that augmented reality (AR) headsets highlight key landmarks, as well as important structures to avoid, which lowers the chance of accidental surgical trauma. Eleven studies investigated patients' pain and noted that VR is able to generate a meditative state. This is beneficial for patients, as it reduces the need for analgesics. Ten studies commented on patient anxiety, suggesting that VR is unsuccessful at altering patients' physiological parameters such as mean arterial blood pressure or cortisol levels. Sixty studies investigated surgical training whilst seven studies suggested that the use of XR-assisted technology increased surgeon confidence.

CONCLUSION

The growth of XR-assisted surgery is driven by advances in hardware and software. Whilst augmented virtuality and mixed reality are underexplored, the use of VR is growing especially in the fields of surgical training and pre-operative planning. Real-time intra-operative guidance is key for surgical precision, which is being supplemented with AR technology. XR-assisted surgery is likely to undertake a greater role in the near future, given the effect of COVID-19 limiting physical presence and the increasing complexity of surgical procedures.

The effectiveness of virtual reality, augmented reality, and mixed reality training in total hip arthroplasty: a systematic review and meta-analysis

BACKGROUND

Extended reality (XR), including virtual reality (VR), augmented reality (AR), and mixed reality (MR), has been used in the training of total hip arthroplasty (THA). This study aims to examine the effectiveness of XR training in THA.

METHODS

In this systematic review and meta-analysis, we searched PubMed (MEDLINE), EMBASE (OVID), Cochrane Central Register of Controlled Trials (CENTRAL), Web of Science, and clinicaltrials.gov from inception to September 2022 for eligible studies. The Review Manager 5.4 software was applied to compare accuracy of inclination and anteversion, and surgical duration between XR training and conventional methods.

RESULTS

We identified 213 articles, of which 4 randomized clinical trials and 1 prospective controlled study including 106 participants met inclusion criteria. The pooled data indicated the XR training had better accuracy of inclination and shorter surgical duration than conventional methods (MD = -2.07, 95% CI [- 4.02 to -0.11], P = 0.04; SMD = -1.30, 95% CI [- 2.01 to -0.60], P = 0.0003), but the accuracy of anteversion was similar in the two groups.

CONCLUSIONS

This systematic review and meta-analysis found XR training had better accuracy of inclination and shorter surgical duration than conventional methods in THA, but the accuracy of anteversion was similar. Based on the pooled results, we suggested that XR training can better improve trainees' surgical skills than conventional methods in THA.

Exploitation of Emerging Technologies and Advanced Networks for a Smart Healthcare System

Current medical methods still confront numerous limitations and barriers to detect and fight against illnesses and disorders. The introduction of emerging technologies in the healthcare industry is anticipated to enable novel medical techniques for an efficient and effective smart healthcare system. Internet of Things (IoT), Wireless Sensor Networks (WSN), Big Data Analytics (BDA), and Cloud Computing (CC) can play a vital role in the instant detection of illnesses, diseases, viruses, or disorders. Complicated techniques such as Artificial Intelligence (AI), Machine Learning (ML), and Deep Learning (DL) could provide acceleration in drug and antibiotics discovery. Moreover, the integration of visualization techniques such as Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR) with Tactile Internet (TI), can be applied from the medical staff to provide the most accurate diagnosis and treatment for the patients. A novel system architecture, which combines several future technologies, is proposed in this paper. The objective is to describe the integration of a mixture of emerging technologies in assistance with advanced networks to provide a smart healthcare system that may be established in hospitals or medical centers. Such a system will be able to deliver immediate and accurate data to the medical stuff in order to aim them in order to provide precise patient diagnosis and treatment.

Smooth and safe tram journeys: tram driver perspectives and opportunities using a haptic master controller in a virtual reality environment

Tram drivers operate a master controller to control the acceleration and braking of the tram. Operation should ensure passenger comfort and safety through smooth tram motion and the avoidance of jerkiness that may cause passengers to fall in the carriage. This work investigates current driver practices and strategies for tram driving in normal operations through interviews and the capacity of a new haptic master controller to support drivers in achieving smooth and safe tram journeys. A haptic feedback algorithm based on viscosity was implemented on the master controller to provide drivers with feedback on the rate at which they were accelerating and braking the tram. This aspect was tested in a virtual tram within a simulated inner city virtual reality environment. Results indicate that the haptic master controller and coupled viscosity feedback algorithm did not increase smoothness of driving during the simulated experiences. Despite this, the drivers indicated a preference for the provision of further haptic information to support driving tasks and the overall journey safety and smoothness. Practitioner Summary: This research comprises two studies. The first investigates strategies currently used by drivers to operate a tram smoothly in order to elicit design requirements for a haptic tram master controller. The second study evaluates the impact of a novel haptic master controller on journey smoothness within a virtual environment.

Applications of Haptic Technology, Virtual Reality, and Artificial Intelligence in Medical Training During the COVID-19 Pandemic

This paper examines how haptic technology, virtual reality, and artificial intelligence help to reduce the physical contact in medical training during the COVID-19 Pandemic. Notably, any mistake made by the trainees during the education process might lead to undesired complications for the patient. Therefore, training of the medical skills to the trainees have always been a challenging issue for the expert surgeons, and this is even more challenging in pandemics. The current method of surgery training needs the novice surgeons to attend some courses, watch some procedure, and conduct their initial operations under the direct supervision of an expert surgeon. Owing to the requirement of physical contact in this method of medical training, the involved people including the novice and expert surgeons confront a potential risk of infection to the virus. This survey paper reviews recent technological breakthroughs along with new areas in which assistive technologies might provide a viable solution to reduce the physical contact in the medical institutes during the COVID-19 pandemic and similar crises.

A virtual reality simulator for training the surgical reduction of patient-specific supracondylar humerus fractures

PURPOSE

Virtual reality has been used as a training platform in medicine, allowing the repetition of a situation/scenario as many times as needed and making it patient-specific prior to an operation. Of special interest is the minimally invasive plate osteosynthesis (MIPO). It represents a novel technique for orthopedic trauma surgery, but requires intensive training to acquire the required skills. In this paper, we propose a virtual reality platform for training the surgical reduction of supracondylar fractures of the humerus using MIPO. The system presents a detailed surgical theater where the surgeon has to place the bone fragments properly.

METHODS

Seven experienced users were selected to perform a surgical reduction using our proposal. Two paired humeri were scanned from a dataset obtained from the Complejo Hospitalario de Jaén. A virtual fracture was performed in one side of the pair, using the other as contralateral part. Users have to simulate a reduction for each case and fill out a survey about usability, using a five-option Likert scale.

RESULTS

The subjects have obtained excellent scores in both simulations. The users have notably reduced the time employed in the second experiment, being 60% less in average. Subjects have valued the usability (5.0), the intuitiveness (4.6), comfort (4.5), and realism (4.9) in a 1-5 Likert scale. The mean score of the usability survey was 4.66.

CONCLUSION

The system has shown a high learning rate, and it is expected that the trainees will reach an expert level after additional runs. By focusing on the movement of bone fragments, specialists acquire motor skills to avoid the malrotation of MIPO-treated fractures. A future study can fulfill the requirements needed to include this training system into the protocol of real surgeries. Therefore, we expect the system to increase the confidence of the trainees as well as to improve their decision making.

A review of computer-assisted orthopaedic surgery systems

BACKGROUND

Computer-assisted orthopaedic surgery systems have great potential, but no review has focused on computer-assisted surgery systems for the spine, hip, and knee.

METHODS

A systematic search was performed in Web of Science and PubMed. We searched the literature on computer-assisted orthopaedic surgery systems from 2008 to the present and focused on three aspects of systems: training, planning, and intraoperative navigation.

RESULTS AND DISCUSSION

In this review study, we reviewed 34 surgical training systems, 31 surgical planning systems, and 41 surgical navigation systems. The functions and characteristics of the surgical systems were compared and analysed, and the current concerns about and the impact of the surgical systems on doctors and surgery were clarified.

CONCLUSION

Computer-assisted orthopaedic surgery systems are still in the development stage. Future surgical training systems should include synthetic models with patient anatomy. Surgical planning systems with automatic planning should be developed, and surgical navigation systems with multimodal fusion, robotic assistance and imaging should be developed.

Developing and Assessing the Feasibility of Implementing a Surgical Objective Structured Clinical Skills Examination (S-OSCE)

OBJECTIVE

To1 describe the development and evaluate the feasibility of a surgical objective structured clinical examination (OSCE) for the purpose of competency assessment based on the Royal College of Canada's CanMEDS framework.

DESIGN

A unique surgical OSCE was developed to evaluate the clinical and surgical management of common orthopaedic problems using simulated patients and cadaveric specimens. Cases were graded by degree of difficulty (less complex, complex, more complex) Developing an assessment tool with significant resource utilization and good correlation with traditional methods is challenging. The feasibility of an OSCE that evaluates independent clinical and surgical decision making was evaluated. In addition, as part of establishing construct validity, correlation of OSCE scores with previously validated O-scores was performed.

SETTING

A tertiary level academic teaching hospital.

PARTICIPANTS

Thirty-four Postgraduate year 3-5 trainees of a 5-year Canadian orthopedic residency program creating 96 operative case performances available for final review.

RESULTS

The development of the OSCE cases involved a multistep process with attending surgeons, residents and a surgical education consultant. There were 4 different OSCE days, over a 3 year period (2016-2018) encompassing a variety of less complex and more complex procedures. Performance on the OSCE correlated strongly with the (O-SCORE, 0.89) and a linear regression analysis correlated moderately with year of training (r² = 0.5737). The feasibility analysis demonstrated good financial practicality with solid programmatic integration.

CONCLUSIONS

The unique surgical OSCE scores correlate strongly with an established entrustability scale. Administering this OSCE to evaluate preoperative and intraoperative decision making to complement other forms of assessment is feasible. The financial burden to training programs is modest in comparison to the insight gained by both residents and faculty.

Do Skills Acquired from Training with a Wire Navigation Simulator Transfer to a Mock Operating Room Environment?

BACKGROUND

Skills training and simulation play an increasingly important role in orthopaedic surgical education. The intent of simulation is to improve performance in the operating room (OR), a trait known as transfer validity. No prior studies have explored how simulator-based wire navigation training can transfer to higher-level tasks. Additionally, there is a lack of knowledge on the format in which wire navigation training should be deployed.

QUESTIONS/PURPOSES

(1) Which training methods (didactic content, deliberate practice, or proficiency-based practice) lead to the greatest improvement in performing a wire navigation task? (2) Does a resident's performance using a wire navigation simulator correlate with his or her performance on a higher-level simulation task in a mock OR involving a C-arm, a radiopaque femur model, and a large soft tissue surrogate surrounding the femur?

METHODS

Fifty-five residents from four different medical centers participated in this study over the course of 2 years. The residents were divided into three groups: traditional training (included first-year residents from the University of Iowa, University of Minnesota, and the Mayo Clinic), deliberate practice (included first-year residents from the University of Nebraska and the University of Minnesota), and proficiency training (included first-year residents from the University of Minnesota and the Mayo Clinic). Residents in each group received a didactic introduction covering the task of placing a wire to treat an intertrochanteric fracture, and this was considered traditional training. Deliberate practice involved training on a radiation-free simulator that provided specific feedback throughout the practice sessions. Proficiency training used the same simulator to train on specific components of wire navigation, like finding the correct starting point, to proficiency before moving to assessment. The wire navigation simulator uses a camera system to track the wire and provide computer-generated fluoroscopy. After training, task performance was assessed in a mock OR. Residents from each group were assessed in the mock OR based on their use of fluoroscopy, total time, and tip-apex distance. Correlation analysis was performed to examine the relationship between resident performance on the simulator and in the mock OR.

RESULTS

Residents in the two simulation-based training groups had a lower tip-apex distance than those in the traditional training group (didactic training tip-apex distance: 24 ± 7 mm, 95% CI, 20-27; deliberate practice tip-apex distance: 16 ± 5 mm, 95% CI, 13-19, p = 0.001; proficiency training tip-apex distance: 15 ± 4 mm, 95% CI, 13-18, p < 0.001). Residents in the proficiency training group used more images than those in the other groups (didactic training: 22 ± 12 images, p = 0.041; deliberate practice: 19 ± 8 images; p = 0.012, proficiency training: 31 ± 14 images). In the two simulation-based training groups, resident performance on the simulator, that is, tip-apex distance, image use, and overall time, was correlated with performance in the mock OR (r-square = 0.15 [p = 0.030], 0.61 [p < 0.001], and 0.43 [p < 0.001], respectively).

CONCLUSIONS

As residency programs are designing their curriculum to train wire navigation skills, emphasis should be placed on providing an environment that allows for deliberate practice with immediate feedback about their performance. Simulators such as the one presented in this study offer a safe environment for residents to learn this key skill.

LEVEL OF EVIDENCE

Level II, therapeutic study.

The presence of residents during orthopedic operation exerts no negative influence on outcome

BACKGROUND

Operative procedural training is a key component of orthopedic surgery residency. It is unclear how and whether residents participation in orthopedic surgical procedures impacts on post-operative outcomes.

SOURCES OF DATA

A systematic search was performed to identify articles in which the presence of a resident in the operating room was certified, and was compared with interventions without the presence of residents.

AREAS OF AGREEMENT

There is a likely beneficial role of residents in the operating room, and there is only a weak association between the presence of a resident and a worse outcome for orthopedic surgical patients.

AREAS OF CONTROVERSY

Most of the studies were undertaken in USA, and this represents a limit from the point of view of comparison with other academic and clinical realities.

GROWING POINT

The data provide support for continued and perhaps increased involvement of resident in orthopedic surgery.

AREAS OF RESEARCH

To clarify the role of residents on clinically relevant outcomes in orthopedic patients, appropriately powered randomized control trials should be planned.

Can an Augmented Reality Headset Improve Accuracy of Acetabular Cup Orientation in Simulated THA? A Randomized Trial

BACKGROUND

Accurate implant orientation reduces wear and increases stability in arthroplasty but is a technically demanding skill. Augmented reality (AR) headsets overlay digital information on top of the real world. We have developed an enhanced AR headset capable of tracking bony anatomy in relation to an implant, but it has not yet been assessed for its suitability as a training tool for implant orientation.

QUESTIONS/PURPOSES

(1) In the setting of simulated THA performed by novices, does an AR headset improve the accuracy of acetabular component positioning compared with hands-on training by an expert surgeon? (2) What are trainees' perceptions of the AR headset in terms of realism of the task, acceptability of the technology, and its potential role for surgical training?

METHODS

Twenty-four study participants (medical students in their final year of school, who were applying to surgery residency programs, and who had no prior arthroplasty experience) participated in a randomized simulation trial using an AR headset and a simulated THA. Participants were randomized to two groups completing four once-weekly sessions of baseline assessment, training, and reassessment. One group trained using AR (with live holographic orientation feedback) and the other received one-on-one training from a hip arthroplasty surgeon. Demographics and baseline performance in orienting an acetabular implant to six patient-specific values on the phantom pelvis were collected before training and were comparable. The orientation error in degrees between the planned and achieved orientations was measured and was not different between groups with the numbers available (surgeon group mean error ± SD 16° ± 7° versus AR 14° ± 7°; p = 0.22). Participants trained by AR also completed a validated posttraining questionnaire evaluating their experiences.

RESULTS

During the four training sessions, participants using AR-guidance had smaller mean (± SD) errors in orientation than those receiving guidance from the surgeon: 1° ± 1° versus AR 6° ± 4°, p < 0.001. In the fourth session's assessment, participants in both groups had improved (surgeon group mean improvement 6°, 95% CI, 4-8°; p < 0.001 versus AR group 9°, 95% CI 7-10°; p < 0.001). There was no difference between participants in the surgeon-trained and AR-trained group: mean difference 1.2°, 95% CI, -1.8 to 4.2°; p = 0.281. In posttraining evaluation, 11 of 12 participants would use the AR platform as a training tool for developing visuospatial skills and 10 of 12 for procedure-specific rehearsals. Most participants (11 of 12) stated that a combination of an expert trainer for learning and AR for unsupervised training would be preferred.

CONCLUSIONS

A novel head-mounted AR platform tracked an implant in relation to bony anatomy to a clinically relevant level of accuracy during simulated THA. Learners were equally accurate, whether trained by AR or a surgeon. The platform enabled the use of real instruments and gave live feedback; AR was thus considered a feasible and valuable training tool as an adjunct to expert guidance in the operating room. Although there were no differences in accuracy between the groups trained using AR and those trained by an expert surgeon, we believe the tool may be useful in education because it demonstrates that some motor skills for arthroplasty may be learned in an unsupervised setting. Future studies will evaluate AR-training for arthroplasty skills other than cup orientation and its transfer validity to real surgery.

LEVEL OF EVIDENCE

Level I, therapeutic study.

Virtual Reality Clinical Research: Promises and Challenges

BACKGROUND

Virtual reality (VR) therapy has been explored as a novel therapeutic approach for numerous health applications, in which three-dimensional virtual environments can be explored in real time. Studies have found positive outcomes for patients using VR for clinical conditions such as anxiety disorders, addictions, phobias, posttraumatic stress disorder, eating disorders, stroke rehabilitation, and for pain management.

OBJECTIVE

This work aims to highlight key issues in the implementation of clinical research for VR technologies.

METHODS

A discussion paper was developed from a narrative review of recent clinical research in the field, and the researchers' own experiences in conducting VR clinical research with chronic pain patients.

RESULTS

Some of the key issues in implementing clinical VR research include theoretical immaturity, a lack of technical standards, the problems of separating effects of media versus medium, practical in vivo issues, and costs.

CONCLUSIONS

Over the last decade, some significant successes have been claimed for the use of VR. Nevertheless, the implementation of clinical VR research outside of the laboratory presents substantial clinical challenges. It is argued that careful attention to addressing these issues in research design and pilot studies are needed in order to make clinical VR research more rigorous and improve the clinical significance of findings.