The System for Telementoring with Augmented Reality (STAR): A head-mounted display to improve surgical coaching and confidence in remote areas

Educational value of a novel telestration device for surgical coaching-a randomized controlled trial

INTRODUCTION

Communication is fundamental to effective surgical coaching. This can be challenging for training during image-guided procedures where coaches and trainees need to articulate technical details on a monitor. Telestration devices that annotate on monitors remotely could potentially overcome these limitations and enhance the coaching experience. This study aims to evaluate the value of a novel telestration device in surgical coaching.

METHODS

A randomized-controlled trial was designed. All participants watched a video demonstrating the task followed by a baseline performance assessment and randomization into either control group (conventional verbal coaching without telestration) or telestration group (verbal coaching with telestration). Coaching for a simulated laparoscopic small bowel anastomosis on a dry lab model was done by a faculty surgeon. Following the coaching session, participants underwent a post-coaching performance assessment of the same task. Assessments were recorded and rated by blinded reviewers using a modified Global Rating Scale of the Objective Structured Assessment of Technical Skills (OSATS). Coaching sessions were also recorded and compared in terms of mentoring moments; guidance misinterpretations, questions/clarifications by trainees, and task completion time. A 5-point Likert scale was administered to obtain feedback.

RESULTS

Twenty-four residents participated (control group 13, telestration group 11). Improvements in some elements of the OSATS scale were noted in the Telestration arm but there was no statistical significance in the overall score between the two groups. Mentoring moments were more in the telestration Group. Amongst the telestration Group, 55% felt comfortable that they could perform this task independently, compared to only 8% amongst the control group and 82% would recommend the use of telestration tools here.

CONCLUSION

There is demonstrated educational value of this novel telestration device mainly in the non-technical aspects of the interaction by enhancing the coaching experience with improvement in communication and greater mentoring moments between coach and trainee.

Healthcare in the Dynamism of Metaverse After COVID-19: A Systematic Review of Literature

The idea of the "metaverse" is a relatively recent technological development. The industries that are most supportive of these developments include finance, entertainment, and communication. In addition to these, the healthcare domain has been added to the list of domains that benefit from the metaverse recently. Within the metaverse, research is being conducted on a wide range of medical topics, including conferences and seminars, surgical simulators, awareness campaigns, research projects, and much more. The metaverse is a flexible and highly customizable virtual digital platform that can be configured to suit specific needs, making it an adaptable instrument for medical advancement. These domains, together with their benefits and drawbacks, are thoroughly covered in this review article, which raises the discussion of the need for medical productivity. These studies have undergone a minimum amount of research and experimentation, and the findings are fair from an investigative standpoint. This review article's major goal is to make a provocative remark about metaverse domains and how they have already been used and might be used as an essential operational tool in the field of medicine in the future. Consequently, the objective of the present study is to review the current literature on post-COVID-19 pandemic development that connected the metaverse with the prevention and treatment of diseases, medical education and training, and expansion of available functionalities in research settings.

Telemedicine-Guided Two-Incision Lower Leg Fasciotomy Performed by Combat Medics During Tactical Combat Casualty Care: A Feasibility Study

INTRODUCTION

During tactical combat casualty care, life- and limb-saving procedures might also be performed by combat medics. This study assesses whether it is feasible to use a head-mounted display (HMD) to provide telemedicine (TM) support from a consulted senior surgeon for combat medics when performing a two-incision lower leg fasciotomy.

MATERIALS AND METHODS

Nine combat medics were randomized into groups to perform a two-incision lower leg fasciotomy. One group used the Vuzix M400 and the second group used the RealWear HMT-1Z1. A third, control, group received no guidance. In the Vuzix M400 group and RealWear HMT-1Z1 group, a senior surgeon examined the results after the two-incision lower leg fasciotomy was finished to assess the release of compartments, possible collateral damage, and performance of the combat medics. In the control group, these results were examined by a surgical resident with expertise in two-incision lower leg fasciotomies. The resident's operative performance questionnaire was used to score the performance of the combat medics. The telehealth usability questionnaire was used to evaluate the usability of the HMDs as perceived by the combat medics.

RESULTS

Combat medics using an HMD were considered competent in performing a two-incision lower leg fasciotomy (Vuzix: median 3 [range 0], RealWear: median 3 [range 1]). These combat medics had a significantly better score in their ability to adapt to anatomical variances compared to the control group (Vuzix: median 3 [range 0], RealWear: median 3 [range 0], control: median 1 [range 0]; P = .018). Combat medics using an HMD were faster than combat medics in the control group (Vuzix: mean 14:14 [SD 3:41], RealWear: mean 15:42 [SD 1:58], control: mean 17:45 [SD 2:02]; P = .340). The overall satisfaction with both HMDs was 5 out of 7 (Vuzix: median 5 [range 0], RealWear: median 5 [range 1]; P = .317).

CONCLUSIONS

This study shows that it is feasible to use an HMD to provide TM support performance from a consulted senior surgeon for combat medics when performing a two-incision lower leg fasciotomy. The results of this study suggest that TM support might be useful for combat medics during tactical combat casualty care when performing life- and limb-saving procedures.

Telemedicine Improves Performance of a Two-Incision Lower Leg Fasciotomy by Combat Medics: A Randomized Controlled Trial

INTRODUCTION

The primary aim of this randomized controlled trial was to assess if a head-mounted display (HMD) providing telemedicine support improves performance of a two-incision lower leg fasciotomy by a NATO special operations combat medic (combat medic).

MATERIALS AND METHODS

Thirty-six combat medics were randomized into two groups: One group performed a two-incision lower leg fasciotomy with the assistance of an HMD, while the control group completed the procedure without guidance. A Mann-Whitney U test was used to determine the possible differences in release of compartments and performance scores, as assessed by a supervising medical specialist. A Fisher's exact test was used to compare the proportions of collateral damage between groups. An independent-samples t-test was used to interpret total procedure times. The usability and technical factors involving HMD utilization were also assessed.

RESULTS

Combat medics in the HMD group released the anterior compartment (P ≤ .001) and deep posterior compartment (P = .008) significantly better. There was significantly more iatrogenic muscle (P ≤ .001) and venous damage (P ≤ .001) in the control group. The overall performance of combat medics in the HMD group was significantly better than that of the control group (P < .001). Combat medics in the control group were significantly faster (P = .012). The combat medics were very satisfied with the HMD. The HMD showed no major technical errors.

CONCLUSIONS

This randomized controlled trial shows that a HMD providing telemedicine support leads to significantly better performance of a two-incision lower leg fasciotomy by a combat medic with less iatrogenic muscle and venous damage.

Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study

INTRODUCTION

The learning curve in minimally invasive surgery (MIS) is steep compared to open surgery. One of the reasons is that training in the operating room in MIS is mainly limited to verbal instructions. The iSurgeon telestration device with augmented reality (AR) enables visual instructions, guidance, and feedback during MIS. This study aims to compare the effects of the iSurgeon on the training of novices performing repeated laparoscopic cholecystectomy (LC) on a porcine liver compared to traditional verbal instruction methods.

METHODS

Forty medical students were randomized into the iSurgeon and the control group. The iSurgeon group performed 10 LCs receiving interactive visual guidance. The control group performed 10 LCs receiving conventional verbal guidance. The performance assessment using Objective Structured Assessments of Technical Skills (OSATS) and Global Operative Assessment of Laparoscopic Skills (GOALS) scores, the total operating time, and complications were compared between the two groups.

RESULTS

The iSurgeon group performed LCs significantly better (global GOALS 17.3 ± 2.6 vs. 16 ± 2.6, p ≤ 0.001, LC specific GOALS 7 ± 2 vs. 5.9 ± 2.1, p ≤ 0.001, global OSATS 25.3 ± 4.3 vs. 23.5 ± 3.9, p ≤ 0.001, LC specific OSATS scores 50.8 ± 11.1 vs. 41.2 ± 9.4, p ≤ 0.001) compared to the control group. The iSurgeon group had significantly fewer intraoperative complications in total (2.7 ± 2.0 vs. 3.6 ± 2.0, p ≤ 0.001) than the control group. There was no difference in operating time (79.6 ± 25.7 vs. 84.5 ± 33.2 min, p = 0.087).

CONCLUSION

Visual guidance using the telestration device with AR, iSurgeon, improves performance and lowers the complication rates in LCs in novices compared to conventional verbal expert guidance.

The Role of Augmented Reality in Surgical Training: A Systematic Review

This review aims to provide an update on the role of augmented reality (AR) in surgical training and investigate whether the use of AR improves performance measures compared to traditional approaches in surgical trainees.

PUBMED, EMBASE, Google Scholar, Cochrane Library, British Library and Science Direct were searched following PRIMSA guidelines. All English language original studies pertaining to AR in surgical training were eligible for inclusion. Qualitative analysis was performed and results were categorised according to simulator models, subsequently being evaluated using Messick's framework for validity and McGaghie's translational outcomes for simulation-based learning.

Of the 1132 results retrieved, 45 were included in the study. 29 platforms were identified, with the highest 'level of effectiveness' recorded as 3. In terms of validity parameters, 10 AR models received a strong 'content validity' score of 2.15 models had a 'response processes' score ≥ 1. 'Internal structure' and 'consequences' were largely not discussed. 'Relations to other variables' was the best assessed criterion, with 9 platforms achieving a high score of 2. Overall, the Microsoft HoloLens received the highest level of recommendation for both validity and level of effectiveness.

Augmented reality in surgical education is feasible and effective as an adjunct to traditional training. The Microsoft HoloLens has shown the most promising results across all parameters and produced improved performance measures in surgical trainees. In terms of the other simulator models, further research is required with stronger study designs, in order to validate the use of AR in surgical training.

Mixed Reality Platforms in Telehealth Delivery: Scoping Review

BACKGROUND

The distinctive features of the digital reality platforms, namely augmented reality (AR), virtual reality (VR), and mixed reality (MR) have extended to medical education, training, simulation, and patient care. Furthermore, this digital reality technology seamlessly merges with information and communication technology creating an enriched telehealth ecosystem. This review provides a composite overview of the prospects of telehealth delivered using the MR platform in clinical settings.

OBJECTIVE

This review identifies various clinical applications of high-fidelity digital display technology, namely AR, VR, and MR, delivered using telehealth capabilities. Next, the review focuses on the technical characteristics, hardware, and software technologies used in the composition of AR, VR, and MR in telehealth.

METHODS

We conducted a scoping review using the methodological framework and reporting design using the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines. Full-length articles in English were obtained from the Embase, PubMed, and Web of Science databases. The search protocol was based on the following keywords and Medical Subject Headings to obtain relevant results: "augmented reality," "virtual reality," "mixed-reality," "telemedicine," "telehealth," and "digital health." A predefined inclusion-exclusion criterion was developed in filtering the obtained results and the final selection of the articles, followed by data extraction and construction of the review.

RESULTS

We identified 4407 articles, of which 320 were eligible for full-text screening. A total of 134 full-text articles were included in the review. Telerehabilitation, telementoring, teleconsultation, telemonitoring, telepsychiatry, telesurgery, and telediagnosis were the segments of the telehealth division that explored the use of AR, VR, and MR platforms. Telerehabilitation using VR was the most commonly recurring segment in the included studies. AR and MR has been mainly used for telementoring and teleconsultation. The most important technical features of digital reality technology to emerge with telehealth were virtual environment, exergaming, 3D avatars, telepresence, anchoring annotations, and first-person viewpoint. Different arrangements of technology-3D modeling and viewing tools, communication and streaming platforms, file transfer and sharing platforms, sensors, high-fidelity displays, and controllers-formed the basis of most systems.

CONCLUSIONS

This review constitutes a recent overview of the evolving digital AR and VR in various clinical applications using the telehealth setup. This combination of telehealth with AR, VR, and MR allows for remote facilitation of clinical expertise and further development of home-based treatment. This review explores the rapidly growing suite of technologies available to users within the digital health sector and examines the opportunities and challenges they present.

Surgical Training for Civilian Surgeons Interested in Humanitarian Surgery: A Scoping Review

INTRODUCTION

Humanitarian surgery is essential to surgical care in limited resource settings. The difficulties associated with resource constraints necessitate special training for civilian surgeons to provide care in these situations. Specific training or curricula for humanitarian surgeons are not well described in the literature. This scoping review summarizes the existing literature and identifies areas for potential improvement.

METHODS

A review of articles describing established courses for civilian surgeons interested in humanitarian surgery, as well as those describing training of civilian surgeons in conflict zones, was performed. A total of 4808 abstracts were screened by two independent reviewers, and 257 abstracts were selected for full-text review. Articles describing prehospital care and military experience were excluded from the full-text review.

RESULTS

Of the eight relevant full texts, 10 established courses for civilian surgeons were identified. Cadaver-based teaching combined with didactics were the most common course themes. Courses provided technical education focused on the management of trauma and burns as well as emergencies in orthopedics, neurosurgery, obstetrics, and gynecology. Other courses were in specialty surgery, mainly orthopedics. Two fellowship programs were identified, and these provide a different model for training humanitarian surgeons.

CONCLUSIONS

Humanitarian surgery is often practiced in austere environments, and civilian surgeons must be adequately trained to first do no harm. Current programs include cadaver-based courses focused on enhancing trauma surgery and surgical subspecialty skills, with adjunctive didactics covering resource allocation in austere environments. Fellowships programs may serve as an avenue to provide a more standardized education and a reliable pipeline of global surgeons.

Use of Extended Reality in Medical Education: An Integrative Review

Extended reality (XR) has emerged as an innovative simulation-based learning modality. An integrative review was undertaken to explore the nature of evidence, usage, and effectiveness of XR modalities in medical education. One hundred and thirty-three (N = 133) studies and articles were reviewed. XR technologies are commonly reported in surgical and anatomical education, and the evidence suggests XR may be as effective as traditional medical education teaching methods and, potentially, a more cost-effective means of curriculum delivery. Further research to compare different variations of XR technologies and best applications in medical education and training are required to advance the field.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s40670-022-01698-4.

Remote and asynchronous training network: from a SAGES grant to an eight-country remote laparoscopic simulation training program

BACKGROUND

Limitations in surgical simulation training include lack of access to validated training programs with continuous year-round training and lack of experts' ongoing availability for feedback. A model of simulation training was developed to address these limitations. It incorporated basic and advanced laparoscopic skills curricula from a previously validated program and provided instruction through a digital platform. The platform allowed for remote and asynchronous feedback from a few trained instructors. The instructors were continuously available and provided personalized feedback using a variety of different media. We describe the upscaling of this model to teach trainees at fourteen centers in eight countries.

METHODS

Institutions with surgical programs lacking robust simulation curricula and needing instructors for ongoing education were identified. The simulation centers ("skills labs") at these sites were equipped with necessary simulation training hardware. A remote training-the-administrators (TTA) program was developed where personnel were trained in how to manage the skills lab, schedule trainees, set up training stations, and use the platform. A train-the-trainers (TTT) program was created to establish a network of trained instructors, who provided objective feedback through the platform remotely and asynchronously.

RESULTS

Between 2019 and 2022, seven institutions in Chile and one in each of the USA, Bolivia, Brazil, Ecuador, El Salvador, México, and Perú implemented a digital platform-based remote simulation curriculum. Most administrators were not physicians (19/33). Eight Instructors were trained with the TTT program and became active proctors. The platform has been used by 369 learners, of whom 57% were general surgeons and general surgery residents. A total of 6729 videos, 28,711 feedback inputs, and 233.7 and 510.2 training hours in the basic and advanced programs, respectively, were registered.

CONCLUSION

A remote and asynchronous method of giving instruction and feedback through a digital platform has been effectively employed in the creation of a robust network of continuous year-round simulation-based training in laparoscopy. Training centers were successfully run only with trained administrators to assist in logistics and setup, and no on-site instructors were necessary.

Perceptions of Augmented Reality in Remote Medical Care: Interview Study of Emergency Telemedicine Providers (Preprint)

BACKGROUND

Augmented reality (AR) and virtual reality (VR) have increasingly appeared in the medical literature in the past decade, with AR recently being studied for its potential role in remote health care delivery and communication. Recent literature describes AR's implementation in real-time telemedicine contexts across multiple specialties and settings, with remote emergency services in particular using AR to enhance disaster support and simulation education. Despite the introduction of AR in the medical literature and its potential to shape the future of remote medical services, studies have yet to investigate the perspectives of telemedicine providers regarding this novel technology.

OBJECTIVE

This study aimed to understand the applications and challenges of AR in telemedicine anticipated by emergency medicine providers with a range of experiences in using telemedicine and AR or VR technology.

METHODS

Across 10 academic medical institutions, 21 emergency medicine providers with variable exposures to telemedicine and AR or VR technology were recruited for semistructured interviews via snowball sampling. The interview questions focused on various potential uses of AR, anticipated obstacles that prevent its implementation in the telemedicine area, and how providers and patients might respond to its introduction. We included video demonstrations of a prototype using AR during the interviews to elicit more informed and complete insights regarding AR's potential in remote health care. Interviews were transcribed and analyzed via thematic coding.

RESULTS

Our study identified 2 major areas of use for AR in telemedicine. First, AR is perceived to facilitate information gathering by enhancing observational tasks such as visual examination and granting simultaneous access to data and remote experts. Second, AR is anticipated to supplement distance learning of both minor and major procedures and nonprocedural skills such as cue recognition and empathy for patients and trainees. AR may also supplement long-distance education programs and thereby support less specialized medical facilities. However, the addition of AR may exacerbate the preexisting financial, structural, and literacy barriers to telemedicine. Providers seek value demonstrated by extensive research on the clinical outcome, satisfaction, and financial benefits of AR. They also seek institutional support and early training before adopting novel tools such as AR. Although an overall mixed reception is anticipated, consumer adoption and awareness are key components in AR's adoption.

CONCLUSIONS

AR has the potential to enhance the ability to gather observational and medical information, which would serve a diverse set of applications in remote health care delivery and education. However, AR faces obstacles similar to those faced by the current telemedicine technology, such as lack of access, infrastructure, and familiarity. This paper discusses the potential areas of investigation that would inform future studies and approaches to implementing AR in telemedicine.

Mixed reality surgical mentoring of combat casualty care related procedures in a perfused cadaver model: Initial results of a randomized feasibility study

BACKGROUND

Most telemedicine modalities have limited ability to enhance procedural and operative care. We developed a novel system to provide synchronous bidirectional expert mixed reality-enabled virtual procedural mentoring. In this feasibility study, we evaluated mixed reality mentoring of combat casualty care related procedures in a re-perfused cadaver model.

METHODS

Novices received real-time holographic mentoring from experts using augmented reality via Hololens (Microsoft Inc, Redmond, WA). The experts maintained real-time awareness of the novice's operative environment using virtual reality via HTC-Vive (HTC Corp, Xindian District, Taiwan). Additional cameras (both environments) and novel software created the immersive, shared, 3-dimensional mixed reality environment in which the novice and expert collaborated. The novices were prospectively randomized to either mixed reality or audio-only mentoring. Blinded experts independently evaluated novice procedural videos using a 5-point Likert scale-based questionnaire. Nonparametric variables were evaluated using the Wilcoxon rank-sum test and comparisons using the χ² analysis; significance was defined at P < .05.

RESULTS

Surgeon and nonsurgeon novices (14) performed 69 combat casualty care-related procedures (38 mixed reality, 31 audio), including various vascular exposures, 4-compartment lower leg fasciotomy, and emergency neurosurgical procedures; 85% were performed correctly with no difference in either group. Upon video review, mixed reality-mentored novices showed no difference in procedural flow and forward planning (3.67 vs 3.28, P = .21) or the likelihood of performing individual procedural steps correctly (4.12 vs 3.59, P = .06).

CONCLUSION

In this initial feasibility study, our novel mixed reality-based mentoring system successfully facilitated the performance of a wide variety of combat casualty care relevant procedures using a high fidelity re-perfused cadaver model. The small sample size and limited variety of novice types likely impacted the ability of holographically mentored novices to demonstrate improvement over the audio-only control group. Despite this, using virtual, augmented, and mixed reality technologies for procedural mentoring demonstrated promise, and further study is needed.

Scoping review: The use of augmented reality in clinical anatomical education and its assessment tools

The purpose of this review was to identify the different augmented reality (AR) modalities used to teach anatomy to students, health professional trainees, and surgeons, and to examine the assessment tools used to evaluate the performance of various AR modalities. A scoping review of four databases was performed using variations of: (1) AR, (2) medical or anatomical teaching/education/training, and (3) anatomy or radiology or cadaver. Scientific articles were identified and screened for the inclusion and exclusion criteria as per Preferred Reporting Items for Systematic Reviews and Meta-Analyses with extension for scoping reviews guidelines. Virtual reality was an exclusion criterion. From this scoping review, data were extracted from a total of 54 articles and the following four AR modalities were identified: head-mounted display, projection, instrument and screen, and mobile device. The usability, feasibility, and acceptability of these AR modalities were evaluated using a variety of quantitative and qualitative assessment tools. Within more recent years of AR integration into anatomy education, the assessment of visuospatial ability, cognitive load, time on task, and increasing academic achievement outcomes are variables of interest, which continue to warrant more exploration. Sufficiently powered studies using validated assessment tools must be conducted to better understand the role of AR in anatomical education.

A Smarter Health through the Internet of Surgical Things

(1) Background: In the last few years, technological developments in the surgical field have been rapid and are continuously evolving. One of the most revolutionizing breakthroughs was the introduction of the IoT concept within surgical practice. Our systematic review aims to summarize the most important studies evaluating the IoT concept within surgical practice, focusing on Telesurgery and surgical Telementoring. (2) Methods: We conducted a systematic review of the current literature, focusing on the Internet of Surgical Things in Telesurgery and Telementoring. Forty-eight (48) studies were included in this review. As secondary research questions, we also included brief overviews of the use of IoT in image-guided surgery, and patient Telemonitoring, by systematically analyzing fourteen (14) and nineteen (19) studies, respectively. (3) Results: Data from 219 patients and 757 healthcare professionals were quantitively analyzed. Study designs were primarily observational or based on model development. Palpable advantages from the IoT incorporation mainly include less surgical hours, accessibility to high quality treatment, and safer and more effective surgical education. Despite the described technological advances, and proposed benefits of the systems presented, there are still identifiable gaps in the literature that need to be further explored in a systematic manner. (4) Conclusions: The use of the IoT concept within the surgery domain is a widely incorporated but less investigated concept. Advantages have become palpable over the past decade, yet further research is warranted.

Utility of optical see-through head mounted displays in augmented reality-assisted surgery: A systematic review

This article presents a systematic review of optical see-through head mounted display (OST-HMD) usage in augmented reality (AR) surgery applications from 2013 to 2020. Articles were categorised by: OST-HMD device, surgical speciality, surgical application context, visualisation content, experimental design and evaluation, accuracy and human factors of human-computer interaction. 91 articles fulfilled all inclusion criteria. Some clear trends emerge. The Microsoft HoloLens increasingly dominates the field, with orthopaedic surgery being the most popular application (28.6%). By far the most common surgical context is surgical guidance (n=58) and segmented preoperative models dominate visualisation (n=40). Experiments mainly involve phantoms (n=43) or system setup (n=21), with patient case studies ranking third (n=19), reflecting the comparative infancy of the field. Experiments cover issues from registration to perception with very different accuracy results. Human factors emerge as significant to OST-HMD utility. Some factors are addressed by the systems proposed, such as attention shift away from the surgical site and mental mapping of 2D images to 3D patient anatomy. Other persistent human factors remain or are caused by OST-HMD solutions, including ease of use, comfort and spatial perception issues. The significant upward trend in published articles is clear, but such devices are not yet established in the operating room and clinical studies showing benefit are lacking. A focused effort addressing technical registration and perceptual factors in the lab coupled with design that incorporates human factors considerations to solve clear clinical problems should ensure that the significant current research efforts will succeed.

Healing Hands: The Tactile Internet in Future Tele-Healthcare

In the early 2020s, the coronavirus pandemic brought the notion of remotely connected care to the general population across the globe. Oftentimes, the timely provisioning of access to and the implementation of affordable care are drivers behind tele-healthcare initiatives. Tele-healthcare has already garnered significant momentum in research and implementations in the years preceding the worldwide challenge of 2020, supported by the emerging capabilities of communication networks. The Tactile Internet (TI) with human-in-the-loop is one of those developments, leading to the democratization of skills and expertise that will significantly impact the long-term developments of the provisioning of care. However, significant challenges remain that require today’s communication networks to adapt to support the ultra-low latency required. The resulting latency challenge necessitates trans-disciplinary research efforts combining psychophysiological as well as technological solutions to achieve one millisecond and below round-trip times. The objective of this paper is to provide an overview of the benefits enabled by solving this network latency reduction challenge by employing state-of-the-art Time-Sensitive Networking (TSN) devices in a testbed, realizing the service differentiation required for the multi-modal human-machine interface. With completely new types of services and use cases resulting from the TI, we describe the potential impacts on remote surgery and remote rehabilitation as examples, with a focus on the future of tele-healthcare in rural settings.

Effect of Artificial Intelligence Tutoring vs Expert Instruction on Learning Simulated Surgical Skills Among Medical Students: A Randomized Clinical Trial

IMPORTANCE

To better understand the emerging role of artificial intelligence (AI) in surgical training, efficacy of AI tutoring systems, such as the Virtual Operative Assistant (VOA), must be tested and compared with conventional approaches.

OBJECTIVE

To determine how VOA and remote expert instruction compare in learners' skill acquisition, affective, and cognitive outcomes during surgical simulation training.

DESIGN, SETTING, AND PARTICIPANTS

This instructor-blinded randomized clinical trial included medical students (undergraduate years 0-2) from 4 institutions in Canada during a single simulation training at McGill Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal, Canada. Cross-sectional data were collected from January to April 2021. Analysis was conducted based on intention-to-treat. Data were analyzed from April to June 2021.

INTERVENTIONS

The interventions included 5 feedback sessions, 5 minutes each, during a single 75-minute training, including 5 practice sessions followed by 1 realistic virtual reality brain tumor resection. The 3 intervention arms included 2 treatment groups, AI audiovisual metric-based feedback (VOA group) and synchronous verbal scripted debriefing and instruction from a remote expert (instructor group), and a control group that received no feedback.

MAIN OUTCOMES AND MEASURES

The coprimary outcomes were change in procedural performance, quantified as Expertise Score by a validated assessment algorithm (Intelligent Continuous Expertise Monitoring System [ICEMS]; range, -1.00 to 1.00) for each practice resection, and learning and retention, measured from performance in realistic resections by ICEMS and blinded Objective Structured Assessment of Technical Skills (OSATS; range 1-7). Secondary outcomes included strength of emotions before, during, and after the intervention and cognitive load after intervention, measured in self-reports.

RESULTS

A total of 70 medical students (41 [59%] women and 29 [41%] men; mean [SD] age, 21.8 [2.3] years) from 4 institutions were randomized, including 23 students in the VOA group, 24 students in the instructor group, and 23 students in the control group. All participants were included in the final analysis. ICEMS assessed 350 practice resections, and ICEMS and OSATS evaluated 70 realistic resections. VOA significantly improved practice Expertise Scores by 0.66 (95% CI, 0.55 to 0.77) points compared with the instructor group and by 0.65 (95% CI, 0.54 to 0.77) points compared with the control group (P < .001). Realistic Expertise Scores were significantly higher for the VOA group compared with instructor (mean difference, 0.53 [95% CI, 0.40 to 0.67] points; P < .001) and control (mean difference. 0.49 [95% CI, 0.34 to 0.61] points; P < .001) groups. Mean global OSATS ratings were not statistically significant among the VOA (4.63 [95% CI, 4.06 to 5.20] points), instructor (4.40 [95% CI, 3.88-4.91] points), and control (3.86 [95% CI, 3.44 to 4.27] points) groups. However, on the OSATS subscores, VOA significantly enhanced the mean OSATS overall subscore compared with the control group (mean difference, 1.04 [95% CI, 0.13 to 1.96] points; P = .02), whereas expert instruction significantly improved OSATS subscores for instrument handling vs control (mean difference, 1.18 [95% CI, 0.22 to 2.14]; P = .01). No significant differences in cognitive load, positive activating, and negative emotions were found.

CONCLUSIONS AND RELEVANCE

In this randomized clinical trial, VOA feedback demonstrated superior performance outcome and skill transfer, with equivalent OSATS ratings and cognitive and emotional responses compared with remote expert instruction, indicating advantages for its use in simulation training.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT04700384.

XR (Extended Reality: Virtual Reality, Augmented Reality, Mixed Reality) Technology in Spine Medicine: Status Quo and Quo Vadis

In recent years, with the rapid advancement and consumerization of virtual reality, augmented reality, mixed reality, and extended reality (XR) technology, the use of XR technology in spine medicine has also become increasingly popular. The rising use of XR technology in spine medicine has also been accelerated by the recent wave of digital transformation (i.e., case-specific three-dimensional medical images and holograms, wearable sensors, video cameras, fifth generation, artificial intelligence, and head-mounted displays), and further accelerated by the COVID-19 pandemic and the increase in minimally invasive spine surgery. The COVID-19 pandemic has a negative impact on society, but positive impacts can also be expected, including the continued spread and adoption of telemedicine services (i.e., tele-education, tele-surgery, tele-rehabilitation) that promote digital transformation. The purpose of this narrative review is to describe the accelerators of XR (VR, AR, MR) technology in spine medicine and then to provide a comprehensive review of the use of XR technology in spine medicine, including surgery, consultation, education, and rehabilitation, as well as to identify its limitations and future perspectives (status quo and quo vadis).

Co-axial Projective Imaging for Augmented Reality Telementoring in Skin Cancer Surgery

Telemedicine has the potential to overcome the unequal distribution of medical resources worldwide. In this study, we report the second-generation co-axial projective imaging (CPI-2) system featured with orthotopic image projection for augmented reality surgical telementoring. The CPI-2 system can acquire surgical scene images from the local site, transmit them wirelessly to the remote site, and project the virtual annotations drawn by a remote expert with great accuracy to the surgical field. The performance characteristics of the CPI-2 system are quantitatively verified in benchtop experiments. The ex vivo study that compares the CPI-2 system and a monitor-based telementoring system shows that the CPI-2 system can reduce the focus shift and avoid subjective mapping of the instructions from a monitor to the real-world scene, thereby saving operation time and achieving precise teleguidance. The clinical feasibility of the CPI-2 system is validated in teleguided skin cancer surgery. Our ex vivo and in vivo experiment results imply the improved performance of surgical telementoring, and the clinical utility of deploying the CPI-2 system for surgical interventions in resource-limited settings. The CPI-2 system has the potential to reduce healthcare disparities in remote areas with limited resources.

Overcoming the Impact of COVID-19 on Surgical Mentorship: A Scoping Review of Long-distance Mentorship in Surgery

BACKGROUND

Mentorship in the surgical field has been increasingly recognized as a crucial component of career success. Distance mentorship models may be utilized to overcome geographic limitations, increase mentorship access, and strengthen mentoring relationships in surgery.

OBJECTIVE

This review aimed to identify the scope of literature on distance mentoring in surgery, the range of its application, its effectiveness, and any gaps in the literature that should be addressed in order to enhance mentorship in the surgical field.

DESIGN

A comprehensive PubMed review was performed in January 2021 on distance mentorship of students, trainees, and surgeons in the surgical field. Reviews, replies, and non-English articles were excluded. Data was extracted regarding publication year, author's country, specialty, subjects, aim of mentorship model, and efficacy.

RESULTS

134 total studies met inclusion and exclusion criteria. Most studies were published in 2020, written by authors in the United States, from general surgery, and featured an expert surgeon paired with a more junior fully trained surgeon. In all, 93.3% of studies utilized distance mentorship to enhance surgical skill through telementoring and only 4.5% were focused on mentorship to enhance careers through professional development. The remaining studies utilized distance mentorship models to increase surgical research (0.7%) and clinical knowledge (1.5%).

CONCLUSION

The results of this review suggest successful implementation of distance mentoring in surgery through telementoring, but a lack of professionally aimed distance mentorship programs. Amidst COVID-19, distance mentorship is particularly important because of decreased face-to-face opportunity. Future studies in the surgical field should investigate distance mentoring as a means of increasing mentorship for professional development.

Opportunities and Challenges of Smartglass-Assisted Interactive Telementoring

The widespread adoption of wearables, extended reality, and metaverses has accelerated the diverse configurations of remote collaboration and telementoring systems. This paper explores the opportunities and challenges of interactive telementoring, especially for wearers of smartglasses. In particular, recent relevant studies are reviewed to derive the needs and trends of telementoring technology. Based on this analysis, we define what can be integrated into smartglass-enabled interactive telementoring. To further illustrate this type of special use case for telementoring, we present five illustrative and descriptive scenarios. We expect our specialized use case to support various telementoring applications beyond medical and surgical telementoring, while harmoniously fostering cooperation using the smart devices of mentors and mentees at different scales for collocated, distributed, and remote collaboration.

Application of technology to educational needs in surgery

Innovations in surgical education follow advancing clinical technology. New surgical methods have prompted demand for systematic methods to leverage computing power and internet tools to achieve proficiency-based training goals. Virtual reality, high-fidelity patient simulation, web-based resources to facilitate performance assessment, and telementoring have become mainstream practices, although patient outcomes benefits are not well studied. Remote virtual meeting and mentoring have had transformative effects on resident experiences, the full effects of which remain to be seen.

Augmented Reality in Medical Practice: From Spine Surgery to Remote Assistance

Background: While performing surgeries in the OR, surgeons and assistants often need to access several information regarding surgical planning and/or procedures related to the surgery itself, or the accessory equipment to perform certain operations. The accessibility of this information often relies on the physical presence of technical and medical specialists in the OR, which is increasingly difficult due to the number of limitations imposed by the COVID emergency to avoid overcrowded environments or external personnel. Here, we analyze several scenarios where we equipped OR personnel with augmented reality (AR) glasses, allowing a remote specialist to guide OR operations through voice and ad-hoc visuals, superimposed to the field of view of the operator wearing them.

Methods: This study is a preliminary case series of prospective collected data about the use of AR-assistance in spine surgery from January to July 2020. The technology has been used on a cohort of 12 patients affected by degenerative lumbar spine disease with lumbar sciatica co-morbidities. Surgeons and OR specialists were equipped with AR devices, customized with P2P videoconference commercial apps, or customized holographic apps. The devices were tested during surgeries for lumbar arthrodesis in a multicenter experience involving author's Institutions.

Findings: A total number of 12 lumbar arthrodesis have been performed while using the described AR technology, with application spanning from telementoring (3), teaching (2), surgical planning superimposition and interaction with the hologram using a custom application for Microsoft hololens (1). Surgeons wearing the AR goggles reported a positive feedback as for the ergonomy, wearability and comfort during the procedure; being able to visualize a 3D reconstruction during surgery was perceived as a straightforward benefit, allowing to speed-up procedures, thus limiting post-operational complications. The possibility of remotely interacting with a specialist on the glasses was a potent added value during COVID emergency, due to limited access of non-resident personnel in the OR.

Interpretation: By allowing surgeons to overlay digital medical content on actual surroundings, augmented reality surgery can be exploited easily in multiple scenarios by adapting commercially available or custom-made apps to several use cases. The possibility to observe directly the operatory theater through the eyes of the surgeon might be a game-changer, giving the chance to unexperienced surgeons to be virtually at the site of the operation, or allowing a remote experienced operator to guide wisely the unexperienced surgeon during a procedure.

Application of Artificial Intelligence in Medicine: An Overview

Artificial intelligence (AI) is a new technical discipline that uses computer technology to research and develop the theory, method, technique, and application system for the simulation, extension, and expansion of human intelligence. With the assistance of new AI technology, the traditional medical environment has changed a lot. For example, a patient's diagnosis based on radiological, pathological, endoscopic, ultrasonographic, and biochemical examinations has been effectively promoted with a higher accuracy and a lower human workload. The medical treatments during the perioperative period, including the preoperative preparation, surgical period, and postoperative recovery period, have been significantly enhanced with better surgical effects. In addition, AI technology has also played a crucial role in medical drug production, medical management, and medical education, taking them into a new direction. The purpose of this review is to introduce the application of AI in medicine and to provide an outlook of future trends.

Telemedicine-guided forearm emergency decompressive fasciotomy for compartment syndrome

Introduction

We highlight the utility of telemedicine and telementoring for the management of orthopaedic emergencies using a case of forearm compartment syndrome following a penetrating trauma in a northern Inuit community in Nunavik, Quebec, Canada.

Methods & Results

As in many cases of compartment syndrome in rural settings, the patient was at a high risk of developing irreversible complications. A prompt diagnosis followed by an emergency decompressive fasciotomy was warranted. Using telemedicine and telementoring guidance, the diagnosis of compartment syndrome was made, and the patient’s volar compartment was successfully decompressed by a local emergency physician in a timely manner. Subsequently, the patient was able to be safely transferred to a level 1 trauma centre for further surgical management. This included a second-look operative exploration, irrigation and debridement, completion of volar fasciotomy and ulnar nerve decompression. No complications were seen.

Discussion

Our experience highlights two important clinical implications. First, telemedicine can be successfully implemented to facilitate clinical diagnosis of surgical emergencies in the rural setting. Second, telementoring can effectively allow surgeons to guide physicians remotely to perform emergency decompressive fasciotomy, which can help salvage the affected limb and significantly decrease the risk of debilitating complications.

Smart glasses display device for fluoroscopically guided minimally invasive spinal instrumentation surgery: a preliminary study

OBJECTIVE

Most surgeons are forced to turn their heads away from the surgical field to see various intraoperative support monitors. These movements may result in inconvenience to surgeons and lead to technical difficulties and potential errors. Wearable devices that can be attached to smart glasses or any glasses are novel visualization tools providing an alternative screen in front of the user's eyes, allowing surgeons to keep their attention focused on the operative task without taking their eyes off the surgical field. The aim of the present study was to examine the feasibility of using glasses equipped with a wearable display device that transmits display monitor data during fluoroscopically guided minimally invasive spinal instrumentation surgery.

METHODS

In this pilot prospective randomized study, 20 consecutively enrolled patients who underwent single-segment posterior lumbar interbody fusion (PLIF) at L5-S1 performed using the percutaneous pedicle screw technique were randomly divided into two groups, a group for which the surgeon used a wearable display device attached to regular glasses while performing surgery (smart glasses group) and a group for which the surgeon did not use such a device (nonglasses group). Real-time intraoperative fluoroscopic images were wirelessly transmitted to the display device attached to the surgeon's glasses. The number of head turns performed by the surgeon to view the standard fluoroscopic monitor during procedures and the operative time, estimated blood loss, radiation exposure time, screw placement accuracy, and intraoperative complication rate were evaluated for comparison between the two groups.

RESULTS

The number of surgeon head turns to view the fluoroscopic monitor in the smart glasses group was 0.10 ± 0.31 times, which was significantly fewer than the head turns in the nonglasses group (82.4 ± 32.5 times; p < 0.001). The operative and radiation exposure times in the smart glasses group were shorter than those in the nonglasses group (operative time 100.2 ± 10.4 vs 105.5 ± 14.6 minutes, radiation exposure time 38.6 ± 6.6 vs 41.8 ± 16.1 seconds, respectively), although the differences were not significant. Postoperative CT showed one screw perforation in the nonglasses group, and no intraoperative complications were observed in either group.

CONCLUSIONS

This is, to the authors' knowledge, the first report on the feasibility of using this wearable display device attached to glasses for fluoroscopically guided minimally invasive spinal instrumentation surgery. Smart glasses display devices such as this one may be a valid option to facilitate better concentration on operative tasks by improving ergonomic efficiency during surgery.