Systematic review of measurement tools to assess surgeons' intraoperative cognitive workload

Feasibility of Wearable Sensors to Assess Cognitive Load During Clinical Performance: Lessons Learned and Blueprint for Success

INTRODUCTION

Cognitive load (CogL) is increasingly recognized as an important resource underlying operative performance. Current innovations in surgery aim to develop objective performance metrics via physiological monitoring from wearable digital sensors. Surgeons have access to consumer technology that could measure CogL but need guidance regarding device selection and implementation. To realize the benefits of surgical performance improvement these methods must be feasible, incorporating human factors usability and design principles. This paper aims to evaluate the feasibility of using wearable sensors to assess CogL, identify the benefits and challenges of implementing devices, and develop guidance for surgeons planning to implement wearable devices in their research or practice.

METHODS

We examined the feasibility of wearable sensors from a series of empirical studies that measured aspects of clinical performance relating to CogL. Across four studies, 84 participants and five sensors were involved in the following clinical settings: (i) real intraoperative surgery; (ii) simulated laparoscopic surgery; and (iii) medical team performance outside the hospital.

RESULTS

Wearable devices worn on the wrist and chest were found to be comfortable. After a learning curve, electrodermal activity data were easily and reliably collected. Devices using photoplethysmography to determine heart rate variability were significantly limited by movement artifact. There was variable success with electroencephalography devices regarding connectivity, comfort, and usability.

CONCLUSIONS

It is feasible to use wearable sensors across various clinical settings, including surgery. There are some limitations, and their implementation is context and device dependent. To scale sensor use in clinical research, surgeons must embrace human factors principles to optimize wearability, usability, reliability, and data security.

Mental workload evaluation using weighted phase lag index and coherence features extracted from EEG data

Electroencephalogram (EEG) represents an effective, non-invasive technology to study mental workload. However, volume conduction, a common EEG artifact, influences functional connectivity analysis of EEG data. EEG coherence has been used traditionally to investigate functional connectivity between brain areas associated with mental workload, while weighted Phase Lag Index (wPLI) is a measure that improves on coherence by reducing susceptibility to volume conduction, a common EEG artifact. The goal of this study was to compare two methods of functional connectivity analysis, wPLI and coherence, in the context of mental workload evaluation. The study involved model development for mental workload domains and comparing their performance using coherence-based features, wPLI-based features, and a combination of both. Generalized linear mixed-effects model (GLMM) with the least absolute shrinkage and selection operator (LASSO) feature selection method was used for model development. Results indicated that the model developed using a combination of both feature types demonstrated improved predictive performance across all mental workload domains, compared to models that used each feature type individually. The R2 values were 0.82 for perceived task complexity, 0.71 for distraction, 0.91 for mental demand, 0.85 for physical demand, 0.74 for situational stress, and 0.74 for temporal demand. Furthermore, task complexity and functional connectivity patterns in different brain areas were identified as significant contributors to perceived mental workload (p-value<0.05). Findings showed the potential of using EEG data for mental workload evaluation which suggests that combination of coherence and wPLI can improve the accuracy of mental workload domains prediction. Future research should aim to validate these results on larger, diverse datasets to confirm their generalizability and refine the predictive models.

A multi-institutional feasibility lead-in trial of lymphatic mapping with SPECT-CT for evaluating contralateral disease in lateralized oropharynx cancer using 99m-technetium sulfur colloid

BACKGROUND

Lymphatic mapping with SPECT-CT has been demonstrated to accurately define lymphatic drainage patterns in oropharyngeal cancer but there has yet to be a study demonstrating its feasibility across multiple institutions.

METHODS

Twelve adult patients with lateralized oropharyngeal carcinoma (T1-T3) who were planned for definitive or adjuvant radiotherapy without contralateral nodal disease underwent injection of 99-m technetium sulfur colloid followed by static planar lymphoscintigraphy to verify tracer migration, and SPECT-CT acquired at 30 ± 15 min (optional) and 3 h (±1 h) (mandatory time-point).

RESULTS

All 12 patients completed the study with 7/12 patients having the injections performed under local anesthetic and 5 patients requiring general anesthetic. There were no tracer migration failures and there were no serious adverse events or complications encountered. Four out of 12 patients (33%) showed contralateral drainage patterns.

CONCLUSIONS

Lymphatic mapping with SPECT-CT of lateralized oropharyngeal squamous cell carcinoma can be performed safely across multiple institutions.

Estimating Cognitive Workload Using Task-Related Pupillary Responses in Simulated Drilling in Cochlear Implantation

OBJECTIVES

Training of temporal bone drilling requires more than mastering technical skills with the drill. Skills such as visual imagery, bimanual dexterity, and stress management need to be mastered along with precise knowledge of anatomy. In otorhinolaryngology, these psychomotor skills underlie performance in the drilling of the temporal bone for access to the inner ear in cochlear implant surgery. However, little is known about how psychomotor skills and workload management impact the practitioners' continuous and overall performance.

METHODS

To understand how the practitioner's workload and performance unfolds over time, we examine task-evoked pupillary responses (TEPR) of 22 medical students who performed transmastoid-posterior tympanotomy (TMPT) and removal of the bony overhang of the round window niche in a 3D-printed model of the temporal bone. We investigate how students' TEPR metrics (Average Pupil Size [APS], Index of Pupil Activity [IPA], and Low/High Index of Pupillary Activity [LHIPA]) and time spent in drilling phases correspond to the performance in key drilling phases.

RESULTS

All TEPR measures revealed significant differences between key drilling phases that corresponded to the anticipated workload. Enlarging the facial recess lasted significantly longer than other phases. IPA captured significant increase of workload in thinning of the posterior canal wall, while APS revealed increased workload during the drilling of the bony overhang.

CONCLUSION

Our findings contribute to the contemporary competency-based medical residency programs where objective and continuous monitoring of participants' progress allows to track progress in expertise acquisition. Laryngoscope, 2024.

Factors prolonging the operative time for transumbilical laparoscopic-assisted appendectomy in pediatric patients: a retrospective single-center study

PURPOSE

Transumbilical laparoscopic-assisted appendectomy (TULAA) is one of the first endoscopic surgeries performed by trainee pediatric surgeons. While the operative time is generally shorter than for conventional laparoscopic appendectomy, the indications for this procedure are unclear and many unknown factors can prolong the operative time. We conducted this study to identify the factors that may prolong the operative time for TULAA.

METHODS

This retrospective, single-center study was conducted between 2015 and 2023. We performed multivariate analysis to identify the factors associated with prolonged operative time by analyzing TULAA procedures performed by trainees.

RESULTS

The study included 243 patients. The median operative time was 84 min (interquartile range, 69-114 min). Multivariate analysis revealed that an increased body mass index, elevated C-reactive protein level, a history of conservative treatment for acute appendicitis, and appendix perforation, for the patient; < 6 years' experience since graduation for the operating surgeon; and lack of board certification as a supervisor from the Japanese Society of Pediatric Surgeons for the attending surgeon were independent risk factors for prolonging the operative time.

CONCLUSION

Having an attending surgeon with board certification as a supervisor by the Japanese Society of Pediatric Surgeons contributes to reducing the operative time required for TULAA.

3D printing in anatomical lung segmentectomies: A randomized pilot trial

Objective

This pilot study evaluated the impact of using a 3D printed model of the patient's bronchovascular lung anatomy on the mental workload and fatigue of surgeons during full thoracoscopic segmentectomy.

Design

We performed a feasibility pilot study of a prospective randomized controlled trial with 2 parallel arms. All included patients underwent digital 3D visual reconstruction of their bronchovascular anatomy and were randomized into the following two groups: Digital arm (only a virtual 3D model was available) and Digital + Object arm (both virtual and printed 3D models were available). The primary end-point was the surgeons' mental workload measured using the National Aeronautics and Space Administration-Task Load Index (NASA-TLX) score.

Setting

Between October 28, 2020 and October 05, 2021, we successively investigated all anatomic segmentectomies performed via thoracoscopy in the Thoracic Department of the Montsouris Mutualiste Institute, except for S6 segmentectomies and S4+5 left bi-segmentectomies.

Participants

We assessed 102 patients for anatomical segmentectomy. Among the, 40 were randomly assigned, and 34 were deemed analysable, with 17 patients included in each arm.

Results

Comparison of the two groups, each comprising 17 patients, revealed no statistically significant difference in primary or secondary end-points. The consultation of the visual digital model was significantly less frequent when a 3D printed model was available (6 versus 54 consultations, p = 0.001). Notably, both arms exhibited high NASA-TLX scores, particularly in terms of mental demand, temporal demand, and effort scores.

Conclusion

In our pilot study, 3D printed models and digital 3D reconstructions for pre-operative planning had an equivalent effect on thoracoscopic anatomic segmentectomy for experienced surgeons. The originality of this study lies in its focus on the impact of 3D printing of bronchovascular anatomy on surgeons, rather than solely on the surgical procedure.

Surgical Sabermetrics: A Scoping Review of Technology-enhanced Assessment of Nontechnical Skills in the Operating Room

OBJECTIVE

To evaluate the current evidence for surgical sabermetrics: digital methods of assessing surgical nontechnical skills and investigate the implications for enhancing surgical performance.

BACKGROUND

Surgeons need high-quality, objective, and timely feedback to optimize performance and patient safety. Digital tools to assess nontechnical skills have the potential to reduce human bias and aid scalability. However, we do not fully understand which of the myriad of digital metrics of performance assessment have efficacy for surgeons.

METHODS

A systematic review was conducted by searching PubMed, EMBASE, CINAHL, and PSYCINFO databases following PRISMA-ScR guidelines. MeSH terms and keywords included "Assessment," "Surgeons," and "Technology". Eligible studies included a digital assessment of nontechnical skills for surgeons, residents, and/or medical students within an operative context.

RESULTS

From 19,229 articles screened, 81 articles met the inclusion criteria. The studies varied in surgical specialties, settings, and outcome measurements. A total of 122 distinct objective, digital metrics were utilized. Studies digitally measured at least 1 category of surgical nontechnical skill using a single (n=54) or multiple objective measures (n=27). The majority of studies utilized simulation (n=48) over live operative settings (n=32). Surgical Sabermetrics has been demonstrated to be beneficial in measuring cognitive load (n=57), situation awareness (n=24), communication (n=3), teamwork (n=13), and leadership (n=2). No studies measured intraoperative decision-making.

CONCLUSIONS

The literature detailing the intersection between surgical data science and operative nontechnical skills is diverse and growing rapidly. Surgical Sabermetrics may provide a promising modifiable technique to achieve desirable outcomes for both the surgeon and the patient. This study identifies a diverse array of measurements possible with sensor devices and highlights research gaps, including the need for objective assessment of decision-making. Future studies may advance the integration of physiological sensors to provide a holistic assessment of surgical performance.

Revision Total Joint Arthroplasty Places a Disproportionate Burden on Surgeons: A Comparison Using the National Aeronautics and Space Administration Task Load Index (NASA TLX)

BACKGROUND

Perceived surgeon workload of performing primary and revision total hip arthroplasty (THA) and total knee arthroplasty (TKA) is challenging to quantify. The National Aeronautics and Space Administration Task Load Index (NASA TLX) survey was developed to quantify experiences following aviation and has been applied to healthcare fields. Our purposes were to 1) quantify the workload endured by surgeons who are performing primary and revision TKA and THA and 2) compare these values to their Center for Medicare & Medicaid Services (CMS) reimbursement.

METHODS

A prospective cohort of 5 fellowship-trained adult reconstruction surgeons completed NASA TLX surveys following primary and revision TKA/THA cases. A total of 122 surveys consisting of 70 TKA (48 primaries and 22 revisions) and 55 THA surveys (38 primaries and 17 revisions) were completed. Patient demographics and surgical variables were recorded. Final NASA TLX workloads were compared to 2021 CMS work relative value units.

RESULTS

Compared to primary TKA, revision TKA had 176% increased intraoperative workload (P < .001), 233% increased mental burden (P < .001), and 150% increased physical burden (P < .001). Compared to primary THA, revision THA had 106% increased intraoperative workload (P < .001), 96% increased mental burden (P < .001), and 91% increased physical burden (P < .001). Operative time was higher in revision versus primary TKA (118 versus 84.5 minutes, P = .05) and THA (150 versus 115 minutes, P = .001). Based upon 2021 CMS data, revision TKA and THA would need to be compensated by an additional 36% and 12.3%, respectively, to parallel intraoperative efforts.

CONCLUSIONS

Revision hip and knee arthroplasty places a major mental and physical workload upon surgeons and is disproportionately compensated by CMS.

Factors contributing to prolonged operative time for laparoscopic cholecystectomy performed by trainee surgeons: a retrospective single-center study

PURPOSE

Laparoscopic cholecystectomy for a benign disease is often the initial endoscopic surgery performed by trainee surgeons. However, a lack of surgical experience is associated with prolonged operative times, which may increase the risk of postoperative complications and poor outcomes. This study aimed to identify the factors associated with prolonged operative times for laparoscopic cholecystectomy performed by inexperienced surgeons.

METHODS

This retrospective single-center study was conducted between January 2018 and December 2023. We performed a multivariate analysis to identify the factors associated with prolonged operative time by analyzing elective cases of laparoscopic cholecystectomy performed by surgeons with limited experience.

RESULTS

The study included 323 patients, subjected to a median operative time of 89 min. Multivariate analysis identified that patient characteristics such as male sex, increased body mass index, and a history of conservative treatment for cholecystitis, as well as operating surgeon's post-graduation years (< 4 years), and an attending surgeon without endoscopic surgical skill certification from the Japan Society of Endoscopic Surgery, were independent risk factors for a prolonged operative time.

CONCLUSION

Our findings suggest that endoscopic surgical skill-certified attending surgeons have excellent coaching skills and mitigate the operative time for elective cholecystectomy.

Pupil Response in Visual Tracking Tasks: The Impacts of Task Load, Familiarity, and Gaze Position

Pupil size is a significant biosignal for human behavior monitoring and can reveal much underlying information. This study explored the effects of task load, task familiarity, and gaze position on pupil response during learning a visual tracking task. We hypothesized that pupil size would increase with task load, up to a certain level before decreasing, decrease with task familiarity, and increase more when focusing on areas preceding the target than other areas. Fifteen participants were recruited for an arrow tracking learning task with incremental task load. Pupil size data were collected using a Tobii Pro Nano eye tracker. A 2 × 3 × 5 three-way factorial repeated measures ANOVA was conducted using R (version 4.2.1) to evaluate the main and interactive effects of key variables on adjusted pupil size. The association between individuals' cognitive load, assessed by NASA-TLX, and pupil size was further analyzed using a linear mixed-effect model. We found that task repetition resulted in a reduction in pupil size; however, this effect was found to diminish as the task load increased. The main effect of task load approached statistical significance, but different trends were observed in trial 1 and trial 2. No significant difference in pupil size was detected among the three gaze positions. The relationship between pupil size and cognitive load overall followed an inverted U curve. Our study showed how pupil size changes as a function of task load, task familiarity, and gaze scanning. This finding provides sensory evidence that could improve educational outcomes.

Operating under the influence: the effect of alcohol on operative performance using a virtual robotic training platform-an experimental comparative cohort study

An elevated percentage of medical personnel reports using alcohol to relieve stress. Levels of alcohol addiction are almost double that of the general population. Robotic surgery is becoming more widespread. The purpose of this study is to evaluate the effects of alcohol ingestion on performance of a standardized curriculum using a robotic training platform. Surgeons and surgical trainees were recruited. Candidates performed 4 standardized exercises (Vitruvian Operation (VO), Stacking Challenge (SC), Ring Tower (RT), Suture Sponge (SS)) at 0.0 blood alcohol concentration (BAC), followed by testing in the elimination phase at a target BAC of 0.8‰. Learning effects were minimised through prior training. A total of 20 participants were recruited. Scores for RT and SS exercises were significantly worse under the influence of alcohol [instruments out of view (SS (z = 2.012; p = 0.044), RT (z score 1.940, p = 0.049)), drops (SS (z = 3.250; p = 0.001)), instrument collisions (SS (z = 2.460; p = 0.014)), missed targets (SS (z = 2.907; p = 0.004)]. None of the scores improved with alcohol consumption, and there were measurable deleterious effects on the compound indicators risk affinity and tissue handling. Despite the potential mitigating features of robotic surgery including tremor filtration, motion scaling, and improved three-dimensional visualization, alcohol consumption was associated with a significant increase in risk affinity and rough tissue handling, along with a deterioration of performance in select virtual robotic tasks. In the interest of patient safety, alcohol should not be consumed prior to performing robotic surgery and sufficiently long intervals between alcohol ingestion and surgical performance are mandatory.

Cognitive ergonomics and robotic surgery

Cognitive ergonomics refer to mental resources and is associated with memory, sensory motor response, and perception. Cognitive workload (CWL) involves use of working memory (mental strain and effort) to complete a task. The three types of cognitive loads have been divided into intrinsic (dependent on complexity and expertise), extraneous (the presentation of tasks) and germane (the learning process) components. The effect of robotic surgery on CWL is complex because the postural, visualisation, and manipulation ergonomic benefits for the surgeon may be offset by the disadvantages associated with team separation and reduced situation awareness. Physical fatigue and workflow disruptions have a negative impact on CWL. Intraoperative CWL can be measured subjectively post hoc with the use of self-reported instruments or objectively with real-time physiological response metrics. Cognitive training can play a crucial role in the process of skill acquisition during the three stages of motor learning: from cognitive to integrative and then to autonomous. Mentorship, technical practice and watching videos are the most common traditional cognitive training methods in surgery. Cognitive training can also occur with computer-based cognitive simulation, mental rehearsal, and cognitive task analysis. Assessment of cognitive skills may offer a more effective way to differentiate robotic expertise level than automated performance (tool-based) metrics.

Comparison of cognitive workload and surgical outcomes between a three-dimensional and conventional microscope macular hole surgery

BACKGROUND

Performing a surgical task subjects the surgeon to multitudinal stressors, especially with the newer 3D technology. The quantum of cognitive workload using this modern surgical system in comparison to the Conventional microscope system remains unexplored. We evaluate the surgeon's cognitive workload and the surgical outcomes of macular hole(MH) surgery performed on a 3D versus a Conventional microscope operating system.

METHODS

50 eyes of 50 patients with MH undergoing surgery using the 3D or Conventional microscope visualization system. Cognitive workload assessment was done by real-time tools(Surgeons' heart rate [HR] and oxygen saturation[SPO2]) and self-report tool(Surgery Task Load Index[SURG-TLX] questionnaire) of three Vitreoretinal surgeons. Based on the SURG-TLX questionnaire, an assessment of the workload was performed.

RESULTS

Of the 50 eyes, 30 eyes and 20 eyes underwent surgery with the Conventional microscope and the 3D system, respectively. No difference was noted in the MH basal-diameter(p = 0.128), total surgical-duration(p = 0.299), internal-limiting membrane(ILM) peel time(p = 0.682), and the final visual acuity (VA; p = 0.515) between the two groups. Both groups showed significant improvement in VA(p < 0.001) with a 90% closure rate at one-month post-surgery. Cognitive workload comparison, the intraoperative HR(p = 0.024), total workload score(P = 0.005), and temporal-demand dimension(p = 0.004) were significantly more in Conventional microscope group as compared to 3D group. In both the groups, the HR increased significantly from the baseline while performing ILM peeling and at the end.

CONCLUSION

The surgeon's cognitive workload is markedly reduced while performing macular hole surgery with a 3D viewing system. Moreover, duration of surgery including ILM peel time, MH closure rates, and visual outcomes remains unaffected irrespective of the operating microscope system.

Granular estimation of user cognitive workload using multi-modal physiological sensors

Mental workload (MWL) is a crucial area of study due to its significant influence on task performance and potential for significant operator error. However, measuring MWL presents challenges, as it is a multi-dimensional construct. Previous research on MWL models has focused on differentiating between two to three levels. Nonetheless, tasks can vary widely in their complexity, and little is known about how subtle variations in task difficulty influence workload indicators. To address this, we conducted an experiment inducing MWL in up to 5 levels, hypothesizing that our multi-modal metrics would be able to distinguish between each MWL stage. We measured the induced workload using task performance, subjective assessment, and physiological metrics. Our simulated task was designed to induce diverse MWL degrees, including five different math and three different verbal tiers. Our findings indicate that all investigated metrics successfully differentiated between various MWL levels induced by different tiers of math problems. Notably, performance metrics emerged as the most effective assessment, being the only metric capable of distinguishing all the levels. Some limitations were observed in the granularity of subjective and physiological metrics. Specifically, the subjective overall mental workload couldn't distinguish lower levels of workload, while all physiological metrics could detect a shift from lower to higher levels, but did not distinguish between workload tiers at the higher or lower ends of the scale (e.g., between the easy and the easy-medium tiers). Despite these limitations, each pair of levels was effectively differentiated by one or more metrics. This suggests a promising avenue for future research, exploring the integration or combination of multiple metrics. The findings suggest that subtle differences in workload levels may be distinguishable using combinations of subjective and physiological metrics.

Use of eye tracking in medical education

Eye tracking has become increasingly applied in medical education research for studying the cognitive processes that occur during the performance of a task, such as image interpretation and surgical skills development. However, analysis and interpretation of the large amount of data obtained by eye tracking can be confusing. In this article, our intention is to clarify the analysis and interpretation of the data obtained from eye tracking. Understanding the relationship between eye tracking metrics (such as gaze, pupil and blink rate) and cognitive processes (such as visual attention, perception, memory and cognitive workload) is essential. The importance of calibration and how the limitations of eye tracking can be overcome is also highlighted.

Collaborative robots can augment human cognition in regret-sensitive tasks

Despite theoretical benefits of collaborative robots, disappointing outcomes are well documented by clinical studies, spanning rehabilitation, prostheses, and surgery. Cognitive load theory provides a possible explanation for why humans in the real world are not realizing the benefits of collaborative robots: high cognitive loads may be impeding human performance. Measuring cognitive availability using an electrocardiogram, we ask 25 participants to complete a virtual-reality task alongside an invisible agent that determines optimal performance by iteratively updating the Bellman equation. Three robots assist by providing environmental information relevant to task performance. By enabling the robots to act more autonomously-managing more of their own behavior with fewer instructions from the human-here we show that robots can augment participants' cognitive availability and decision-making. The way in which robots describe and achieve their objective can improve the human's cognitive ability to reason about the task and contribute to human-robot collaboration outcomes. Augmenting human cognition provides a path to improve the efficacy of collaborative robots. By demonstrating how robots can improve human cognition, this work paves the way for improving the cognitive capabilities of first responders, manufacturing workers, surgeons, and other future users of collaborative autonomy systems.

Ergonomics in Urology: Current Landscape and Future Directions

Optimal ergonomics are essential to improving clinical performance and longevity among urologists, as poor ergonomics can contribute to work-related injury and physician burnout. While a majority of urologists experience muscular injury throughout their career, women and trainees are disproportionately affected. These disparities are exacerbated by the lack of formal ergonomics education within urologic training programs. This review provides an overview of practical approaches to optimize ergonomics across working environments for urologists and trainees. We highlight intraoperative techniques and novel devices which have been shown to reduce work-related injury, and we identify knowledge gaps to guide future areas of ergonomic research.

Development of performance and learning rate evaluation models in robot-assisted surgery using electroencephalography and eye-tracking

The existing performance evaluation methods in robot-assisted surgery (RAS) are mainly subjective, costly, and affected by shortcomings such as the inconsistency of results and dependency on the raters' opinions. The aim of this study was to develop models for an objective evaluation of performance and rate of learning RAS skills while practicing surgical simulator tasks. The electroencephalogram (EEG) and eye-tracking data were recorded from 26 subjects while performing Tubes, Suture Sponge, and Dots and Needles tasks. Performance scores were generated by the simulator program. The functional brain networks were extracted using EEG data and coherence analysis. Then these networks, along with community detection analysis, facilitated the extraction of average search information and average temporal flexibility features at 21 Brodmann areas (BA) and four band frequencies. Twelve eye-tracking features were extracted and used to develop linear random intercept models for performance evaluation and multivariate linear regression models for the evaluation of the learning rate. Results showed that subject-wise standardization of features improved the R2 of the models. Average pupil diameter and rate of saccade were associated with performance in the Tubes task (multivariate analysis; p-value = 0.01 and p-value = 0.04, respectively). Entropy of pupil diameter was associated with performance in Dots and Needles task (multivariate analysis; p-value = 0.01). Average temporal flexibility and search information in several BAs and band frequencies were associated with performance and rate of learning. The models may be used to objectify performance and learning rate evaluation in RAS once validated with a broader sample size and tasks.

Simulated skill complexity and perceived cognitive load during preclinical dental training

INTRODUCTION

Cognitive Load theory (CLT) focuses on the information processing aspect of learning and how the working memory handles the mental effort associated with new task. The aim of this study is to investigate the association between the perceived cognitive load and performance amongst dental students during preclinical simulation training at various levels of procedural task complexity. Additionally, some cognitive load-modifying factors were examined.

MATERIALS AND METHODS

This cross-sectional study evaluated the perceived cognitive load amongst second-year dental students (n = 34), using the validated National Aeronautics and Space Administration's Task Load Index (NASA TLX index) after training on four dental tasks at two levels of complexity, in addition to structured online anonymous questionnaire about demographics, feedback and performance. The NASA TLX raw scores and the weighted global score were calculated for each exercise. Descriptive statistics and Pearson's correlations between performance and the corresponding NASA TLX-weighted score were calculated. Mean differences in the perceived cognitive load across the exercise levels were assessed using RM-ANOVA with Bonferroni corrections at p < .05.

RESULTS

Reduced performance was significantly associated with higher cognitive load particularly in high complexity dental task (class II-mirror vision). Simulated exercise complexity significantly influenced the students' perceived mental demand, physical demand and temporal demand; all were significantly higher for class II- mirror vision task than for direct vision tasks. The majority of participants (82.1%) preferred detailed feedback from instructors, and more than half of the participants (60.7%) preferred continuous feedback throughout the training session.

CONCLUSION

Complex dental tasks are associated with higher cognitive load in novice dental students during preclinical training. The NASA TLX index is a useful instrument to explore the level of perceived cognitive load associated with performance of simulated complex dental skills. Cognitive load theory is relevant to simulation-based dental education to improve the preclinical instructional efficiency and to enhance students learning.

Spinal Navigation for Lateral Instrumentation of the Thoracolumbar Spine

BACKGROUND AND OBJECTIVES

Three-dimensional imaging-based navigation in spine surgery is mostly applied for pedicle screw placement. However, its potential reaches beyond. In this study, we analyzed the incorporation of spinal navigation for lateral instrumentation of the thoracolumbar spine in clinical routine at a high-volume spine center.

METHODS

Patients scheduled for lateral instrumentation were prospectively enrolled. A reference array was attached to the pelvis, and a computed tomography scan was acquired intraoperatively. A control computed tomography scan was routinely performed after final cage placement, replacing conventional 2-dimensional X-ray imaging.

RESULTS

145 cases were enrolled from April to October 2021 with a median of 1 (1-4) level being instrumented. Indications for surgery were trauma (35.9%), spinal infection (31.7%), primary and secondary tumors of the spine (17.2%), and degenerative spine disease (15.2%). The duration of surgery after the first scan was 98 ± 41 (20-342) minutes. In total, 190 cages were implanted (94 expandable cages for vertebral body replacement (49.5%) and 96 cages for interbody fusion [50.5%]). Navigation was successfully performed in 139 cases (95.9%). The intraoperative mental load was rated on a scale from 0 to 150 (maximal effort) by the surgeons, showing a moderate effort (median 30 [10-120]).

CONCLUSION

Three-dimensional imaging-based spinal navigation can easily be incorporated in clinical routine and serves as a reliable tool to achieve precise implant placement in lateral instrumentation of the spine. It helps to minimize radiation exposure to the surgical staff.

Demands of surgical teams in robotic-assisted surgery: An assessment of intraoperative workload within different surgical specialties

BACKGROUND

Current approaches to assessing workload in robotic-assisted surgery (RAS) focus on surgeons and lack real-world data. Understanding how workload varies by role and specialty aids in identifying effective ways to optimize workload.

METHODS

SURG-TLX surveys with six domains of workload were administered to surgical staff at three sites. Staff reported workload perceptions for each domain on a 20-point Likert scale, and aggregate scores were determined per participant.

RESULTS

188 questionnaires were obtained across 90 RAS procedures. Significantly higher aggregate scores were reported for gynecology (Mdn ​= ​30.00) (p ​= ​0.034) and urology (Mdn ​= ​36.50) (p ​= ​0.006) than for general (Mdn ​= ​25.00). Surgeons reported significantly higher scores for task complexity (Mdn ​= ​8.00) than both technicians (Mdn ​= ​5.00) (p ​= ​0.007), and nurses (Mdn ​= ​5.00).

CONCLUSIONS

Staff reported significantly higher workload during urology and gynecology procedures, and experienced significant differences in domain workload by role and specialty, elucidating the need for tailored workload interventions.

Fundamentals of Microsurgery: A Novel Simulation Curriculum Based on Validated Laparoscopic Education Approaches

BACKGROUND

 Microsurgical techniques have a steep learning curve. We adapted validated surgical approaches to develop a novel, competency-based microsurgical simulation curriculum called Fundamentals of Microsurgery (FMS). The purpose of this study is to present our experience with FMS and quantify the effect of the curriculum on resident performance in the operating room.

METHODS

 Trainees underwent the FMS curriculum requiring task progression: (1) rubber band transfer, (2) coupler tine grasping, (3) glove laceration repair, (4) synthetic vessel anastomosis, and (5) vessel anastomosis in a deep cavity. Resident anastomoses were also evaluated in the operative room with the Stanford Microsurgery and Resident Training (SMaRT) tool to evaluate technical performance. The National Aeronautics and Space Administration Task Load Index (NASA-TLX) and Short-Form Spielberger State-Trait Anxiety Inventory (STAI-6) quantified learner anxiety and workload.

RESULTS

 A total of 62 anastomoses were performed by residents in the operating room during patient care. Higher FMS task completion showed an increased mean SMaRT score (p = 0.05), and a lower mean STAI-6 score (performance anxiety) (p = 0.03). Regression analysis demonstrated residents with higher SMaRT score had lower NASA-TLX score (mental workload) (p < 0.01) and STAI-6 scores (p < 0.01).

CONCLUSION

 A novel microsurgical simulation program FMS was implemented. We found progression of trainees through the program translated to better technique (higher SMaRT scores) in the operating room and lower performance anxiety on STAI-6 surveys. This suggests that the FMS curriculum improves proficiency in basic microsurgical skills, reduces trainee mental workload, anxiety, and improves intraoperative clinical proficiency.

Crew Autonomy During Simulated Medical Event Management on Long Duration Space Exploration Missions

OBJECTIVE

Our primary aim was to investigate crew performance during medical emergencies with and without ground-support from a flight surgeon located at mission control.

BACKGROUND

There are gaps in knowledge regarding the potential for unanticipated in-flight medical events to affect crew health and capacity, and potentially compromise mission success. Additionally, ground support may be impaired or periodically absent during long duration missions.

METHOD

We reviewed video recordings of 16 three-person flight crews each managing four unique medical events in a fully immersive spacecraft simulator. Crews were randomized to two conditions: with and without telemedical flight surgeon (FS) support. We assessed differences in technical performance, behavioral skills, and cognitive load between groups.

RESULTS

Crews with FS support performed better clinically, were rated higher on technical skills, and completed more clinical tasks from the medical checklists than crews without FS support. Crews with FS support also had better behavioral/non-technical skills (information exchange) and reported significantly lower cognitive demand during the medical event scenarios on the NASA-TLX scale, particularly in mental demand and temporal demand. There was no significant difference between groups in time to treat or in objective measures of cognitive demand derived from heart rate variability and electroencephalography.

CONCLUSION

Medical checklists are necessary but not sufficient to support high levels of autonomous crew performance in the absence of real-time flight surgeon support.

APPLICATION

Potential applications of this research include developing ground-based and in-flight training countermeasures; informing policy regarding autonomous spaceflight, and design of autonomous clinical decision support systems.

Human Factors Approach to Assess Physician Workload in Elective Plastic Surgery Breast Procedures

Background

Human factors research involves the study of work system interactions, physician workload, cognitive effort, and performance. This pilot study incorporated a human factor approach and other surgery-based metrics to assess cognitive workload among plastic surgeons during elective plastic surgery breast procedures.

Methods

In this prospective study of plastic surgery breast procedures over a 3-month period, surgeon and patient demographics and procedural details were collected. The lead surgeon assessed each procedure using a validated workload questionnaire (National Aeronautics and Space Administration Task Load Index [NASA-TLX]) that included 6 subscales (ie, mental, physical, temporal demand, performance, effort, and frustration), a question on distraction, and their expectation of procedural difficulty.

Results

Fifty-seven cases were included in this study. Surgical duration had a positive correlation with increased mental demand (P < .001), physical demand (P < .001), and degree of distractions (P < .001). Free flap reconstruction, breast reduction, and transgender mastectomy had the highest average mental, physical demands, and perceived effort. Bilateral cases had significantly higher workload than unilateral ones (P = .002). NASA-TLX scores between immediate and delayed reconstructions were comparable, but delayed cases had higher degree of distractions (P = .04). There was a strong correlation between degree of distractions and increased mental workload (R = 0.68; P < .001), increased physical demand (P = 0.61; P < .001), and increased temporal demand (R = 0.78; P < .001). More difficult procedures were associated with greater procedural duration than those rated as difficult as expected or less difficult than expected (P = .02).

Conclusions

These preliminary data demonstrated multiple factors that may influence and govern perceived physician workload and may provide insight for targeted quality improvement to plan procedures safely and effectively.

Identifying the response process validity of clinical vignette-type multiple choice questions: An eye-tracking study

INTRODUCTION

Clinical vignette-type multiple choice questions (CV-MCQs) are widely used in assessment and identifying the response process validity (RPV) of questions with low and high integration of knowledge is essential. Answering CV-MCQs of different levels of knowledge application and integration can be understood from a cognitive workload perspective and this can be identified by using eye-tracking. The aim of the pilot study was to identify the cognitive workload and RPV of CV-MCQs of different levels of knowledge application and integration by the use eye-tracking.

METHODS

Fourteen fourth-year medical students answered a test with 40 CV-MCQs, which were equally divided into low-level and high-level complexity (knowledge application and integration). Cognitive workload was measured using screen-based eye tracking, with the number of fixations and revisitations for each area of interest.

RESULTS

We found a higher cognitive workload for high-level complexity (M = 121.74) compared with lower-level complexity questions (M = 51.94) and also for participants who answered questions incorrectly (M = 94.31) compared with correctly (M = 79.36).

CONCLUSION

Eye-tracking has the potential to become a useful and practical approach for helping to identify the RPV of CV-MCQs. This approach can be used for improving the design and development of CV-MCQs, and to provide feedback to inform teaching and learning.[Box: see text].

Emerging Applications for Computer Vision and Artificial Intelligence in Management of the Cardiovascular Patient

Artificial intelligence and telemedicine promise to reshape patient care to an unprecedented extent, leading to a safer and more sustainable work environment and improved patient care. In this article, we summarize how these emerging technologies can be used in the care of cardiovascular patients in such ways as fall detection and prevention, virtual nursing, remote case support, automation of instrument counts in the operating room, and efficiency optimization in the cardiovascular suite.

Cognitive Ergonomics: A Review of Interventions for Outpatient Practice

Doctoring is difficult mental work, involving many cognitively demanding processes such as diagnosing, decision-making, parallel processing, communicating, and managing the emotions of others. According to cognitive load theory (CLT), working memory is a limited cognitive resource that can support a finite amount of cognitive load. While the intrinsic cognitive load is the innate load associated with a task, the extraneous load is generated by inefficiency or suboptimal work conditions. Causes of extraneous cognitive load in healthcare include inefficiency, distractions, interruptions, multitasking, stress, poor communication, conflict, and incivility. High levels of cognitive load are associated with impaired function and an increased risk of burnout among physicians. Cognitive ergonomics is the branch of human factors and ergonomics (HFE) focused on supporting the cognitive processes of individuals within a system. In health care, where the cognitive burden on physicians is high, cognitive ergonomics can establish practices and systems that decrease extraneous cognitive load and support pertinent cognitive processes. In this review, we present cognitive ergonomics as a useful framework for conceptualizing an oft-overlooked dimension of labor and apply theory to practice by summarizing evidence-based cognitive ergonomics interventions for outpatient care settings. Our proposed interventions are structured within four general recommendations: 1. minimize distractions, interruptions, and multitasking; 2. optimize the use of the electronic health record (EHR); 3. optimize the use of health information systems (HIS); and 4. support good communication and teamwork. Best practices in cognitive ergonomics can benefit patients, minimize practice inefficiency, and support physician career longevity.

Robotic-assisted versus laparoscopic bowel anastomoses: randomized crossover in vivo experimental study

BACKGROUND

Initial learning curves are potentially shorter in robotic-assisted surgery (RAS) than in conventional laparoscopic surgery (LS). There is little evidence to support this claim. Furthermore, there is limited evidence how skills from LS transfer to RAS.

METHODS

A randomized controlled, assessor blinded crossover study to compare how RAS naïve surgeons (n = 40) performed linear-stapled side-to-side bowel anastomoses in an in vivo porcine model with LS and RAS. Technique was rated using the validated anastomosis objective structured assessment of skills (A-OSATS) score and the conventional OSATS score. Skill transfer from LS to RAS was measured by comparing the RAS performance of LS novices and LS experienced surgeons. Mental and physical workload was measured with the NASA-task load index (NASA-Tlx) and the Borg-scale.

OUTCOMES

In the overall cohort, there were no differences between RAS and LS for surgical performance (A-OSATS, time, OSATS). Surgeons that were naïve in both LS and RAS had significantly higher A-OSATS scores in RAS (Mean (Standard deviation (SD)): LS: 48.0 ± 12.1; RAS: 52.0 ± 7.5); p = 0.044) mainly deriving from better bowel positioning (LS: 8.7 ± 1.4; RAS: 9.3 ± 1.0; p = 0.045) and closure of enterotomy (LS: 12.8 ± 5.5; RAS: 15.6 ± 4.7; p = 0.010). There was no statistically significant difference in how LS novices and LS experienced surgeons performed in RAS [Mean (SD): novices: 48.9 ± 9.0; experienced surgeons: 55.9 ± 11.0; p = 0.540]. Mental and physical demand was significantly higher after LS.

CONCLUSION

The initial performance was improved for RAS versus LS for linear stapled bowel anastomosis, whereas workload was higher for LS. There was limited transfer of skills from LS to RAS.

Unpacking the Broad Landscape of Intraoperative Stressors for Clinical Personnel: A Mixed-Methods Systematic Review

Purpose

The main goals of this mixed-methods systematic review are to identify what types of intraoperative stressors for operating room personnel have been reported in collected studies and examine the characteristics of each intraoperative stressor.

Methods

With a systematic literature search, we retrieved empirical studies examining intraoperative stress published between 2010 and 2020. To synthesize findings, we applied two approaches. First, a textual narrative synthesis was employed to summarize key study information of the selected studies by focusing on surgical platforms and study participants. Second, a thematic synthesis was employed to identify and characterize intraoperative stressors and their subtypes.

Results

Ninety-four studies were included in the review. Regarding the surgical platforms, the selected studies mainly focused on minimally invasive surgery and few studies examined issues around robotic surgery. Most studies examined intra-operative stress from surgeons' perspectives but rarely considered other clinical personnel such as nurses and anesthetists. Among seven identified stressors, technical factors were the most frequently examined followed by individual, operating room environmental, interpersonal, temporal, patient, and organizational factors.

Conclusion

By presenting stressors as multifaceted elements affecting collaboration and interaction between multidisciplinary team members in the operating room, we discuss the potential interactions between stressors which should be further investigated to build a safe and efficient environment for operating room personnel.

Multimodal Approach to Assess a Virtual Reality-based Surgical Training Platform

Virtual reality (VR) can bring numerous benefits to the learning process. Combining a VR environment with physiological sensors can be beneficial in skill assessment. We aim to investigate trainees' physiological (ECG) and behavioral differences during the virtual reality-based surgical training environment. Our finding showed a significant association between the VR-Score and all participants' total NASA-TLX workload score. The extent of the NASA-TLX workload score was negatively correlated with VR-Score (R2 =0.15, P < 0.03). In time-domain ECG analysis, we found that RMSSD (R2 =0.16, P < 0.05) and pNN50 (R2 =0.15, P < 0.05) scores correlated with significantly higher VR-score of all participants. In this study, we used SVM (linear kernel) and Logistic Regression classification techniques to classify the participants as gamers and non-gamers using data from VR headsets. Both SVM and Logistic Regression accurately classified the participants as gamers and non-gamers with 83% accuracy. For both SVM and Linear Regression, precision was noted as 88%, recall as 83%, and f1-score as 83%. There is increasing interest in characterizing trainees' physiological and behavioral activity profiles in a VR environment, aiming to develop better training and assessment methodologies.

Using Digital Biomarkers for Objective Assessment of Perfusionists' Workload and Acute Stress During Cardiac Surgery

The cardiac operating room (OR) is a high-risk, high-stakes environment inserted into a complex socio-technical healthcare system. During cardiopulmonary bypass (CPB), the most critical phase of cardiac surgery, the perfusionist has a crucial role within the interprofessional OR team, being responsible for optimizing patient perfusion while coordinating other tasks with the surgeon, anesthesiologist, and nurses. The aim of this study was to investigate objective digital biomarkers of perfusionists' workload and stress derived from heart rate variability (HRV) metrics captured via a wearable physiological sensor in a real cardiac OR. We explored the relationships between several HRV parameters and validated self-report measures of surgical task workload (SURG-TLX) and acute stress (STAI-SF), as well as surgical processes and outcome measures. We found that the frequency-domain HRV parameter HF relative power - FFT (%) presented the strongest association with task workload (correlation coefficient: -0.491, p-value: 0.003). We also found that the time-domain HRV parameter RMSSD (ms) presented the strongest correlation with perfusionists' acute stress (correlation coefficient: -0.489, p-value: 0.005). A few workload and stress biomarkers were also associated with bypass time and patient length of stay in the hospital. The findings from this study will inform future research regarding which HRV-based biomarkers are best suited for the development of cognitive support systems capable of monitoring surgical workload and stress in real time.

Cognitive Load Assessment Scales in Simulation: Validity Evidence for a Novel Measure of Cognitive Load Types

INTRODUCTION

Cognitive load (CL) theory provides a framework to inform simulation instructional design. Reliable measures of CL types (intrinsic [IL], extraneous [EL], and germane load [GL]) in simulation are lacking. We developed the novel Cognitive Load Assessment Scales in Simulation (CLAS-Sim) and report validity evidence using Kane's framework.

METHODS

This quasi-experimental study tested the effect of a segmented/pause-and-debrief or standard/end-of-case-debrief intervention on pediatric residents' performance and self-rated CL in 2 complex- and simple-case simulations. After each simulation, participants completed 22 items measuring CL types. Three validity inferences were examined: scoring (instrument development and principal component analysis); generalization (internal consistency reliability of CL-component items across cases); and extrapolation [CLAS-Sim correlations with the single-item Paas scale, which measures overall CL; differences in primary task performance (high vs low); and discriminant validity of IL under different instructional-design conditions].

RESULTS

Seventy-four residents completed both simulations and postcase CLAS-Sim measures. The principal component analysis yielded 3 components: 4-item IL, 4-item EL, and 3-item GL scales (Cronbach's α, 0.68-0.77). The Paas scores correlated with CLAS-Sim IL and total CL scores in both cases ( rs range, 0.39-0.70; P ≤ 0.001). High complex-case performers reported lower IL and total CL (analyses of variance, each P < 0.001). In multivariate analyses of variance, CLAS-Sim IL, GL, and total CL varied across both cases by arm (each P ≤ 0.018); the segmented-debrief arm reported lower IL than the standard-debrief arm in both cases (each P ≤ 0.01).

CONCLUSIONS

The CLAS-Sim demonstrates preliminary validity evidence for distinguishing 3 CL types but requires further study to evaluate the impact of simulation-design elements on CL and learning.

Persistent effects of mobile phone conversation while driving after disconnect: Physiological evidence and driving performance

Cognitive workload has been known as a key factor in traffic accidents, which can be highly increased by talking on the phone while driving. A wide range of studies around the world investigated the effects of mobile phone conversations on driving performance and traffic accidents. But less noticed is the durability of cognitive effects of mobile phone conversations. This study aimed to determine the effects of different types of mobile phone conversations on physiological response and driving performance during and after the conversation. Heart rate, heart rate variability (physiological response), Standard deviation of lane position (SDLP), and the relative distance between two cars (driving performance) of 34 samples (male and female) in the driving simulator were recorded. In this study, three types of conversations (neutral, cognitive, and arousal) were used. Neutral conversation did not pursue specific purpose questions. Cognitive conversations were simple mathematical problem-solving questions and arousal conversations aimed at arousing participant emotions. Each conversation was used as a secondary task in a condition. The study had three conditions; in each condition the participant drove for 15 min. Each condition consisted of 5 min of driving (Background), 5 min of driving and conversation (dual tasks) and 5 min of driving after conversation to trace the effects of the conversation. Vehicle speed was 110 km/h in each of the three conditions using car-following scenario. The results showed that neutral conversations had no significant effects on physiological response. Though, arousal conversations had significant effects on physiological responsiveness and driving performance during conversations, where it was even more significant after disconnection. Therefore, the content of the conversation determines the amount of cognitive load imposed on the driver. Considering the persistence of cognitive effects caused by conversation, the risk of traffic accidents is still high even after disconnection.

Measuring cognitively demanding activities in pediatric out-of-hospital cardiac arrest

BACKGROUND

This methodological intersection article demonstrates a method to measure cognitive load in clinical simulations. Researchers have hypothesized that high levels of cognitive load reduce performance and increase errors. This phenomenon has been studied primarily by experimental designs that measure responses to predetermined stimuli and self-reports that reduce the experience to a summative value. Our goal was to develop a method to identify clinical activities with high cognitive burden using physiologic measures.

METHODS

Teams of emergency medical responders were recruited from local fire departments to participate in a scenario with a shockable pediatric out-of-hospital cardiac arrest (POHCA) patient. The scenario was standardized with the patient being resuscitated after receiving high-quality CPR and 3 defibrillations. Each team had a person in charge (PIC) who wore a functional near-infrared spectroscopy (fNIRS) device that recorded changes in oxygenated and deoxygenated hemoglobin concentration in their prefrontal cortex (PFC), which was interpreted as cognitive activity. We developed a data processing pipeline to remove nonneural noise (e.g., motion artifacts, heart rate, respiration, and blood pressure) and detect statistically significant changes in cognitive activity. Two researchers independently watched videos and coded clinical tasks corresponding to detected events. Disagreements were resolved through consensus, and results were validated by clinicians.

RESULTS

We conducted 18 simulations with 122 participants. Participants arrived in teams of 4 to 7 members, including one PIC. We recorded the PIC's fNIRS signals and identified 173 events associated with increased cognitive activity. [Defibrillation] (N = 34); [medication] dosing (N = 33); and [rhythm checks] (N = 28) coincided most frequently with detected elevations in cognitive activity. [Defibrillations] had affinity with the right PFC, while [medication] dosing and [rhythm checks] had affinity with the left PFC.

CONCLUSIONS

FNIRS is a promising tool for physiologically measuring cognitive load. We describe a novel approach to scan the signal for statistically significant events with no a priori assumptions of when they occur. The events corresponded to key resuscitation tasks and appeared to be specific to the type of task based on activated regions in the PFC. Identifying and understanding the clinical tasks that require high cognitive load can suggest targets for interventions to decrease cognitive load and errors in care.

The Evidence Basis for Learning Theory and Technology in Surgical Skills Training

Orthopaedic trainees face a complex and challenging training environment that is currently becoming more competency driven. Associated with these changes are an increasing introduction and use of a variety of technologically driven surgical training augments. Although these new learning resources can positively transform the educational environment, they must be used appropriately by both learners and educators. To aid in this, we review learning theories because they apply to surgical skills training and highlight recent surgical training evidence that demonstrates how technology use can be optimized to promote surgical learning, with an emphasis on procedural learning theory and cognitive load theory. Specifically, we review the evidence demonstrating the importance of targeting technology to a learner's experience level and methods to optimize cognitive load by managing intrinsic load, minimizing extraneous load, and maximizing germane load.

An Open-Source, Interoperable Architecture for Generating Real-Time Surgical Team Cognitive Alerts from Heart-Rate Variability Monitoring

Clinical alarm and decision support systems that lack clinical context may create non-actionable nuisance alarms that are not clinically relevant and can cause distractions during the most difficult moments of a surgery. We present a novel, interoperable, real-time system for adding contextual awareness to clinical systems by monitoring the heart-rate variability (HRV) of clinical team members. We designed an architecture for real-time capture, analysis, and presentation of HRV data from multiple clinicians and implemented this architecture as an application and device interfaces on the open-source OpenICE interoperability platform. In this work, we extend OpenICE with new capabilities to support the needs of the context-aware OR including a modularized data pipeline for simultaneously processing real-time electrocardiographic (ECG) waveforms from multiple clinicians to create estimates of their individual cognitive load. The system is built with standardized interfaces that allow for free interchange of software and hardware components including sensor devices, ECG filtering and beat detection algorithms, HRV metric calculations, and individual and team alerts based on changes in metrics. By integrating contextual cues and team member state into a unified process model, we believe future clinical applications will be able to emulate some of these behaviors to provide context-aware information to improve the safety and quality of surgical interventions.

Impact of minimally invasive surgery on surgeon health (ISSUE) study: protocol of a single-arm observational study conducted in the live surgery setting

INTRODUCTION

The rapid evolution of minimally invasive surgery has had a positive impact on patient outcomes; however, it is reported to be associated with work-related musculoskeletal symptoms (WMS) in surgeons. Currently there is no objective measure to monitor the physical and psychological impact of performing a live surgical procedure on the surgeon.

METHODS AND ANALYSIS

A single-arm observational study with the aim of developing a validated assessment tool to quantify the impact of surgery (open/laparoscopic/robotic-assisted) on the surgeon. Development and validation cohorts of major surgical cases of varying levels of complexity performed by consultant gynaecological and colorectal surgeons will be recruited. Recruited surgeons wear three Xsens DOT monitors (muscle activity) and an Actiheart monitor (heart rate). Salivary cortisol levels will be taken and questionnaires (WMS and State-Trait Anxiety Inventory) completed by the participants preoperatively and postoperatively. All the measures will be incorporated to produce a single score that will be called the 'S-IMPACT' score.

ETHICS AND DISSEMINATION

Ethical approval for this study has been granted by the East Midlands Leicester Central Research Ethics Committee REC ref 21/EM/0174. Results will be disseminated to the academic community through conference presentations and peer-reviewed journal publications. The S-IMPACT score developed within this study will be taken forward for use in definitive multicentre prospective randomised control trials.

The physiology of intraoperative error: using electrokardiograms to understand operator performance during robot-assisted surgery simulations

BACKGROUND

No platform for objective, synchronous and on-line evaluation of both intraoperative error and surgeon physiology yet exists. Electrokardiogram (EKG) metrics have been associated with cognitive and affective features that are known to impact surgical performance but have not yet been analyzed in conjunction with real-time error signals using objective, real-time methods.

METHODS

EKGs and operating console point-of-views (POVs) for fifteen general surgery residents and five non-medically trained participants were captured during three simulated robotic-assisted surgery (RAS) procedures. Time and frequency-domain EKG statistics were extracted from recorded EKGs. Intraoperative errors were detected from operating console POV videos. EKG statistics were synchronized with intraoperative error signals.

RESULTS

Relative to personalized baselines, IBI, SDNN and RMSSD decreased 0.15% (S.E. 3.603e-04; P = 3.25e-05), 3.08% (S.E. 1.603e-03; P < 2e-16) and 1.19% (S.E. 2.631e-03; P = 5.66e-06), respectively, during error. Relative LF RMS power decreased 1.44% (S.E. 2.337e-03; P = 8.38e-10), and relative HF RMS power increased 5.51% (S.E. 1.945e-03; P < 2e-16).

CONCLUSIONS

Use of a novel, on-line biometric and operating room data capture and analysis platform enabled detection of distinct operator physiological changes during intraoperative errors. Monitoring operator EKG metrics during surgery may help improve patient outcomes through real-time assessments of intraoperative surgical proficiency and perceived difficulty as well as inform personalized surgical skills development.

Cognitive Load Management: An Invaluable Tool for Safe and Effective Surgical Training

This article highlights the importance of considering Cognitive Load (CL) and Cognitive Load Theory (CLT) during surgical training, focusing on the acquisition of intra-operative skills. It describes the basis of CLT with the overarching aim of describing CLT-based techniques to enhance current training strategies and surgical performance, many of which are instinctively already employed in surgical practice. Currently, methods of feedback and assessment are imperfect - typically subjective, unsystematic, opportunistic, or retrospective, and at risk of human bias. Surgical Sabermetrics, the advanced analytics of surgical and audio-visual data, aims to enhance this feedback by providing objective, real-time, digital-based feedback. This article introduces the benefit of real-time measurement of CL to enhance feedback and its applications to surgical performance that follow the ethos of Surgical Sabermetrics.¹ The 2022 theme for ICOSET was "Making it Better." Cognitive Load and Surgical Sabermetrics principles provide tools to make Surgical training better, with the goal of higher quality care for patients.

Protocol for a scoping review on 'surgical sabermetrics:' technology-enhanced measurement of operative non-technical skills

INTRODUCTION

Surgeons need high fidelity, high quality, objective, non-judgemental and quantitative feedback to measure their performance in order to optimise their performance and improve patient safety. This can be provided through surgical sabermetrics, defined as 'advanced analytics of digitally recorded surgical training and operative procedures to enhance insight, support professional development and optimise clinical and safety outcomes'. The aim of this scoping review is to investigate the assessment of surgeon's non-technical skills using sabermetrics principles, focusing on digital, automated measurements that do not require a human observer.

METHODS AND ANALYSIS

To investigate the current methods of digital, automated measurements of surgeons' non-technical skills, a systematic scoping review will be conducted following Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidelines, using databases from medicine and other fields. Covidence software is used for screening of potential studies. A data extraction tool will be developed specifically for this study to evaluate the methods of measurement. Quality assurance will be assessed using Quality Assessment Tool for Diverse Designs. Multiple reviewers will be responsible for screening of studies and data extraction.

ETHICS AND DISSEMINATION

This is a review study, not using primary data, and therefore, ethical approval is not required. A range of methods will be employed for dissemination of the results of this study, including publication in journals and conference presentations.

Measurement and Management of Cognitive Load in Surgical Education: A Narrative Review

BACKGROUND

Cognitive load should be considered in designing optimal educational programs in health care. Despite the highly demanding nature of surgery and surgical education, a consensus on how to manage cognitive load has not been established. The objective of this review is to map out how recent surgical education research incorporates cognitive load.

METHODS

A literature search was performed using keywords related to cognitive load and digital education up to December 2021. Studies published in English relevant to assessment and management of cognitive load in surgical education were included. Terminology, assessment tools, association with different surgical procedures and training modalities, and programs considering cognitive load were reported.

RESULTS

We identified several terms to describe cognitive load. Cognitive load was measured by subjective, self-reported questionnaires and by objective measurements, such as physiological parameters or estimated by reaction time to secondary tasks. Subjective measurements reported cognitive load in one or multiple dimensions. Correlations between subjective and objective measurements were shown in multiple studies. Overall, higher cognitive load was observed in training for more complex tasks and high-fidelity modalities, and among less experienced trainees. Cognitive load theory has been lately incorporated into designing teaching programs.

CONCLUSIONS

A broad range of terms and assessment tools were identified for cognitive load. To maximize the learning outcome, management of cognitive load is necessary in surgical education. This review summarizes the current knowledge in assessment and management of cognitive load in surgical education and provides suggestions for future studies.

Training and proficiency level in endoscopic sinus surgery change residents' eye movements

Nose surgery is challenging and needs a lot of training for safe and efficient treatments. Eye tracking can provide an objective assessment to measure residents' learning curve. The aim of the current study was to assess residents' fixation duration and other dependent variables over the course of a dedicated training in functional endoscopic sinus surgery (FESS). Sixteen residents performed a FESS training over 18 sessions, split into three surgical steps. Eye movements in terms of percent fixation on the screen and average fixation duration were measured, in addition to residents' completion time, cognitive load, and surgical performance. Results indicated performance improvements in terms of completion time and surgical performance. Cognitive load and average fixation duration showed a significant change within the last step of training. Percent fixation on screen increased within the first step, and then stagnated. Results showed that eye movements and cognitive load differed between residents of different proficiency levels. In conclusion, eye tracking is a helpful objective measuring tool in FESS. It provides additional insights of the training level and changes with increasing performance. Expert-like gaze was obtained after half of the training sessions and increased proficiency in FESS was associated with increased fixation duration.

Using extended reality (XR) for medical training and real-time clinical support during deep space missions

Medical events can affect space crew health and compromise the success of deep space missions. To successfully manage such events, crew members must be sufficiently prepared to manage certain medical conditions for which they are not technically trained. Extended Reality (XR) can provide an immersive, realistic user experience that, when integrated with augmented clinical tools (ACT), can improve training outcomes and provide real-time guidance during non-routine tasks, diagnostic, and therapeutic procedures. The goal of this study was to develop a framework to guide XR platform development using astronaut medical training and guidance as the domain for illustration. We conducted a mixed-methods study-using video conference meetings (45 subject-matter experts), Delphi panel surveys, and a web-based card sorting application-to develop a standard taxonomy of essential XR capabilities. We augmented this by identifying additional models and taxonomies from related fields. Together, this "taxonomy of taxonomies," and the essential XR capabilities identified, serve as an initial framework to structure the development of XR-based medical training and guidance for use during deep space exploration missions. We provide a schematic approach, illustrated with a use case, for how this framework and materials generated through this study might be employed.

Ergonomic Assessment of Surgeon Characteristics and Laparoscopic Device Strain in Gynecologic Surgery

STUDY OBJECTIVE

To evaluate whether surgeon characteristics, including sex and hand size, were associated with grip strength decline with laparoscopic advanced energy devices.

DESIGN

Prospective cohort study.

SETTING

Ergonomic simulation at an academic tertiary care site and the Society of Gynecologic Surgeons 47th Annual Meeting.

PATIENTS

Thirty-eight participants (19 women and 19 men) were recruited.

INTERVENTIONS

Surgeon anthropometric measurements were collected. Each participant completed a 120-second trial of maximum voluntary effort with 3 laparoscopic advanced energy devices (LigaSure, HALO PKS, and ENSEAL). Grip strength was measured using a handheld dynamometer. Subjects completed the NASA Raw Task Load Index scale after each device trial. Grip strengths and ergonomic workload scores were compared using Student t tests and Wilcoxon rank sum tests where appropriate. Univariate and multivariate models analyzed hand size and ergonomic workload.

MEASUREMENTS AND MAIN RESULTS

Women had lower baseline grip strength (288 vs 451 N) than men, as did participants with glove size <7 compared with ≥7 (231 vs 397 N). Normalized grip strength was not associated with surgeon sex (p = .08), whereas it was significantly associated with surgeon glove size (p <.01). Grip strength decline was significantly greater for smaller compared to larger handed surgeons for LigaSure (p = .02) and HALO PKS devices (p <.01). The ergonomic workload of device use was significantly greater for smaller compared to larger handed surgeons (p <.01). Surgeon handspan significantly predicted grip strength decline with device use, even after accounting for potential confounders (R² = .23, β = .8, p <.01).

CONCLUSION

Surgeons with smaller hand size experienced a greater grip strength decline and greater ergonomic workload during repetitive laparoscopic device use. No relationship was found between surgeon sex and grip strength decline or ergonomic workload. Laparoscopic device type was also identified as a significant main effect contributing to grip strength decline. These findings point toward ergonomic strain stemming from an improper fit between the laparoscopic device and the surgeon's hand during device use.

Handedness did not affect motor skill acquisition by the dominant hand or interlimb transfer to the non-dominant hand regardless of task complexity level

Patients undergoing unilateral orthopedic or neurological rehabilitation have different levels of impairments in the right- or left-dominant hand. However, how handedness and the complexity of the motor task affect motor skill acquisition and its interlimb transfer remains unknown. In the present study, participants performed finger key presses on a numeric keypad at 4 levels of sequence complexities with each hand in a randomized order. Furthermore, they also performed motor sequence practice with the dominant hand to determine its effect on accuracy, reaction time, and movement time. The NASA-TLX at the end of each block of both testing and practice was used to confirm participants' mental workload related to sequence complexity. Both right- and left-handed participants performed the motor sequence task with faster RT when using their right hand. Although participants had increasing RT with increasing sequence complexity, this association was unrelated to handedness. Motor sequence practice produced motor skill acquisition and interlimb transfer indicated by a decreased RT, however, these changes were independent of handedness. Higher sequence complexity was still associated with longer RT after the practice, moreover, both right- and left-handed participants' RT increased with the same magnitude with the increase in sequence complexity. Similar behavioral pattern was observed in MT as in RT. Overall, our RT results may indicate left-hemisphere specialization for motor sequencing tasks, however, neuroimaging studies are needed to support these findings. On the other hand, handedness did not affect motor skill acquisition by the dominant hand or interlimb transfer to the non-dominant hand regardless of task complexity level.

Classification of Drivers' Mental Workload Levels: Comparison of Machine Learning Methods Based on ECG and Infrared Thermal Signals

Mental workload (MW) represents the amount of brain resources required to perform concurrent tasks. The evaluation of MW is of paramount importance for Advanced Driver-Assistance Systems, given its correlation with traffic accidents risk. In the present research, two cognitive tests (Digit Span Test-DST and Ray Auditory Verbal Learning Test-RAVLT) were administered to participants while driving in a simulated environment. The tests were chosen to investigate the drivers' response to predefined levels of cognitive load to categorize the classes of MW. Infrared (IR) thermal imaging concurrently with heart rate variability (HRV) were used to obtain features related to the psychophysiology of the subjects, in order to feed machine learning (ML) classifiers. Six categories of models have been compared basing on unimodal IR/unimodal HRV/multimodal IR + HRV features. The best classifier performances were reached by the multimodal IR + HRV features-based classifiers (DST: accuracy = 73.1%, sensitivity = 0.71, specificity = 0.69; RAVLT: accuracy = 75.0%, average sensitivity = 0.75, average specificity = 0.87). The unimodal IR features based classifiers revealed high performances as well (DST: accuracy = 73.1%, sensitivity = 0.73, specificity = 0.73; RAVLT: accuracy = 71.1%, average sensitivity = 0.71, average specificity = 0.85). These results demonstrated the possibility to assess drivers' MW levels with high accuracy, also using a completely non-contact and non-invasive technique alone, representing a key advancement with respect to the state of the art in traffic accident prevention.

Mild simulator sickness can alter heart rate variability, mental workload, and learning outcomes in a 360° virtual reality application for medical education: a post hoc analysis of a randomized controlled trial

Virtual reality (VR) applications could be beneficial for education, training, and treatment. However, VR may induce symptoms of simulator sickness (SS) such as difficulty focusing, difficulty concentrating, or dizziness that could impair autonomic nervous system function, affect mental workload, and worsen interventional outcomes. In the original randomized controlled trial, which explored the effectiveness of using a 360° VR video versus a two-dimensional VR video to learn history taking and physical examination skills, only the former group participants had SS. Therefore, 28 undergraduate medical students who participated in a 360° VR learning module were included in this post hoc study using a repeated measures design. Data of the Simulator Sickness Questionnaire (SSQ), heart rate variability (HRV) analysis, Task Load Index, and Mini-Clinical Evaluation Exercise were retrospectively reviewed and statistically analyzed. Ten (36%) participants had mild SS (total score > 0 and ≤ 20), and 18 (64%) had no SS symptom. Total SSQ score was positively related to the very low frequency (VLF) band power, physical demand subscale, and frustration subscale, and inversely related to physical examination score. Using multilevel modeling, the VLF power mediated the relationship between total SSQ score and physical examination score. Furthermore, frustration subscale moderated the mediating effects of the VLF power. Our results highlight the importance of documenting SS to evaluate a 360° VR training program. Furthermore, the combination of HRV analysis with mental workload measurement and outcome assessments provided the important clinical value in evaluating the effects of SS in VR applications in medical education.

Perception of Physical Demand, Mental Demand, and Performance: A Comparison of Two Voice Interventions for Parkinson's Disease

PURPOSE

The purpose of the study was to examine the effect of two voice intervention approaches for hypophonia secondary to Parkinson's disease (PD) on self-reported measures of physical demand, mental demand, and vocal performance.

METHOD

Thirty-four persons with hypophonia secondary to PD were assigned to one of three groups: Lee Silverman Voice Treatment (LSVT) LOUD (n = 12), SpeechVive (n = 12), and nontreatment clinical control (n = 10). The LSVT LOUD and the SpeechVive participants received 8 weeks of voice intervention following the standardized protocol previously described for each approach. To confirm the effectiveness of each voice intervention, sound pressure level (dB SPL) data were analyzed for the experimental and control participants for a monologue sample obtained pretreatment, midtreatment, and posttreatment. During the voice intervention period, the LSVT LOUD and the SpeechVive participants were instructed to complete a modified version of the National Aeronautics and Space Administration Task Load Index rating scale to indicate the mental and physical demand required to complete the intervention activities, and to indicate how well they performed in completing the assigned vocal tasks.

RESULTS

The LSVT LOUD and the SpeechVive participants demonstrated a significant posttreatment increase in SPL (dB), in comparison to the clinical controls, thus confirming a positive intervention effect. The LSVT LOUD participants reported significantly higher ratings of physical and mental demand over the course of treatment, in comparison to the SpeechVive participants.

CONCLUSION

Consideration of the mental and physical demand associated with two voice intervention approaches, commonly used for PD, may help to foster improved therapeutic compliance and treatment outcomes.

The Measurement of Cognitive Workload in Surgery Using Pupil Metrics: A Systematic Review and Narrative Analysis

INTRODUCTION

Increased cognitive workload (CWL) is a well-established entity that can impair surgical performance and increase the likelihood of surgical error. The use of pupil and gaze tracking data is increasingly being used to measure CWL objectively in surgery. The aim of this review is to summarize and synthesize the existing evidence that surrounds this.

METHODS

A systematic review was undertaken in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. A search of OVID MEDLINE, IEEE Xplore, Web of Science, Google Scholar, APA PsychINFO, and EMBASE was conducted for articles published in English between 1990 and January 2021. In total, 6791 articles were screened and 32 full-text articles were selected based on the inclusion criteria. A narrative analysis was undertaken in view of the heterogeneity of studies.

RESULTS

Seventy-eight percent of selected studies were deemed high quality. The most frequent surgical environment and task studied was surgical simulation (75%) and performance of laparoscopic skills (56%) respectively. The results demonstrated that the current literature can be broadly categorized into pupil, blink, and gaze metrics used in the assessment of CWL. These can be further categorized according to their use in the context of CWL: (1) direct measurement of CWL (n = 16), (2) determination of expertise level (n = 14), and (3) predictors of performance (n = 2).

CONCLUSIONS

Eye-tracking data provide a wealth of information; however, there is marked study heterogeneity. Pupil diameter and gaze entropy demonstrate promise in CWL assessment. Future work will entail the use of artificial intelligence in the form of deep learning and the use of a multisensor platform to accurately measure CWL.

A novel scale to measure students' perceptions of exemplars in a dental school

INTRODUCTION

Exemplars are an effective strategy for initial cognitive and psychomotor skill acquisition and promoting students' self-regulation. Yet, there is limited evidence about students' use and perception of exemplars in dental education. Therefore, this study aimed to develop a scale to measure students' perception of exemplars in an Australian dental school.

MATERIALS AND METHODS

Phase I assessed the relevant literature and students' responses to an interview. Four themes were identified for developing a 19-item questionnaire rated by an expert panel. Phase II piloted the questionnaire amongst a group of 30 students. Phase III analysed psychometric and qualitative open-ended questions data obtained from a large group of students.

RESULTS

The principal axis factoring resulted in one single factor that explained over 62% of the variance and had an alpha of .88. The number of questions was reduced from 19 to 6 items with loadings of 0.72 or above for each item. Students reported exemplars are beneficial for their learning and to visually guide them to understand procedures and their intended outcomes. This prompts them to think and mentally prepare before performing. Students further reported using exemplars provided by their courses almost as often as exemplars they search in social media.

CONCLUSION

Well-developed exemplars could play a key role in enhancing learning and could assist teaching. Understanding students' use and perception of exemplars will help educators to develop and evaluate appealing exemplars. Therefore, this study developed a new instrument to measure students' perception of exemplars, verified its reliability and validity.