Wu C, Cha J, Sulek J, Zhou T, Sundaram CP, Wachs J, Yu D. Eye-Tracking Metrics Predict Perceived Workload in Robotic Surgical Skills Training.
HUMAN FACTORS 2020;
62:1365-1386. [PMID:
31560573 PMCID:
PMC7672675 DOI:
10.1177/0018720819874544]
[Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/23/2018] [Accepted: 08/05/2019] [Indexed: 05/10/2023]
Abstract
OBJECTIVE
The aim of this study is to assess the relationship between eye-tracking measures and perceived workload in robotic surgical tasks.
BACKGROUND
Robotic techniques provide improved dexterity, stereoscopic vision, and ergonomic control system over laparoscopic surgery, but the complexity of the interfaces and operations may pose new challenges to surgeons and compromise patient safety. Limited studies have objectively quantified workload and its impact on performance in robotic surgery. Although not yet implemented in robotic surgery, minimally intrusive and continuous eye-tracking metrics have been shown to be sensitive to changes in workload in other domains.
METHODS
Eight surgical trainees participated in 15 robotic skills simulation sessions. In each session, participants performed up to 12 simulated exercises. Correlation and mixed-effects analyses were conducted to explore the relationships between eye-tracking metrics and perceived workload. Machine learning classifiers were used to determine the sensitivity of differentiating between low and high workload with eye-tracking features.
RESULTS
Gaze entropy increased as perceived workload increased, with a correlation of .51. Pupil diameter and gaze entropy distinguished differences in workload between task difficulty levels, and both metrics increased as task level difficulty increased. The classification model using eye-tracking features achieved an accuracy of 84.7% in predicting workload levels.
CONCLUSION
Eye-tracking measures can detect perceived workload during robotic tasks. They can potentially be used to identify task contributors to high workload and provide measures for robotic surgery training.
APPLICATION
Workload assessment can be used for real-time monitoring of workload in robotic surgical training and provide assessments for performance and learning.
Collapse