The evaluation of eye gaze using an eye tracking system in simulation training of real-time ultrasound-guided venipuncture

Where do ICU trainees really look? An eye-tracking analysis of gaze patterns during central venous catheter insertion

BACKGROUND

There is limited knowledge about gaze patterns of intensive care unit (ICU) trainee doctors during the insertion of a central venous catheter (CVC). The primary objective of this study was to examine visual patterns exhibited by ICU trainee doctors during CVC insertion. Additionally, the study investigated whether differences in gaze patterns could be identified between more and less experienced trainee doctors.

METHODS

In a real-life, prospective observational study conducted at the interdisciplinary ICU at the University Hospital Zurich, Switzerland, ICU trainee doctors underwent eye-tracking during CVC insertion in a real ICU patient. Using mixed-effects model analyses, the primary outcomes were dwell time, first fixation duration, revisits, fixation count, and average fixation time on different areas of interest (AOI). Secondary outcomes were above eye-tracking outcome measures stratified according to experience level of participants.

RESULTS

Eighteen participants were included, of whom 10 were inexperienced and eight more experienced. Dwell time was highest for CVC preparation table (p = 0.02), jugular vein on ultrasound image (p < 0.001) and cervical puncture location (p < 0.001). Concerning experience, dwell time and revisits on jugular vein on ultrasound image (p = 0.02 and p = 0.04, respectively) and cervical puncture location (p = 0.004 and p = 0.01, respectively) were decreased in more experienced ICU trainees.

CONCLUSIONS

Various AOIs have distinct significance for ICU trainee doctors during CVC insertion. Experienced participants exhibited different gaze behavior, requiring less attention for preparation and handling tasks, emphasizing the importance of hand-eye coordination.

Comparison of stereopsis thresholds measured with conventional methods and a new eye tracking method

PURPOSE

Stereopsis is the ability to perceive depth using the slightly different views from two eyes. This study aims to conduct innovative stereopsis tests using the objective data outputted by eye tracking technology.

METHODS

A laptop and an eye tracker were used to establish the test system. Anaglyphic glasses were employed to execute the stereopsis assessment. The test symbol employed was devised to emulate the quantitative measurement component of the Random Dot 3 Stereo Acuity Test. Sub-pixel technology was used to increase the disparity accuracy of test pages. The tested disparities were: 160″, 100″, 63″, 50″, 40″, 32″, 25″, 20″, 16″, and 12.5″. The test was conducted at a distance of 0.65m. Conventional and eye tracking stereopsis assessments were conducted on 120 subjects. Wilcoxon signed-rank test was used to test the difference, while the Bland-Altman method was used to test the consistency between the two methods.

RESULTS

The Wilcoxon signed-rank test showed no significant difference between conventional and eye tracking thresholds of stereopsis (Z = -1.497, P = 0.134). There was a high level of agreement between the two methods using Bland- Altman statistical analysis (The 95 per cent limits of agreement were -0.40 to 0.47 log arcsec).

CONCLUSIONS

Stereoacuity can be evaluated utilizing an innovative stereopsis measurement system grounded in eye tracking technology.

Using Task-Evoked Pupillary Response to Predict Clinical Performance during a Simulation Training

Training in healthcare skills can be affected by trainees' workload when completing a task. Due to cognitive processing demands being negatively correlated to clinical performance, assessing mental workload through objective measures is crucial. This study aimed to investigate task-evoked changes in pupil size as reliable markers of mental workload and clinical performance. A sample of 49 nursing students participated in a cardiac arrest simulation-based practice. Measurements of cognitive demands (NASA-Task Load Index), physiological parameters (blood pressure, oxygen saturation, and heart rate), and pupil responses (minimum, maximum, and difference diameters) throughout revealed statistically significant differences according to performance scores. The analysis of a multiple regression model produced a statistically significant pattern between pupil diameter differences and heart rate, systolic blood pressure, workload, and performance (R² = 0.280; F (6, 41) = 2.660; p < 0.028; d = 2.042). Findings suggest that pupil variations are promising markers to complement physiological metrics for predicting mental workload and clinical performance in medical practice.

The Advantage of Using an Optical See-Through Head-Mounted Display in Ultrasonography-Guided Needle Biopsy Procedures: A Prospective Randomized Study

An optical see-through head-mounted display (OST-HMD) can potentially improve the safety and accuracy of ultrasonography (US)-guided fine-needle aspiration. We aimed to evaluate the usefulness of an OST-HMD in US-guided needle-puncture procedures. We conducted a prospective randomized controlled study in which we compared the accuracy and safety of the US-guided needle puncture procedure and the stress on the practitioner when using OST-HMD versus standard US display (SUD). Inexperienced medical students were enrolled and randomly divided into two groups. A breast phantom was used to evaluate the required time and accuracy of the US-guided needle puncture. Practitioner stress was quantified using a visual analog scale (VAS). When the procedure was performed for the first time, the time required to reach the target lesion at a shallow depth was significantly shorter in the OST-HMD group (39.8 ± 39.9 s) than in the SUD group (71.0 ± 81.0 s) (p = 0.01). Using the OST-HMD significantly reduced the unintentional puncture of a non-target lesion (p = 0.01). Furthermore, the stress felt by the practitioners when capturing the image of the target lesion (p < 0.001), inserting and advancing the needle more deeply (p < 0.001), and puncturing the target lesion (p < 0.001) was significantly reduced in the OST-HMD group compared with that in the SUD group. Use of OST-HMD may improve the accuracy and safety of US-guided needle puncture procedures and may reduce practitioner stress during the procedure.

Assessment of changes in gaze patterns during training in point-of-care ultrasound

BACKGROUND

Point-of-care ultrasound (POCUS) is a core skill in emergency medicine (EM), however, there is a lack of objective competency measures. Eye-tracking technology is a potentially useful assessment tool, as gaze patterns can reliably discriminate between experts and novices across medical specialties. We aim to determine if gaze metrics change in an independent and predictable manner during ultrasound training.

METHODS

A convenience sample of first-year residents from a single academic emergency department was recruited. Participants interpreted 16 ultrasound videos of the focused assessment with sonography for trauma (FAST) scan while their gaze patterns were recorded using a commercially available eye-tracking device. The intervention group then completed an introductory ultrasound course whereas the control group received no additional education. The gaze assessment was subsequently repeated. The primary outcome was total gaze duration on the area of interest (AOI). Secondary outcomes included time to fixation, mean duration of first fixation and mean number of fixations on the AOI.

RESULTS

10 EM residents in the intervention group and 10 non-EM residents in the control group completed the study. After training, there was an 8.8 s increase in the total gaze time on the AOI in the intervention group compared to a 4.0 s decrease in the control group (p = .03). EM residents were also 3.8 s quicker to fixate on the AOI whereas the control group became 2.5 s slower (p = .04). There were no significant interactions on the number of fixations (0.43 vs. 0.18, p = .65) or duration of first fixation on the AOI (0.02 s vs. 0.06 s, p = .63).

CONCLUSIONS

There are significant and quantifiable changes in gaze metrics, which occur with incremental learning after an ultrasound course. Further research is needed to validate the serial use of eye-tracking technology in following a learner's progress toward competency in point-of-care ultrasound image interpretation.

Skill Characterisation of Sonographer Gaze Patterns during Second Trimester Clinical Fetal Ultrasounds using Time Curves

We present a method for skill characterisation of sonographer gaze patterns while performing routine second trimester fetal anatomy ultrasound scans. The position and scale of fetal anatomical planes during each scan differ because of fetal position, movements and sonographer skill. A standardised reference is required to compare recorded eye-tracking data for skill characterisation. We propose using an affine transformer network to localise the anatomy circumference in video frames, for normalisation of eye-tracking data. We use an event-based data visualisation, time curves, to characterise sonographer scanning patterns. We chose brain and heart anatomical planes because they vary in levels of gaze complexity. Our results show that when sonographers search for the same anatomical plane, even though the landmarks visited are similar, their time curves display different visual patterns. Brain planes also, on average, have more events or landmarks occurring than the heart, which highlights anatomy-specific differences in searching approaches.

Comparing the Visual Perception According to the Performance Using the Eye-Tracking Technology in High-Fidelity Simulation Settings

Introduction: We used eye-tracking technology to explore the visual perception of clinicians during a high-fidelity simulation scenario. We hypothesized that physicians who were able to successfully manage a critical situation would have a different visual focus compared to those who failed. Methods: A convenience sample of 18 first-year emergency medicine residents were enrolled voluntarily to participate in a high-fidelity scenario involving a patient in shock with a 3rd degree atrioventricular block. Their performance was rated as pass or fail and depended on the proper use of the pacing unit. Participants were wearing pre-calibrated eye-tracking glasses throughout the 9-min scenario and infrared (IR) markers installed in the simulator were used to define various Areas of Interest (AOI). Total View Duration (TVD) and Time to First Fixation (TFF) by the participants were recorded for each AOI and the results were used to produce heat maps. Results: Twelve residents succeeded while six failed the scenario. The TVD for the AOI containing the pacing unit was significantly shorter (median [quartile]) for those who succeeded compared to the ones who failed (42 [31–52] sec vs. 70 [61–90] sec, p = 0.0097). The TFF for the AOI containing the ECG and vital signs monitor was also shorter for the participants who succeeded than for those who failed (22 [6–28] sec vs. 30 [27–77] sec, p = 0.0182). Discussion: There seemed to be a connection between the gaze pattern of residents in a high-fidelity bradycardia simulation and their performance. The participants who succeeded looked at the monitor earlier (diagnosis). They also spent less time fixating the pacing unit, using it promptly to address the bradycardia. This study suggests that eye-tracking technology could be used to explore how visual perception, a key information-gathering element, is tied to decision-making and clinical performance.