Comparing the Visual Perception According to the Performance Using the Eye-Tracking Technology in High-Fidelity Simulation Settings

Discrimination of Radiologists' Experience Level Using Eye-Tracking Technology and Machine Learning: Case Study

BACKGROUND

Perception-related errors comprise most diagnostic mistakes in radiology. To mitigate this problem, radiologists use personalized and high-dimensional visual search strategies, otherwise known as search patterns. Qualitative descriptions of these search patterns, which involve the physician verbalizing or annotating the order he or she analyzes the image, can be unreliable due to discrepancies in what is reported versus the actual visual patterns. This discrepancy can interfere with quality improvement interventions and negatively impact patient care.

OBJECTIVE

The objective of this study is to provide an alternative method for distinguishing between radiologists by means of captured eye-tracking data such that the raw gaze (or processed fixation data) can be used to discriminate users based on subconscious behavior in visual inspection.

METHODS

We present a novel discretized feature encoding based on spatiotemporal binning of fixation data for efficient geometric alignment and temporal ordering of eye movement when reading chest x-rays. The encoded features of the eye-fixation data are used by machine learning classifiers to discriminate between faculty and trainee radiologists. A clinical trial case study was conducted using metrics such as the area under the curve, accuracy, F1-score, sensitivity, and specificity to evaluate the discriminability between the 2 groups regarding their level of experience. The classification performance was then compared with state-of-the-art methodologies. In addition, a repeatability experiment using a separate dataset, experimental protocol, and eye tracker was performed with 8 participants to evaluate the robustness of the proposed approach.

RESULTS

The numerical results from both experiments demonstrate that classifiers using the proposed feature encoding methods outperform the current state-of-the-art in differentiating between radiologists in terms of experience level. An average performance gain of 6.9% is observed compared with traditional features while classifying experience levels of radiologists. This gain in accuracy is also substantial across different eye tracker-collected datasets, with improvements of 6.41% using the Tobii eye tracker and 7.29% using the EyeLink eye tracker. These results signify the potential impact of the proposed method for identifying radiologists' level of expertise and those who would benefit from additional training.

CONCLUSIONS

The effectiveness of the proposed spatiotemporal discretization approach, validated across diverse datasets and various classification metrics, underscores its potential for objective evaluation, informing targeted interventions and training strategies in radiology. This research advances reliable assessment tools, addressing challenges in perception-related errors to enhance patient care outcomes.

Exploring eye-tracking data as an indicator of situational awareness in nursing students during a cardiorespiratory arrest simulation

AIM

To examine the components of visual attention that maintain situational awareness during simulation training in undergraduate nursing students with different instruction levels.

BACKGROUND

Eye-tracking can provide deep insight into the nurses' attention during simulated practice. Knowing which gaze patterns promote situational awareness can significantly improve nurse instruction.

DESIGN

A comparative observational study investigated the role of visual attention on the performance quality, psychophysiological parameters (vital signs, anxiety and stress) and socioemotional competencies (cognitive workload, motivation and self-efficacy) of nursing students with various experience levels.

METHODS

Thirty nursing students divided into two groups according to their academic level: first cycle (n=14) and second-cycle (n=16) faced a clinical simulation scenario to resolve a cardiorespiratory arrest event. Eye tracking-based analysis required the selection of six areas of interest. The monitorization of vital signs included measuring blood pressure, heart rate, respiratory rate and oxygen saturation before and after the simulation practice. Participants completed the socioemotional questionnaire (NASA-TLX). They answered the state subscale of the State-Trait Anxiety Inventory (STAI), the Visual Analogue Scale (VAS) of stress, the Situational Motivation Scale (SIMS) and the Baessler and Schwarzer General Self-Efficacy Scale.

RESULTS

The first-cycle group displayed higher vital sign scores than the second cycle, apart from the post-simulation respiratory rate. All physiological parameters increased in mean value after the clinical simulation, except oxygen saturation. Anxiety was the only parameter in the socioemotional domain to present a statistically significant difference between the groups. First-year nursing students showed greater anxiety, stress, mental workload, identified regulation and intrinsic motivation, while second-year students showed higher levels of amotivation, external regulation and perceived self-efficacy. Eye-tracking data (revisits, gaze and duration of fixations) exhibited statistically significant differences depending on the area of interest in both groups (p =. 05). The performance outcomes showed a negative and moderate association with gaze the total number of gazes in the second-cycle group (rho = -0.640, p = 0.010).

CONCLUSION

Eye-tracking-based analysis can help to predict performance quality while maintaining situational awareness during nursing instruction.

Assessing the Link between Nurses' Proficiency and Situational Awareness in Neonatal Care Practice Using an Eye Tracker: An Observational Study Using a Simulator

Nurses are expected to depend on a wide variety of visually available pieces of patient information to understand situations. Thus, we assumed a relationship between nurses' skills and their gaze trajectories. An observational study using a simulator was conducted to analyze gaze during neonatal care practice using eye tracking. We defined the face, thorax, and abdomen of the neonate, the timer, and the pulse oximeter as areas of interest (AOIs). We compared the eye trajectories for respiration and heart rate assessment between 7 experienced and 13 novice nurses. There were no statistically significant differences in the time spent on each AOI for breathing or heart rate confirmation. However, in novice nurses, we observed a significantly higher number of instances of gazing at the thorax and abdomen. The deviation in the number of instances of gazing at the face was also significantly higher among novice nurses. These results indicate that experienced and novice nurses differ in their gaze movements during situational awareness. These objective and quantitative differences in gaze trajectories may help to establish new educational tools for less experienced nurses.

Brain computed tomography reading of stroke patients by resident doctors from different medical specialities: An eye-tracking study

BACKGROUND

Using the eye-tracking technique, our work aimed to examine whether difference in clinical background may affect the training outcome of resident doctors' interpretation skills and reading behaviour related to brain computed tomography (CT).

METHODS

Twelve resident doctors in the neurology, radiology, and emergency departments were recruited. Each participant had to read CT images of the brain for two cases. We evaluated each participant's accuracy of lesion identification. We also used the eye-tracking technique to assess reading behaviour. We recorded dwell times, fixation counts, run counts, and first-run dwell times of target lesions to evaluate visual attention. Transition entropy was applied to assess the temporal relations and spatial dynamics of systematic image reading.

RESULTS

The eye-tracking results showed that the image reading sequence examined by transition entropy was comparable among resident doctors from different medical specialties (p = 0.82). However, the dwell time of the target lesions was shorter for the resident doctors from the neurology department (4828.63 ms, p = 0.01) than for those from the resident doctors from the radiology (6275.88 ms) and emergency (5305.00 ms) departments. The eye-tracking results in individual areas of interest only showed differences in the eye-tracking performance of the first-run dwell time (p = 0.05) in the anterior cerebral falx.

DISCUSSION

Our findings demonstrate that resident doctors from different medical specialties may achieve similar imaging reading patterns for brain CT. This may mitigate queries regarding the influence of different backgrounds on training outcomes.

Leveraging User Comments for the Construction of Recycled Water Infrastructure-Evidence from an Eye-Tracking Experiment

Building sufficient recycled water infrastructure is an effective way to solve problems related to water shortages and environmental degradation, and is of great strategic significance for saving resources, protecting the ecological environment, and promoting sustainable social and economic development. Although recycled water is environmentally friendly, the public is still skeptical about its use, which has led to the failure of a large number of recycled water infrastructure investments; therefore, increasing the public's willingness to re-use is critical for the construction of recycled water infrastructure. To identify the influence mechanism of user comments on public re-use behaviors, we conducted an eye-tracking experiment in China. The results demonstrated that (1) perceived usefulness, perceived quality, and perceived risk have significant impacts on the public's willingness to buy; (2) user reviews can enhance the public's perceived usefulness of recycled products and increase their willingness to buy; and (3) in the process of consumption, the public tends to pay attention to negative reviews, where user reviews alter the perceived risks and perceived prices of recycled products, thereby affecting the willingness to buy of consumers. This study provides a scientific reference for the construction of recycled water infrastructure and the further promotion of recycled water.

The Impact of Physical Motion Cues on Driver Braking Performance: A Clinical Study Using Driving Simulator and Eye Tracker

Driving simulators are increasingly being incorporated by driving schools into a training process for a variety of vehicles. The motion platform is a major component integrated into simulators to enhance the sense of presence and fidelity of the driving simulator. However, less effort has been devoted to assessing the motion cues feedback on trainee performance in simulators. To address this gap, we thoroughly study the impact of motion cues on braking at a target point as an elementary behavior that reflects the overall driver's performance. In this paper, we use an eye-tracking device to evaluate driver behavior in addition to evaluating data from a driving simulator and considering participants' feedback. Furthermore, we compare the effect of different motion levels ("No motion", "Mild motion", and "Full motion") in two road scenarios: with and without the pre-braking warning signs with the speed feedback given by the speedometer. The results showed that a full level of motion cues had a positive effect on braking smoothness and gaze fixation on the track. In particular, the presence of full motion cues helped the participants to gradually decelerate from 5 to 0 ms^-1 in the last 240 m before the stop line in both scenarios, without and with warning signs, compared to the hardest braking from 25 to 0 ms^-1 produced under the no motion cues conditions. Moreover, the results showed that a combination of the mild motion conditions and warning signs led to an underestimation of the actual speed and a greater fixation of the gaze on the speedometer. Questionnaire data revealed that 95% of the participants did not suffer from motion sickness symptoms, yet participants' preferences did not indicate that they were aware of the impact of simulator conditions on their driving behavior.

Anesthesia personnel’s visual attention regarding patient monitoring in simulated non-critical and critical situations, an eye-tracking study

Background

Cognitive ergonomics design of patient monitoring may reduce human factor errors in high-stress environments. Eye-tracking is a suitable tool to gain insight into the distribution of visual attention of healthcare professionals with patient monitors, which may facilitate their further development.

Methods

This prospective, exploratory, high-fidelity simulation study compared anesthesia personnel’s visual attention (fixation count and dwell-time) to 15 areas of interest on the patient monitor during non-critical and critical anesthesia situations. Furthermore, we examined the extent to which participants’ experience influenced visual attention and which vital signs displayed on the patient monitor received the most visual attention. We used mixed zero-inflated Poisson regression and mixed linear models to analyze the data.

Results

Analyzing 23 ten-minute scenarios, we found significantly more fixations to the areas of interest on the patient monitor during critical than non-critical situations (rate ratio of 1.45; 95% CI 1.33 to 1.59; p < 0.001). However, the dwell-time on the areas of interest did not significantly differ between the non-critical and critical situations (coefficient of − 1.667; 95% CI − 4.549 to 1.229; p = 0.27). The professional experience did not significantly influence the visual attention (fixation: rate ratio of 0.88; 95% CI 0.54 to 1.43; p = 0.61 and dwell-time: coefficient of 0.889; 95% CI − 1.465 to 3.229; p = 0.27).

Over all situations, anesthesia personnel paid the most attention to the vital signs blood pressure (fixation: mean [SD] of 108 [74.83]; dwell-time: mean [SD] of 27 [15.90] seconds), end-expiratory carbon dioxide (fixation: mean [SD] of 59 [47.39]; dwell-time: mean [SD] of 30 [21.51] seconds), and the electrocardiogram (fixation: mean [SD] of 58 [64.70]; dwell-time: mean [SD] of 15 [14.95] seconds).

Conclusions

Critical anesthesia situations increased anesthesia personnel’s visual interaction with the patient monitor. Furthermore, we found that their visual attention focused mainly on a few vital signs. To assist clinicians in critical situations, manufacturers should optimize monitors to convey necessary information as easily and quickly as possible and optimize the visibility of less frequently observed but equally critical vital signs, especially when they are in an abnormal range.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12871-022-01705-6.