Expertise Differences in the Comprehension of Visualizations: a Meta-Analysis of Eye-Tracking Research in Professional Domains

Eye tracking in digital pathology: A comprehensive literature review

Eye tracking has been used for decades in attempt to understand the cognitive processes of individuals. From memory access to problem-solving to decision-making, such insight has the potential to improve workflows and the education of students to become experts in relevant fields. Until recently, the traditional use of microscopes in pathology made eye tracking exceptionally difficult. However, the digital revolution of pathology from conventional microscopes to digital whole slide images allows for new research to be conducted and information to be learned with regards to pathologist visual search patterns and learning experiences. This has the promise to make pathology education more efficient and engaging, ultimately creating stronger and more proficient generations of pathologists to come. The goal of this review on eye tracking in pathology is to characterize and compare the visual search patterns of pathologists. The PubMed and Web of Science databases were searched using 'pathology' AND 'eye tracking' synonyms. A total of 22 relevant full-text articles published up to and including 2023 were identified and included in this review. Thematic analysis was conducted to organize each study into one or more of the 10 themes identified to characterize the visual search patterns of pathologists: (1) effect of experience, (2) fixations, (3) zooming, (4) panning, (5) saccades, (6) pupil diameter, (7) interpretation time, (8) strategies, (9) machine learning, and (10) education. Expert pathologists were found to have higher diagnostic accuracy, fewer fixations, and shorter interpretation times than pathologists with less experience. Further, literature on eye tracking in pathology indicates that there are several visual strategies for diagnostic interpretation of digital pathology images, but no evidence of a superior strategy exists. The educational implications of eye tracking in pathology have also been explored but the effect of teaching novices how to search as an expert remains unclear. In this article, the main challenges and prospects of eye tracking in pathology are briefly discussed along with their implications to the field.

Visual search strategies and game knowledge in junior Australian rules football players: testing potential in talent identification and development

This study explored video-based decision-making and eye-movement behavior as a complementary method to assess the decision-making skills and knowledge of elite junior Australian Rules (AR) Football players. Performance was measured twice over an 18-month period. This approach tested a practical and reliable assessment of decision-making and game knowledge that does not contribute to physical training load. N = 59 participants were categorized based on their training age groups, U14 (N = 38, Mage 13.37 ± 0.47) and U16 (N = 21, Mage 14.80 ± 0.39). Participants watched 14 brief video clips and provided action choices while wearing eye-movement recording glasses that captured visual search patterns (e.g., fixations). Decision accuracy and speed of decision-making were also recorded. Participants with accurate decisions made significantly faster decisions compared to less skilled players (p < 0.001). Further, skilled participants had significantly fewer fixations of shorter duration compared to less skilled participants at both the initial and follow-up testing sessions (p < 0.0001). This suggests that eye-movement characteristics, remain a relatively stable measure over moderate periods of time. With the ability to differentiate between more and less skilled decision-makers, this proof-of-concept study proposes that examining eye movements in relation to decision-making and game knowledge is a viable tool for Talent Identification and Development (TID) to complement current measures. We provide a platform for further development and research in the quest for efficient and effective talent identification processes.

Evidence of elevated situational awareness for active duty soldiers during navigation of a virtual environment

U.S. service members maintain constant situational awareness (SA) due to training and experience operating in dynamic and complex environments. Work examining how military experience impacts SA during visual search of a complex naturalistic environment, is limited. Here, we compare Active Duty service members and Civilians' physiological behavior during a navigational visual search task in an open-world virtual environment (VE) while cognitive load was manipulated. We measured eye-tracking and electroencephalogram (EEG) outcomes from Active Duty (N = 21) and Civilians (N = 15) while they navigated a desktop VE at a self-regulated pace. Participants searched and counted targets (N = 15) presented among distractors, while cognitive load was manipulated with an auditory Math Task. Results showed Active Duty participants reported significantly greater/closer to the correct number of targets compared to Civilians. Overall, Active Duty participants scanned the VE with faster peak saccade velocities and greater average saccade magnitudes compared to Civilians. Convolutional Neural Network (CNN) response (EEG P-300) was significantly weighted more to initial fixations for the Active Duty group, showing reduced attentional resources on object refixations compared to Civilians. There were no group differences in fixation outcomes or overall CNN response when comparing targets versus distractor objects. When cognitive load was manipulated, only Civilians significantly decreased their average dwell time on each object and the Active Duty group had significantly fewer numbers of correct answers on the Math Task. Overall, the Active Duty group explored the VE with increased scanning speed and distance and reduced cognitive re-processing on objects, employing a different, perhaps expert, visual search strategy indicative of increased SA. The Active Duty group maintained SA in the main visual search task and did not appear to shift focus to the secondary Math Task. Future work could compare how a stress inducing environment impacts these groups' physiological or cognitive markers and performance for these groups.

The use of the eye-fixation-related potential to investigate visual perception in professional domains with high attentional demand: a literature review

INTRODUCTION

Visual attention is a cognitive skill related to visual perception and neural activity, and also moderated by expertise, in time-constrained professional domains (e.g., aviation, driving, sport, surgery). However, the contribution of both perceptual and neural processes on performance has been studied separately in the literature.

DEVELOPMENT

We defend an integration of visual and neural signals to offer a more complete picture of the visual attention displayed by professionals of different skill levels when performing free-viewing tasks. Specifically, we propose to zoom the analysis in data related to the quiet eye and P300 component jointly, as a novel signal processing approach to evaluate professionals' visual attention.

CONCLUSION

This review highlights the advantages of using portable eye trackers and electroencephalogram systems altogether, as a promising technique for a better understanding of early cognitive components related to attentional processes. Altogether, the eye-fixation-related potentials method may provide a better understanding of the cognitive mechanisms employed by the participants in natural settings, revealing what visual information is of interest for participants and distinguishing the neural bases of visual attention between targets and non-targets whenever they perceive a stimulus during free viewing experiments.

Gaze patterns reflect the retrieval and selection of memories in a context-dependent object location retrieval task

Selective retrieval of context-relevant memories is critical for animal survival. A behavioral index that captures its dynamic nature in real time is necessary to investigate this retrieval process. Here, we found a bias in eye gaze towards the locations previously associated with individual objects during retrieval. Participants learned two locations associated with each visual object and recalled one of them indicated by a contextual cue in the following days. Before the contextual cue presentation, participants often gazed at both locations associated with the given object on the background screen (look-at-both), and the frequency of look-at-both gaze pattern increased as learning progressed. Following the cue presentation, their gaze shifted toward the context-appropriate location. Interestingly, participants showed a higher accuracy of memory retrieval in trials where they gazed at both object-associated locations, implying functional advantage of the look-at-both gaze patterns. Our findings indicate that naturalistic eye movements reflect the dynamic process of memory retrieval and selection, highlighting the potential of eye gaze as an indicator for studying these cognitive processes.

Integrating Biomarkers From Virtual Reality and Magnetic Resonance Imaging for the Early Detection of Mild Cognitive Impairment Using a Multimodal Learning Approach: Validation Study

BACKGROUND

Early detection of mild cognitive impairment (MCI), a transitional stage between normal aging and Alzheimer disease, is crucial for preventing the progression of dementia. Virtual reality (VR) biomarkers have proven to be effective in capturing behaviors associated with subtle deficits in instrumental activities of daily living, such as challenges in using a food-ordering kiosk, for early detection of MCI. On the other hand, magnetic resonance imaging (MRI) biomarkers have demonstrated their efficacy in quantifying observable structural brain changes that can aid in early MCI detection. Nevertheless, the relationship between VR-derived and MRI biomarkers remains an open question. In this context, we explored the integration of VR-derived and MRI biomarkers to enhance early MCI detection through a multimodal learning approach.

OBJECTIVE

We aimed to evaluate and compare the efficacy of VR-derived and MRI biomarkers in the classification of MCI while also examining the strengths and weaknesses of each approach. Furthermore, we focused on improving early MCI detection by leveraging multimodal learning to integrate VR-derived and MRI biomarkers.

METHODS

The study encompassed a total of 54 participants, comprising 22 (41%) healthy controls and 32 (59%) patients with MCI. Participants completed a virtual kiosk test to collect 4 VR-derived biomarkers (hand movement speed, scanpath length, time to completion, and the number of errors), and T1-weighted MRI scans were performed to collect 22 MRI biomarkers from both hemispheres. Analyses of covariance were used to compare these biomarkers between healthy controls and patients with MCI, with age considered as a covariate. Subsequently, the biomarkers that exhibited significant differences between the 2 groups were used to train and validate a multimodal learning model aimed at early screening for patients with MCI among healthy controls.

RESULTS

The support vector machine (SVM) using only VR-derived biomarkers achieved a sensitivity of 87.5% and specificity of 90%, whereas the MRI biomarkers showed a sensitivity of 90.9% and specificity of 71.4%. Moreover, a correlation analysis revealed a significant association between MRI-observed brain atrophy and impaired performance in instrumental activities of daily living in the VR environment. Notably, the integration of both VR-derived and MRI biomarkers into a multimodal SVM model yielded superior results compared to unimodal SVM models, achieving higher accuracy (94.4%), sensitivity (100%), specificity (90.9%), precision (87.5%), and F1-score (93.3%).

CONCLUSIONS

The results indicate that VR-derived biomarkers, characterized by their high specificity, can be valuable as a robust, early screening tool for MCI in a broader older adult population. On the other hand, MRI biomarkers, known for their high sensitivity, excel at confirming the presence of MCI. Moreover, the multimodal learning approach introduced in our study provides valuable insights into the improvement of early MCI detection by integrating a diverse set of biomarkers.

Classification images for aerial images capture visual expertise for binocular disparity and a prior for lighting from above

Using a novel approach to classification images (CIs), we investigated the visual expertise of surveyors for luminance and binocular disparity cues simultaneously after screening for stereoacuity. Stereoscopic aerial images of hedges and ditches were classified in 10,000 trials by six trained remote sensing surveyors and six novices. Images were heavily masked with luminance and disparity noise simultaneously. Hedge and ditch images had reversed disparity on around half the trials meaning hedges became ditch-like and vice versa. The hedge and ditch images were also flipped vertically on around half the trials, changing the direction of the light source and completing a 2 × 2 × 2 stimulus design. CIs were generated by accumulating the noise textures associated with "hedge" and "ditch" classifications, respectively, and subtracting one from the other. Typical CIs had a central peak with one or two negative side-lobes. We found clear differences in the amplitudes and shapes of perceptual templates across groups and noise-type, with experts prioritizing binocular disparity and using this more effectively. Contrariwise, novices used luminance cues more than experts meaning that task motivation alone could not explain group differences. Asymmetries in the luminance CIs revealed individual differences for lighting interpretation, with experts less prone to assume lighting from above, consistent with their training on aerial images of UK scenes lit by a southerly sun. Our results show that (i) dual noise in images can be used to produce simultaneous CI pairs, (ii) expertise for disparity cues does not depend on stereoacuity, (iii) CIs reveal the visual strategies developed by experts, (iv) top-down perceptual biases can be overcome with long-term learning effects, and (v) CIs have practical potential for directing visual training.

Clinical reasoning in pharmacy: What do eye movements and verbal protocols tell us about the processing of a case task?

This study investigates pharmacy students' reasoning while solving a case task concerning an acute patient counselling situation in a pharmacy. Participants' (N = 34) reasoning processes were investigated with written tasks utilizing eye-tracking in combination with verbal protocols. The case was presented in three pages, each page being followed by written questions. Eye movements were recorded during case processing. Success in the task required differentiating the relevant information from the task redundant information, and initial activation of several scripts and verification of the most likely one, when additional information became available. 2nd (n = 16) and 3rd (n = 18)-year students' and better and worse succeeding students' processes were compared. The results showed that only a few 2nd-year students solved the case correctly, whereas almost all of the 3rd-year students were successful. Generally, the average total processing times of the case material did not differ between the groups. However, better-succeeding and 3rd-year students processed the very first task-relevant sentences longer, indicating that they were able to focus on relevant information. Differences in the written answers to the 2nd and 3rd question were significant, whereas differences regarding the first question were not. Thus, eye-tracking seems to be able to capture illness script activation during case processing, but other methods are needed to depict the script verification process. Based on the results, pedagogical suggestions for advancing pharmacy education are discussed.

Evaluating Operator Training Performance Using Recurrence Quantification Analysis of Autocorrelation Transformed Eye Gaze Data

OBJECTIVE

This research aimed to investigate the relationship between gaze behaviour dynamics and operator performance.

BACKGROUND

Individuals differ in their approach when learning a new task often resulting in performance disparity. During training some individuals learn the structure and dynamics of the task and develop a systematic approach, whereas others may achieve the same result albeit with increased perceived workload, or indeed some may fail to achieve superior performance levels. Previous research has shown that comparing gaze of experts with novices can provide unique insights into cognitive functioning of superior performers.

METHODS

Twenty-five individuals participated in a computer-based simulation task. The concept of coefficient of variation (CoV) of task scores was used to compute the participants' consistency of performance. Based on CoV, the cohort was split into two performance categories. The temporal patterns in participants gaze data were transformed using autocorrelation, and recurrence quantification analysis (RQA) was employed to analyse and quantify the patterns.

RESULTS

A Mann-Whitney U analysis demonstrated significantly (p < .01) higher determinism, entropy and laminarity in the superior group compared to the moderate group. Pearson's correlation revealed a significant (p < .01) negative correlation between the consistency of task performance (CoV) and the RQA measures.

CONCLUSION

The results demonstrated that eye gaze dynamics can be used as an objective measure of performance. Participants classified as superior performers consistently demonstrated a systematic gaze activity which were in line with the task structure.

APPLICATION

The methods presented here are applicable to observe and evaluate operators' strategic distribution of gaze. Specifically, for tactical monitoring and decision making in task environments where spatial locations of elements-of-interest vary continuously.

Effects of Exercise Habits and Gender on Sports e-Learning Behavior: Evidence from an Eye-Tracking Study

Background/Objective

In the post-epidemic era, an increasing number of individuals were accustomed to learning sports and physical activity knowledge online for fitness and health demands. However, most previous studies have examined the influence of e-learning materials and resources on learners and have neglected intrinsic factors such as experience and physiological characteristics. Therefore, we conducted a study to investigate the effect of exercise habits and gender on sports e-learning behavior via eye-tracking technology.

Methods

We recruited a sample of 60 undergraduate students (mean age = 19.6) from a university in Nanjing, China. They were randomly assigned into 4 groups based on 2 genders × 2 exercise habits. Their gaze behavior was collected by an eye-tracking device during the experiment. The cognitive Load Test and Learning Effect Test were conducted at the end of the individual experiment.

Results

(1) Compared to the non-exercise habit group, the exercise habit group had a higher fixation count (P<0.05), a shorter average fixation duration (P<0.05), a smaller average pupil diameter (P<0.05), and a lower subjective cognitive load (P<0.05) and better learning outcome (P<0.05). (2) Male participants showed a greater tendency to process information from the video area of interest (AOIs), and had lower subjective cognitive load (P < 0.05) and better learning outcomes (P < 0.05). (3) There was no interaction effect between exercise habits and gender for any of the indicators (P > 0.05).

Conclusion

Our results indicate that exercise habits effectively enhance sports e-learning outcomes and reduce cognitive load. The exercise habits group showed significant improvements in fixation counts, average fixation duration, and average pupil diameter. Furthermore, male subjects exhibited superior learning outcomes, experienced lower cognitive load, and demonstrated greater attentiveness to dynamic visual information. These conclusions are expected to improve sports e-learning success and address educational inequality.

Embodied planning in climbing: how pre-planning informs motor execution

Introduction

The aim of the study is to address embodied planning in climbing. Embodied planning was conceptualized as the interaction between perceptual-cognitive pre-planning and motor execution.

Methods

In an experimental study, 18 climbers were asked to pre-plan a climbing route and to perform the route afterward. During pre-planning, the visual search pattern of climbers was captured using a portable eye tracker. After previewing, they were invited to climb the wall.

Results

Results revealed that holds looked at during pre-planning were used twice as much during route execution than those not looked at. The duration of fixations was longer for holds used than those not used during route execution. The experience of climbers (training years) correlated with visual strategies and climbing performance, such that experienced participants climbed faster and fixated at the holds not used for a shorter time.

Discussion

The visual behaviors of climbers were influenced by their past sensorimotor experiences during route previewing, impacting subsequent climbing performance.

Viewing angle, skill level and task representativeness affect response times in basketball defence

In basketball defence, it is impossible to keep track of all players without peripheral vision. This is the first study to investigate peripheral vision usage in an experimentally controlled setup, with sport-specific basketball stimuli from a first-person perspective, large viewing eccentricities (up to 90° to the left and right), and natural action responses. A CAVE and a motion-tracking system was used to project the scenarios and capture movement responses of high- and low-skilled basketball players, respectively. Four video conditions were created: (1) a simple reaction time task without crowding (only attackers), (2) a simple reaction time task with crowding (with attackers and defenders), (3) a choice-reaction time task where the player cutting to the basket eventually passed the ball to another player and (4) a game simulation. The results indicated eccentricity effects in all tests, a crowding effect in condition 2, and expertise differences in conditions 3 and 4 only. These findings suggest that viewing eccentricity has an impact on response times, that crowding is a limiting factor for peripheral perception in sports games, and that high-skilled but not low-skilled players can compensate for eccentricity effects in real game situations, indicating their superior positioning and perceptual strategies.

Patterns of saliency and semantic features distinguish gaze of expert and novice viewers of surveillance footage

When viewing the actions of others, we not only see patterns of body movements, but we also "see" the intentions and social relations of people. Experienced forensic examiners - Closed Circuit Television (CCTV) operators - have been shown to convey superior performance in identifying and predicting hostile intentions from surveillance footage than novices. However, it remains largely unknown what visual content CCTV operators actively attend to, and whether CCTV operators develop different strategies for active information seeking from what novices do. Here, we conducted computational analysis for the gaze-centered stimuli captured by experienced CCTV operators and novices' eye movements when viewing the same surveillance footage. Low-level image features were extracted by a visual saliency model, whereas object-level semantic features were extracted by a deep convolutional neural network (DCNN), AlexNet, from gaze-centered regions. We found that the looking behavior of CCTV operators differs from novices by actively attending to visual contents with different patterns of saliency and semantic features. Expertise in selectively utilizing informative features at different levels of visual hierarchy may play an important role in facilitating the efficient detection of social relationships between agents and the prediction of harmful intentions.

Action Quality Assessment Model Using Specialists' Gaze Location and Kinematics Data-Focusing on Evaluating Figure Skating Jumps

Action quality assessment (AQA) tasks in computer vision evaluate action quality in videos, and they can be applied to sports for performance evaluation. A typical example of AQA is predicting the final score from a video that captures an entire figure skating program. However, no previous studies have predicted individual jump scores, which are of great interest to competitors because of the high weight of competition. Despite the presence of unnecessary information in figure skating videos, human specialists can focus and reduce information when they evaluate jumps. In this study, we clarified the eye movements of figure skating judges and skaters while evaluating jumps and proposed a prediction model for jump performance that utilized specialists' gaze location to reduce information. Kinematic features obtained from the tracking system were input into the model in addition to videos to improve accuracy. The results showed that skaters focused more on the face, whereas judges focused on the lower extremities. These gaze locations were applied to the model, which demonstrated the highest accuracy when utilizing both specialists' gaze locations. The model outperformed human predictions and the baseline model (RMSE:0.775), suggesting a combination of human specialist knowledge and machine capabilities could yield higher accuracy.

The effect of dynamic versus static visualizations on acquisition of basketball game actions: a diurnal study

This study aimed to examine the effect of time of day (TOD) on the acquisition of basketball game actions from dynamic and static visualizations in physical education students (novice practitioners). Participants were quasi-randomly assigned to three treatments (static pictures, enriched static-pictures, or video). Morning and late-afternoon sessions were conducted, involving study phases and immediate-recall tests [game comprehension (GC) test and game performance (GP) test]. Oral temperature (OT) and mood states (MS) were also measured. Compared to the morning, the results revealed that afternoon resulted in higher OT, higher negative MS (e.g., anxiety and fatigue), and lower positive MS (i.e., vigor) in all experimental conditions. Moreover, the results showed that: (a) GC and GP decreased throughout the day (regardless of treatments), (b) GC and GP were better with enriched static-pictures (with arrows) than with static pictures, at both TOD, and (c) the video resulted in better GC and GP than the two static presentations, at both TOD. This study (a) highlights the morning's superiority in the acquisition of motor skills from dynamic and static visualizations, due to mood disturbances and lower arousal levels, and (b) encourages basketball teachers to use video modeling by experts, particularly in the morning, for explaining tactical skills.

Webcam-based eye-tracking to measure visual expertise of medical students during online histology training

Objectives

Visual expertise is essential for image-based tasks that rely on visual cues, such as in radiology or histology. Studies suggest that eye movements are related to visual expertise and can be measured by near-infrared eye-tracking. With the popularity of device-embedded webcam eye-tracking technology, cost-effective use in educational contexts has recently become amenable. This study investigated the feasibility of such methodology in a curricular online-only histology course during the 2021 summer term.

Methods

At two timepoints (t1 and t2), third-semester medical students were asked to diagnose a series of histological slides while their eye movements were recorded. Students' eye metrics, performance and behavioral measures were analyzed using variance analyses and multiple regression models.

Results

First, webcam-eye tracking provided eye movement data with satisfactory quality (mean accuracy=115.7 px±31.1). Second, the eye movement metrics reflected the students' proficiency in finding relevant image sections (fixation count on relevant areas=6.96±1.56 vs. irrelevant areas=4.50±1.25). Third, students' eye movement metrics successfully predicted their performance (R2adj=0.39, p<0.001).

Conclusion

This study supports the use of webcam-eye-tracking expanding the range of educational tools available in the (digital) classroom. As the students' interest in using the webcam eye-tracking was high, possible areas of implementation will be discussed.

Investigation of Camera-Free Eye-Tracking Glasses Compared to a Video-Based System

Technological advances in eye-tracking have resulted in lightweight, portable solutions that are capable of capturing eye movements beyond laboratory settings. Eye-tracking devices have typically relied on heavier, video-based systems to detect pupil and corneal reflections. Advances in mobile eye-tracking technology could facilitate research and its application in ecological settings; more traditional laboratory research methods are able to be modified and transferred to real-world scenarios. One recent technology, the AdHawk MindLink, introduced a novel camera-free system embedded in typical eyeglass frames. This paper evaluates the AdHawk MindLink by comparing the eye-tracking recordings with a research "gold standard", the EyeLink II. By concurrently capturing data from both eyes, we compare the capability of each eye tracker to quantify metrics from fixation, saccade, and smooth pursuit tasks-typical elements in eye movement research-across a sample of 13 adults. The MindLink system was capable of capturing fixation stability within a radius of less than 0.5∘, estimating horizontal saccade amplitudes with an accuracy of 0.04∘± 2.3∘, vertical saccade amplitudes with an accuracy of 0.32∘± 2.3∘, and smooth pursuit speeds with an accuracy of 0.5 to 3∘s, depending on the pursuit speed. While the performance of the MindLink system in measuring fixation stability, saccade amplitude, and smooth pursuit eye movements were slightly inferior to the video-based system, MindLink provides sufficient gaze-tracking capabilities for dynamic settings and experiments.

Cues for predictive eye movements in naturalistic scenes

We previously compared following of the same trajectories with eye movements, but either as an isolated targets or embedded in a naturalistic scene-in this case, the movement of a puck in an ice hockey game. We observed that the oculomotor system was able to leverage the contextual cues available in the naturalistic scene to produce predictive eye movements. In this study, we wanted to assess which factors are critical for achieving this predictive advantage by manipulating four factors: the expertise of the viewers, the amount of available peripheral information, and positional and kinematic cues. The more peripheral information became available (by manipulating the area of the video that was visible), the better the predictions of all observers. However, expert ice hockey fans were consistently better at predicting than novices and used peripheral information more effectively for predictive saccades. Artificial cues about player positions did not lead to a predictive advantage, whereas impairing the causal structure of kinematic cues by playing the video in reverse led to a severe impairment. When videos were flipped vertically to introduce more difficult kinematic cues, predictive behavior was comparable to watching the original videos. Together, these results demonstrate that, when contextual information is available in naturalistic scenes, the oculomotor system is successfully integrating them and is not relying only on low-level information about the target trajectory. Critical factors for successful prediction seem to be the amount of available information, experience with the stimuli, and the availability of intact kinematic cues for player movements.

Gaze patterns of dentists while evaluating bitewing radiographs

OBJECTIVES

Understanding dentists' gaze patterns on radiographs may allow to unravel sources of their limited accuracy and develop strategies to mitigate them. We conducted an eye tracking experiment to characterize dentists' scanpaths and thus their gaze patterns when assessing bitewing radiographs to detect primary proximal carious lesions.

METHODS

22 dentists assessed a median of nine bitewing images each, resulting in 170 datasets after excluding data with poor quality of gaze recording. Fixation was defined as an area of attentional focus related to visual stimuli. We calculated time to first fixation, fixation count, average fixation duration, and fixation frequency. Analyses were performed for the entire image and stratified by (1) presence of carious lesions and/or restorations and (2) lesion depth (E1/2: outer/inner enamel; D1-3: outer-inner third of dentin). We also examined the transitional nature of the dentists' gaze.

RESULTS

Dentists had more fixations on teeth with lesions and/or restorations (median=138 [interquartile range=87, 204]) than teeth without them (32 [15, 66]), p<0.001. Notably, teeth with lesions had longer fixation durations (407 milliseconds [242, 591]) than those with restorations (289 milliseconds [216, 337]), p<0.001. Time to first fixation was longer for teeth with E1 lesions (17,128 milliseconds [8813, 21,540]) than lesions of other depths (p = 0.049). The highest number of fixations were on teeth with D2 lesions (43 [20, 51]) and lowest on teeth with E1 lesions (5 [1, 37]), p<0.001. Generally, a systematic tooth-by-tooth gaze pattern was observed.

CONCLUSIONS

As hypothesized, while visually inspecting bitewing radiographic images, dentists employed a heightened focus on certain image features/areas, relevant to the assigned task. Also, they generally examined the entire image in a systematic tooth-by-tooth pattern.

Eye-tracking technology and the dynamics of natural gaze behavior in sports: an update 2016-2022

Updating and complementing a previous review on eye-tracking technology and the dynamics of natural gaze behavior in sports, this short review focuses on the progress concerning researched sports tasks, applied methods of gaze data collection and analysis as well as derived gaze measures for the time interval of 2016-2022. To that end, a systematic review according to the PRISMA guidelines was conducted, searching Web of Science, PubMed Central, SPORTDiscus, and ScienceDirect for the keywords: eye tracking, gaze behavio*r, eye movement, and visual search. Thirty-one studies were identified for the review. On the one hand, a generally increased research interest and a wider area of researched sports with a particular increase in official's gaze behavior were diagnosed. On the other hand, a general lack of progress concerning sample sizes, amounts of trials, employed eye-tracking technology and gaze analysis procedures must be acknowledged. Nevertheless, first attempts to automated gaze-cue-allocations (GCA) in mobile eye-tracking studies were seen, potentially enhancing objectivity, and alleviating the burden of manual workload inherently associated with conventional gaze analyses. Reinforcing the claims of the previous review, this review concludes by describing four distinct technological approaches to automating GCA, some of which are specifically suited to tackle the validity and generalizability issues associated with the current limitations of mobile eye-tracking studies on natural gaze behavior in sports.

From Image to Diagnosis: Characterizing Sources of Error in Histopathologic Interpretation

An accurate histopathologic diagnosis on surgical biopsy material is necessary for the clinical management of patients and has important implications for research, clinical trial design/enrollment, and public health education. This study used a mixed methods approach to isolate sources of diagnostic error while residents and attending pathologists interpreted digitized breast biopsy slides. Ninety participants including pathology residents and attendings at major United States medical centers reviewed a set of 14 digitized whole slide images of breast biopsies. Each case had a consensus-defined diagnosis and critical region of interest (cROI) representing the most significant pathology on the slide. Participants were asked to view unmarked digitized slides, draw their own participant region of interest (pROI), describe its features, and render a diagnosis. Participants' review behavior was tracked using case viewer software and an eye-tracking device. Diagnostic accuracy was calculated in comparison to the consensus diagnosis. We measured the frequency of errors emerging during four interpretive phases: 1) detecting the cROI, 2) recognizing its relevance, 3) using the correct terminology to describe findings in the pROI, and 4) making a diagnostic decision. According to eye tracking data, both trainees and attending pathologists were very likely (about 94% of the time) to find the cROI when inspecting a slide. However, trainees were less likely to consider the cROI relevant to their diagnosis. Pathology trainees were more likely (41% of cases) to use incorrect terminology to describe pROI features than attending pathologists (21% of cases). Failure to accurately describe features was the only factor strongly associated with an incorrect diagnosis. Identifying where errors emerge in the interpretive and/or descriptive process and working on building organ-specific feature recognition and verbal fluency in describing those features are critical steps for achieving competency in diagnostic decision making.

Gaze patterns reflect and predict expertise in dynamic echocardiographic imaging

Purpose

Echocardiography is the most important modality in cardiac imaging. Rapid valid visual assessment is a critical skill for image interpretation. However, it is unclear how skilled viewers assess echocardiographic images. Therefore, guidance and implicit advice are needed for learners to achieve valid image interpretation.

Approach

Using a signal detection approach, we compared 15 certified experts with 15 medical students in their diagnostic decision-making and viewing behavior. To quantify attention allocation, we recorded eye movements while viewing dynamic echocardiographic imaging loops of patients with reduced ejection fraction and healthy controls. Participants evaluated left ventricular ejection fraction and image quality (as diagnostic and visual control tasks, respectively).

Results

Experts were much better at discriminating between patients and healthy controls (d ' of 2.58, versus 0.98 for novices). Eye tracking revealed that experts fixated diagnostically relevant areas earlier and more often, whereas novices were distracted by visually salient task-irrelevant stimuli. We show that expertise status can be almost perfectly classified either based on judgments or purely on eye movements and that an expertise score derived from viewing behavior predicts diagnostic quality.

Conclusions

Judgments and eye tracking revealed significant differences between echocardiography experts and novices that can be used to derive numerical expertise scores. Experts have implicitly learned to ignore the salient motion cue presented by the mitral valve and to focus on the diagnostically more relevant left ventricle. These findings have implications for echocardiography training, objective characterization of echocardiographic expertise, and the design of user-friendly interfaces for echocardiography.

Research on visual search behaviors of basketball players at different levels of sports expertise

This study aims to examine visual search strategies of skilled basketball players in an anticipation task. This study selected 48 experienced and inexperienced basketball players. The participants were grouped into novice and expert groups based on their experience. The participants were asked to look at series of pictures of offensive patterns of play in a basketball game from a third person perspective and chose one of the three options: passing, shooting and break through. This study measured and recorded the response time, key pressing results, and eye movements. Eye movement data were recorded using the Tobii X-3 120 eye tracker. The results showed that, the expert group demonstrated superior anticipation performance, and were more accuracy. In addition, the results showed that participants in the expert group and faster predicted the offensive way faster than the novice group. The results also showed that experienced basketball players employed a simple and efficient visual search strategy including greater fixation counts and longer fixation duration on more informative areas than the novice group. Furthermore, the visualization metrics showed that the expert group had a more concise fixation trajectory and focused mainly on key information area. Generally, expert players exhibited a more efficient and effective visual search strategy demonstrating better performance on anticipation tasks.

Eye tracking: empirical foundations for a minimal reporting guideline

In this paper, we present a review of how the various aspects of any study using an eye tracker (such as the instrument, methodology, environment, participant, etc.) affect the quality of the recorded eye-tracking data and the obtained eye-movement and gaze measures. We take this review to represent the empirical foundation for reporting guidelines of any study involving an eye tracker. We compare this empirical foundation to five existing reporting guidelines and to a database of 207 published eye-tracking studies. We find that reporting guidelines vary substantially and do not match with actual reporting practices. We end by deriving a minimal, flexible reporting guideline based on empirical research (Section "An empirically based minimal reporting guideline").

Visual expertise is more than meets the eye: an examination of holistic visual processing in radiologists and architects

Purpose

One of the dominant behavioral markers of visual-expert search strategy, holistic visual processing (HVP), suggests that experts process information from a larger region of space in conjunction with a more focused gaze pattern to improve search speed and accuracy. To date, extant literature suggests that visual search expertise is domain specific, including HVP and its associated behaviors.

Approach

The current study is the first to use eye tracking to directly measure the HVP strategies of two expert groups, radiologists and architects, in comparison to one another and a novice control.

Results

In doing so, we replicated and extended this prior research: visual expertise is domain specific. However, our eye-tracking data indicate that contrary to this prior work, HVP strategies are transferable across domains. Yet, despite the transfer of HVP strategies, there is neither reduced search time nor greater accuracy in visual search outside of an expert's domain.

Conclusions

Therefore, our data suggest that HVP behaviors are a particular form of visual search mechanism that, outside of an expert's native search-ecology, are not necessarily conducive to more general visual search success. It is in addition to explicit knowledge of an expert's domain, how to search, and where to search, that HVP strategies are their most effective for visual search success.

Information acquisition and cognitive processes during strategic decision-making: Combining a policy-capturing study with eye-tracking data

Policy-capturing (PC) methodologies have been employed to study decision-making, and to assess how decision-makers use available information when asked to evaluate hypothetical situations. An important assumption of the PC techniques is that respondents develop cognitive models to help them efficiently process the many information cues provided while reviewing a large number of decision scenarios. With this study, we seek to analyze the process of answering a PC study. We do this by investigating the information acquisition and the cognitive processes behind policy-capturing, building on cognitive and attention research and exploiting the tools of eye-tracking. Additionally, we investigate the role of experience in mediating the relationship between the information processed and judgments in order to determine how the cognitive models of student samples differ from those of professionals. We find evidence of increasing efficiency as a function of practice when respondents undergo the PC experiment. We also detect a selective process on information acquisition; such selection is consistent with the respondents' evaluation. While some differences are found in the information processing among the split sample of students and professionals, remarkable similarities are detected. Our study adds confidence to the assumption that respondents build cognitive models to handle the large amounts of information presented in PC experiments, and the defection of such models is not substantially affected by the applied sample.

Don't overthink it: The paradoxical nature of expertise for the detection of errors in conceptual business process models

Business process models are widely used artifacts in design activities to facilitate communication about business domains and processes. Despite being an extensively researched topic, some aspects of conceptual business modeling are yet to be fully explored and understood by academicians and practitioners alike. We study the attentional characteristics specific to experts and novices in a semantic and syntactic error detection task across 75 Business Process Model and Notation (BPMN) models. We find several intriguing results. Experts correctly identify more error-free models than novices, but also tend to find more false positive defects. Syntactic errors are diagnosed faster than semantic errors by both groups. Both groups spend more time on error-free models. Our findings regarding the ambiguous differences between experts and novices highlight the paradoxical nature of expertise and the need to further study how best to train business analysts to design and evaluate conceptual models.

A Platform for Tracking Surgeon and Observer Gaze as a Surrogate for Attention in Ophthalmic Surgery

Purpose

To develop and validate a platform that can extract eye gaze metrics from surgeons observing cataract and vitreoretinal procedures and to enable post hoc data analysis to assess potential discrepancies in eye movement behavior according to surgeon experience.

Design

Experimental, prospective, single-center study.

Participants

Eleven ophthalmic surgeons observing deidentified vitreoretinal and cataract surgical procedures performed at a single university-based medical center.

Methods

An open-source platform was developed to extract gaze coordinates and metrics from ophthalmic surgeons via a computer vision algorithm in conjunction with a neural network to track and segment instruments and tissues, identifying areas of attention in the visual field of study subjects. Eleven surgeons provided validation data by watching videos of 6 heterogeneous vitreoretinal and cataract surgical phases.

Main Outcome Measures

Accuracy and distance traveled by the eye gaze of participants and overlap of the participants' eye gaze with instruments and tissues while observing surgical procedures.

Results

The platform demonstrated repeatability of > 94% when acquiring the eye gaze behavior of subjects. Attending ophthalmic surgeons and clinical fellows exhibited a lower overall cartesian distance traveled in comparison to resident physicians in ophthalmology (P < 0.02). Ophthalmology residents and clinical fellows exhibited more fixations to the display area where surgical device parameters were superimposed than attending surgeons (P < 0.05). There was a trend toward gaze overlap with the instrument tooltip location among resident physicians in comparison to attending surgeons and fellows (41.42% vs. 34.8%, P > 0.2). The number and duration of fixations did not vary substantially among groups (P > 0.3).

Conclusions

The platform proved effective in extracting gaze metrics of ophthalmic surgeons. These preliminary data suggest that surgeon gaze behavior differs according to experience.

A review of the essential visual skills required for soccer: Beyond 20-20 optometry

In ball sports such as soccer, the visual system is critical in guiding a player's search for crucial information that underpins skillful behavior, which requires the incorporation of all of the relevant information in the environment in order to make successful decisions under pressure. However, vision in sport, and focusing on the specific visual skills required to be successful in a particular sport has largely been a practice ignored by experts and coaches as being an essential component of athletic performance. This is the first attempt to summarize and compile the necessary visual skills for soccer. This review's evidence suggests that, while current research still tends to focus on visual skills as a whole, there is a need to streamline this focus to the necessities of a particular sport. Furthermore, in identifying the visual skills essential for soccer, it allows for the effective training and testing of these skills, as well as for talent identification.

Differences in visual search behavior between expert and novice team sports athletes: A systematic review with meta-analysis

Background

For a long time, in sports, researchers have tried to understand an expert by comparing them with novices, raising the doubts if the visual search characteristics distinguish experts from novices. Therefore, the aim of the present study was to review and conduct a meta-analysis to evaluate the differences in visual search behavior between experts and novices in team sports athletes.

Methods

This systematic review with meta-analysis followed the PRISMA 2020 and Cochrane's guidelines. Healthy team athletes were included, which engaged in regular practice, from any sex or competitive level, specifically classified a priori as expert or novice in the original research (i.e., if they were classified after the experiment, based on one of the tests, the study would be excluded). We considered only research published in peer-reviewed journals, with no limitations regarding date or language. It was considered healthy team sport athletes engaged in regular practice. The scenarios could be in situ or film-based. The databases of EBSCO (Academic Search Complete, Academic Search Ultimate, APA PsycArticles, and APA PsycINFO), PubMed, Scopus, SPORTDiscus, and Web of Science were used to perform the searches. The risk of bias was calculated through the RoBANS tool.

Results

From a total of 6,257 records, of which 985 were duplicates, titles and abstracts of 5,272 were screened, and 45 required full-text analysis. Of those, 23 were excluded due to not fulfilling the eligibility criteria regarding participants. In the end, 22 studies were selected, however, as two studies were part of the same trial and were analyzed conjointly.

Discussion

Experts showed to be older and with more years of practice. The ability to distinguish experts from novices was not so clear regarding the variables analyzed. This could be due to the strategies chosen in each study, which were specific to each scenario, and when grouping all together, it was lost information within non-representative averages. The distinction between experts and novices was not clear, showing a lot of heterogeneity in the included studies. The expert classification itself may have been the conditioning aspect for these results, retaining the doubt and the need for more studies in the field.

Systematic review registration

The protocol was pre-registered in OSF (project https://osf.io/3j4qv/, register https://osf.io/dvk2n).

A Meta-analysis on the Effect of Expertise on Eye Movements during Music Reading

The current meta-analysis was conducted on 12 studies comparing the eye movements of expert versus non-expert musicians and attempted to determine which eye movement measures are expertise dependent during music reading. The total dataset of 61 comparisons was divided into four subsets, each concerning one eye-movement variable (i.e., fixation duration, number of fixations, saccade amplitude, and gaze duration). We used a variance estimation method to aggregate the effect sizes. The results support the robust finding of reduced fixation duration in expert musicians (Subset 1, g = -0.72). Due to low statistical power because of limited effect sizes, the results on the number of fixations, saccade amplitude, and gaze duration were not reliable. We conducted meta-regression analyses to determine potential moderators of the effect of expertise on eye movements (i.e., definition of experimental groups, type of musical task performed, type of musical material used or tempo control). Moderator analyses did not yield any reliable results. The need for consistency in the experimental methodology is discussed.

Examining the Eye Movement Behaviors Associated With Skilled Decision-Making by Elite Australian Rules Football Players

Exploration of eye-movement behaviors of humans can provide insight into the processes used to inform and make decisions, with a large body of research revealing general trends, especially in the sporting context. Despite this some questions remain within the sport context particularly for elite groups engaged in diverse sports, and the potential for this information to provide for training, development, and performance. Therefore, the purpose of this study was to examine the critical fixation points and durations associated with superior decision-making within an elite group of Australian Rules football players. To achieve this eye-movement behavior (fixations) and associated decision-making skills of (N = 27; Mage = 25.0 ± 3.7 yrs) elite Australian Rules (AR) football players were measured while they watched game-based video clips. The most skilled players made significantly faster decisions compared to less skilled players (p < 0.001), who also had significantly shorter total fixation duration (p < 0.0001). Further, analysis showed that the most skilled players spent more time fixating on potential options within an area of interest (p = 0.003). Thus, within a group of highly skilled group of athletes, distinctions can be made on perceptual-cognitive skills, for outcome decisions and decision processes. That is, skilled decision-makers appear to have more efficient visual search strategies, which may help them process visual information more effectively. Further, examination of these behaviors may aid sport science and coaching staff identify the process that can be refined to increase player ability between and within various teams.

The Defender's Vision-Gaze Behavior of One-on-One Defenders in Basketball

In fast-paced team sports, anticipation is one important element in defense strategies. The primary objective of this study was to examine the recommendation for action and use of defensive gaze strategies by defensive players in basketball. Four national-level expert-basketball coaches were interviewed and a field study with mobile eye-tracking devices was conducted on 16 expert and 16 novice players defending in a one-on-one situation. Differences in relative fixation times between experts and novices were elaborated for the predetermined gaze zones-head, ball, torso, and feet-as given by the expert coaches. This was done for three phases of the movement sequence: receiving, dribbling, and shooting. The results of the interviews with expert coaches indicated that the existing coaching doctrine instructs players to look at the torso of an opponent to avoid being vulnerable to fakes. Surprisingly, our findings with the players showed a discrepancy in the evaluated gaze behavior of the experts and novices. For the receiving and dribbling phase, experts mainly fixated their gaze on the head while novices focused on the ball. For the final shooting phase, both the groups mainly fixated their gaze on the ball. Fixating the gaze on the ball or head makes the player potentially vulnerable to deceptive movements, as video-based research has shown. Expert coaches also indicated that peripheral vision is of importance to defenders, contradicting the existing assumption in the literature that focusing on the task-relevant areas is key for anticipation performance.

LAG-1: A dynamic, integrative model of learning, attention, and gaze

It is clear that learning and attention interact, but it is an ongoing challenge to integrate their psychological and neurophysiological descriptions. Here we introduce LAG-1, a dynamic neural field model of learning, attention and gaze, that we fit to human learning and eye-movement data from two category learning experiments. LAG-1 comprises three control systems: one for visuospatial attention, one for saccadic timing and control, and one for category learning. The model is able to extract a kind of information gain from pairwise differences in simple associations between visual features and categories. Providing this gain as a reentrant signal with bottom-up visual information, and in top-down spatial priority, appropriately influences the initiation of saccades. LAG-1 provides a moment-by-moment simulation of the interactions of learning and gaze, and thus simultaneously produces phenomena on many timescales, from the duration of saccades and gaze fixations, to the response times for trials, to the slow optimization of attention toward task relevant information across a whole experiment. With only three free parameters (learning rate, trial impatience, and fixation impatience) LAG-1 produces qualitatively correct fits for learning, behavioural timing and eye movement measures, and also for previously unmodelled empirical phenomena (e.g., fixation orders showing stimulus-specific attention, and decreasing fixation counts during feedback). Because LAG-1 is built to capture attention and gaze generally, we demonstrate how it can be applied to other phenomena of visual cognition such as the free viewing of visual stimuli, visual search, and covert attention.

The elephant in the room: attention to salient scene features increases with comedic expertise

What differentiates the joke writing strategy employed by professional comedians from non-comedians? Previous MRI work found that professional comedians relied to a greater extent on "bottom-up processes," i.e., associations driven by the prompt stimuli themselves, while controls relied more on prefrontal lobe directed, "top-down" processes. In the present work, professional improv comedians and controls generated humorous captions to cartoons while their eye movements were tracked. Participants' visual fixation patterns were compared to predictions of the saliency model (Harel et al. in Adv Neural Inf Process Syst 19:545-552, 2007)-a computer model for identifying the most salient locations in an image based on visual features. Captions generated by the participants were rated for funniness by independent raters. Relative to controls, professional comedians' gaze was driven to a greater extent by the cartoons' salient visual features. For all participants, captions' funniness positively correlated with visual attention to salient cartoon features. Results suggest that comedic expertise is associated with increased reliance on bottom-up, stimulus-driven creativity, and that a bottom-up strategy results, on average, in funnier captions whether employed by comedians or controls. The cognitive processes underlying successful comedic creativity appear to adhere to the old comedians' adage "pay attention to the elephant in the room."

Improving Soccer Players' Memorization of Soccer Tactics: Effects of Visual Realism, Soccer Expertise and Visuospatial Abilities

In this study we aimed to examine the effect of visual realism on soccer players' memorization of soccer tactics according to their level of expertise and visuospatial abilities. We divided 48 volunteers into novice and expert soccer players and had them first perform a multitask visuospatial abilities (VSA) test and then undergo training with three dynamic soccer scenes, each presented with varied levels of realism (schematic, moderately realistic and highly realistic). We then tested players' memorization and reproduction of the soccer scenes and measured their visual processing with eye-tracking glasses to identify their cognitive processes during memorization. We found that reducing visual realism improved visual processing and memorization when compared to higher realism (p < .001). Second, both higher (versus lower) player expertise and higher (versus lower) VSA influenced visual processing and enhanced memorization efficiency (p < .001). Third, there were significant interaction effects between visual realism, player expertise, and player VSA (p < .001) such that players with high VSA benefited more from reduced (versus accentuated) visual realism than did players with low-VSA. Thus, increasing visual realism can hinder tactical learning effectiveness, especially for learners who lack domain expertise and visuospatial abilities. Practically speaking, coaches and educators might improve their communications by tailoring tactical instructions to learners' cognitive skills.

Eye-Tracking Indicators of Workload in Surgery: A Systematic Review

BackgroundEye tracking is a powerful tool for unobtrusive and real time assessment of workload in clinical settings. Before the complex eye tracking derived surrogates can be proactively utilized to improve surgical safety, the indications, validity and reliability requires careful evaluation.MethodsWe conducted a systematic review of literature from 2010 to 2020 according to PRISMA guidelines. A search on PubMed, Cochrane, Scopus, Web of science, PsycInfo and Google scholar databases was conducted on July 2020. The following search query was used" ("eye tracking" OR "gaze tracking") AND (surgery OR surgical OR operative OR intraoperative) AND (workload OR stress)". Short papers, no peer reviewed or papers in which eye-tracking methodology was not used to investigate workload or stress factors in surgery, were omitted.ResultsA total of 17 (N = 17) studies were identified eligible to this review. Most of the studies (n = 15) measured workload in simulated setting. Task difficulty and expertise were the most studied factors. Studies consistently showed surgeon's eye movements such as pupil responses, gaze patterns, blinks were associated with the level of perceived workload. However, differences between measurements in operational room and simulated environments have been found.ConclusionPupil responses, blink rate and gaze indices are valid indicators of workload. However, the effect of distractions and non-technical factors on workload is underrepresented aspect in the literature even though recognized as underlying factors in successful surgery.

Is AI Augmenting or Substituting Humans?

In this paper, the authors focus on Artificial Intelligence as a tangible technology that is designed to sense, comprehend, act, and learn. There are two manifestations of AI in the medical service: an algorithm that analyzes and interprets the test result and a virtual assistant that communicates the result to the patient. The aim of this paper is to consider how AI can substitute a doctor in measuring human health and how the interaction with virtual assistant impacts one’s visual attention processes. Theoretically, the article refers to the following research strands: Human-Computer Interaction, technology in services, implementation of AI in the medical sector, and behavioral economy. By conducting an eye-tracking experimental study, it is demonstrated that the perception of medical diagnosis does not differ across experimental groups (human vs. AI). However, it is observed that participants exposed to AI-based assistant focused more on button allowing to contact a real doctor.

Dissociations between performance and visual fixations after subordinate- and basic-level training with novel objects

Previous work suggests that subordinate-level object training improves exemplar-level perceptual discrimination over basic-level training. However, the extent to which visual fixation strategies and the use of visual features, such as color and spatial frequency (SF), change with improved discrimination was not previously known. In the current study, adults (n = 24) completed 6 days of training with 2 families of computer-generated novel objects. Participants were trained to identify one object family at the subordinate level and the other object family at the basic level. Before and after training, discrimination accuracy and visual fixations were measured for trained and untrained exemplars. To examine the impact of training on visual feature use, image color and SF were manipulated and tested before and after training. Discrimination accuracy increased for the object family trained at the subordinate-level, but not for the family trained at the basic level. This increase was seen for all image manipulations (color, SF) and generalized to untrained exemplars within the trained family. Both subordinate- and basic-level training increased average fixation duration and saccadic amplitude and decreased the number of total fixations. Collectively, these results suggest a dissociation between discrimination accuracy, indicative of recognition, and the associated pattern of changes present for visual fixations.

Brain substrates for automatic retrieval of value memory in the primate basal ganglia

Our behavior is often carried out automatically. Automatic behavior can be guided by past experiences, such as learned values associated with objects. Passive-viewing and free-viewing tasks with no immediate outcomes provide a testable condition in which monkeys and humans automatically retrieve value memories and perform habitual searching. Interestingly, in these tasks, caudal regions of the basal ganglia structures are involved in automatic retrieval of learned object values and habitual gaze. In contrast, rostral regions do not participate in these activities but instead monitor the changes in outcomes. These findings indicate that automatic behaviors based on the value memories are processed selectively by the caudal regions of the primate basal ganglia system. Understanding the distinct roles of the caudal basal ganglia may provide insight into finding selective causes of behavioral disorders in basal ganglia disease.

Teachers' visual processing of children's off-task behaviors in class: A comparison between teachers and student teachers

As teachers are responsible for responding instantaneously to students' statements and actions, the progress of the class, and their teaching purpose, they need to be able to engage in responsive teaching. Teachers obtain information about students' learning by observing them in the classroom, and subsequently make instructional decisions based on this information. Teachers need to be sensitive to student behaviors and respond accordingly, because there are students who follow the teacher's instructions and those who do not in every classroom. Skilled teachers may distribute their gaze over the entire class and discover off-task behaviors. So how does a teacher's visual processing and noticing ability develop? It is important to clarify this process for both experienced teachers and student teachers. Therefore, the purpose of this study was to investigate whether there is a difference in visual processing and the ability to notice off-task behaviors in class between teachers and student teachers through gaze analysis. Using an eye tracking device, 76 teachers and 147 student teachers were asked to watch a video, and gaze measurements were collected. In the video, students exhibiting off-task behaviors in class were prompted by their classroom teacher to participate in the lesson. After the video, the participants were asked if they could identify the students who had displayed off-task behaviors and whom the teachers had warned. The results showed that teachers gazed at students engaging in off-task behaviors in class more often and noticed them at a higher rate than student teachers did. These results may be attributed to differences in the experiences of visual processing of relevant information in the classroom between teachers and student teachers. Thus, the findings on teachers' visual processing by direct measurement of gaze will be able to contribute to teachers' development.

Effects of Acute Physical Fatigue on Gaze Behavior and Performance During a Badminton Game

In badminton, the ability to quickly gather relevant visual information is one of the most important determinants of performance. However, gaze behavior has never been investigated in a real-game setting (with fatigue), nor related to performance. The aim of this study was to evaluate the effect of fatigue on gaze behavior during a badminton game setting, and to determine the relationship between fatigue, performance and gaze behavior. Nineteen novice badminton players equipped with eye-tracking glasses played two badminton sets: one before and one after a fatiguing task. The duration and number of fixations for each exchange were evaluated for nine areas of interest. Performance in terms of points won or lost and successful strokes was not impacted by fatigue, however fatigue induced more fixations per exchange on two areas of interest (shuttlecock and empty area after the opponent's stroke). Furthermore, two distinct gaze behaviors were found for successful and unsuccessful performance: points won were associated with fixations on the boundary lines and few fixation durations on empty area before the participant's stroke; successful strokes were related to long fixation durations, few fixation durations on empty area and a large number of fixations on the shuttlecock, racket, opponent's upper body and anticipation area. This is the first study to use a mobile eye-tracking system to capture gaze behavior during a real badminton game setting: fatigue induced changes in gaze behavior, and successful and unsuccessful performance were associated with two distinct gaze behaviors.

Improving Airline Pilots’ Visual Scanning and Manual Flight Performance through Training on Skilled Eye Gaze Strategies

Poor cockpit monitoring has been identified as an important contributor to aviation accidents. Improving pilots’ monitoring strategies could therefore help to enhance flight safety. During two different sessions, we analyzed the flight performance and eye movements of professional airline pilots in a full-flight simulator. In a pre-training session, 20 pilots performed a manual approach scenario as pilot flying (PFs) and were classified into three groups according to their flight performance: unstabilized, standard, and most accurate. The unstabilized pilots either under- or over-focused various instruments. Their number of visual scanning patterns was lower than those of pilots who managed to stabilize their approach. The most accurate pilots showed a higher perceptual efficiency with shorter fixation times and more fixations on important primary flight instruments. Approximately 10 months later, fourteen pilots returned for a post-training session. They received a short training program and performed a similar manual approach as during the pre-training session. Seven of them, the experimental group, received individual feedback on their own performance and visual behavior (i.e., during the pre-training session) and a variety of data obtained from the most accurate pilots, including an eye-tracking video showing efficient visual scanning strategies from one of the most accurate pilots. The other seven, the control group, received general guidelines on cockpit monitoring. During the post-training session, the experimental group had better flight performance (compared to the control group), and its visual scanning strategies became more similar to those of the most accurate pilots. In summary, our results suggest that cockpit monitoring underlies manual flight performance and that it can be improved using a training program based mainly on exposure to eye movement examples from highly accurate pilots.

More scanning, but not zooming, is associated with diagnostic accuracy in evaluating digital breast pathology slides

Diagnoses of medical images can invite strikingly diverse strategies for image navigation and visual search. In computed tomography screening for lung nodules, distinct strategies, termed scanning and drilling, relate to both radiologists' clinical experience and accuracy in lesion detection. Here, we examined associations between search patterns and accuracy for pathologists (N = 92) interpreting a diverse set of breast biopsy images. While changes in depth in volumetric images reveal new structures through movement in the z-plane, in digital pathology changes in depth are associated with increased magnification. Thus, "drilling" in radiology may be more appropriately termed "zooming" in pathology. We monitored eye-movements and navigation through digital pathology slides to derive metrics of how quickly the pathologists moved through XY (scanning) and Z (zooming) space. Prior research on eye-movements in depth has categorized clinicians as either "scanners" or "drillers." In contrast, we found that there was no reliable association between a clinician's tendency to scan or zoom while examining digital pathology slides. Thus, in the current work we treated scanning and zooming as continuous predictors rather than categorizing as either a "scanner" or "zoomer." In contrast to prior work in volumetric chest images, we found significant associations between accuracy and scanning rate but not zooming rate. These findings suggest fundamental differences in the relative value of information types and review behaviors across two image formats. Our data suggest that pathologists gather critical information by scanning on a given plane of depth, whereas radiologists drill through depth to interrogate critical features.

Lernergebnisse und individuelle Prozesse des Physik-Lernens mit auditiven und visuellen Hinweisen

Zusammenfassung. Die vorliegende Studie untersuchte im Kontext einer videobasierten Lernumgebung, inwieweit Personen durch die Darbietung von auditiven und visuellen Hinweisen beim Lernen komplexer Inhalte unterstützt werden können. Vor dem Hintergrund von Theorien des multimedialen Lernens wurden die Wirkungen der Hinweise auf kognitive Belastung, Lernerfolg sowie Blickbewegungen der Lernenden analysiert. In einem experimentellen Zwei-Gruppen-Design mit Vor- und Nachtest lernten 46 Teilnehmerinnen und Teilnehmer mithilfe visueller ( n = 23) oder auditiver ( n = 23) Unterstützung. Den Lerngegenstand bildeten Skizzen elektrischer Schaltungen, die als kognitives Werkzeug zur Lösung physikalischer Aufgaben eingesetzt werden. Es ergaben sich zwischen den Versuchsbedingungen keine signifikanten Unterschiede in Belastungserleben und Lernerfolg (.00 ≤ ηp2 ≤ .08). Allerdings waren Maße der kognitiven Belastung signifikante Prädiktoren des Lernerfolgs. Es zeigten sich auch bedeutsame Einflüsse des Vorwissens auf Wissensabruf ( R2 = .213) und Wissenstransfer ( R2 = .257). Im Rahmen qualitativer Auswertungen wurden zudem die Blickpfade von Personen mit niedrigem und hohem Vorwissen verglichen. Hier zeigte sich in beiden Modalitäten bei Personen mit niedrigem Vorwissen eher ein detailorientiertes Blickmuster auf Einzelelemente der Schaltungen und bei Personen mit hohem Vorwissen eher ein ganzheitlich orientiertes Blickmuster über das System von Schaltungen. In Bezug auf die vorwissensabhängigen Unterschiede in den Blickmustern und die Komplexität des Lerngegenstandes erscheinen sowohl eine zeitliche als auch eine instruktionale Adaptierbarkeit der Lernumgebung für Lernende mit wenig Vorwissen in beiden Hinweismodalitäten sinnvoll. Für die zukünftige Forschung bietet es sich im Sinne eines Mixed-Method-Ansatzes an, Prozesse und Ergebnisse des Lernens stärker aufeinander zu beziehen, um zu tieferen Erkenntnissen über die Nutzung und Wirkung instruktionaler Hinweise zu gelangen.