Evaluation of strategies to train visual search performance in professional populations

Visual inspection problem-solving strategies at different experience levels

Airport security screening is a visual inspection task comprising search and decision. Problem solving is used to support decision making. However, it is not well understood. This study investigated how airport security screeners employ problem solving during x-ray screening, and how strategies change with experience. Thirty-nine professional security screeners were observed performing x-ray screening in the field at an Australian International Airport. Video and eye-tracking data were collected and analysed to explore activity phases and problem-solving strategies. Less-experienced screeners performed more problem solving and preferred problem-solving strategies that rely on visual examination without decision support or that defer decision making, compared to more-experienced screeners, who performed efficient and independent strategies. Findings also show that screeners need more time to develop problem-solving skills than visual scanning skills. Screeners would benefit from problem-solving support tools and intensified training and mentorship within the first six months of experience to advance problem-solving competencies.

The effects of gaze-display feedback on medical students' self-monitoring and learning in radiology

Self-monitoring is essential for effectively regulating learning, but difficult in visual diagnostic tasks such as radiograph interpretation. Eye-tracking technology can visualize viewing behavior in gaze displays, thereby providing information about visual search and decision-making. We hypothesized that individually adaptive gaze-display feedback improves posttest performance and self-monitoring of medical students who learn to detect nodules in radiographs. We investigated the effects of: (1) Search displays, showing which part of the image was searched by the participant; and (2) Decision displays, showing which parts of the image received prolonged attention in 78 medical students. After a pretest and instruction, participants practiced identifying nodules in 16 cases under search-display, decision-display, or no feedback conditions (n = 26 per condition). A 10-case posttest, without feedback, was administered to assess learning outcomes. After each case, participants provided self-monitoring and confidence judgments. Afterward, participants reported on self-efficacy, perceived competence, feedback use, and perceived usefulness of the feedback. Bayesian analyses showed no benefits of gaze displays for post-test performance, monitoring accuracy (absolute difference between participants' estimated and their actual test performance), completeness of viewing behavior, self-efficacy, and perceived competence. Participants receiving search-displays reported greater feedback utilization than participants receiving decision-displays, and also found the feedback more useful when the gaze data displayed was precise and accurate. As the completeness of search was not related to posttest performance, search displays might not have been sufficiently informative to improve self-monitoring. Information from decision displays was rarely used to inform self-monitoring. Further research should address if and when gaze displays can support learning.

From Image to Diagnosis: Characterizing Sources of Error in Histopathologic Interpretation

An accurate histopathologic diagnosis on surgical biopsy material is necessary for the clinical management of patients and has important implications for research, clinical trial design/enrollment, and public health education. This study used a mixed methods approach to isolate sources of diagnostic error while residents and attending pathologists interpreted digitized breast biopsy slides. Ninety participants, including pathology residents and attending physicians at major United States medical centers reviewed a set of 14 digitized whole-slide images of breast biopsies. Each case had a consensus-defined diagnosis and critical region of interest (cROI) representing the most significant pathology on the slide. Participants were asked to view unmarked digitized slides, draw their participant region of interest (pROI), describe its features, and render a diagnosis. Participants' review behavior was tracked using case viewer software and an eye-tracking device. Diagnostic accuracy was calculated in comparison to the consensus diagnosis. We measured the frequency of errors emerging during 4 interpretive phases: (1) detecting the cROI, (2) recognizing its relevance, (3) using the correct terminology to describe findings in the pROI, and (4) making a diagnostic decision. According to eye-tracking data, trainees and attending pathologists were very likely (∼94% of the time) to find the cROI when inspecting a slide. However, trainees were less likely to consider the cROI relevant to their diagnosis. Pathology trainees (41% of cases) were more likely to use incorrect terminology to describe pROI features than attending pathologists (21% of cases). Failure to accurately describe features was the only factor strongly associated with an incorrect diagnosis. Identifying where errors emerge in the interpretive and/or descriptive process and working on building organ-specific feature recognition and verbal fluency in describing those features are critical steps for achieving competency in diagnostic decision making.

Research on visual search behaviors of basketball players at different levels of sports expertise

This study aims to examine visual search strategies of skilled basketball players in an anticipation task. This study selected 48 experienced and inexperienced basketball players. The participants were grouped into novice and expert groups based on their experience. The participants were asked to look at series of pictures of offensive patterns of play in a basketball game from a third person perspective and chose one of the three options: passing, shooting and break through. This study measured and recorded the response time, key pressing results, and eye movements. Eye movement data were recorded using the Tobii X-3 120 eye tracker. The results showed that, the expert group demonstrated superior anticipation performance, and were more accuracy. In addition, the results showed that participants in the expert group and faster predicted the offensive way faster than the novice group. The results also showed that experienced basketball players employed a simple and efficient visual search strategy including greater fixation counts and longer fixation duration on more informative areas than the novice group. Furthermore, the visualization metrics showed that the expert group had a more concise fixation trajectory and focused mainly on key information area. Generally, expert players exhibited a more efficient and effective visual search strategy demonstrating better performance on anticipation tasks.

Does cognitive reflection predict attentional control in visual tasks?

The cognitive reflection test (CRT) measures the ability to suppress an intuitive, but incorrect, answer that easily comes to mind. The relationship between the CRT and different cognitive biases has been widely studied. However, whether cognitive reflection is related to attentional control is less well studied. The aim of this paper is to investigate whether the inhibitory component of the CRT, measured by the number of non-intuitive answers of the CRT (Inhibitory Control Score), is related to the control of visual attention in visual tasks that involve overriding a bias in what to attend: an anti-saccade task and a visual search task. To test this possibility, we analyzed whether the CRT-Inhibitory Control Score (CRT-ICS) predicted attention allocation in each task. We compared the relationship between the CRT-ICS to two other potential predictors of attentional control: numeracy and visual working memory (VWM). Participants who scored lower on the CRT-ICS made more errors in the "look-away" trials in the anti-saccade task. Participants who scored higher on the CRT-ICS looked more often towards more informative color subsets in the visual search task. However, when controlling for numeracy and visual working memory, CRT-ICS scores were only related to the control of visual attention in the anti-saccade task.

Sources of variation in search and foraging: A theoretical perspective

Search-the problem of exploring a space of alternatives to identify target goals-is a fundamental behaviour for many species. Although its foundation lies in foraging, most studies of human search behaviour have been directed towards understanding the attentional mechanisms that underlie the efficient visual exploration of two-dimensional (2D) scenes. With this review, we aim to characterise how search behaviour can be explained across a wide range of contexts, environments, spatial scales, and populations, both typical and atypical. We first consider the generality of search processes across psychological domains. We then review studies of interspecies differences in search. Finally, we explore in detail the individual and contextual variables that affect visual search and related behaviours in established experimental psychology paradigms. Despite the heterogeneity of the findings discussed, we identify that variations in control processes, along with the ability to regulate behaviour as a function of the structure of search space and the sampling processes adopted, to be central to explanations of variations in search behaviour. We propose a tentative theoretical model aimed at integrating these notions and close by exploring questions that remain unaddressed.

Using aversive conditioning with near-real-time feedback to shape eye movements during naturalistic viewing

Strategically shaping patterns of eye movements through training has manifold promising applications, with the potential to improve the speed and efficiency of visual search, improve the ability of humans to extract information from complex displays, and help correct disordered eye movement patterns. However, training how a person moves their eyes when viewing an image or scene is notoriously difficult, with typical approaches relying on explicit instruction and strategy, which have notable limitations. The present study introduces a novel approach to eye movement training using aversive conditioning with near-real-time feedback. Participants viewed indoor scenes (eight scenes presented over 48 trials) with the goal of remembering those scenes for a later memory test. During viewing, saccades meeting specific amplitude and direction criteria probabilistically triggered an aversive electric shock, which was felt within 50 ms after the eliciting eye movement, allowing for a close temporal coupling between an oculomotor behavior and the feedback intended to shape it. Results demonstrate a bias against performing an initial saccade in the direction paired with shock (Experiment 1) or generally of the amplitude paired with shock (Experiment 2), an effect that operates without apparent awareness of the relationship between shocks and saccades, persists into extinction, and generalizes to the viewing of novel images. The present study serves as a proof of concept concerning the implementation of near-real-time feedback in eye movement training.

Eye movements reflect expertise development in hybrid search

Domain-specific expertise changes the way people perceive, process, and remember information from that domain. This is often observed in visual domains involving skilled searches, such as athletics referees, or professional visual searchers (e.g., security and medical screeners). Although existing research has compared expert to novice performance in visual search, little work has directly documented how accumulating experiences change behavior. A longitudinal approach to studying visual search performance may permit a finer-grained understanding of experience-dependent changes in visual scanning, and the extent to which various cognitive processes are affected by experience. In this study, participants acquired experience by taking part in many experimental sessions over the course of an academic semester. Searchers looked for 20 categories of targets simultaneously (which appeared with unequal frequency), in displays with 0-3 targets present, while having their eye movements recorded. With experience, accuracy increased and response times decreased. Fixation probabilities and durations decreased with increasing experience, but saccade amplitudes and visual span increased. These findings suggest that the behavioral benefits endowed by expertise emerge from oculomotor behaviors that reflect enhanced reliance on memory to guide attention and the ability to process more of the visual field within individual fixations.

Effects of transcranial direct current stimulation over the posterior parietal cortex on novice X-ray screening performance

Existing theories of visual search are generally deduced from lab-based studies involving the identification of a target object among similar distractors. The role of the right parietal cortex in visual search is well-established. However, less is known about real-world visual search tasks, such as X-ray screening, which require targets to be disembedded from their background. Research has shown variations in the cognitive abilities required for these tasks and typical lab-based visual search tasks. Thus, the findings of traditional visual search studies do not always transfer into the applied domain. Although brain imaging studies have offered insights into visual search tasks involving disembedding, highlighting an association between the left parietal cortex and disembedding performance, no causal link has yet been established. To this end, we carried out a pilot study (n = 34, between-subjects) administering non-invasive brain stimulation over the posterior parietal cortex (PPC) prior to completing a security X-ray screening task. The findings suggested that anodal left PPC tDCS enhanced novice performance in X-ray screening over that of sham stimulation, in line with brain imaging findings. However, the efficacy of tDCS is under question, with a growing number of failed replications. With this in mind, this study aims to re-test our original hypothesis by examining the effects of left-side parietal stimulation on novice X-ray screener performance and comparing them to those of sham stimulation and of stimulation on a control site (right PPC). As such, this within-subjects study comprised three sessions (2 mA left PPC, 2 mA right PPC, low-intensity sham stimulation left PPC), to investigate effects of anodal tDCS on X-ray screening performance. The pre-registered analysis did not detect any significant differences between left PPC tDCS and sham tDCS or left PPC tDCS and right PPC tDCS on novice performance (d') in X-ray screening. Further exploratory analyses detected no effects of left PPC tDCS on any other indices of performance in the X-ray security screening task (c, RTs and accuracy), or a disembedding control task (RTs and accuracy). The use of alternative stimulation techniques, with replicable behavioural effects on the parietal lobe (or a multi-technique approach), and well-powered studies with a systematic variation of stimulation parameters, could help to choose between two possible interpretations: that neither left nor right PPC are causally related to either tasks or that tDCS was ineffective. Finally, low-intensity sham stimulation (.016 mA), previously shown to outperform other sham conditions in between-subjects designs, was found to be ineffective for blinding participants in a within-subjects design. Our findings raise concerns for the current lack of optimal control conditions and add to the growing literature highlighting the need for replication in the field.

Reward learning biases the direction of saccades

The role of associative reward learning in guiding feature-based attention and spatial attention is well established. However, no studies have looked at the extent to which reward learning can modulate the direction of saccades during visual search. Here, we introduced a novel reward learning paradigm to examine whether reward-associated directions of eye movements can modulate performance in different visual search tasks. Participants had to fixate a peripheral target before fixating one of four disks that subsequently appeared in each cardinal position. This was followed by reward feedback contingent upon the direction chosen, where one direction consistently yielded a high reward. Thus, reward was tied to the direction of saccades rather than the absolute location of the stimulus fixated. Participants selected the target in the high-value direction on the majority of trials, demonstrating robust learning of the task contingencies. In an untimed visual foraging task that followed, which was performed in extinction, initial saccades were reliably biased in the previously rewarded-associated direction. In a second experiment, following the same training procedure, eye movements in the previously high-value direction were facilitated in a saccade-to-target task. Our findings suggest that rewarding directional eye movements biases oculomotor search patterns in a manner that is robust to extinction and generalizes across stimuli and task.

Examining the effects of passive and active strategies on behavior during hybrid visual memory search: evidence from eye tracking

Hybrid search requires observers to search both through a visual display and through the contents of memory in order to find designated target items. Because professional hybrid searchers such as airport baggage screeners are required to look for many items simultaneously, it is important to explore any potential strategies that may beneficially impact performance during these societally important tasks. The aim of the current study was to investigate the role that cognitive strategies play in facilitating hybrid search. We hypothesized that observers in a hybrid search task would naturally adopt a strategy in which they remained somewhat passive, allowing targets to "pop out." Alternatively, we considered the possibility that observers could adopt a strategy in which they more actively directed their attention around the visual display. In experiment 1, we compared behavioral responses during uninstructed, passive, and active hybrid search. We found that uninstructed search tended to be more active in nature, but that adopting a passive strategy led to above average performance as indicated by a combined measure of speed and accuracy called a balanced integration score (BIS). We replicated these findings in experiment 2. Additionally, we found that oculomotor behavior in passive hybrid search was characterized by longer saccades, improved attentional guidance, and an improved ability to identify items as targets or distractors (relative to active hybrid search). These results have implications for understanding hybrid visual search and the effect that strategy use has on performance and oculomotor behavior during this common, and at times societally important, task.