Failures of perception in the low-prevalence effect: Evidence from active and passive visual search

Activation thresholds, not quitting thresholds, account for the low prevalence effect in dynamic search

The low-prevalence effect (LPE) is the finding that target detection rates decline as targets become less frequent in a visual search task. A major source of this effect is thought to be that fewer targets result in lower quitting thresholds, i.e., observers respond target-absent after looking at fewer items compared to searches with a higher prevalence of targets. However, a lower quitting threshold does not directly account for an LPE in searches where observers continuously monitor a dynamic display for targets. In these tasks there are no discrete "trials" to which a quitting threshold could be applied. This study examines whether the LPE persists in this type of dynamic search context. Experiment 1 was a 2 (dynamic/static) x 2 (10%/40% prevalence targets) design. Although overall performance was worse in the dynamic task, both tasks showed a similar magnitude LPE. In Experiment 2, we replicated this effect using a task where subjects searched for either of two targets (Ts and Ls). One target appeared infrequently (10%) and the other moderately (40%). Given this method of manipulating prevalence rate, the quitting threshold explanation does not account for the LPE even for static displays. However, replicating Experiment 1, we found an LPE of similar magnitude for both search scenarios, and lower target detection rates with the dynamic displays, demonstrating the LPE is a potential concern for both static and dynamic searches. These findings suggest an activation threshold explanation of the LPE may better account for our observations than the traditional quitting threshold model.

The message matters: changes to binary Computer Aided Detection recommendations affect cancer detection in low prevalence search

Computer Aided Detection (CAD) has been used to help readers find cancers in mammograms. Although these automated systems have been shown to help cancer detection when accurate, the presence of CAD also leads to an over-reliance effect where miss errors and false alarms increase when the CAD system fails. Previous research investigated CAD systems which overlayed salient exogenous cues onto the image to highlight suspicious areas. These salient cues capture attention which may exacerbate the over-reliance effect. Furthermore, overlaying CAD cues directly on the mammogram occludes sections of breast tissue which may disrupt global statistics useful for cancer detection. In this study we investigated whether an over-reliance effect occurred with a binary CAD system, which instead of overlaying a CAD cue onto the mammogram, reported a message alongside the mammogram indicating the possible presence of a cancer. We manipulated the certainty of the message and whether it was presented only to indicate the presence of a cancer, or whether a message was displayed on every mammogram to state whether a cancer was present or absent. The results showed that although an over-reliance effect still occurred with binary CAD systems miss errors were reduced when the CAD message was more definitive and only presented to alert readers of a possible cancer.

Effects of machine learning errors on human decision-making: manipulations of model accuracy, error types, and error importance

This study addressed the cognitive impacts of providing correct and incorrect machine learning (ML) outputs in support of an object detection task. The study consisted of five experiments that manipulated the accuracy and importance of mock ML outputs. In each of the experiments, participants were given the T and L task with T-shaped targets and L-shaped distractors. They were tasked with categorizing each image as target present or target absent. In Experiment 1, they performed this task without the aid of ML outputs. In Experiments 2-5, they were shown images with bounding boxes, representing the output of an ML model. The outputs could be correct (hits and correct rejections), or they could be erroneous (false alarms and misses). Experiment 2 manipulated the overall accuracy of these mock ML outputs. Experiment 3 manipulated the proportion of different types of errors. Experiments 4 and 5 manipulated the importance of specific types of stimuli or model errors, as well as the framing of the task in terms of human or model performance. These experiments showed that model misses were consistently harder for participants to detect than model false alarms. In general, as the model's performance increased, human performance increased as well, but in many cases the participants were more likely to overlook model errors when the model had high accuracy overall. Warning participants to be on the lookout for specific types of model errors had very little impact on their performance. Overall, our results emphasize the importance of considering human cognition when determining what level of model performance and types of model errors are acceptable for a given task.

AAPM WGPE report 394: Simulated error training for the physics plan and chart review

BACKGROUND

Simulated error training is a method to practice error detection in situations where the occurrence of error is low. Such is the case for the physics plan and chart review where a physicist may check several plans before encountering a significant problem. By simulating potentially hazardous errors, physicists can become familiar with how they manifest and learn from mistakes made during a simulated plan review.

PURPOSE

The purpose of this project was to develop a series of training datasets that allows medical physicists and trainees to practice plan and chart reviews in a way that is familiar and accessible, and to provide exposure to the various failure modes (FMs) encountered in clinical scenarios.

METHODS

A series of training datasets have been developed that include a variety of embedded errors based on the risk-assessment performed by American Association of Physicists in Medicine (AAPM) Task Group 275 for the physics plan and chart review. The training datasets comprise documentation, screen shots, and digital content derived from common treatment planning and radiation oncology information systems and are available via the Cloud-based platform ProKnow.

RESULTS

Overall, 20 datasets have been created incorporating various software systems (Mosaiq, ARIA, Eclipse, RayStation, Pinnacle) and delivery techniques. A total of 110 errors representing 50 different FMs were embedded with the 20 datasets. The project was piloted at the 2021 AAPM Annual Meeting in a workshop where participants had the opportunity to review cases and answer survey questions related to errors they detected and their perception of the project's efficacy. In general, attendees detected higher-priority FMs at a higher rate, though no correlation was found between detection rate and the detectability of the FMs. Familiarity with a given system appeared to play a role in detecting errors, specifically when related to missing information at different locations within a given software system. Overall, 96% of respondents either agreed or strongly agreed that the ProKnow portal and training datasets were effective as a training tool, and 75% of respondents agreed or strongly agreed that they planned to use the tool at their local institution.

CONCLUSIONS

The datasets and digital platform provide a standardized and accessible tool for training, performance assessment, and continuing education regarding the physics plan and chart review. Work is ongoing to expand the project to include more modalities, radiation oncology treatment planning and information systems, and FMs based on emerging techniques such as auto-contouring and auto-planning.

No evidence of attentional prioritization for threatening targets in visual search

Throughout human evolutionary history, snakes have been associated with danger and threat. Research has shown that snakes are prioritized by our attentional system, despite many of us rarely encountering them in our daily lives. We conducted two high-powered, pre-registered experiments (total N = 224) manipulating target prevalence to understand this heightened prioritization of threatening targets. Target prevalence refers to the proportion of trials wherein a target is presented; reductions in prevalence consistently reduce the likelihood that targets will be found. We reasoned that snake targets in visual search should experience weaker effects of low target prevalence compared to non-threatening targets (rabbits) because they should be prioritized by searchers despite appearing rarely. In both experiments, we found evidence of classic prevalence effects but (contrasting prior work) we also found that search for threatening targets was slower and less accurate than for nonthreatening targets. This surprising result is possibly due to methodological issues common in prior studies, including comparatively smaller sample sizes, fewer trials, and a tendency to exclusively examine conditions of relatively high prevalence. Our findings call into question accounts of threat prioritization and suggest that prior attention findings may be constrained to a narrow range of circumstances.

Can the processing of task-irrelevant threatening stimuli be inhibited? - The role of shape and valence in the saliency of threatening objects

Numerous studies have demonstrated that attention is quickly oriented towards threatening stimuli, and that this attentional bias is difficult to inhibit. The root cause(s) of this bias may be attributable to the affective (e.g., valence) or visual features (e.g., shape) of threats. In two experiments (behavioral, eye-tracking), we tested which features play a bigger role in the salience of threats. In both experiments, participants looked for a neutral target (butterfly, lock) among other neutral objects. In half of the trials a threatening (snake, gun) or nonthreatening (but visually similar; worm, hairdryer) task-irrelevant distractor was also present at a near or far distance from the target. Behavioral results indicate that both distractor types interfered with task performance. Rejecting nonthreatening distractors as nontargets was easier when they were presented further from the target but distance had no effect when the distractor was threatening. Eye-tracking results showed that participants fixated less often (and for less time) on threatening compared to nonthreatening distractors. They also viewed targets for less time when a threatening distractor was present (compared to nonthreatening). Results suggest that visual features of threats are easier to suppress than affective features, and the latter may have a stronger role in eliciting attentional biases.

High target prevalence may reduce the spread of attention during search tasks

Target prevalence influences many cognitive processes during visual search, including target detection, search efficiency, and item processing. The present research investigated whether target prevalence may also impact the spread of attention during search. Relative to low-prevalence searches, high-prevalence searches typically yield higher fixation counts, particularly during target-absent trials. This may emerge because the attention spread around each fixation may be smaller for high than low prevalence searches. To test this, observers searched for targets within object arrays in Experiments 1 (free-viewing) and 2 (gaze-contingent viewing). In Experiment 3, observers searched for targets in a Rapid Serial Visual Presentation (RSVP) stream at the center of the display while simultaneously processing occasional peripheral objects. Experiment 1 used fixation patterns to estimate attentional spread, and revealed that attention was narrowed during high, relative to low, prevalence searches. This effect was weakened during gaze-contingent search (Experiment 2) but emerged again when eye movements were unnecessary in RSVP search (Experiment 3). These results suggest that, although task demands impact how attention is allocated across displays, attention may also narrow when searching for frequent targets.

Graded prioritisation of targets in search: reward diminishes the low prevalence effect

In many real-life contexts, observers are required to search for targets that are rarely present (e.g. tumours in X-rays; dangerous items in airport security screenings). Despite the rarity of these items, they are of enormous importance for the health and safety of the public, yet they are easily missed during visual search. This is referred to as the prevalence effect. In the current series of experiments, we investigate whether unequal reward can modulate the prevalence effect, in a multiple target search task. Having first established the impact of prevalence (Experiment 1) and reward (Experiment 2) on how efficiently participants can find one of several targets in the current paradigm, we then combined the two forms of priority to investigate their interaction. An unequal reward distribution (where lower prevalence items are more rewarded; Experiment 3) was found to diminish the effect of prevalence, compared to an equal reward distribution (Experiment 4) as indicated by faster response times and fewer misses. These findings suggest that when combined with an unequal reward distribution, the low prevalence effect can be diminished.

The Manifestation of Incidental Findings in Different Experimental Visual Search Paradigms

Background

Incidental findings are items of visual search that are potentially of significance, but were not the main object of the initial search. They have been previously widely discussed in the field of radiology. However, the underlying perceptual mechanisms of such phenomenon are still unclear.

Objective

The current study aims to examine incidental findings in different paradigms of visual search in order to reveal their primary perceptual aspects.

Design

Two behavioral visual search experiments were conducted. The mixed hybrid search task model was used in the first experiment, while the subsequent search miss effect was employed in the second experiment. The task was to find targets among distractors, according to given instructions. Stimuli material consisted of images of real-life objects that were randomly distributed across the screen for each trial.

Results

Accuracy and reaction time of the participants were analyzed in both experiments. Similar effects were observed for both parameters. Specific targets in the first experiment and typical targets in the second experiment were found significantly faster and more accurately in comparison to categorical and atypical targets. Moreover, this tendency did not depend on the order of target identification. Hence, the prevalence of the targets was revealed to be the primary factor in the case of incidental findings.

Conclusion

The study revealed the emergence of incidental findings in both experiments. Typical or specific targets were detected significantly more accurately, compared to atypical or categorical targets. Subsequent search misses were not detected, suggesting that target prevalence could be a crucial factor that is specific for incidental findings.

Mirror blindness: Our failure to recognize the target in search for mirror-reversed shapes

It is well known that visual search for a mirror target (i.e., a horizontally flipped item) is more difficult than search for other-oriented items (e.g., vertically flipped items). Previous studies have typically attributed costs of mirror search to early, attention-guiding processes but could not rule out contributions from later processes. In the present study we used eye tracking to distinguish between early, attention-guiding processes and later target identification processes. The results of four experiments revealed a marked human weakness in identifying mirror targets: Observers appear to frequently fail to classify a mirror target as a target on first fixation and to continue with search even after having directly looked at the target. Awareness measures corroborated that the location of a mirror target could not be reported above chance level after it had been fixated once. This mirror blindness effect explained a large proportion (45-87%) of the overall costs of mirror search, suggesting that part of the difficulties with mirror search are rooted in later, object identification processes (not attentional guidance). Mirror blindness was significantly reduced but not completely eliminated when both the target and non-targets were held constant, which shows that perfect top-down knowledge can reduce mirror blindness, without completely eliminating it. The finding that non-target certainty reduced mirror blindness suggests that object identification is not solely achieved by comparing a selected item to a target template. These results demonstrate that templates that guide search toward targets are not identical to the templates used to conclusively identify those targets.

The Oddity Detection in Diverse Scenes (ODDS) database: Validated real-world scenes for studying anomaly detection

Many applied screening tasks (e.g., medical image or baggage screening) involve challenging searches for which standard laboratory search is rarely equivalent. For example, whereas laboratory search frequently requires observers to look for precisely defined targets among isolated, non-overlapping images randomly arrayed on clean backgrounds, medical images present unspecified targets in noisy, yet spatially regular scenes. Those unspecified targets are typically oddities, elements that do not belong. To develop a closer laboratory analogue to this, we created a database of scenes containing subtle, ill-specified "oddity" targets. These scenes have similar perceptual densities and spatial regularities to those found in expert search tasks, and each includes 16 variants of the unedited scene wherein an oddity (a subtle deformation of the scene) is hidden. In Experiment 1, eight volunteers searched thousands of scene variants for an oddity. Regardless of their search accuracy, they were then shown the highlighted anomaly and rated its subtlety. Subtlety ratings reliably predicted search performance (accuracy and response times) and did so better than image statistics. In Experiment 2, we conducted a conceptual replication in which a larger group of naïve searchers scanned subsets of the scene variants. Prior subtlety ratings reliably predicted search outcomes. Whereas medical image targets are difficult for naïve searchers to detect, our database contains thousands of interior and exterior scenes that vary in difficulty, but are nevertheless searchable by novices. In this way, the stimuli will be useful for studying visual search as it typically occurs in expert domains: Ill-specified search for anomalies in noisy displays.

The influence of category representativeness on the low prevalence effect in visual search

Visual search is greatly affected by the appearance rate of given target types, such that low-prevalence items are harder to detect, which has consequences for real-world search tasks where target frequency cannot be balanced. However, targets that are highly representative of a categorically defined task set are also easier to find. We hypothesized that targets that are highly representative are less vulnerable to low-prevalence effects because an observer's attentional set prioritizes guidance toward them even when they are rare. We assessed this hypothesis by first determining the categorical structure of "prohibited carry-ons" via an exemplar-naming task, and used this structure to assess how category representativeness interacted with prevalence. Specifically, from the exemplar-naming task we selected a commonly named (knives) and rarely named (gas cans) target for a search task in which one of the targets was shown infrequently. As predicted, highly representative targets were found more easily than their less representative counterparts, but they also were less affected by prevalence manipulations. Experiment 1b replicated the results with targets matched for emotional valence (water bottles and fireworks). These findings demonstrate the powerful explanatory power of theories of attentional guidance that incorporate the dynamic influence of recent experience with the knowledge that comes from life experience to better predict behavioral outcomes associated with high-stakes search environments.

Target-rate effect in continuous visual search

From infrared body temperature surveillance to lifeguarding, real-life visual search is usually continuous and comes with rare targets. Previous research has examined realistic search tasks involving separate slides (such as baggage screening and radiography), but search tasks that require continuous monitoring have generally received less attention. In this study, we investigated whether continuous visual search would display a target-rate effect similar to the low-prevalence effect (LPE) in regular visual search. We designed a continuous detection task for a target feature (e.g., a green color) among items of continuously and gradually changing features (e.g., other colors). In four experiments, we demonstrated target-rate effects in terms of slower hit response times (RTs) and higher miss rates when targets were rare. Similar to regular search, target-rate effects were also observed for relative frequencies across two target features. Taken together, these results suggest a target-rate effect in continuous visual search, and its behavioral characteristics are generally similar to those of the LPE in regular visual search.

Prior experience with target encounter affects attention allocation and prospective memory performance

We examined how prior experience encountering targets affected attention allocation and event-based prospective memory. Participants performed four color match task blocks with a difficult, but specified prospective memory task (Experiment 1) or an easier, but unspecified prospective memory task (Experiment 2). Participants were instructed to search for targets on each block. Participants in the prior experience condition saw targets on each block, participants in the no prior experience condition only saw targets on the fourth block, and, in Experiment 2, participants in the mixed prior experience condition encountered some of the targets on the first three blocks, and saw all the targets on the fourth block. In Experiment 1, participants in the no prior experience condition were less accurate at recognizing targets and quicker to respond on ongoing task trials than participants in the prior experience condition. In Experiment 2, we replicated the effect of prior experience on target accuracy, but there was no effect on ongoing trial response time. The mixed experience condition did not vary from the other conditions on either dependent variable, but their target accuracy varied in accordance with their experience. These findings demonstrate that prospective memory performance is influenced by experience with related tasks, thus extending our understanding of the dynamic nature of search efforts across related prospective memory tasks. This research has implications for understanding prospective memory in applied settings where targets do not reliably occur such as baggage screenings and missing person searches.

Feedback moderates the effect of prevalence on perceptual decisions

How does the prevalence of a target influence how it is perceived and categorized? A substantial body of work, mostly in visual search, shows that a higher proportion of targets are missed when prevalence is low. This classic low prevalence effect (LPE) involves a shift to a more conservative decision criterion that makes it less likely that observers will call an ambiguous item a target. In contrast, Levari et al. (Science, 360[6396], 1465-1467, 2018) recently reported the opposite effect in a simple categorization task. In their hands, at low prevalence, observers adopted a more liberal criterion, making observers more likely to label ambiguous dots on a blue-purple continuum "blue." They called this "prevalence-induced concept change" (PICC). Here, we report that the presence or absence of feedback is critical. With feedback, observers become more conservative at low prevalence, as in the LPE. Without feedback, they become more liberal, identifying a wider range of stimuli as targets, as in Levari's PICC studies. Stimuli from a shape continuum ranging from rounded ("Bouba") to bumpy ("Kiki") shapes produced similar results. Other variables: response type (2AFC vs. go/no-go), color (blue-purple vs. red-green), and stimuli type (solid color vs. texture) did not influence the criterion shifts. Understanding these effects of prevalence and ways they can be controlled illuminates the context-specific nature of perceptual decisions and may be useful in socially important, low prevalence tasks like cancer screening, airport security, and disease diagnosis in pathology.

Avoiding potential pitfalls in visual search and eye-movement experiments: A tutorial review

Examining eye-movement behavior during visual search is an increasingly popular approach for gaining insights into the moment-to-moment processing that takes place when we look for targets in our environment. In this tutorial review, we describe a set of pitfalls and considerations that are important for researchers – both experienced and new to the field – when engaging in eye-movement and visual search experiments. We walk the reader through the research cycle of a visual search and eye-movement experiment, from choosing the right predictions, through to data collection, reporting of methodology, analytic approaches, the different dependent variables to analyze, and drawing conclusions from patterns of results. Overall, our hope is that this review can serve as a guide, a talking point, a reflection on the practices and potential problems with the current literature on this topic, and ultimately a first step towards standardizing research practices in the field.

Great expectations: minor differences in initial instructions have a major impact on visual search in the absence of feedback

Professions such as radiology and aviation security screening that rely on visual search-the act of looking for targets among distractors-often cannot provide operators immediate feedback, which can create situations where performance may be largely driven by the searchers' own expectations. For example, if searchers do not expect relatively hard-to-spot targets to be present in a given search, they may find easy-to-spot targets but systematically quit searching before finding more difficult ones. Without feedback, searchers can create self-fulfilling prophecies where they incorrectly reinforce initial biases (e.g., first assuming and then, perhaps wrongly, concluding hard-to-spot targets are rare). In the current study, two groups of searchers completed an identical visual search task but with just a single difference in their initial task instructions before the experiment started; those in the "high-expectation" condition were told that each trial could have one or two targets present (i.e., correctly implying no target-absent trials) and those in the "low-expectation" condition were told that each trial would have up to two targets (i.e., incorrectly implying there could be target-absent trials). Compared to the high-expectation group, the low-expectation group had a lower hit rate, lower false alarm rate and quit trials more quickly, consistent with a lower quitting threshold (i.e., performing less exhaustive searches) and a potentially higher target-present decision criterion. The expectation effect was present from the start and remained across the experiment-despite exposure to the same true distribution of targets, the groups' performances remained divergent, primarily driven by the different subjective experiences caused by each groups' self-fulfilling prophecies. The effects were limited to the single-targets trials, which provides insights into the mechanisms affected by the initial expectations set by the instructions. In sum, initial expectations can have dramatic influences-searchers who do not expect to find a target, are less likely to find a target as they are more likely to quit searching earlier.

Eye movements reflect expertise development in hybrid search

Domain-specific expertise changes the way people perceive, process, and remember information from that domain. This is often observed in visual domains involving skilled searches, such as athletics referees, or professional visual searchers (e.g., security and medical screeners). Although existing research has compared expert to novice performance in visual search, little work has directly documented how accumulating experiences change behavior. A longitudinal approach to studying visual search performance may permit a finer-grained understanding of experience-dependent changes in visual scanning, and the extent to which various cognitive processes are affected by experience. In this study, participants acquired experience by taking part in many experimental sessions over the course of an academic semester. Searchers looked for 20 categories of targets simultaneously (which appeared with unequal frequency), in displays with 0-3 targets present, while having their eye movements recorded. With experience, accuracy increased and response times decreased. Fixation probabilities and durations decreased with increasing experience, but saccade amplitudes and visual span increased. These findings suggest that the behavioral benefits endowed by expertise emerge from oculomotor behaviors that reflect enhanced reliance on memory to guide attention and the ability to process more of the visual field within individual fixations.

A procedural analogue of prey detection and applied signal detection

Researchers have employed a variety of laboratory analogues of cryptic prey detection and applied signal detection to study factors influencing learning and performance in these ethological and applied scenarios. However, these procedural analogues do not appear to map closely onto their "real-world" counterparts, particularly with respect to the role of the "yes" (i.e., "attack") response and the payoff for this response (or its absence) on signal-present and signal-absent trials. Using domestic hens, we developed a procedural analogue in which a "yes" response requires some time to emit; such responses were reinforced only in the presence of a signal. In Experiment 1, we evaluated the influence of the "yes" response requirement by manipulating the number of responses required to qualify as a "yes" response. As the "yes" response requirement was increased, bias toward responding "no" increased, revealing that this is a critical factor controlling accuracy in this procedure. In Experiment 2, we evaluated the influence of signal probability and reinforcement rate on signal detection accuracy and found that neither of these factors significantly influenced accuracy or bias. These findings suggest that this procedural analogue may represent a valuable alternative for studying behaviour in relevant signal detection scenarios.

Categorical similarity modulates temporal integration in the attentional blink

Attentional blink (AB) speaks to a phenomenon that, when reporting two targets in a rapid serial visual presentation, the second target (T2) is often missed if it followed the first target (T1) within an interval of less than 500 ms. An interesting exception is the preserved performance of T2 at Lag 1 position (Lag-1 sparing), or even in an extended period, which recently has been termed temporal integration. Both T1 and T2 can be successfully reported but with a loss of their temporal order. The integration has been attributed to the temporal distance between the two targets. However, previous studies on temporal perception have revealed that similarity between two stimuli modulated their temporal order judgment, suggesting that temporal integration is affected by stimulus characteristics. In the present study, we investigated whether stimulus characteristics modulated temporal integration in the AB. We manipulated the categorical similarity between T1 and T2 targets and found that the order reversals were significantly higher in the same-category condition than that in the different-category condition. Our results thus provided clear evidence for the contribution of categorical similarity to the temporal integration in the AB.

The confirmation and prevalence biases in visual search reflect separate underlying processes

Research by Rajsic, Wilson, and Pratt (2015, 2017) suggests that people are biased to use a target-confirming strategy when performing simple visual search. In 3 experiments, we sought to determine whether another stubborn phenomenon in visual search, the low-prevalence effect (Wolfe, Horowitz, & Kenner, 2005), would modulate this confirmatory bias. We varied the reliability of the initial cue: For some people, targets usually occurred in the cued color (high prevalence). For others, targets rarely matched the cues (low prevalence). High cue-target prevalence exacerbated the confirmation bias, indexed via search response times (RTs) and eye-tracking measures. Surprisingly, given low cue-target prevalence, people remained biased to examine cue-colored letters, even though cue-colored targets were exceedingly rare. At the same time, people were more fluent at detecting the more common, cue-mismatching targets. The findings suggest that attention is guided to "confirm" the more available cued target template, but prevalence learning over time determines how fluently objects are perceptually appreciated. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Examining the Role of Eye Movements During Conversational Listening in Noise

Speech comprehension is often thought of as an entirely auditory process, but both normal hearing and hearing-impaired individuals sometimes use visual attention to disambiguate speech, particularly when it is difficult to hear. Many studies have investigated how visual attention (or the lack thereof) impacts the perception of simple speech sounds such as isolated consonants, but there is a gap in the literature concerning visual attention during natural speech comprehension. This issue needs to be addressed, as individuals process sounds and words in everyday speech differently than when they are separated into individual elements with no competing sound sources or noise. Moreover, further research is needed to explore patterns of eye movements during speech comprehension - especially in the presence of noise - as such an investigation would allow us to better understand how people strategically use visual information while processing speech. To this end, we conducted an experiment to track eye-gaze behavior during a series of listening tasks as a function of the number of speakers, background noise intensity, and the presence or absence of simulated hearing impairment. Our specific aims were to discover how individuals might adapt their oculomotor behavior to compensate for the difficulty of the listening scenario, such as when listening in noisy environments or experiencing simulated hearing loss. Speech comprehension difficulty was manipulated by simulating hearing loss and varying background noise intensity. Results showed that eye movements were affected by the number of speakers, simulated hearing impairment, and the presence of noise. Further, findings showed that differing levels of signal-to-noise ratio (SNR) led to changes in eye-gaze behavior. Most notably, we found that the addition of visual information (i.e. videos vs. auditory information only) led to enhanced speech comprehension - highlighting the strategic usage of visual information during this process.

You shall not pass: how facial variability and feedback affect the detection of low-prevalence fake IDs

In many real-world settings, individuals rarely present another person's ID, which increases the likelihood that a screener will fail to detect it. Three experiments examined how within-person variability (i.e., differences between two images of the same person) and feedback may have influenced criterion shifting, thought to be one of the sources of the low-prevalence effect (LPE). Participants made identity judgments of a target face and an ID under either high, medium, or low mismatch prevalence. Feedback appeared after every trial, only error trials, or no trials. Experiment 1 used two controlled images taken on the same day. Experiment 2 used two controlled images taken at least 6 months apart. Experiment 3 used one controlled and one ambient image taken at least 1 year apart. Importantly, receiver operating characteristic curves revealed that feedback and greater within-person variability exacerbated the LPE by affecting both criterion and discriminability. These results carry implications for many real-world settings, such as border crossings and airports, where identity screening plays a major role in securing public safety.

Spotting rare items makes the brain "blink" harder: Evidence from pupillometry

In many visual search tasks (e.g., cancer screening, airport baggage inspections), the most serious search targets occur infrequently. As an ironic side effect, when observers finally encounter important objects (e.g., a weapon in baggage), they often fail to notice them, a phenomenon known as the low-prevalence effect (LPE). Although many studies have investigated LPE search errors, we investigated the attentional consequences of successful rare target detection. Using an attentional blink paradigm, we manipulated how often observers encountered the first serial target (T1), then measured its effects on their ability to detect a following target (T2). Across two experiments, we show that the LPE is more than just an inflated miss rate: When observers successfully detected rare targets, they were less likely to spot subsequent targets. Using pupillometry to index locus-coeruleus (LC) mediated attentional engagement, Experiment 2 confirmed that an LC refractory period mediates the attentional blink (`Nieuwenhuis, Gilzenrat, Holmes, & Cohen, 2005, Journal of Experimental Psychology: General, 134[3], 291-307), and that these effects emerge relatively quickly following T1 onset. Moreover, in both behavioral and pupil analyses, we found that detecting low-prevalence targets exacerbates the LC refractory period. Consequences for theories of the LPE are discussed.

Examining the effects of passive and active strategies on behavior during hybrid visual memory search: evidence from eye tracking

Hybrid search requires observers to search both through a visual display and through the contents of memory in order to find designated target items. Because professional hybrid searchers such as airport baggage screeners are required to look for many items simultaneously, it is important to explore any potential strategies that may beneficially impact performance during these societally important tasks. The aim of the current study was to investigate the role that cognitive strategies play in facilitating hybrid search. We hypothesized that observers in a hybrid search task would naturally adopt a strategy in which they remained somewhat passive, allowing targets to "pop out." Alternatively, we considered the possibility that observers could adopt a strategy in which they more actively directed their attention around the visual display. In experiment 1, we compared behavioral responses during uninstructed, passive, and active hybrid search. We found that uninstructed search tended to be more active in nature, but that adopting a passive strategy led to above average performance as indicated by a combined measure of speed and accuracy called a balanced integration score (BIS). We replicated these findings in experiment 2. Additionally, we found that oculomotor behavior in passive hybrid search was characterized by longer saccades, improved attentional guidance, and an improved ability to identify items as targets or distractors (relative to active hybrid search). These results have implications for understanding hybrid visual search and the effect that strategy use has on performance and oculomotor behavior during this common, and at times societally important, task.

Non-invasive neurophysiological measures of learning: A meta-analysis

In a meta-analysis of 113 experiments we examined neurophysiological outcomes of learning, and the relationship between neurophysiological and behavioral outcomes of learning. Findings showed neurophysiology yielding large effect sizes, with the majority of studies examining electroencephalography and eye-related outcome measures. Effect sizes on neurophysiological outcomes were smaller than effect sizes on behavioral outcomes, however. Neurophysiological outcomes were, but behavioral outcomes were not, influenced by several modulating factors. These factors included the sensory system in which learning took place, number of learning days, whether feedback on performance was provided, and age of participants. Controlling for these factors resulted in the effect size differences between behavior and neurophysiology to disappear. The findings of the current meta-analysis demonstrate that neurophysiology is an appropriate measure in assessing learning, particularly when taking into account factors that could have an influence on neurophysiology. We propose a first model to aid further studies that are needed to examine the exact interplay between learning, neurophysiology, behavior, individual differences, and task-related aspects.

Prevalence-induced concept change in human judgment

Why do some social problems seem so intractable? In a series of experiments, we show that people often respond to decreases in the prevalence of a stimulus by expanding their concept of it. When blue dots became rare, participants began to see purple dots as blue; when threatening faces became rare, participants began to see neutral faces as threatening; and when unethical requests became rare, participants began to see innocuous requests as unethical. This “prevalence-induced concept change” occurred even when participants were forewarned about it and even when they were instructed and paid to resist it. Social problems may seem intractable in part because reductions in their prevalence lead people to see more of them.

Group benefits in joint perceptual tasks-a review

In daily life, humans often perform perceptual tasks together to reach a shared goal. In these situations, individuals may collaborate (e.g., by distributing task demands) to perform the task better than when the task is performed alone (i.e., attain a group benefit). In this review, we identify the factors influencing if, and to what extent, a group benefit is attained and provide a framework of measures to assess group benefits in perceptual tasks. In particular, we integrate findings from two frequently investigated joint perceptual tasks: visuospatial tasks and decision-making tasks. For both task types, we find that an exchange of information between coactors is critical to improve joint performance. Yet, the type of exchanged information and how coactors collaborate differs between tasks. In visuospatial tasks, coactors exchange information about the performed actions to distribute task demands. In perceptual decision-making tasks, coactors exchange their confidence on their individual perceptual judgments to negotiate a joint decision. We argue that these differences can be explained by the task structure: coactors distribute task demands if a joint task allows for a spatial division and stimuli can be accurately processed by one individual. Otherwise, they perform the task individually and then integrate their individual judgments.

Cutting through the MADness: Expectations about what a target is doing impact how likely it is to be found in dynamic visual displays

When searching for things in the world, we seldom encounter the static environment so often afforded by laboratory search tasks. Dynamic events tend to capture attention; however, Kunar and Watson previously found that dynamic search displays (search for vowel targets among moving and blinking letter stimuli) resulted in strikingly high miss rates. A possible explanation for the high miss rates is that the presence of dynamic features resulted in participants becoming sensitive to the likelihood of appearance for each target category and dynamic feature combination (e.g., moving A, blinking A, moving E), even though dynamic features did not define the targets. Overall target prevalence was high in these studies, but the prevalence of each target + dynamic feature combination was low, which may have led to a low-prevalence effect, whereby infrequent targets were disproportionately missed. Searchers may have preferentially searched for (or avoided) certain dynamic features, even though the dynamic features did not differentiate targets from distractors. We investigated whether the frequency with which targets possessed particular dynamic features would affect the likelihood of search misses. We found that targets possessing features which rarely accompanied a "hit" were more often missed than those with dynamic features more strongly associated with target detection. This suggests that searchers are sensitive to the prevalence of non-defining features and use this information to direct their searches.

Target-present guessing as a function of target prevalence and accumulated information in visual search

Target prevalence influences visual search behavior. At low target prevalence, miss rates are high and false alarms are low, while the opposite is true at high prevalence. Several models of search aim to describe search behavior, one of which has been specifically intended to model search at varying prevalence levels. The multiple decision model (Wolfe & Van Wert, Current Biology, 20(2), 121--124, 2010) posits that all searches that end before the observer detects a target result in a target-absent response. However, researchers have found very high false alarms in high-prevalence searches, suggesting that prevalence rates may be used as a source of information to make "educated guesses" after search termination. Here, we further examine the ability for prevalence level and knowledge gained during visual search to influence guessing rates. We manipulate target prevalence and the amount of information that an observer accumulates about a search display prior to making a response to test if these sources of evidence are used to inform target present guess rates. We find that observers use both information about target prevalence rates and information about the proportion of the array inspected prior to making a response allowing them to make an informed and statistically driven guess about the target's presence.

Simple eye-movement feedback during visual search is not helpful

Searching for targets in the visual world, or visual search, is something we all do every day. We frequently make 'false-negative' errors, wherein we erroneously conclude a target was absent when one was, in fact, present. These sorts of errors can have tremendous costs, as when signs of cancers are missed in diagnostic radiology. Prior research has characterized the cause of many of these errors as being due to failure to completely search the area where targets may be present; indeed, roughly one-third of chest nodules missed in lung cancer screening are never fixated (Drew, Võ, Olwal, Jacobson, Seltzer and Wolfe, Journal of Vision 13:3, 2013). This suggests that observers do not have a good representation of what areas have and have not been searched prior to declaring an area target free. Therefore, in six experiments, we sought to examine the utility of reducing the uncertainty with respect to what areas had been examined via online eye-tracking feedback. We hypothesized that providing information about what areas had or had not been examined would lead to lower rates of false negatives or more efficient search, namely faster response times with no cost on target detection accuracy. Neither of these predictions held true. Over six experiments, online eye-tracking feedback did not yield any reliable performance benefits.

Eye movement feedback fails to improve visual search performance

Many real-world searches (e.g., radiology and baggage screening) have rare targets. When targets are rare, observers perform rapid, incomplete searches, leading to higher miss rates. To improve search for rare (10% prevalence) targets, we provided eye movement feedback (EMF) to observers during their searches. Although the nature of the EMF varied across experiments, each method informed observers about the regions of the display that had not yet been inspected. We hypothesized that feedback would help guide attention to unsearched areas and increase the proportion of the display searched before making a target-absent response, thereby increasing accuracy. An eye tracker was used to mark fixated areas by either removing a semiopaque gray overlay (Experiments 1 and 4) as portions of the display were fixated or by adding the overlay once the eye left a segment of the image (Experiments 2 and 4). Experiment 3 provided automated EMF, such that a new region was uncovered every 540 milliseconds. Across experiments, we varied whether people searched for “Waldo” in images from “Where’s Waldo?” search books or searched for a T among offset Ls. We found weak evidence that EMF improves accuracy in Experiment 1. However, in the remaining experiments, EMF had no effect (Experiment 4), or even reduced accuracy (Experiments 2 and 3). We conclude that the one positive result we found is likely a Type I error and that the EMF method that we used is unlikely to improve visual search performance.

Dual Target Search is Neither Purely Simultaneous nor Purely Successive

Previous research shows that visual search for two different targets is less efficient than search for a single target. Stroud, Menneer, Cave and Donnelly (2012) concluded that two target colours are represented separately based on modeling the fixation patterns. Although those analyses provide evidence for two separate target representations, they do not show whether participants search simultaneously for both targets, or first search for one target and then the other. Some studies suggest that multiple target representations are simultaneously active, while others indicate that search can be voluntarily simultaneous, or switching, or a mixture of both. Stroud et al.'s participants were not explicitly instructed to use any particular strategy. These data were revisited to determine which strategy was employed. Each fixated item was categorised according to whether its colour was more similar to one target or the other. Once an item similar to one target is fixated, the next fixated item is more likely to be similar to that target than the other, showing that at a given moment during search, one target is generally favoured. However, the search for one target is not completed before search for the other begins. Instead, there are often short runs of one or two fixations to distractors similar to one target, with each run followed by a switch to the other target. Thus, the results suggest that one target is more highly weighted than the other at any given time, but not to the extent that search is purely successive.

Comparing visual search and eye movements in bilinguals and monolinguals

Recent research has suggested that bilinguals show advantages over monolinguals in visual search tasks, although these findings have been derived from global behavioral measures of accuracy and response times. In the present study we sought to explore the bilingual advantage by using more sensitive eyetracking techniques across three visual search experiments. These spatially and temporally fine-grained measures allowed us to carefully investigate any nuanced attentional differences between bilinguals and monolinguals. Bilingual and monolingual participants completed visual search tasks that varied in difficulty. The experiments required participants to make careful discriminations in order to detect target Landolt Cs among similar distractors. In Experiment 1, participants performed both feature and conjunction search. In Experiments 2 and 3, participants performed visual search while making different types of speeded discriminations, after either locating the target or mentally updating a constantly changing target. The results across all experiments revealed that bilinguals and monolinguals were equally efficient at guiding attention and generating responses. These findings suggest that the bilingual advantage does not reflect a general benefit in attentional guidance, but could reflect more efficient guidance only under specific task demands.

Understanding the contribution of target repetition and target expectation to the emergence of the prevalence effect in visual search

Behavior in visual search tasks is influenced by the proportion of trials on which a target is presented (the target prevalence). Previous research has shown that when target prevalence is low (2 % prevalence), participants tend to miss targets, as compared with higher prevalence levels (e.g., 50 % prevalence). There is an ongoing debate regarding the relative contributions of target repetition and the expectation that a target will occur in the emergence of prevalence effects. In order to disentangle these two factors, we went beyond previous studies by directly manipulating participants’ expectations regarding how likely a target was to appear on a given trial. This we achieved without using cues or feedback. Our results indicated that both target repetition and target expectation contribute to the emergence of the prevalence effect.

Individual differences predict low prevalence visual search performance

Critical real-world visual search tasks such as radiology and baggage screening rely on the detection of rare targets. When targets are rare, observers search for a relatively short amount of time and have a high miss rate, a pattern of results known as the low prevalence effect. Attempts to improve the search for rare targets have been unsuccessful or resulted in an increase in detections at the price of more false alarms. As an alternative to improving visual search performance through experimental manipulations, an individual differences approach found that those with higher working memory capacity were better at finding rare targets. We build on the individual differences approach and assess 141 observers’ visual working memory capacity (vWMC), vigilance, attentional control, big five personality traits, and performance in both high and low prevalence search tasks. vWMC, vigilance, attentional control, high prevalence visual search performance, and level of introversion were all significant predictors of low prevalence search accuracy, and together account for more than 50% of the variance in search performance. With the exception of vigilance, these factors are also significant predictors of reaction time; better performance was associated with longer reaction times, suggesting these factors identify observers who maintain relatively high quitting thresholds, even with low target prevalence. Our results suggest that a quick and easy-to-administer battery of tasks can identify observers who are likely to perform well in low prevalence search tasks, and these predictor variables are associated with higher quitting thresholds, leading to higher accuracy.

Working Memory Capacity Predicts Selection and Identification Errors in Visual Search

As public safety relies on the ability of professionals, such as radiologists and baggage screeners, to detect rare targets, it could be useful to identify predictors of visual search performance. Schwark, Sandry, and Dolgov found that working memory capacity (WMC) predicts hit rate and reaction time in low prevalence searches. This link was attributed to higher WMC individuals exhibiting a higher quitting threshold and increasing the probability of finding the target before terminating search in low prevalence search. These conclusions were limited based on the methods; without eye tracking, the researchers could not differentiate between an increase in accuracy due to fewer identification errors (failing to identify a fixated target), selection errors (failing to fixate a target), or a combination of both. Here, we measure WMC and correlate it with reaction time and accuracy in a visual search task. We replicate the finding that WMC predicts reaction time and hit rate. However, our analysis shows that it does so through both a reduction in selection and identification errors. The correlation between WMC and selection errors is attributable to increased quitting thresholds in those with high WMC. The correlation between WMC and identification errors is less clear, though potentially attributable to increased item inspection times in those with higher WMC. In addition, unlike Schwark and coworkers, we find that these WMC effects are fairly consistent across prevalence rates rather than being specific to low-prevalence searches.

Implicit object naming in visual search: Evidence from phonological competition

During visual search, people are distracted by objects that visually resemble search targets; search is impaired when targets and distractors share overlapping features. In this study, we examined whether a nonvisual form of similarity, overlapping object names, can also affect search performance. In three experiments, people searched for images of real-world objects (e.g., a beetle) among items whose names either all shared the same phonological onset (/bi/), or were phonologically varied. Participants either searched for 1 or 3 potential targets per trial, with search targets designated either visually or verbally. We examined standard visual search (Experiments 1 and 3) and a self-paced serial search task wherein participants manually rejected each distractor (Experiment 2). We hypothesized that people would maintain visual templates when searching for single targets, but would rely more on object names when searching for multiple items and when targets were verbally cued. This reliance on target names would make performance susceptible to interference from similar-sounding distractors. Experiments 1 and 2 showed the predicted interference effect in conditions with high memory load and verbal cues. In Experiment 3, eye-movement results showed that phonological interference resulted from small increases in dwell time to all distractors. The results suggest that distractor names are implicitly activated during search, slowing attention disengagement when targets and distractors share similar names.

A Graph is Worth a Thousand Words: How Overconfidence and Graphical Disclosure of Numerical Information Influence Financial Analysts Accuracy on Decision Making

Previous researches support that graphs are relevant decision aids to tasks related to the interpretation of numerical information. Moreover, literature shows that different types of graphical information can help or harm the accuracy on decision making of accountants and financial analysts. We conducted a 4×2 mixed-design experiment to examine the effects of numerical information disclosure on financial analysts’ accuracy, and investigated the role of overconfidence in decision making. Results show that compared to text, column graph enhanced accuracy on decision making, followed by line graphs. No difference was found between table and textual disclosure. Overconfidence harmed accuracy, and both genders behaved overconfidently. Additionally, the type of disclosure (text, table, line graph and column graph) did not affect the overconfidence of individuals, providing evidence that overconfidence is a personal trait. This study makes three contributions. First, it provides evidence from a larger sample size (295) of financial analysts instead of a smaller sample size of students that graphs are relevant decision aids to tasks related to the interpretation of numerical information. Second, it uses the text as a baseline comparison to test how different ways of information disclosure (line and column graphs, and tables) can enhance understandability of information. Third, it brings an internal factor to this process: overconfidence, a personal trait that harms the decision-making process of individuals. At the end of this paper several research paths are highlighted to further study the effect of internal factors (personal traits) on financial analysts’ accuracy on decision making regarding numerical information presented in a graphical form. In addition, we offer suggestions concerning some practical implications for professional accountants, auditors, financial analysts and standard setters.

Hybrid foraging search: Searching for multiple instances of multiple types of target

This paper introduces the "hybrid foraging" paradigm. In typical visual search tasks, observers search for one instance of one target among distractors. In hybrid search, observers search through visual displays for one instance of any of several types of target held in memory. In foraging search, observers collect multiple instances of a single target type from visual displays. Combining these paradigms, in hybrid foraging tasks observers search visual displays for multiple instances of any of several types of target (as might be the case in searching the kitchen for dinner ingredients or an X-ray for different pathologies). In the present experiment, observers held 8-64 target objects in memory. They viewed displays of 60-105 randomly moving photographs of objects and used the computer mouse to collect multiple targets before choosing to move to the next display. Rather than selecting at random among available targets, observers tended to collect items in runs of one target type. Reaction time (RT) data indicate searching again for the same item is more efficient than searching for any other targets, held in memory. Observers were trying to maximize collection rate. As a result, and consistent with optimal foraging theory, they tended to leave 25-33% of targets uncollected when moving to the next screen/patch. The pattern of RTs shows that while observers were collecting a target item, they had already begun searching memory and the visual display for additional targets, making the hybrid foraging task a useful way to investigate the interaction of visual and memory search.