Visual Search Revived: The Slopes Are Not That Slippery: A Reply to Kristjansson (2015)

Reading problems and their connection with visual search and attention

Attention has been hypothesized to act as a sequential gating mechanism for the orderly processing of letters and words. These same visuoattentional processes are often assumed to partake in some but not all types of visual search. In the current study, 24 dyslexic and 36 typical readers completed an attentionally demanding visual conjunction search. Visual feature search served as an internal control. It has been suggested that reading problems should go hand in hand with specific problems in visual conjunction search-particularly elevated conjunction search slopes (time per search item)-often interpreted as a problem with visual attention. Results showed that reading problems were associated with slower visual search, especially conjunction search. However, reading deficits were not associated with increased conjunction search slopes but instead with increased search intercepts, traditionally not interpreted as reflecting attention. We discuss these results in the context of hypothesized visuoattentional problems in dyslexia. Remaining open to multiple interpretations of the data, the current study demonstrates that difficulties in visual search are associated with reading problems, in accordance with growing literature on visual cognition problems in developmental dyslexia.

Visual search and childhood vision impairment: A GAMLSS-oriented multiverse analysis approach

The aim of this report was to analyze reaction times and accuracy in children with a vision impairment performing a feature-based visual search task using a multiverse statistical approach. The search task consisted of set sizes 4, 16, and 24, consisting of distractors (circle) and a target (ellipse) that were presented randomly to school-aged individuals with or without a vision impairment. Interactions and main effects of key variables relating to reaction times and accuracy were analyzed via a novel statistical method blending GAMLSS (generalized additive models for location, scale, and shape) and distributional regression trees. Reaction times for the target-present and target-absent conditions were significantly slower in the vision impairment group with increasing set sizes (p < .001). Female participants were significantly slower than were males for set sizes 16 and 24 in the target-absent condition (p < .001), with male participants being significantly slower than females in the target-present condition (p < .001). Accuracy was only significantly worse (p = .03) for participants less than 14 years of age for the target-absent condition with set sizes 16 and 24. There was a positive association between binocular visual acuity and search time (p < .001). The application of GAMLSS with distributional regression trees to the analysis of visual search data may provide further insights into underlying factors affecting search performance in case-control studies where psychological or physical differences may influence visual search outcomes.

Brighter Time: A Smartphone App Recording Cognitive Task Performance and Illuminance in Everyday Life

Light is an influential regulator of behavioural and physiological state in mammals. Features of cognitive performance such as memory, vigilance and alertness can be altered by bright light exposure under laboratory and field conditions. However, the importance of light as a regulator of performance in everyday life is hard to assess and has so far remained largely unclear. We set out to address this uncertainty by developing a tool to capture measures of cognitive performance and light exposure, at scale, and during everyday life. To this end, we generated an app (Brighter Time) which incorporated a psychomotor vigilance (PVT), an N-back and a visual search task with questionnaire-based assessments of demographic characteristics, general health, chronotype and sleep. The app also measured illuminance during task completion using the smartphone's intrinsic light meter. We undertook a pilot feasibility study of Brighter Time based on 91-week-long acquisition phases within a convenience sample (recruited by local advertisements and word of mouth) running Brighter Time on their own smartphones over two study phases in winter and summer. Study compliance was suitable (median = 20/21 requested task completions per subject). Statistically significant associations were observed between subjective sleepiness and performance in all tasks. Significant daily variations in PVT and visual search performance were also observed. Higher illuminance was associated with reduced reaction time and lower inverse efficiency score in the visual search. Brighter Time thus represents a viable option for large-scale collection of cognitive task data in everyday life, and is able to reveal associations between task performance and sleepiness, time of day and current illuminance. Brighter Time's utility could be extended to exploring associations with longer-term patterns of light exposure and/or other light metrics by integrating with wearable light meters.

Varieties of Selective Influence: Toward a More Complete Taxonomy and Implications for Systems Identification

All science, including psychological science, is subject to what Townsend and Ashby have called the principle of correspondent change which ensures that experimental manipulations act as informed agents with respect to predictions and testing critical theoretical features. Mostly, this type of program goes unspoken. Within the general field known as the information processing approach, S. Sternberg invented the additive factors method in which the aforesaid feature plays a major and explicit role. We call this approach a theory driven methodology because the scientist formulates a set of theories or models and then formulates experimental variables that will permit strong tests among the hypothetical alternatives. Our term for the general approach is systems factorial technology. Often, these tests can be accomplished with qualitative, non-parametric, distribution free methods, but our so-called sieve method advocates, once the initial qualitative steps are accomplished, a move to assessing more detail parametric versions of the model classes. Over the decades, the meta-theory underpinning SFT and like approaches has evidenced dramatic growth in both expanse and depth. Particularly, the critical assumption of selective influence, testable to some extent, has received extensive and sophisticated treatment. The various central allied concepts are interlinked but do not form a simple linearly-ordered chain. This study carries on exploration of the central concepts and relationships and their implications for psychological research.

Does feature intertrial priming guide attention? The jury is still out

Our search performance is strongly influenced by our past experience. In the lab, this influence has been demonstrated by investigating a variety of phenomena, including intertrial priming, statistical learning, and reward history, and collectively referred to as selection history. The resulting findings have led researchers to claim that selection history guides attention, thereby challenging the prevailing dichotomy, according to which top-down and bottom-up factors alone determine attentional priority. Here, we re-examine this claim with regard to one selection-history phenomenon, feature intertrial priming (aka priming of pop-out). We evaluate the evidence that specifically pertains to the role of feature intertrial priming in attentional guidance, rather than in later selective processes occurring after the target is found. We distinguish between the main experimental rationales, while considering the extent to which feature intertrial priming, as studied through different protocols, shares characteristics of top-down attention. We show that there is strong evidence that feature intertrial priming guides attention when the experimental protocol departs from the canonical paradigm and encourages observers to maintain the critical feature in visual working memory or to form expectations about the upcoming target. By contrast, the current evidence regarding the standard feature intertrial priming phenomenon is inconclusive. We propose directions for future research and suggest that applying the methodology used here in order to re-evaluate of the role of other selection history phenomena in attentional guidance should clarify the mechanisms underlying the strong impact of past experience on visual search performance.

Keeping it real: Looking beyond capacity limits in visual cognition

Research within visual cognition has made tremendous strides in uncovering the basic operating characteristics of the visual system by reducing the complexity of natural vision to artificial but well-controlled experimental tasks and stimuli. This reductionist approach has for example been used to assess the basic limitations of visual attention, visual working memory (VWM) capacity, and the fidelity of visual long-term memory (VLTM). The assessment of these limits is usually made in a pure sense, irrespective of goals, actions, and priors. While it is important to map out the bottlenecks our visual system faces, we focus here on selected examples of how such limitations can be overcome. Recent findings suggest that during more natural tasks, capacity may be higher than reductionist research suggests and that separable systems subserve different actions, such as reaching and looking, which might provide important insights about how pure attentional or memory limitations could be circumvented. We also review evidence suggesting that the closer we get to naturalistic behavior, the more we encounter implicit learning mechanisms that operate "for free" and "on the fly." These mechanisms provide a surprisingly rich visual experience, which can support capacity-limited systems. We speculate whether natural tasks may yield different estimates of the limitations of VWM, VLTM, and attention, and propose that capacity measurements should also pass the real-world test within naturalistic frameworks. Our review highlights various approaches for this and suggests that our understanding of visual cognition will benefit from incorporating the complexities of real-world cognition in experimental approaches.

Beyond Looking for the Rewarded Target: The Effects of Reward on Attention in Search Tasks

One puzzling result in training-test paradigms is that effects of reward-associated stimuli on attention are often seen in test but not in training. We focus on one study, where reward-related performance benefits occur in the training and which was discussed contentiously. By using a similar design, we conceptually replicated the results. Moreover, we investigated the underlying mechanisms and processes resulting in these reward-related performance benefits. In two experiments, using search tasks and having participants perform the tasks either with or without individually adjusted time pressure, we disentangled the mechanisms and processes contributing to the reward-related benefits. We found evidence that not only search efficiency is increased with increasing reward, but also that non-search factors contribute to the results. By also investigating response time distributions, we were able to show that reward-related performance effects increased as search time increased in demanding tasks but not in less demanding tasks. Theoretical implications of the results regarding how reward influences attentional processing are discussed.

Temporal organization of color and shape processing during visual search

The mechanisms guiding visual attention are of great interest within cognitive and perceptual psychology. Many researchers have proposed models of these mechanisms, which serve to both formalize their theories and to guide further empirical investigations. The assumption that a number of basic features are processed in parallel early in the attentional process is common among most models of visual attention and visual search. To date, much of the evidence for parallel processing has been limited to set-size manipulations. Unfortunately, set-size manipulations have been shown to be insufficient evidence for parallel processing. We applied Systems Factorial Technology, a general nonparametric framework, to test this assumption, specifically whether color and shape are processed in parallel or in serial, in three experiments representative of feature search, conjunctive search, and odd-one-out search, respectively. Our results provide strong evidence that color and shape information guides search through parallel processes. Furthermore, we found evidence for facilitation between color and shape when the target was known in advance but performance consistent with unlimited capacity, independent parallel processing in odd-one-out search. These results confirm core assumptions about color and shape feature processing instantiated in most models of visual search and provide more detailed clues about the manner in which color and shape information is combined to guide search.

Is apparent instability a guiding feature in visual search?

Humans are quick to notice if an object is unstable. Does that assessment require attention or can instability serve as a preattentive feature that can guide the deployment of attention? This paper describes a series of visual search experiments, designed to address this question. Experiment 1 shows that less stable images among more stable images are found more efficiently than more stable among less stable; a search asymmetry that supports guidance by instability. Experiment 2 shows efficient search but no search asymmetry when the orientation of the objects is removed as a confound. Experiment 3 independently varies the orientation cues and perceived stability and finds a clear main effect of apparent stability. Experiment 4 shows converging evidence for a role of stability using different stimuli that lack an orientation cue. However, here both search for stable and unstable targets is inefficient. Experiment 5 is a control for Experiment 4, showing that the stability effect in Experiment 4 is not simple side-effects of the geometry of the stimuli. On balance, the data support a role for instability in the guidance of attention in visual search. (184 words).

Dynamics of visual attention revealed in foraging tasks

Visual search tasks play a key role in theories of visual attention. But single-target search tasks may provide only a snapshot of attentional orienting. Foraging tasks with multiple targets of different types arguably provide a closer analogy to everyday attentional processing. Set-size effects have in the literature formed the basis for inferring how attention operates during visual search. We therefore measured the effects of absolute set-size (constant target-distractor ratio) and relative set-size (constant set-size but target-distractor ratio varies) on foraging patterns during "feature" foraging (targets differed from distractors on a single feature) and "conjunction" foraging (targets differed from distractors on a combination of two features). Patterns of runs of same target-type selection were similar regardless of whether absolute or relative set-size varied: long sequential runs during conjunction foraging but rapid switching between target types during feature foraging. But although foraging strategies differed between feature and conjunction foraging, surprisingly, intertarget times throughout foraging trials did not differ much between the conditions. Typical response time by set-size patterns for single-target visual search tasks were only observed for the last target during foraging. Furthermore, the foraging patterns within trials involved several distinct phases, that may serve as markers of particular attentional operations. Foraging tasks provide a remarkably intricate picture of attentional selection, far more detailed than traditional single-target visual search tasks, and well-known theories of visual attention have difficulty accounting for key aspects of the observed foraging patterns. Finally, we discuss how theoretical conceptions of attention could be modified to account for these effects.

Evidence that within-dimension features are generally processed coactively

In this paper, we examine whether information about an item's category, provided by the same dimension type presented across multiple spatial locations (which we term within-dimension features), is processed independently or pooled into a common representation. We use Systems Factorial Technology (SFT; Townsend & Nozawa, Journal of Mathematical Psychology, 39, 321-340, 1995) and fit parametric logical rule-based models to diagnose whether information processing is serial, parallel, or coactive. The present work focuses on expanding the scope of categorization response time (RT) models by synthesizing recent work in perceptual categorization with theories of visual attention. Our results show that for the majority of participants, processing occurs coactively (i.e., is pooled into a single decision process). For the remainder, other processing strategies were found (e.g., parallel processing). This finding provides new insight into decision-making using within-dimension features presented in multiple locations. It also highlights the importance of both featural information and spatial attention in categorization decision-making.

Guidance and selection history in hybrid foraging visual search

In Hybrid Foraging tasks, observers search for multiple instances of several types of target. Collecting all the dirty laundry and kitchenware out of a child's room would be a real-world example. How are such foraging episodes structured? A series of four experiments shows that selection of one item from the display makes it more likely that the next item will be of the same type. This pattern holds if the targets are defined by basic features like color and shape but not if they are defined by their identity (e.g., the letters p & d). Additionally, switching between target types during search is expensive in time, with longer response times between successive selections if the target type changes than if they are the same. Finally, the decision to leave a screen/patch for the next screen in these foraging tasks is imperfectly consistent with the predictions of optimal foraging theory. The results of these hybrid foraging studies cast new light on the ways in which prior selection history guides subsequent visual search in general.

Visual mental imagery influences attentional guidance in a visual-search task

Visual mental imagery resembles visual working memory (VWM). Because both visual mental imagery and VWM involve the representation and manipulation of visual information, it was hypothesized that they would exert similar effects on visual attention. Several previous studies have demonstrated that working-memory representations guide attention toward a memory-matching task-irrelevant stimulus during visual-search tasks. Therefore, mental imagery may also guide attention toward imagery-matching stimuli. In the present study, five experiments were conducted to investigate the effects of visual mental imagery on visual attention during a visual-search task. Participants were instructed to visualize a color or an object clearly associated with a specific color, after which they were asked to detect a colored target in the visual-search task. Reaction times for target detection were shorter when the color of the target matched the imagined color, and when the color of the target was similar to that strongly associated with the imagined object, than when the color of the target did not match that of the mental representation. This effect was not observed when participants were not instructed to imagine a color. These results suggest that similar to VWM, visual mental imagery guides attention toward imagery-matching stimuli.

What pops out for you pops out for fish: Four common visual features

Visual search is the ability to detect a target of interest against a background of distracting objects. For many animals, performing this task fast and accurately is crucial for survival. Typically, visual-search performance is measured by the time it takes the observer to detect a target against a backdrop of distractors. The efficiency of a visual search depends fundamentally on the features of the target, the distractors, and the interaction between them. Substantial efforts have been devoted to investigating the influence of different visual features on visual-search performance in humans. In particular, it has been demonstrated that color, size, orientation, and motion are efficient visual features to guide attention in humans. However, little is known about which features are efficient and which are not in other vertebrates. Given earlier observations that moving targets elicit pop-out and parallel search in the archerfish during visual-search tasks, here we investigate and confirm that all four of these visual features also facilitate efficient search in the archerfish in a manner comparable to humans. In conjunction with results reported for other species, these finding suggest universality in the way visual search is carried out by animals despite very different brain anatomies and living environments.

Searching for Radial Symmetry

Symmetry is ubiquitous in the natural world. Numerous investigations, dating back over one hundred years, have explored the visual processing of symmetry. However, these studies have been concerned with mirror symmetry, overlooking radial (or rotational) symmetry, which is also prevalent in nature. Using a visual search paradigm, which approximates the everyday task of searching for an object embedded in background clutter, we have measured how quickly and how accurately human observers detect radially symmetric dot patterns. Performance was compared with mirror symmetry. We found that with orders of radial symmetry greater than 5, radial symmetry can be detected more easily than mirror symmetry, revealing for the first time that radial symmetry is a salient property of objects for human vision.

Five Factors that Guide Attention in Visual Search

How do we find what we are looking for? Fundamental limits on visual processing mean that even when the desired target is in our field of view, we often need to search, because it is impossible to recognize everything at once. Searching involves directing attention to objects that might be the target. This deployment of attention is not random. It is guided to the most promising items and locations by five factors discussed here: Bottom-up salience, top-down feature guidance, scene structure and meaning, the previous history of search over time scales from msec to years, and the relative value of the targets and distractors. Modern theories of search need to specify how all five factors combine to shape search behavior. An understanding of the rules of guidance can be used to improve the accuracy and efficiency of socially-important search tasks, from security screening to medical image perception.

A Note on Drawing Conclusions in the Study of Visual Search and the Use of Slopes in Particular

The slope of the set size function as a critical statistic first gained favor in the 1960s due in large part to the seminal papers on short-term memory search by Saul Sternberg and soon, many others. In the 1980s, the slope statistic reemerged in much the same role in visual search as Anne Treisman and again, soon many others brought that research topic into great prominence. This note offers the historical and current perspective of the present author, who has devoted a significant portion of his theoretical efforts to this and related topics over the past 50 years.

The Slopes Remain the Same: Reply to Wolfe (2016)

Wolfe (2016) responds to my article (Kristjánsson, 2015), arguing among other things, that the differences in slope by response method in my data reflect speed accuracy trade-offs. But when reaction times and errors are combined in one score (inverse efficiency) to sidestep speed accuracy trade-offs, slope differences still remain. The problem that slopes, which are thought to measure search speed, differ by response type therefore remains.