Perceptual load corresponds with factors known to influence visual search

Social prioritisation in scene viewing and the effects of a spatial memory load

When free-viewing scenes, participants tend to preferentially fixate social elements (e.g., people). In the present study, we tested whether this bias would be disrupted by increasing the demands of a secondary dual-task: holding a set of (one or six) spatial locations in memory, presented either simultaneously or sequentially. Following a retention interval, participants judged whether a test location was present in the to-be-remembered stimuli. During the retention interval participants free-viewed scenes containing a social element (a person) and a non-social element (an object) that served as regions of interest. In order to assess the impact of physical salience, the non-social element was presented in both an unaltered baseline version, and in a version where its salience was artificially increased. The results showed that the preference to look at social elements decreased when the demands of the spatial memory task were increased from one to six locations, regardless of presentation mode (simultaneous or sequential). The high-load condition also resulted in more central fixations and reduced exploration of the scene. The results indicate that the social prioritisation effect, and scene viewing more generally, can be affected by a concurrent memory load.

Establishing gaze markers of perceptual load during multi-target visual search

Highly-automated technologies are increasingly incorporated into existing systems, for instance in advanced car models. Although highly automated modes permit non-driving activities (e.g. internet browsing), drivers are expected to reassume control upon a 'take over' signal from the automation. To assess a person's readiness for takeover, non-invasive eye tracking can indicate their attentive state based on properties of their gaze. Perceptual load is a well-established determinant of attention and perception, however, the effects of perceptual load on a person's ability to respond to a takeover signal and the related gaze indicators are not yet known. Here we examined how load-induced attentional state affects detection of a takeover-signal proxy, as well as the gaze properties that change with attentional state, in an ongoing task with no overt behaviour beyond eye movements (responding by lingering the gaze). Participants performed a multi-target visual search of either low perceptual load (shape targets) or high perceptual load (targets were two separate conjunctions of colour and shape), while also detecting occasional auditory tones (the proxy takeover signal). Across two experiments, we found that high perceptual load was associated with poorer search performance, slower detection of cross-modal stimuli, and longer fixation durations, while saccade amplitude did not consistently change with load. Using machine learning, we were able to predict the load condition from fixation duration alone. These results suggest monitoring fixation duration may be useful in the design of systems to track users' attentional states and predict impaired user responses to stimuli outside of the focus of attention.

Is a new feature learned behind a newly efficient color-orientation conjunction search?

It is well known that feature search is efficient, whereas conjunction search is usually inefficient. However, prior studies have shown that some conjunction search could become very efficient through perceptual learning, behaving like a traditional feature search. An unanswered question is whether a new feature is learned when an inefficient conjunction search become efficient after extensive training. A popular view is that the trained conjunction has been successfully unitized into a new feature and thus could pop out from neighboring distractors. Here, by using stimulus specificity and transfer of perceptual learning as an approach, we investigate whether a new feature is learned when an initially inefficient conjunction search becomes highly efficient after extensive training. In two experiments, we consistently found that long-term perceptual learning over days could induce an inefficient-to-efficient pattern change in a color-orientation conjunction search. Moreover, the learning effect of the conjunction target could partly transfer to a new target that shared a same color or a same orientation with the trained target. Remarkably, the total amount of the learning effect was approximately equal to the sum of the transfer effects of individual features. Such additive learning pattern could last for at least several months, although the learning of separate features showed different patterns of persistence. These results do not support that the trained conjunction is unitized into a new and inseparable feature after learning. Instead, our findings point to a feature-based attention enhancement mechanism underlying long-term perceptual learning and its persistence of color-orientation conjunction search.

Virtual reality-based distraction on pain, performance, and anxiety during and after moderate-vigorous intensity cycling

PURPOSE

To determine whether increased visual perceptual load (PL) within an immersive virtual environment may help explain previously shown pain-relieving effects of virtual reality (VR) during high intensity cycling.

METHODS

Using a within-subjects design, participants cycled at a perceptually "hard" intensity for 10 min on three separate occasions. The first session did not use VR (i.e., no perceptual load - NPL). Subsequent sessions employed VR during cycling with either a low or high perceptual load (LPL or HPL). Quadriceps pain intensity (PI) was reported by participants throughout cycling.

RESULTS

Data were analyzed for 43 healthy participants (20 females, mean age 21  [SD 1.4]). For PI, ANOVA showed there were significant main effects of condition (F = 13.458, df =1.579, 66.334, p<0.001) and time (F = 113.045, df =1.618, 227.683, p<0.001). At every time point, t-tests revealed mean PI was significantly lower in the NPL than in the LPL condition (t(42)=4.737, p<0.001, d = 0.472) and HPL condition (t(42)=3.380, p = 0.002, d = 0.391). Dependent t-tests showed that more work (kilojoules) was performed during the LPL condition than the NPL (t(42)=2.992, p = 0.005) and HPL (t(42)=5.810, p<0.001) conditions.

CONCLUSIONS

Compared to a traditional 10-minute bout of cycle ergometry (NPL), individuals who cycled in the LPL condition chose to exercise at a higher intensity despite greater PI. Those who cycled in the HPL condition did not change their exercise intensity, but did report higher PI, possibly, because of the greater mental effort/energy requirement.

Developing the Rationale for Including Virtual Reality in Cognitive Rehabilitation and Exercise Training Approaches for Managing Cognitive Dysfunction in MS

Cognitive impairment is a common and detrimental consequence of multiple sclerosis (MS) and current rehabilitation methods are insufficient. Cognitive rehabilitation (CR) and exercise training (ET) are the most promising behavioral approaches to mitigate cognitive deficits, but effects are small and do not effectively translate to improvements in everyday function. This article presents a conceptual framework supporting the use of virtual reality (VR) as an ideal, common adjuvant traditional CR and ET in MS. VR could strengthen the effects of CR and ET by increasing sensory input and promoting multisensory integration and processing during rehabilitation. For ET specifically, VR can also help incorporate components of CR into exercise sessions. In addition, VR can enhance the transfer of cognitive improvements to everyday functioning by providing a more ecologically valid training environment. There is a clear interest in adding VR to traditional rehabilitation techniques for neurological populations, a stronger body of evidence of this unique approach is needed in MS. Finally, to better understand how to best utilize VR in rehabilitation for cognitive deficits in MS, more systematic research is needed to better understand the mechanism(s) of action of VR with CR and ET.

Is perceptual learning always better at task-relevant locations? It depends on the distractors

The role of attention in task-irrelevant perceptual learning has been contested. Attention has been studied in the past using distractor-type manipulations. Hence, during an initial exposure phase, we manipulated distractor similarity within a set of six gratings, to study its effects on perceptual learning at task-relevant and task-irrelevant locations. Of these six gratings, one was at a task-relevant location, one at a task-irrelvant location, which shared the orientation with the task-relevant grating, and the rest (four) were distractor gratings. The orientations of the distractor gratings were all either the same (homogeneous) or different from each other (heterogeneity). We hypothesized that learning at the task-irrelevant location would be worse than learning at the task-relevant location when distractors are heterogeneous and vice versa when the distractors are homogeneous. Participants were initially exposed to a grating set; they reported contrast changes at only one prespecified task-relevant location. This grating was grouped based on orientation with a task-irrelevant grating presented at the furthermost distractor location and presented alongside four control-distractors (homogeneous or heterogeneous). In the testing phase, orientation discrimination performance was measured at task-relevant, task-irrelevant (grouped), and control-distractor locations. Participants were exposed and tested sequentially, each day for 5 days. Participants learned and performed better at the task-irrelevant location compared to the task-relevant location with homogenous distractors and vice versa with heterogenous distractors. The poorer learning at the task-relevant location compared to the task-irrelevant location challenges current models of perceptual learning. Selection mechanisms driven by the nature of distractors influence perceptual learning at both task-relevant and task-irrelevant locations.

The role of perceptual and cognitive load on inattentional blindness: A systematic review and three meta-analyses

The inattentional blindness phenomenon refers to situations in which a visible but unexpected stimulus remains consciously unnoticed by observers. This phenomenon is classically explained as the consequence of insufficient attention, because attentional resources are already engaged elsewhere or vary between individuals. However, this attentional-resources view is broad and often imprecise regarding the variety of attentional models, the different pools of resources that can be involved in attentional tasks, and the heterogeneity of the experimental paradigms. Our aim was to investigate whether a classic theoretical model of attention, namely the Load Theory, could account for a large range of empirical findings in this field by distinguishing the role of perceptual and cognitive resources in attentional selection and attentional capture by irrelevant stimuli. As this model has been mostly built on implicit measures of distractor interference, it is unclear whether its predictions also hold when explicit and subjective awareness of an unexpected stimulus is concerned. Therefore, we conducted a systematic review and meta-analyses of inattentional blindness studies investigating the role of perceptual and/or cognitive resources. The results reveal that, in line with the perceptual account of the Load Theory, inattentional blindness significantly increases with the perceptual load of the task. However, the cognitive account of this theory is not clearly supported by the empirical findings analysed here. Furthermore, the interaction between perceptual and cognitive load on inattentional blindness remains understudied. Theoretical implications for the Load Theory are discussed, notably regarding the difference between attentional capture and subjective awareness paradigms, and further research directions are provided.

A critical review of the cognitive and perceptual factors influencing attentional scaling and visual processing

An important mechanism used to selectively process relevant information in the environment is spatial attention. One fundamental way in which spatial attention is deployed is attentional scaling - the process of focusing attentional resources either narrowly or broadly across the visual field. Although early empirical work suggested that narrowing attention improves all aspects of visual processing, recent studies have demonstrated that narrowing attention can also have no effect or even a detrimental impact when it comes to vision that is thought to be mediated via the magnocellular pathway of the visual system. Here, for the first time, we synthesize empirical evidence measuring the behavioral effects of attentional scaling on tasks gauging the contribution of the major neural pathways of the visual system, with the purpose of determining the potential factors driving these contradictory empirical findings. This analysis revealed that attentional scaling could be best understood by considering the unique methodologies used in the research literature to date. The implications of this analysis for theoretical frameworks of attentional scaling are discussed, and methodological improvements for future research are proposed.

Vision at a glance: The role of attention in processing object-to-object categorical relations

When viewing a scene at a glance, the visual and categorical relations between objects in the scene are extracted rapidly. In the present study, the involvement of spatial attention in the processing of such relations was investigated. Participants performed a category detection task (e.g., "is there an animal") on briefly flashed object pairs. In one condition, visual attention spanned both stimuli, and in another, attention was focused on a single object while its counterpart object served as a task-irrelevant distractor. The results showed that when participants attended to both objects, a categorical relation effect was obtained (Exp. 1). Namely, latencies were shorter to objects from the same category than to those from different superordinate categories (e.g., clothes, vehicles), even if categories were not prioritized by the task demands. Focusing attention on only one of two stimuli, however, largely eliminated this effect (Exp. 2). Some relational processing was seen when categories were narrowed to the basic level and were highly distinct from each other (Exp. 3), implying that categorical relational processing necessitates attention, unless the unattended input is highly predictable. Critically, when a prioritized (to-be-detected) object category, positioned in a distractor's location, differed from an attended object, a robust distraction effect was consistently observed, regardless of category homogeneity and/or of response conflict factors (Exp. 4). This finding suggests that object relations that involve stimuli that are highly relevant to the task settings may survive attentional deprivation at the distractor location. The involvement of spatial attention in object-to-object categorical processing is most critical in situations that include wide categories that are irrelevant to one's current goals.

Traditional Visual Search vs. X-Ray Image Inspection in Students and Professionals: Are the Same Visual-Cognitive Abilities Needed?

The act of looking for targets amongst an array of distractors is a cognitive task that has been studied extensively over many decades and has many real-world applications. Research shows that specific visual-cognitive abilities are needed to efficiently and effectively locate a target among distractors. It is, however, not always clear whether the results from traditional, simplified visual search tasks conducted by students will extrapolate to an applied inspection tasks in which professionals search for targets that are more complex, ambiguous, and less salient. More concretely, there are several potential challenges when interpreting traditional visual search results in terms of their implications for the X-ray image inspection task. In this study, we tested whether a theoretical intelligence model with known facets of visual-cognitive abilities (visual processing Gv, short-term memory Gsm, and processing speed Gs) can predict performance in both a traditional visual search task and an X-ray image inspection task in both students and professionals. Results showed that visual search ability as measured with a traditional visual search task is not comparable to an applied X-ray image inspection task. Even though both tasks require aspects of the same visual-cognitive abilities, the overlap between the tasks was small. We concluded that different aspects of visual-cognitive abilities predict performance on the measured tasks. Furthermore, although our tested populations were comparable in terms of performance predictors based on visual-cognitive abilities, professionals outperformed students on an applied X-ray image inspection task. Hence, inferences from our research questions have to be treated with caution, because the comparability of the two populations depends on the task.

Visual Task Demands and the Auditory Mismatch Negativity: An Empirical Study and a Meta-Analysis

Because the auditory system is particularly useful in monitoring the environment, previous research has examined whether task-irrelevant, auditory distracters are processed even if subjects focus their attention on visual stimuli. This research suggests that attentionally demanding visual tasks decrease the auditory mismatch negativity (MMN) to simultaneously presented auditory distractors. Because a recent behavioral study found that high visual perceptual load decreased detection sensitivity of simultaneous tones, we used a similar task (n = 28) to determine if high visual perceptual load would reduce the auditory MMN. Results suggested that perceptual load did not decrease the MMN. At face value, these nonsignificant findings may suggest that effects of perceptual load on the MMN are smaller than those of other demanding visual tasks. If so, effect sizes should differ systematically between the present and previous studies. We conducted a selective meta-analysis of published studies in which the MMN was derived from the EEG, the visual task demands were continuous and varied between high and low within the same task, and the task-irrelevant tones were presented in a typical oddball paradigm simultaneously with the visual stimuli. Because the meta-analysis suggested that the present (null) findings did not differ systematically from previous findings, the available evidence was combined. Results of this meta-analysis confirmed that demanding visual tasks reduce the MMN to auditory distracters. However, because the meta-analysis was based on small studies and because of the risk for publication biases, future studies should be preregistered with large samples (n > 150) to provide confirmatory evidence for the results of the present meta-analysis. These future studies should also use control conditions that reduce confounding effects of neural adaptation, and use load manipulations that are defined independently from their effects on the MMN.

Visual short-term memory load strengthens selective attention

Perceptual load theory accounts for many attentional phenomena; however, its mechanism remains elusive because it invokes underspecified attentional resources. Recent dual-task evidence has revealed that a concurrent visual short-term memory (VSTM) load slows visual search and reduces contrast sensitivity, but it is unknown whether a VSTM load also constricts attention in a canonical perceptual load task. If attentional selection draws upon VSTM resources, then distraction effects-which measure attentional "spill-over"-will be reduced as competition for resources increases. Observers performed a low perceptual load flanker task during the delay period of a VSTM change detection task. We observed a reduction of the flanker effect in the perceptual load task as a function of increasing concurrent VSTM load. These findings were not due to perceptual-level interactions between the physical displays of the two tasks. Our findings suggest that perceptual representations of distractor stimuli compete with the maintenance of visual representations held in memory. We conclude that access to VSTM determines the degree of attentional selectivity; when VSTM is not completely taxed, it is more likely for task-irrelevant items to be consolidated and, consequently, affect responses. The "resources" hypothesized by load theory are at least partly mnemonic in nature, due to the strong correspondence they share with VSTM capacity.

Accurate expectancies diminish perceptual distraction during visual search

The load theory of visual attention proposes that efficient selective perceptual processing of task-relevant information during search is determined automatically by the perceptual demands of the display. If the perceptual demands required to process task-relevant information are not enough to consume all available capacity, then the remaining capacity automatically and exhaustively “spills-over” to task-irrelevant information. The spill-over of perceptual processing capacity increases the likelihood that task-irrelevant information will impair performance. In two visual search experiments, we tested the automaticity of the allocation of perceptual processing resources by measuring the extent to which the processing of task-irrelevant distracting stimuli was modulated by both perceptual load and top-down expectations using behavior, functional magnetic resonance imaging, and electrophysiology. Expectations were generated using a trial-by-trial cue that provided information about the likely load of the upcoming visual search task. When the cues were valid, behavioral interference was eliminated and the influence of load on frontoparietal and visual cortical responses was attenuated relative to when the cues were invalid. In conditions in which task-irrelevant information interfered with performance and modulated visual activity, individual differences in mean blood oxygenation level dependent responses measured from the left intraparietal sulcus were negatively correlated with individual differences in the severity of distraction. These results are consistent with the interpretation that a top-down biasing mechanism interacts with perceptual load to support filtering of task-irrelevant information.

High perceptual load leads to both reduced gain and broader orientation tuning

Due to its limited capacity, visual perception depends on the allocation of attention. The resultant phenomena of inattentional blindness, accompanied by reduced sensory visual cortex response to unattended stimuli in conditions of high perceptual load in the attended task, are now well established (Lavie, 2005; Lavie, 2010, for reviews). However, the underlying mechanisms for these effects remain to be elucidated. Specifically, is reduced perceptual processing under high perceptual load a result of reduced sensory signal gain, broader tuning, or both? We examined this question with psychophysical measures of orientation tuning under different levels of perceptual load in the task performed. Our results show that increased perceptual load leads to both reduced sensory signal and broadening of tuning. These results clarify the effects of attention on elementary visual perception and suggest that high perceptual load is critical for attentional effects on sensory tuning.

Response terminated displays unload selective attention

Perceptual load theory successfully replaced the early vs. late selection debate by appealing to adaptive control over the efficiency of selective attention. Early selection is observed unless perceptual load (p-Load) is sufficiently low to grant attentional “spill-over” to task-irrelevant stimuli. Many studies exploring load theory have used limited display durations that perhaps impose artificial limits on encoding processes. We extended the exposure duration in a classic p-Load task to alleviate temporal encoding demands that may otherwise tax mnemonic consolidation processes. If the load effect arises from perceptual demands alone, then freeing-up available mnemonic resources by extending the exposure duration should have little effect. The results of Experiment 1 falsify this prediction. We observed a reliable flanker effect under high p-Load, response-terminated displays. Next, we orthogonally manipulated exposure duration and task-relevance. Counter-intuitively, we found that the likelihood of observing the flanker effect under high p-Load resides with the duration of the task-relevant array, not the flanker itself. We propose that stimulus and encoding demands interact to produce the load effect. Our account clarifies how task parameters differentially impinge upon cognitive processes to produce attentional “spill-over” by appealing to visual short-term memory as an additional processing bottleneck when stimuli are briefly presented.

Competition explains limited attention and perceptual resources: implications for perceptual load and dilution theories

Both perceptual load theory and dilution theory purport to explain when and why task-irrelevant information, or so-called distractors are processed. Central to both explanations is the notion of limited resources, although the theories differ in the precise way in which those limitations affect distractor processing. We have recently proposed a neurally plausible explanation of limited resources in which neural competition among stimuli hinders their representation in the brain. This view of limited capacity can also explain distractor processing, whereby the competitive interactions and bias imposed to resolve the competition determine the extent to which a distractor is processed. This idea is compatible with aspects of both perceptual load and dilution models of distractor processing, but also serves to highlight their differences. Here we review the evidence in favor of a biased competition view of limited resources and relate these ideas to both classic perceptual load theory and dilution theory.

Context-dependent control over attentional capture

A number of studies have demonstrated that the likelihood of a salient item capturing attention is dependent on the "attentional set" an individual employs in a given situation. The instantiation of an attentional set is often viewed as a strategic, voluntary process, relying on working memory systems that represent immediate task priorities. However, influential theories of attention and automaticity propose that goal-directed control can operate more or less automatically on the basis of longer term task representations, a notion supported by a number of recent studies. Here, we provide evidence that longer term contextual learning can rapidly and automatically influence the instantiation of a given attentional set. Observers learned associations between specific attentional sets and specific task-irrelevant background scenes during a training session, and in the ensuing test session, simply reinstating particular scenes on a trial-by-trial basis biased observers to employ the associated attentional set. This directly influenced the magnitude of attentional capture, suggesting that memory for the context in which a task is performed can play an important role in the ability to instantiate a particular attentional set and overcome distraction by salient, task-irrelevant information.