Shared resources between visual attention and visual working memory are allocated through rhythmic sampling

Alpha and theta rhythm support perceptual and attentional sampling in vision

The visual system operates rhythmically, through timely coordinated perceptual and attentional processes, involving coexisting patterns in the alpha range (7-13 Hz) at ∼10 Hz, and theta (3-6 Hz) range, respectively. Here we aimed to disambiguate whether variations in task requirements, in terms of attentional demand and side of target presentation, might influence the occurrence of either perceptual or attentional components in behavioral visual performance, also uncovering possible differences in the sampling mechanisms of the two cerebral hemispheres. To this aim, visuospatial performance was densely sampled in two versions of a visual detection task where the side of target presentation was fixed (Task 1), with participants monitoring one single hemifield, or randomly varying across trials, with participants monitoring both hemifields simultaneously (Task 2). Performance was analyzed through spectral decomposition, to reveal behavioral oscillatory patterns. For Task 1, when attentional resources where focused on one hemifield only, the results revealed an oscillatory pattern fluctuating at ∼10 Hz and ∼6-9 Hz, for stimuli presented to the left and the right hemifield, respectively, possibly representing a perceptual sampling mechanism with different efficiency within the left and the right hemispheres. For Task 2, when attentional resources were simultaneously deployed to the two hemifields, a ∼5 Hz rhythm emerged both for stimuli presented to the left and the right, reflecting an attentional sampling process, equally supported by the two hemispheres. Overall, the results suggest that distinct perceptual and attentional sampling mechanisms operate at different oscillatory frequencies and their prevalence and hemispheric lateralization depends on task requirements.

Correlations between Visual Temporal Resolution and Individual Alpha Peak Frequency: Evidence that Internal and Measurement Noise Drive Null Findings

The brain organizes the continuous flow of sensory input by parsing it into discrete events. In the case of two flashes separated by a brief ISI, for example, perception may be of a single flash or two distinct flashes, depending on the ISI but also on the speed of processing. A number of studies have reported evidence that participants with a higher EEG peak alpha frequency are able to detect the presence of two flashes separated by short intervals, whereas those with slower alpha report only one flash. Other studies have not found this correlation. We investigated potential factors that might mask the relationship between individual alpha frequency and visual perception. We recorded resting-state EEG from a large sample of participants (n = 50) and measured the temporal resolution of visual perception with the two-flash fusion task. We found that individual alpha frequency over posterior channels predicted the two-flash fusion threshold, in line with previous studies, but this correlation was significant only when taking into account the steepness of the psychophysical curve of the two-flash task. Participants with a relatively shallow psychophysical curve, likely reflecting high sensory and/or decision noise, failed to show this relationship. These findings replicate previous reports of a correlation between alpha frequency and visual temporal resolution, while also suggesting that an explanation of two-flash fusion performance that neglects the role of internal noise might be insufficient to account for all individual differences.

Electrophysiological hallmarks for event relations and event roles in working memory

The ability to maintain events (i.e., interactions between/among objects) in working memory is crucial for our everyday cognition, yet the format of this representation is poorly understood. The current ERP study was designed to answer two questions: How is maintaining events (e.g., the tiger hit the lion) neurally different from maintaining item coordinations (e.g., the tiger and the lion)? That is, how is the event relation (present in events but not coordinations) represented? And how is the agent, or initiator of the event encoded differently from the patient, or receiver of the event during maintenance? We used a novel picture-sentence match-across-delay approach in which the working memory representation was "pinged" during the delay, replicated across two ERP experiments with Chinese and English materials. We found that maintenance of events elicited a long-lasting late sustained difference in posterior-occipital electrodes relative to non-events. This effect resembled the negative slow wave reported in previous studies of working memory, suggesting that the maintenance of events in working memory may impose a higher cost compared to coordinations. Although we did not observe significant ERP differences associated with pinging the agent vs. the patient during the delay, we did find that the ping appeared to dampen the ongoing sustained difference, suggesting a shift from sustained activity to activity silent mechanisms. These results suggest a new method by which ERPs can be used to elucidate the format of neural representation for events in working memory.

Selection within working memory impairs perceptual detection

There is broad consensus supporting the reciprocal influence of working memory (WM) and attention. Top-down mechanisms operate to cope with either environmental or internal demands. In that sense, it is possible to select an item within the contents of WM to endow it with prioritized access. Although evidence supports that maintaining an item in this privileged state does not rely on sustained visual attention, it is unknown whether selection within WM depends on perceptual attention. To answer this question, we recorded electrophysiological neural activity while participants performed a retro-cue task in which we inserted a detection task in the delay period after retro-cue presentation. Critically, the onset of to-be-detected near threshold stimuli was unpredictable, and thus, sustained perceptual spatial attention was needed to accomplish the detection task from the offset of the retro-cue. At a behavioral level, we found decreased visual detection when a WM representation was retro-cued. At a neural level, alpha oscillatory activity confirmed a spatial shift of attention to the retro-cued representation. We interpret the convergence of neural oscillations and behavioral data to point towards the theory that selection within WM could be accomplished through a perceptual attentional mechanism.

The effect of familiarity on behavioral oscillations in face perception

Studies on behavioral oscillations demonstrate that visual sensitivity fluctuates over time and visual processing varies periodically, mirroring neural oscillations at the same frequencies. Do these behavioral oscillations reflect fixed and relatively automatic sensory sampling, or top-down processes such as attention or predictive coding? To disentangle these theories, the current study used a dual-target rapid serial visual presentation paradigm, where participants indicated the gender of a face target embedded in streams of distractors presented at 30 Hz. On critical trials, two identical targets were presented with varied stimulus onset asynchrony from 200 to 833 ms. The target was either familiar or unfamiliar faces, divided into different blocks. We found a 4.6 Hz phase-coherent fluctuation in gender discrimination performance across both trial types, consistent with previous reports. In addition, however, we found an effect at the alpha frequency, with behavioral oscillations in the familiar blocks characterized by a faster high-alpha peak than for the unfamiliar face blocks. These results are consistent with the combination of both a relatively stable modulation in the theta band and faster modulation of the alpha oscillations. Therefore, the overall pattern of perceptual sampling in visual perception may depend, at least in part, on task demands. PROTOCOL REGISTRATION: The stage 1 protocol for this Registered Report was accepted in principle on 16/08/2022. The protocol, as accepted by the journal, can be found at: https://doi.org/10.17605/OSF.IO/A98UF .

Alerting attention is sufficient to induce a phase-dependent behavior that can be predicted by frontal EEG

Recent studies suggest that attention is rhythmic. Whether that rhythmicity can be explained by the phase of ongoing neural oscillations, however, is still debated. We contemplate that a step toward untangling the relationship between attention and phase stems from employing simple behavioral tasks that isolate attention from other cognitive functions (perception/decision-making) and by localized monitoring of neural activity with high spatiotemporal resolution over the brain regions associated with the attentional network. In this study, we investigated whether the phase of electroencephalography (EEG) oscillations predicts alerting attention. We isolated the alerting mechanism of attention using the Psychomotor Vigilance Task, which does not involve a perceptual component, and collected high resolution EEG using novel high-density dry EEG arrays at the frontal region of the scalp. We identified that alerting attention alone is sufficient to induce a phase-dependent modulation of behavior at EEG frequencies of 3, 6, and 8 Hz throughout the frontal region, and we quantified the phase that predicts the high and low attention states in our cohort. Our findings disambiguate the relationship between EEG phase and alerting attention.

Spatial attention based on 2D location and relative depth order modulates visual working memory in a 3D environment

The attentional effect on visual working memory (VWM) has been a heated research topic in the past two decades. Studies show that VWM performance for an attended memory item can be improved by cueing its two-dimensional (2D) spatial location during retention. However, few studies have investigated the effect of attentional selection on VWM in a three-dimensional setting, and it remains unknown whether depth information can produce beneficial attentional effects on 2D visual representations similar to 2D spatial information. Here we conducted four experiments, displaying memory items at various stereoscopic depth planes, and examined the retro-cue effects of four types of cues - a cue would either indicate the 2D or depth location of a memory item, and either in the form of physical (directly pointing to a location) or symbolic (numerically mapping onto a location) cues. We found that retro-cue benefits were only observed for cues directly pointing to a 2D location, whereas a null effect was observed for cues directly pointing to a depth location. However, there was a retro-cue effect when cueing the relative depth order, though the effect was weaker than that for cueing the 2D location. The selective effect on VWM based on 2D spatial attention is different from depth-based attention, and the divergence suggests that an object representation is primarily bound with its 2D spatial location, weakly bound with its depth order but not with its metric depth location. This indicates that attentional selection based on memory for depth, particularly metric depth, is ineffective.

Investigating the role of the foveal cortex in peripheral object discrimination

Peripheral object discrimination is hindered by a central dynamic mask presented between 150 and 300 ms after stimulus onset. The mask is thought to interfere with task-relevant feedback coming from higher visual areas to the foveal cortex in V1. Fan et al. (2016) supported this hypothesis by showing that the effect of mask can be further delayed if the task requires mental manipulation of the peripheral target. The main purpose of this study was to better characterize the temporal dynamics of foveal feedback. Specifically, in two experiments we have shown that (1) the effect of foveal noise mask is sufficiently robust to be replicated in an online data collection (2) in addition to a change in sensitivity the mask affects also the criterion, which becomes more conservative; (3) the expected dipper function for sensitivity approximates a quartic with a global minimum at 94 ms, while the best fit for criterion is a quintic with a global maximum at 174 ms; (4) the power spectrum analysis of perceptual oscillations in sensitivity data shows a cyclic effect of mask at 3 and 12 Hz. Overall, our results show that foveal noise affects sensitivity in a cyclic manner, with a global dip emerging earlier than previously found. The noise also affects the response bias, even though with a different temporal profile. We, therefore, suggest that foveal noise acts on two distinct feedback mechanisms, a faster perceptual feedback followed by a slower cognitive feedback.

Evidence for a theta-band behavioural oscillation in rapid face detection

Theories of rhythmic perception propose that perceptual sampling operates in a periodic way, with alternating moments of high and low responsiveness to sensory inputs. This rhythmic sampling is linked to neural oscillations and thought to produce fluctuations in behavioural outcomes. Previous studies have revealed theta- and alpha-band behavioural oscillations in low-level visual tasks and object categorization. However, less is known about fluctuations in face perception, for which the human brain has developed a highly specialized network. To investigate this, we ran an online study (N = 179) incorporating the dense sampling technique with a dual-target rapid serial visual presentation (RSVP) paradigm. In each trial, a stream of object images was presented at 30 Hz and participants were tasked with detecting whether or not there was a face image in the sequence. On some trials, one or two (identical) face images (the target) were embedded in each stream. On dual-target trials, the targets were separated by an interstimulus interval (ISI) that varied between 0 to 633 ms. The task was to indicate the presence of the target and its gender if present. Performance varied as a function of ISI, with a significant behavioural oscillation in the face detection task at 7.5 Hz, driven mainly by the male target faces. This finding is consistent with a high theta-band-based fluctuation in visual processing. Such fluctuations might reflect rhythmic attentional sampling or, alternatively, feedback loops involved in updating top-down predictions.

Periodic attention operates faster during more complex visual search

Attention has been found to sample visual information periodically, in a wide range of frequencies below 20 Hz. This periodicity may be supported by brain oscillations at corresponding frequencies. We propose that part of the discrepancy in periodic frequencies observed in the literature is due to differences in attentional demands, resulting from heterogeneity in tasks performed. To test this hypothesis, we used visual search and manipulated task complexity, i.e., target discriminability (high, medium, low) and number of distractors (set size), while electro-encephalography was simultaneously recorded. We replicated previous results showing that the phase of pre-stimulus low-frequency oscillations predicts search performance. Crucially, such effects were observed at increasing frequencies within the theta-alpha range (6–18 Hz) for decreasing target discriminability. In medium and low discriminability conditions, correct responses were further associated with higher post-stimulus phase-locking than incorrect ones, in increasing frequency and latency. Finally, the larger the set size, the later the post-stimulus effect peaked. Together, these results suggest that increased complexity (lower discriminability or larger set size) requires more attentional cycles to perform the task, partially explaining discrepancies between reports of attentional sampling. Low-frequency oscillations structure the temporal dynamics of neural activity and aid top-down, attentional control for efficient visual processing.

Moderating Effects of Self-Efficacy and Time Pressure on the Relationship Between Employee Aging and Work Performance

Purpose

The relationships among employee aging, working memory capacity, and task performance in the context of information technology were studied, and these investigations in turn provide insight into improving employee task performance and mitigating the negative effects of employee aging.

Participants and Methods

Based on the limited resource theory and the inhibitory deficit theory, a total of 296 valid questionnaires were collected and the relationships among the variables were examined using cascaded linear regression via SPSS 22.0.

Results

Aging negatively affects working memory capacity and task performance. Working memory capacity partially mediates the relationship between age and task performance. Time pressure can exacerbate the negative effects of age on task performance, and self-efficacy mitigates the negative effects of age on task performance.

Discussion

Employee information system learning and training can be enhanced to ameliorate the negative impact of aging on task performance. IT-related work can be limited to a manageable level to reduce the negative effects of reduced working memory capacity. Employees’ internal motivation can be gradually cultivated, and employees can be guided toward the improvement of their IT self-efficacy.

Rhythmic sampling revisited: Experimental paradigms and neural mechanisms

Sampling of information is thought to be an important aspect of explorative behaviour. Evidence for it has been gained in behavioural assessments of a variety of overt and covert cognitive domains, including sensation, attention, memory, eye movements and dexterity. A common aspect across many findings is that sampling tends to exhibit a rhythmicity at low frequencies (theta, 4-8 Hz; alpha, 9-12 Hz). Neurophysiological investigations in a wide range of species, including rodents, non-human primates and humans have demonstrated the presence of sampling related neural oscillations in a number of brain areas ranging from early sensory cortex, hippocampus to high-level cognitive areas. However, to assess whether rhythmic sampling represents a general aspect of exploratory behaviour one must critically evaluate the task parameters, and their potential link with neural oscillations. Here we focus on sampling during attentive vision to present an overview on the experimental conditions that are used to investigate rhythmic sampling and associated oscillatory brain activity in this domain. This review aims to (1) provide guidelines to efficiently quantify behavioural rhythms, (2) compare results from human and non-human primate studies and (3) argue that the underlying neural mechanisms of sampling can co-occur in both sensory and high-level areas.

How do we measure attention? Using factor analysis to establish construct validity of neuropsychological tests

We investigated whether standardized neuropsychological tests and experimental cognitive paradigms measure the same cognitive faculties. Specifically, do neuropsychological tests commonly used to assess attention measure the same construct as attention paradigms used in cognitive psychology and neuroscience? We built on the “general attention factor”, comprising several widely used experimental paradigms (Huang et al., 2012). Participants (n = 636) completed an on-line battery (TestMyBrain.org) of six experimental tests [Multiple Object Tracking, Flanker Interference, Visual Working Memory, Approximate Number Sense, Spatial Configuration Visual Search, and Gradual Onset Continuous Performance Task (Grad CPT)] and eight neuropsychological tests [Trail Making Test versions A & B (TMT-A, TMT-B), Digit Symbol Coding, Forward and Backward Digit Span, Letter Cancellation, Spatial Span, and Arithmetic]. Exploratory factor analysis in a subset of 357 participants identified a five-factor structure: (1) attentional capacity (Multiple Object Tracking, Visual Working Memory, Digit Symbol Coding, Spatial Span), (2) search (Visual Search, TMT-A, TMT-B, Letter Cancellation); (3) Digit Span; (4) Arithmetic; and (5) Sustained Attention (GradCPT). Confirmatory analysis in 279 held-out participants showed that this model fit better than competing models. A hierarchical model where a general cognitive factor was imposed above the five specific factors fit as well as the model without the general factor. We conclude that Digit Span and Arithmetic tests should not be classified as attention tests. Digit Symbol Coding and Spatial Span tap attentional capacity, while TMT-A, TMT-B, and Letter Cancellation tap search (or attention-shifting) ability. These five tests can be classified as attention tests.