Temporal windows in visual processing: "prestimulus brain state" and "poststimulus phase reset" segregate visual transients on different temporal scales

Distinct Cortical Networks Subserve Spatio-temporal Sampling in Vision through Different Oscillatory Rhythms

Although visual input arrives continuously, sensory information is segmented into (quasi-)discrete events. Here, we investigated the neural correlates of spatiotemporal binding in humans with magnetoencephalography using two tasks where separate flashes were presented on each trial but were perceived, in a bistable way, as either a single or two separate events. The first task (two-flash fusion) involved judging one versus two flashes, whereas the second task (apparent motion: AM) involved judging coherent motion versus two stationary flashes. Results indicate two different functional networks underlying two unique aspects of temporal binding. In two-flash fusion trials, involving an integration window of ∼50 msec, evoked responses differed as a function of perceptual interpretation by ∼25 msec after stimuli offset. Multivariate decoding of subjective perception based on prestimulus oscillatory phase was significant for alpha-band activity in the right medial temporal (V5/MT) area, with the strength of prestimulus connectivity between early visual areas and V5/MT being predictive of performance. In contrast, the longer integration window (∼130 msec) for AM showed evoked field differences only ∼250 msec after stimuli offset. Phase decoding of the perceptual outcome in AM trials was significant for theta-band activity in the right intraparietal sulcus. Prestimulus theta-band connectivity between V5/MT and intraparietal sulcus best predicted AM perceptual outcome. For both tasks, phase effects found could not be accounted by concomitant variations in power. These results show a strong relationship between specific spatiotemporal binding windows and specific oscillations, linked to the information flow between different areas of the where and when visual pathways.

Beta oscillations in vision: a (preconscious) neural mechanism for the dorsal visual stream?

Neural oscillations in alpha (8-12 Hz) and beta (13-30 Hz) frequency bands are thought to reflect feedback/reentrant loops and large-scale cortical interactions. In the last decades a main effort has been made in linking perception with alpha-band oscillations, with converging evidence showing that alpha oscillations have a key role in the temporal and featural binding of visual input, configuring the alpha rhythm a key determinant of conscious visual experience. Less attention has been historically dedicated to link beta oscillations and visual processing. Nonetheless, increasing studies report that task conditions that require to segregate/integrate stimuli in space, to disentangle local/global shapes, to spatially reorganize visual inputs, and to achieve motion perception or form-motion integration, rely on the activity of beta oscillations, with a main hub in parietal areas. In the present review, we summarize the evidence linking oscillations within the beta band and visual perception. We propose that beta oscillations represent a neural code that supports the functionality of the magnocellular-dorsal (M-D) visual pathway, serving as a fast primary neural code to exert top-down influences on the slower parvocellular-ventral visual pathway activity. Such M-D-related beta activity is proposed to act mainly pre-consciously, providing the spatial coordinates of vision and guiding the conscious extraction of objects identity that are achieved with slower alpha rhythms in ventral areas. Finally, within this new theoretical framework, we discuss the potential role of M-D-related beta oscillations in visuo-spatial attention, oculo-motor behavior and reading (dis)abilities.

Pre-stimulus alpha activity modulates long-lasting unconscious feature integration

Pre-stimulus alpha (α) activity can influence perception of shortly presented, low-contrast stimuli. The underlying mechanisms are often thought to affect perception exactly at the time of presentation. In addition, it is suggested that α cycles determine temporal windows of integration. However, in everyday situations, stimuli are usually presented for periods longer than ∼100 ms and perception is often an integration of information across space and time. Moving objects are just one example. Hence, the question is whether α activity plays a role also in temporal integration, especially when stimuli are integrated over several α cycles. Using electroencephalography (EEG), we investigated the relationship between pre-stimulus brain activity and long-lasting integration in the sequential metacontrast paradigm (SQM), where two opposite vernier offsets, embedded in a stream of lines, are unconsciously integrated into a single percept. We show that increases in α power, even 300 ms before the stimulus, affected the probability of reporting the first offset, shown at the very beginning of the SQM. This effect was mediated by the systematic slowing of the α rhythm that followed the peak in α power. No phase effects were found. Together, our results demonstrate a cascade of neural changes, following spontaneous bursts of α activity and extending beyond a single moment, which influences the sensory representation of visual features for hundreds of milliseconds. Crucially, as feature integration in the SQM occurs before a conscious percept is elicited, this also provides evidence that α activity is linked to mechanisms regulating unconscious processing.

Frequency modulation of cortical rhythmicity governs behavioral variability, excitability and synchrony of neurons in the visual cortex

Research in cognitive neuroscience has renewed the idea that brain oscillations are a core organization implicated in fundamental brain functions. Growing evidence reveals that the characteristic features of these oscillations, including power, phase and frequency, are highly non-stationary, fluctuating alongside alternations in sensation, cognition and behavior. However, there is little consensus on the functional implications of the instantaneous frequency variation in cortical excitability and concomitant behavior. Here, we capitalized on intracortical electrophysiology in the macaque monkey's visual area MT performing a visuospatial discrimination task with visual cues. We observed that the instantaneous frequency of the theta-alpha oscillations (4-13 Hz) is modulated among specific neurons whose RFs overlap with the cued stimulus location. Interestingly, we found that such frequency modulation is causally correlated with MT excitability at both scales of individual and ensemble of neurons. Moreover, studying the functional relevance of frequency variations indicated that the average theta-alpha frequencies foreshadow the monkey's reaction time. Our results also revealed that the neural synchronization strength alters with the average frequency shift in theta-alpha oscillations, suggesting frequency modulation is critical for mutually adjusting MTs' rhythms. Overall, our findings propose that theta-alpha frequency variations modulate MT's excitability, regulate mutual neurons' rhythmicity and indicate variability in behavior.

Evidence for a theta-band behavioural oscillation in rapid face detection

Theories of rhythmic perception propose that perceptual sampling operates in a periodic way, with alternating moments of high and low responsiveness to sensory inputs. This rhythmic sampling is linked to neural oscillations and thought to produce fluctuations in behavioural outcomes. Previous studies have revealed theta- and alpha-band behavioural oscillations in low-level visual tasks and object categorization. However, less is known about fluctuations in face perception, for which the human brain has developed a highly specialized network. To investigate this, we ran an online study (N = 179) incorporating the dense sampling technique with a dual-target rapid serial visual presentation (RSVP) paradigm. In each trial, a stream of object images was presented at 30 Hz and participants were tasked with detecting whether or not there was a face image in the sequence. On some trials, one or two (identical) face images (the target) were embedded in each stream. On dual-target trials, the targets were separated by an interstimulus interval (ISI) that varied between 0 to 633 ms. The task was to indicate the presence of the target and its gender if present. Performance varied as a function of ISI, with a significant behavioural oscillation in the face detection task at 7.5 Hz, driven mainly by the male target faces. This finding is consistent with a high theta-band-based fluctuation in visual processing. Such fluctuations might reflect rhythmic attentional sampling or, alternatively, feedback loops involved in updating top-down predictions.

Manipulation of Attention Affects Subitizing Performance: A Systematic Review and Meta-analysis

Subitizing is the fast and accurate enumeration of small sets. Whether attention is necessary for subitizing remains controversial considering (1) subitizing is claimed to be "pre-attentive", and (2) existing experimental methods and results are inconsistent. To determine whether manipulations to attention demonstratively affect subitizing, the current study comprises a systematic review and meta-analysis. Results from fourteen studies (22 experiments, 35 comparisons) suggest that changes to attentional demands interferes with enumeration of small sets; leading to slower response times, lower accuracy, and poorer Weber acuity (p <.010; p <.001; p <.001; respectively)-notwithstanding a potential publication bias. A unifying framework is proposed to explain the role of attention in visual enumeration, with progressively greater attentional involvement from estimation to subitizing to counting. Our findings suggest attention is integral for subitizing and highlights the need to emphasise attentional mechanisms into neurocognitive models of numerosity processing. We also discuss the possible role of attention in numerical processing difficulties (e.g., dyscalculia).

Visual cortex responds to sound onset and offset during passive listening

Sounds enhance our ability to detect, localize, and respond to co-occurring visual targets. Research suggests that sounds improve visual processing by resetting the phase of ongoing oscillations in visual cortex. However, it remains unclear what information is relayed from the auditory system to visual areas and if sounds modulate visual activity even in the absence of visual stimuli (e.g., during passive listening). Using intracranial electroencephalography (iEEG) in humans, we examined the sensitivity of visual cortex to three forms of auditory information during a passive listening task: auditory onset responses, auditory offset responses, and rhythmic entrainment to sounds. Because some auditory neurons respond to both sound onsets and offsets, visual timing and duration processing may benefit from each. Additionally, if auditory entrainment information is relayed to visual cortex, it could support the processing of complex stimulus dynamics that are aligned between auditory and visual stimuli. Results demonstrate that in visual cortex, amplitude-modulated sounds elicited transient onset and offset responses in multiple areas, but no entrainment to sound modulation frequencies. These findings suggest that activity in visual cortex (as measured with iEEG in response to auditory stimuli) may not be affected by temporally fine-grained auditory stimulus dynamics during passive listening (though it remains possible that this signal may be observable with simultaneous auditory-visual stimuli). Moreover, auditory responses were maximal in low-level visual cortex, potentially implicating a direct pathway for rapid interactions between auditory and visual cortices. This mechanism may facilitate perception by time-locking visual computations to environmental events marked by auditory discontinuities.

Neural correlates of temporal integration and segregation in metacontrast masking: A phenomenological study

Temporal integration and segregation have been investigated both in the research on the temporal mechanisms in visual perception and in the research on visual masking. Although both research lines share theoretical, methodological, and empirical similarities, there is little overlap between them and their models of temporal processing are incompatible. As a first step toward the unification of both lines of research, we investigated the electrophysiological correlates of temporal integration and segregation in a metacontrast masking paradigm. Participants reported in each trial whether they perceived the target-mask sequence as a simultaneous or temporally segregated percept while their EEG was recorded. A comparison of both temporal report categories resulted in an ERP difference after stimulus presentation (200-450 ms) that closely resembles the contour integration negativity. Moreover, we found that phase states were shifted between perceptual report categories in the alpha (450-250 ms) and beta (225-125 ms) frequency band before stimulus presentation and induced a sinusoidal periodicity in later temporal report proportions. Thus, we show that neural correlates of temporal integration and segregation can be generalized to metacontrast masking. These findings emphasize the potential role of temporal mechanisms in the emergence of the masking phenomenon. Additionally, our findings validate our phenomenological approach by demonstrating similar neural correlates of temporal integration and segregation as in performance-based tasks. Future research may profit from our phenomenological approach to disentangle the (neural) interplay between temporal and masking mechanisms.

Individual resting-state alpha peak frequency and within-trial changes in alpha peak frequency both predict visual dual-pulse segregation performance

Although sensory input is continuous, information must be combined over time to guide action and cognition, leading to the proposal of temporal sampling windows. A number of studies have suggested that a 10-Hz sampling window might be involved in the "frame rate" of visual processing. To investigate this, we tested the ability of participants to localize and enumerate 1 or 2 visual flashes presented either at near-threshold or full-contrast intensities, while recording magnetoencephalography. The inter-stimulus interval (ISI) between the 2 flashes was varied across trials. Performance in distinguishing between 1 and 2 flashes was linked to the alpha frequency, both at the individual level and trial-by-trial. Participants with a higher resting-state alpha peak frequency showed the greatest improvement in performance as a function of ISI within a 100-ms time window, while those with slower alpha improved more when ISI exceeded 100 ms. On each trial, correct enumeration (1 vs. 2) performance was paired with faster pre-stimulus instantaneous alpha frequency. Our results suggest that visual sampling/processing speed, linked to peak alpha frequency, is both an individual trait and can vary in a state-dependent manner.

Revealing the Relevant Spatiotemporal Scale Underlying Whole-Brain Dynamics

The brain rapidly processes and adapts to new information by dynamically transitioning between whole-brain functional networks. In this whole-brain modeling study we investigate the relevance of spatiotemporal scale in whole-brain functional networks. This is achieved through estimating brain parcellations at different spatial scales (100-900 regions) and time series at different temporal scales (from milliseconds to seconds) generated by a whole-brain model fitted to fMRI data. We quantify the richness of the dynamic repertoire at each spatiotemporal scale by computing the entropy of transitions between whole-brain functional networks. The results show that the optimal relevant spatial scale is around 300 regions and a temporal scale of around 150 ms. Overall, this study provides much needed evidence for the relevant spatiotemporal scales and recommendations for analyses of brain dynamics.

New methods for oscillation analyses push new theories of discrete cognition

Classical ways of analyzing neural time series data has led to static views on cognition, in which the cognitive processes are linked to sustained neural activity and interpreted as stationary states. The core analytical focus was on slow power modulations of neural oscillations averaged across many experimental trials. Whereas this custom analytical approach reduces the complexity and increases the signal-to-noise ratio, it may disregard or even remove important aspects of the underlying neural dynamics. Novel analysis methods investigate the instantaneous frequency and phase of neural oscillations and relate them to the precisely controlled timing of brief successive sensory stimuli. This enables to capture how cognitive processes unfold in discrete windows within and across oscillatory cycles. Moreover, several recent studies analyze the oscillatory power modulations on single experimental trials. They suggest that the power modulations are packed into discrete bursts of activity, which occur at different rates and times, and with different durations from trial-to-trial. Here, we review the current work that made use of these methodological advances for neural oscillations. These novel analysis perspectives emphasize that cognitive processes occur in discrete time windows, instead of sustained, stationary states. Evidence for discretization was observed for the entire range of cognitive functions from perception and attention to working memory, goal-directed thought and motor actions, as well as throughout the entire cortical hierarchy and in subcortical regions. These empirical observations create demand for new psychological theories and computational models of cognition in the brain, which integrate its discrete temporal dynamics.

Probabilistic, entropy-maximizing control of large-scale neural synchronization

Oscillatory neural activity is dynamically controlled to coordinate perceptual, attentional and cognitive processes. On the macroscopic scale, this control is reflected in the U-shaped deviations of EEG spectral-power dynamics from stochastic dynamics, characterized by disproportionately elevated occurrences of the lowest and highest ranges of power. To understand the mechanisms that generate these low- and high-power states, we fit a simple mathematical model of synchronization of oscillatory activity to human EEG data. The results consistently indicated that the majority (~95%) of synchronization dynamics is controlled by slowly adjusting the probability of synchronization while maintaining maximum entropy within the timescale of a few seconds. This strategy appears to be universal as the results generalized across oscillation frequencies, EEG current sources, and participants (N = 52) whether they rested with their eyes closed, rested with their eyes open in a darkened room, or viewed a silent nature video. Given that precisely coordinated behavior requires tightly controlled oscillatory dynamics, the current results suggest that the large-scale spatial synchronization of oscillatory activity is controlled by the relatively slow, entropy-maximizing adjustments of synchronization probability (demonstrated here) in combination with temporally precise phase adjustments (e.g., phase resetting generated by sensorimotor interactions). Interestingly, we observed a modest but consistent spatial pattern of deviations from the maximum-entropy rule, potentially suggesting that the mid-central-posterior region serves as an "entropy dump" to facilitate the temporally precise control of spectral-power dynamics in the surrounding regions.

Enumerating the forest before the trees: The time courses of estimation-based and individuation-based numerical processing

Ensemble perception refers to the ability to report attributes of a group of objects, rather than focusing on only one or a few individuals. An everyday example of ensemble perception is the ability to estimate the numerosity of a large number of items. The time course of ensemble processing, including that of numerical estimation, remains a matter of debate, with some studies arguing for rapid, "preattentive" processing and other studies suggesting that ensemble perception improves with longer presentation durations. We used a forward-simultaneous masking procedure that effectively controls stimulus durations to directly measure the temporal dynamics of ensemble estimation and compared it with more precise enumeration of individual objects. Our main finding was that object individuation within the subitizing range (one to four items) took about 100-150 ms to reach its typical capacity limits, whereas estimation (six or more items) showed a temporal resolution of 50 ms or less. Estimation accuracy did not improve over time. Instead, there was an increasing tendency, with longer effective durations, to underestimate the number of targets for larger set sizes (11-35 items). Overall, the time course of enumeration for one or a few single items was dramatically different from that of estimating numerosity of six or more items. These results are consistent with the idea that the temporal resolution of ensemble processing may be as rapid as, or even faster than, individuation of individual items, and support a basic distinction between the mechanisms underlying exact enumeration of small sets (one to four items) from estimation.

Pre-stimulus alpha-band power and phase fluctuations originate from different neural sources and exert distinct impact on stimulus-evoked responses

Ongoing oscillatory neural activity before stimulus onset influences subsequent visual perception. Specifically, both the power and the phase of oscillations in the alpha-frequency band (9-13 Hz) have been reported to predict the detection of visual stimuli. Up to now, the functional mechanisms underlying pre-stimulus power and phase effects on upcoming visual percepts are debated. Here, we used magnetoencephalography recordings together with a near-threshold visual detection task to investigate the neural generators of pre-stimulus power and phase and their impact on subsequent visual-evoked responses. Pre-stimulus alpha-band power and phase opposition effects were found consistent with previous reports. Source localization suggested clearly distinct neural generators for these pre-stimulus effects: Power effects were mainly found in occipital-temporal regions, whereas phase effects also involved prefrontal areas. In order to be functionally relevant, the pre-stimulus correlates should influence post-stimulus processing. Using a trial-sorting approach, we observed that only pre-stimulus power modulated the Hits versus Misses difference in the evoked response, a well-established post-stimulus neural correlate of near-threshold perception, such that trials with stronger pre-stimulus power effect showed greater post-stimulus difference. By contrast, no influence of pre-stimulus phase effects were found. In sum, our study shows distinct generators for two pre-stimulus neural patterns predicting visual perception, and that only alpha power impacts the post-stimulus correlate of conscious access. This underlines the functional relevance of prestimulus alpha power on perceptual awareness, while questioning the role of alpha phase.

Investigating the role of temporal processing in developmental dyslexia: Evidence for a specific deficit in rapid visual segmentation

The current study investigates the role of temporal processing in the visual domain in participants with developmental dyslexia (DD), the most common neurodevelopmental disorder, which is characterized by severe and specific difficulties in learning to read despite normal intelligence and adequate education. Specifically, our aim was to test whether DD is associated with a general impairment of temporal sensory processing or a specific deficit in temporal integration (which ensures stability of object identity and location) or segregation (which ensures sensitivity to changes in visual input). Participants with DD performed a task that measured both temporal integration and segregation using an identical sequence of two displays separated by a varying interstimulus interval (ISI) under two different task instructions. Results showed that participants with DD performed worse in the segregation task, with a shallower slope of the psychometric curve of percentage correct as a function of the ISI between the two target displays. Moreover, we found also a relationship between temporal segregation performance and text, words, and pseudowords reading speeds at the individual level. In contrast, no significant association between reading (dis)ability and temporal integration emerged. The current findings provide evidence for a difference in the fine temporal resolution of visual processing in DD and, considering the growing evidence about a link between visual temporal segregation and neural oscillations at specific frequencies, they support the idea that DD is characterized by an altered oscillatory sampling within the visual system.

Testing the effect of tACS over parietal cortex in modulating endogenous alpha rhythm and temporal integration windows in visual perception

Neural oscillations in the alpha band (8-12 Hz) have been proposed as a key mechanism for the temporal resolution of visual perception. Higher alpha frequencies have been related to improved segregation of visual events over time, whereas lower alpha frequencies have been related to improved temporal integration. Similarly, also the phase of ongoing alpha has been shown to correlate with temporal integration/segregation. To test a causal relationship between alpha oscillations and perception, we here employed multi-channel transcranial alternating current stimulation (mc-tACS) over the right parietal cortex, whereas participants performed a visual temporal integration/segregation task that used identical stimuli with different instructions. Before and after mc-tACS we recorded the resting-state electroencephalogram (EEG) to extract the individual alpha frequency (IAF) and delivered electrical stimulation at slightly slower and faster frequencies (IAF±2 Hz). We hypothesized that this would not only drive endogenous alpha rhythms, but also affect temporal integration and segregation in an opposite way. However, the mc-tACS protocol used here did not consistently increase or decrease the IAF after the stimulation and did not affect temporal integration/segregation accuracy as expected. Although we found some preliminary evidence for an influence of tACS phase on temporal integration accuracy, the ongoing phase of mc-tACS oscillations did not reliably modulate temporal integration/segregation accuracy in a sinusoidal way as would have been predicted by an effective entrainment of brain oscillations. These findings may guide future studies using different stimulation montages for investigating the role of cortical alpha oscillations for human vision.

Oscillatory Bursts in Parietal Cortex Reflect Dynamic Attention between Multiple Objects and Ensembles

The visual system uses two complimentary strategies to process multiple objects simultaneously within a scene and update their spatial positions in real time. It either uses selective attention to individuate a complex, dynamic scene into a few focal objects (i.e., object individuation), or it represents multiple objects as an ensemble by distributing attention more globally across the scene (i.e., ensemble grouping). Neural oscillations may be a key signature for focal object individuation versus distributed ensemble grouping, because they are thought to regulate neural excitability over visual areas through inhibitory control mechanisms. We recorded whole-head MEG data during a multiple-object tracking paradigm, in which human participants (13 female, 11 male) switched between different instructions for object individuation and ensemble grouping on different trials. The stimuli, responses, and the demand to keep track of multiple spatial locations over time were held constant between the two conditions. We observed increased α-band power (9-13 Hz) packed into oscillatory bursts in bilateral inferior parietal cortex during multiple-object processing. Single-trial analysis revealed greater burst occurrences on object individuation versus ensemble grouping trials. By contrast, we found no differences using standard analyses on across-trials averaged α-band power. Moreover, the bursting effects occurred only below/at, but not above, the typical capacity limits for multiple-object processing (at ∼4 objects). Our findings reveal the real-time neural correlates underlying the dynamic processing of multiple-object scenarios, which are modulated by grouping strategies and capacity. They support a rhythmic, α-pulsed organization of dynamic attention to multiple objects and ensembles.SIGNIFICANCE STATEMENT Dynamic multiple-object scenarios are an important problem in real-world and computer vision. They require keeping track of multiple objects as they move through space and time. Such problems can be solved in two ways: One can individuate a scene object by object, or alternatively group objects into ensembles. We observed greater occurrences of α-oscillatory burst events in parietal cortex for processing objects versus ensembles and below/at versus above processing capacity. These results demonstrate a unique top-down mechanism by which the brain dynamically adjusts its computational level between objects and ensembles. They help to explain how the brain copes with its capacity limitations in real-time environments and may lead the way to technological innovations for time-critical video analysis in computer vision.

The Effect of Alpha tACS on the Temporal Resolution of Visual Perception

We experience the world around us as a smooth and continuous flow. However, there is growing evidence that the stream of sensory inputs is not elaborated in an analog way but is instead organized in discrete or quasi-discrete temporal processing windows. These discrete windows are suggested to depend on rhythmic neural activity in the alpha (and theta) frequency bands, which in turn reflect changes in neural activity within, and coupling between, cortical areas. In the present study, we investigated a possible causal link between oscillatory brain activity in the alpha range (8-12 Hz) and the temporal resolution of visual perception, which determines whether sequential stimuli are perceived as distinct entities or combined into a single representation. To this aim, we employed a two-flash fusion task while participants received focal transcranial alternating current stimulation (tACS) in extra-striate visual regions including V5/MT of the right hemisphere. Our findings show that 10-Hz tACS, as opposed to a placebo (sham tACS), reduces the temporal resolution of perception, inducing participants to integrate the two stimuli into a unique percept more often. This pattern was observed only in the contralateral visual hemifield, providing further support for a specific effect of alpha tACS. The present findings corroborate the idea of a causal link between temporal windows of integration/segregation and oscillatory alpha activity in V5/MT and extra-striate visual regions. They also stimulate future research on possible ways to shape the temporal resolution of human vision in an individualized manner.

Spontaneous Brain Oscillations and Perceptual Decision-Making

Making rapid decisions on the basis of sensory information is essential to everyday behaviors. Why, then, are perceptual decisions so variable despite unchanging inputs? Spontaneous neural oscillations have emerged as a key predictor of trial-to-trial perceptual variability. New work casting these effects in the framework of models of perceptual decision-making has driven novel insight into how the amplitude of spontaneous oscillations impact decision-making. This synthesis reveals that the amplitude of ongoing low-frequency oscillations (<30 Hz), particularly in the alpha-band (8-13 Hz), bias sensory responses and change conscious perception but not, surprisingly, the underlying sensitivity of perception. A key model-based insight is that various decision thresholds do not adapt to alpha-related changes in sensory activity, demonstrating a seeming suboptimality of decision mechanisms in tracking endogenous changes in sensory responses.

Anticipation-induced delta phase reset improves human olfactory perception

Anticipating an odor improves detection and perception, yet the underlying neural mechanisms of olfactory anticipation are not well understood. In this study, we used human intracranial electroencephalography (iEEG) to show that anticipation resets the phase of delta oscillations in piriform cortex prior to odor arrival. Anticipatory phase reset correlates with ensuing odor-evoked theta power and improvements in perceptual accuracy. These effects were consistently present in each individual subject and were not driven by potential confounds of pre-inhale motor preparation or power changes. Together, these findings suggest that states of anticipation enhance olfactory perception through phase resetting of delta oscillations in piriform cortex.

Use of human intracranial electroencephalography methods, including rare direct recordings from human olfactory cortex, shows that anticipation of odor resets the phase of delta oscillations prior to the arrival of an odor.

Slow-paced inspiration regularizes alpha phase dynamics in the human brain

The phase of low-frequency, rhythmic cortical activity is essential for organizing brain processes because it provides a recurrent temporal frame for information coding. However, the low-frequency cortical phase exhibits great flexibility in response to external influences. Given that brain rhythms have been found to track respiratory inputs, we hypothesized that slow breathing, commonly associated with mental regulation, could reorganize the relationship between these two rhythmic systems through the adjustment of the cortical phase to such a slow train of inputs. Based on simultaneous magnetoencephalography and respiratory measurements, we report that while participants performed paced breathing, slow relative to normal breathing modulated cortical phase activity in the alpha range across widespread brain areas. Such modulation effects were specifically locked to the middle of the inspiration stage and exhibited a well-structured pattern. At the single-subject level, the phase angles underlying the effects became more likely to be diametrically opposed across breaths, indicating unique and consistent phase adjustment to slow inspiratory inputs. Neither cardiac fluctuations nor breathing-unrelated task effects could account for the findings. We suggest that slow-paced inspiration could organize the cortical phase in a regularized phase pattern, revealing a rhythmic but dynamic neural network integrated with different neurophysiological systems through volitional control.NEW & NOTEWORTHY Breathing is more complicated than a simple gas exchange, as it is integrated with numerous cognitive and emotional functions. Controlled slow breathing has often been used to regulate mental processes. This magnetoencephalography study demonstrates that slow-paced relative to normal-paced inspiration could organize the timing of alpha rhythmic activities across breathing cycles in a structured manner over widespread brain areas. Our results reveal how a volitionally controlled change in respiratory behavior could systematically modulate cortical activity.

Impaired Tactile Temporal Discrimination in Patients With Hepatic Encephalopathy

The sensory system constantly receives stimuli from the external world. To discriminate two stimuli correctly as two temporally distinct events, the temporal distance or stimulus onset asynchrony (SOA) between the two stimuli has to exceed a specific threshold. If the SOA between two stimuli is shorter than this specific threshold, the two stimuli will be perceptually fused and perceived as one single stimulus. Patients with hepatic encephalopathy (HE) are known to show manifold perceptual impairments, including slowed visual temporal discrimination abilities as measured by the critical flicker frequency (CFF). Here, we hypothesized that HE patients are also impaired in their tactile temporal discrimination abilities and, thus, require a longer SOA between two tactile stimuli to perceive the stimuli as two temporally distinct events. To test this hypothesis, patients with varying grades of HE and age-matched healthy individuals performed a tactile temporal discrimination task. All participants received two tactile stimuli with varying SOA applied to their left index finger and reported how many distinct stimuli they perceived ("1" vs. "2"). HE patients needed a significantly longer SOA (138.0 ± 11.3 ms) between two tactile stimuli to perceive the stimuli as two temporally distinct events than healthy controls (78.6 ± 13.1 ms; p < 0.01). In addition, we found that the temporal discrimination ability in the tactile modality correlated positively with the temporal discrimination ability in the visual domain across all participants (i.e., negative correlation between tactile SOA and visual CFF: r = -0.37, p = 0.033). Our findings provide evidence that temporal tactile perception is substantially impaired in HE patients. In addition, the results suggest that tactile and visual discrimination abilities are affected in HE in parallel. This finding might argue for a common underlying pathophysiological mechanism. We argue that the known global slowing of neuronal oscillations in HE might represent such a common mechanism.

Alpha-band sensory entrainment alters the duration of temporal windows in visual perception

The phase and frequency of neural oscillations in the alpha band (8-12 Hz) have been recently proposed as key parameters for the temporal resolution of visual perception. Here, we tested the possible causal links between these oscillatory features and temporal integration/segregation. The individual alpha frequency (IAF) peak as obtained from resting-state electroencephalography was used to set the frequency of sensory (audio-visual) entrainment for the lower (IAF - 2 Hz) and upper (IAF + 2 Hz) alpha. Entrainment at IAF ± 2 Hz was administered in the prestimulus interval to align oscillations to a faster or slower rhythm. We densely sampled in time the accuracy for integration/segregation by using identical stimuli with different instructions. The spectral peaks of performance fluctuations over time were found in the upper or lower alpha band for the IAF + 2 and IAF - 2 Hz entrainment, respectively, implying that faster entrainment resulted in faster behavioral fluctuations. Moreover, the entrainment frequency had opposite effects on temporal resolution: faster entrainment improved segregation while slower entrainment improved integration. Performance fluctuations were almost in anti-phase between the two tasks, such that highest integration performance coincided with lowest segregation performance. These findings provide evidence for a direct link between changes in the alpha band and the temporal resolution of perception.

The Role of Working Memory in the Probabilistic Inference of Future Sensory Events

The ability to represent the emerging regularity of sensory information from the external environment has been thought to allow one to probabilistically infer future sensory occurrences and thus optimize behavior. However, the underlying neural implementation of this process is still not comprehensively understood. Through a convergence of behavioral and neurophysiological evidence, we establish that the probabilistic inference of future events is critically linked to people's ability to maintain the recent past in working memory. Magnetoencephalography recordings demonstrated that when visual stimuli occurring over an extended time series had a greater statistical regularity, individuals with higher working-memory capacity (WMC) displayed enhanced slow-wave neural oscillations in the θ frequency band (4-8 Hz.) prior to, but not during stimulus appearance. This prestimulus neural activity was specifically linked to contexts where information could be anticipated and influenced the preferential sensory processing for this visual information after its appearance. A separate behavioral study demonstrated that this process intrinsically emerges during continuous perception and underpins a realistic advantage for efficient behavioral responses. In this way, WMC optimizes the anticipation of higher level semantic concepts expected to occur in the near future.

Frequency modulation of neural oscillations according to visual task demands

Temporal integration in visual perception is thought to occur within cycles of occipital alpha-band (8-12 Hz) oscillations. Successive stimuli may be integrated when they fall within the same alpha cycle and segregated for different alpha cycles. Consequently, the speed of alpha oscillations correlates with the temporal resolution of perception, such that lower alpha frequencies provide longer time windows for perceptual integration and higher alpha frequencies correspond to faster sampling and segregation. Can the brain's rhythmic activity be dynamically controlled to adjust its processing speed according to different visual task demands? We recorded magnetoencephalography (MEG) while participants switched between task instructions for temporal integration and segregation, holding stimuli and task difficulty constant. We found that the peak frequency of alpha oscillations decreased when visual task demands required temporal integration compared with segregation. Alpha frequency was strategically modulated immediately before and during stimulus processing, suggesting a preparatory top-down source of modulation. Its neural generators were located in occipital and inferotemporal cortex. The frequency modulation was specific to alpha oscillations and did not occur in the delta (1-3 Hz), theta (3-7 Hz), beta (15-30 Hz), or gamma (30-50 Hz) frequency range. These results show that alpha frequency is under top-down control to increase or decrease the temporal resolution of visual perception.

Multiple oscillatory rhythms determine the temporal organization of perception

Incoming sensory input is condensed by our perceptual system to optimally represent and store information. In the temporal domain, this process has been described in terms of temporal windows (TWs) of integration/segregation, in which the phase of ongoing neural oscillations determines whether two stimuli are integrated into a single percept or segregated into separate events. However, TWs can vary substantially, raising the question of whether different TWs map onto unique oscillations or, rather, reflect a single, general fluctuation in cortical excitability (e.g., in the alpha band). We used multivariate decoding of electroencephalography (EEG) data to investigate perception of stimuli that either repeated in the same location (two-flash fusion) or moved in space (apparent motion). By manipulating the interstimulus interval (ISI), we created bistable stimuli that caused subjects to perceive either integration (fusion/apparent motion) or segregation (two unrelated flashes). Training a classifier searchlight on the whole channels/frequencies/times space, we found that the perceptual outcome (integration vs. segregation) could be reliably decoded from the phase of prestimulus oscillations in right parieto-occipital channels. The highest decoding accuracy for the two-flash fusion task (ISI = 40 ms) was evident in the phase of alpha oscillations (8-10 Hz), while the highest decoding accuracy for the apparent motion task (ISI = 120 ms) was evident in the phase of theta oscillations (6-7 Hz). These results reveal a precise relationship between specific TW durations and specific oscillations. Such oscillations at different frequencies may provide a hierarchical framework for the temporal organization of perception.

The Role of Oscillatory Phase in Determining the Temporal Organization of Perception: Evidence from Sensory Entrainment

Recent behavioral, neuroimaging, and neurophysiological studies have renewed the idea that the information processing within different temporal windows is linked to the phase and/or frequency of the ongoing oscillations, predominantly in the theta/alpha band (∼4–7 and 8–12 Hz, respectively). However, being correlational in nature, this evidence might reflect a nonfunctional byproduct rather than having a causal role. A more direct link can be shown with methods that manipulate oscillatory activity. Here, we used audiovisual entrainment at different frequencies in the prestimulus period of a temporal integration/segregation task. We hypothesized that entrainment would align ongoing oscillations and drive them toward the stimulation frequency. To reveal behavioral oscillations in temporal perception after the entrainment, we sampled the segregation/integration performance densely in time. In Experiment 1, two groups of human participants (both males and females) received stimulation either at the lower or the upper boundary of the alpha band (∼8.5 vs 11.5 Hz). For both entrainment frequencies, we found a phase alignment of the perceptual oscillation across subjects, but with two different power spectra that peaked near the entrainment frequency. These results were confirmed when perceptual oscillations were characterized in the time domain with sinusoidal fittings. In Experiment 2, we replicated the findings in a within-subject design, extending the results for frequencies in the theta (∼6.5 Hz), but not in the beta (∼15 Hz), range. Overall, these findings show that temporal segregation can be modified by sensory entrainment, providing evidence for a critical role of ongoing oscillations in the temporal organization of perception.

SIGNIFICANCE STATEMENT The continuous flow of sensory input is not processed in an analog fashion, but rather is grouped by the perceptual system over time. Recent studies pinpointed the phase and/or frequency of the neural oscillations in the theta/alpha band (∼4–12 Hz) as possible mechanisms underlying temporal windows in perception. Here, we combined two innovative methodologies to provide more direct support for this evidence. We used sensory entrainment to align neural oscillations to different frequencies and then characterized the resultant perceptual oscillation with a temporal dense sampling of the integration/segregation performance. Our results provide the first evidence that the frequency of temporal segregation can be modified by sensory entrainment, supporting a critical role of ongoing oscillations in the integration/segregation of information over time.

Spontaneous Neural Oscillations Bias Perception by Modulating Baseline Excitability

The brain exhibits organized fluctuations of neural activity, even in the absence of tasks or sensory input. A prominent type of such spontaneous activity is the alpha rhythm, which influences perception and interacts with other ongoing neural activity. It is currently hypothesized that states of decreased prestimulus α oscillations indicate enhanced neural excitability, resulting in improved perceptual acuity. Nevertheless, it remains debated how changes in excitability manifest at the behavioral level in perceptual tasks. We addressed this issue by comparing two alternative models describing the effect of spontaneous α power on signal detection. The first model assumes that decreased α power increases baseline excitability, amplifying the response to both signal and noise, predicting a liberal detection criterion with no effect on sensitivity. The second model predicts that decreased α power increases the trial-by-trial precision of the sensory response, resulting in improved sensitivity. We tested these models in two EEG experiments in humans where we analyzed the effects of prestimulus α power on visual detection and discrimination using a signal detection framework. Both experiments provide strong evidence that decreased α power reflects a more liberal detection criterion, rather than improved sensitivity, consistent with the baseline model. In other words, when the task requires detecting stimulus presence versus absence, reduced α oscillations make observers more likely to report the stimulus regardless of actual stimulus presence. Contrary to previous interpretations, these results suggest that states of decreased α oscillations increase the global baseline excitability of sensory systems without affecting perceptual acuity.

SIGNIFICANCE STATEMENT

Spontaneous fluctuations of brain activity explain why a faint sensory stimulus is sometimes perceived and sometimes not. The prevailing view is that heightened neural excitability, indexed by decreased α oscillations, promotes better perceptual performance. Here, we provide evidence that heightened neural excitability instead reflects a state of biased perception, during which a person is more likely to see a stimulus, whether or not it is actually present. Therefore, we propose that changes in neural excitability leave the precision of sensory processing unaffected. These results establish the link between spontaneous brain activity and the variability in human perception.

Time for Awareness: The Influence of Temporal Properties of the Mask on Continuous Flash Suppression Effectiveness

Visual processing is not instantaneous, but instead our conscious perception depends on the integration of sensory input over time. In the case of Continuous Flash Suppression (CFS), masks are flashed to one eye, suppressing awareness of stimuli presented to the other eye. One potential explanation of CFS is that it depends, at least in part, on the flashing mask continually interrupting visual processing before the stimulus reaches awareness. We investigated the temporal features of masks in two ways. First, we measured the suppression effectiveness of a wide range of masking frequencies (0-32Hz), using both complex (faces/houses) and simple (closed/open geometric shapes) stimuli. Second, we varied whether the different frequencies were interleaved within blocks or separated in homogenous blocks, in order to see if suppression was stronger or weaker when the frequency remained constant across trials. We found that break-through contrast differed dramatically between masking frequencies, with mask effectiveness following a skewed-normal curve peaking around 6Hz and little or no masking for low and high temporal frequencies. Peak frequency was similar for trial-randomized and block randomized conditions. In terms of type of stimulus, we found no significant difference in peak frequency between the stimulus groups (complex/simple, face/house, closed/open). These findings suggest that temporal factors play a critical role in perceptual awareness, perhaps due to interactions between mask frequency and the time frame of visual processing.

Temporal Integration Windows in Neural Processing and Perception Aligned to Saccadic Eye Movements

When processing dynamic input, the brain balances the opposing needs of temporal integration and sensitivity to change. We hypothesized that the visual system might resolve this challenge by aligning integration windows to the onset of newly arriving sensory samples. In a series of experiments, human participants observed the same sequence of two displays separated by a brief blank delay when performing either an integration or segregation task. First, using magneto-encephalography (MEG), we found a shift in the stimulus-evoked time courses by a 150-ms time window between task signals. After stimulus onset, multivariate pattern analysis (MVPA) decoding of task in occipital-parietal sources remained above chance for almost 1 s, and the task-decoding pattern interacted with task outcome. In the pre-stimulus period, the oscillatory phase in the theta frequency band was informative about both task processing and behavioral outcome for each task separately, suggesting that the post-stimulus effects were caused by a theta-band phase shift. Second, when aligning stimulus presentation to the onset of eye fixations, there was a similar phase shift in behavioral performance according to task demands. In both MEG and behavioral measures, task processing was optimal first for segregation and then integration, with opposite phase in the theta frequency range (3-5 Hz). The best fit to neurophysiological and behavioral data was given by a dampened 3-Hz oscillation from stimulus or eye fixation onset. The alignment of temporal integration windows to input changes found here may serve to actively organize the temporal processing of continuous sensory input.

The Speed of Alpha-Band Oscillations Predicts the Temporal Resolution of Visual Perception

Evidence suggests that scalp-recorded occipital alpha-band (8-13 Hz) oscillations reflect phasic information transfer in thalamocortical neurons projecting from lateral geniculate nucleus to visual cortex. In animals, the phase of ongoing alpha oscillations has been shown to modulate stimulus discrimination and neuronal spiking. Human research has shown that alpha phase predicts visual perception of near-threshold stimuli and subsequent neural activity and that the frequency of these oscillations predicts reaction times, as well as the maximum temporal interval necessary for perceived simultaneity. These phasic effects have led to the hypothesis that conscious perception occurs in discrete temporal windows, clocked by the frequency of alpha oscillations. Under this hypothesis, variation in the frequency of occipital alpha oscillations should predict variation in the temporal resolution of visual perception. Specifically, when two stimuli fall within the same alpha cycle, they may be perceived as a single stimulus, resulting in perception with lower temporal resolution when alpha frequency is lower. We tested this by assessing the relationship between two-flash fusion thresholds (a measure of the temporal resolution of visual perception) and the frequency of eyes-closed and task-related alpha rhythms. We found, both between and within subjects, that faster alpha frequencies predicted more accurate flash discrimination, providing novel evidence linking alpha frequency to the temporal resolution of perception.

Expansion and Compression of Time Correlate with Information Processing in an Enumeration Task

Perception of temporal duration is subjective and is influenced by factors such as attention and context. For example, unexpected or emotional events are often experienced as if time subjectively expands, suggesting that the amount of information processed in a unit of time can be increased. Time dilation effects have been measured with an oddball paradigm in which an infrequent stimulus is perceived to last longer than standard stimuli in the rest of the sequence. Likewise, time compression for the oddball occurs when the duration of the standard items is relatively brief. Here, we investigated whether the amount of information processing changes when time is perceived as distorted. On each trial, an oddball stimulus of varying numerosity (1-14 items) and duration was presented along with standard items that were either short (70 ms) or long (1050 ms). Observers were instructed to count the number of dots within the oddball stimulus and to judge its relative duration with respect to the standards on that trial. Consistent with previous results, oddballs were reliably perceived as temporally distorted: expanded for longer standard stimuli blocks and compressed for shorter standards. The occurrence of these distortions of time perception correlated with perceptual processing; i.e. enumeration accuracy increased when time was perceived as expanded and decreased with temporal compression. These results suggest that subjective time distortions are not epiphenomenal, but reflect real changes in sensory processing. Such short-term plasticity in information processing rate could be evolutionarily advantageous in optimizing perception and action during critical moments.

Information processing in the CNS: a supramolecular chemistry?

How does central nervous system process information? Current theories are based on two tenets: (a) information is transmitted by action potentials, the language by which neurons communicate with each other-and (b) homogeneous neuronal assemblies of cortical circuits operate on these neuronal messages where the operations are characterized by the intrinsic connectivity among neuronal populations. In this view, the size and time course of any spike is stereotypic and the information is restricted to the temporal sequence of the spikes; namely, the "neural code". However, an increasing amount of novel data point towards an alternative hypothesis: (a) the role of neural code in information processing is overemphasized. Instead of simply passing messages, action potentials play a role in dynamic coordination at multiple spatial and temporal scales, establishing network interactions across several levels of a hierarchical modular architecture, modulating and regulating the propagation of neuronal messages. (b) Information is processed at all levels of neuronal infrastructure from macromolecules to population dynamics. For example, intra-neuronal (changes in protein conformation, concentration and synthesis) and extra-neuronal factors (extracellular proteolysis, substrate patterning, myelin plasticity, microbes, metabolic status) can have a profound effect on neuronal computations. This means molecular message passing may have cognitive connotations. This essay introduces the concept of "supramolecular chemistry", involving the storage of information at the molecular level and its retrieval, transfer and processing at the supramolecular level, through transitory non-covalent molecular processes that are self-organized, self-assembled and dynamic. Finally, we note that the cortex comprises extremely heterogeneous cells, with distinct regional variations, macromolecular assembly, receptor repertoire and intrinsic microcircuitry. This suggests that every neuron (or group of neurons) embodies different molecular information that hands an operational effect on neuronal computation.

Dissociation between spatial and temporal integration mechanisms in Vernier fusion

The visual system constructs a percept of the world across multiple spatial and temporal scales. This raises the questions of whether different scales involve separate integration mechanisms and whether spatial and temporal factors are linked via spatio-temporal reference frames. We investigated this using Vernier fusion, a phenomenon in which the features of two Vernier stimuli presented in close spatio-temporal proximity are fused into a single percept. With increasing spatial offset, perception changes dramatically from a single percept into apparent motion and later, at larger offsets, into two separately perceived stimuli. We tested the link between spatial and temporal integration by presenting two successive Vernier stimuli presented at varying spatial and temporal offsets. The second Vernier either had the same or the opposite offset as the first. We found that the type of percept depended not only on spatial offset, as reported previously, but interacted with the temporal parameter as well. At temporal separations around 30-40 ms the majority of trials were perceived as motion, while above 70 ms predominantly two separate stimuli were reported. The dominance of the second Vernier varied systematically with temporal offset, peaking around 40 ms ISI. Same-offset conditions showed increasing amounts of perceived separation at large ISIs, but little dependence on spatial offset. As subjects did not always completely fuse stimuli, we separated trials by reported percept (single/fusion, motion, double/segregation). We found systematic indications of spatial fusion even on trials in which subjects perceived temporal segregation. These findings imply that spatial integration/fusion may occur even when the stimuli are perceived as temporally separate entities, suggesting that the mechanisms responsible for temporal segregation and spatial integration may not be mutually exclusive.

The temporal window of individuation limits visual capacity

One of the main tasks of vision is to individuate and recognize specific objects. Unlike the detection of basic features, object individuation is strictly limited in capacity. Previous studies of capacity, in terms of subitizing ranges or visual working memory, have emphasized spatial limits in the number of objects that can be apprehended simultaneously. Here, we present psychophysical and electrophysiological evidence that capacity limits depend instead on time. Contrary to what is commonly assumed, subitizing, the reading-out a small set of individual objects, is not an instantaneous process. Instead, individuation capacity increases in steps within the lifetime of visual persistence of the stimulus, suggesting that visual capacity limitations arise as a result of the narrow window of feedforward processing. We characterize this temporal window as coordinating individuation and integration of sensory information over a brief interval of around 100 ms. Neural signatures of integration windows are revealed in reset alpha oscillations shortly after stimulus onset within generators in parietal areas. Our findings suggest that short-lived alpha phase synchronization (≈1 cycle) is key for individuation and integration of visual transients on rapid time scales (<100 ms). Within this time frame intermediate-level vision provides an equilibrium between the competing needs to individuate invariant objects, integrate information about those objects over time, and remain sensitive to dynamic changes in sensory input. We discuss theoretical and practical implications of temporal windows in visual processing, how they create a fundamental capacity limit, and their role in constraining the real-time dynamics of visual processing.

Temporal integration windows for naturalistic visual sequences

There is increasing evidence that the brain possesses mechanisms to integrate incoming sensory information as it unfolds over time-periods of 2-3 seconds. The ubiquity of this mechanism across modalities, tasks, perception and production has led to the proposal that it may underlie our experience of the subjective present. A critical test of this claim is that this phenomenon should be apparent in naturalistic visual experiences. We tested this using movie-clips as a surrogate for our day-to-day experience, temporally scrambling them to require (re-) integration within and beyond the hypothesized 2-3 second interval. Two independent experiments demonstrate a step-wise increase in the difficulty to follow stimuli at the hypothesized 2-3 second scrambling condition. Moreover, only this difference could not be accounted for by low-level visual properties. This provides the first evidence that this 2-3 second integration window extends to complex, naturalistic visual sequences more consistent with our experience of the subjective present.