Top-down control of visual cortex by the frontal eye fields through oscillatory realignment

Differential cortical and subcortical visual processing with eyes shut

Closing our eyes largely shuts down our ability to see. That said, our eyelids still pass some light, allowing our visual system to coarsely process information about visual scenes, such as changes in luminance. However, the specific impact of eye closure on processing within the early visual system remains largely unknown. To understand how visual processing is modulated when eyes are shut, we used functional magnetic resonance imaging (fMRI) to measure responses to a flickering visual stimulus at high (100%) and low (10%) temporal contrasts, while participants viewed the stimuli with their eyes open or closed. Interestingly, we discovered that eye closure produced a qualitatively distinct pattern of effects across the visual thalamus and visual cortex. We found that with eyes open, low temporal contrast stimuli produced smaller responses across the lateral geniculate nucleus (LGN), primary (V1) and extrastriate visual cortex (V2). However, with eyes closed, we discovered that the LGN and V1 maintained similar blood oxygenation level-dependent (BOLD) responses as the eyes open condition, despite the suppressed visual input through the eyelid. In contrast, V2 and V3 had strongly attenuated BOLD response when eyes were closed, regardless of temporal contrast. Our findings reveal a qualitatively distinct pattern of visual processing when the eyes are closed-one that is not simply an overall attenuation but rather reflects distinct responses across visual thalamocortical networks, wherein the earliest stages of processing preserve information about stimuli but are then gated off downstream in visual cortex.NEW & NOTEWORTHY When we close our eyes coarse luminance information is still accessible by the visual system. Using functional magnetic resonance imaging, we examined whether eyelid closure plays a unique role in visual processing. We discovered that while the LGN and V1 show equivalent responses when the eyes are open or closed, extrastriate cortex exhibited attenuated responses with eye closure. This suggests that when the eyes are closed, downstream visual processing is blind to this information.

Multiband task related components enhance rapid cognition decoding for both small and similar objects

The cortically-coupled target recognition system based on rapid serial visual presentation (RSVP) has a wide range of applications in brain computer interface (BCI) fields such as medical and military. However, in the complex natural environment backgrounds, the identification of event-related potentials (ERP) of both small and similar objects that are quickly presented is a research challenge. Therefore, we designed corresponding experimental paradigms and proposed a multi-band task related components matching (MTRCM) method to improve the rapid cognitive decoding of both small and similar objects. We compared the areas under the receiver operating characteristic curve (AUC) between MTRCM and other 9 methods under different numbers of training sample using RSVP-ERP data from 50 subjects. The results showed that MTRCM maintained an overall superiority and achieved the highest average AUC (0.6562 ± 0.0091). We also optimized the frequency band and the time parameters of the method. The verification on public data sets further showed the necessity of designing MTRCM method. The MTRCM method provides a new approach for neural decoding of both small and similar RSVP objects, which is conducive to promote the further development of RSVP-BCI.

Transcranial Alternating Current Stimulation over Frontal Eye Fields Mimics Attentional Modulation of Visual Processing

Attentional control over sensory processing has been linked to neural alpha oscillations and related inhibition of cerebral cortex. Despite the wide consensus on the functional relevance of alpha oscillations for attention, precise neural mechanisms of how alpha oscillations shape perception and how this top-down modulation is implemented in cortical networks remain unclear. Here, we tested the hypothesis that alpha oscillations in frontal eye fields (FEFs) are causally involved in the top-down regulation of visual processing in humans (male and female). We applied sham-controlled, intermittent transcranial alternating current stimulation (tACS) over bilateral FEF at either 10 Hz (alpha) or 40 Hz (gamma) to manipulate attentional preparation in a visual discrimination task. Under each stimulation condition, we measured psychometric functions for contrast perception and introduced a novel linear mixed modeling approach for statistical control of neurosensory side effects of the electric stimulation. tACS at alpha frequency reduced the slope of the psychometric function, resulting in improved subthreshold and impaired superthreshold contrast perception. Side effects on the psychometric functions were complex and showed large interindividual variability. Controlling for the impact of side effects on the psychometric parameters by using covariates in the linear mixed model analysis reduced this variability and strengthened the perceptual effect. We propose that alpha tACS over FEF mimicked a state of endogenous attention by strengthening a fronto-occipitoparietal network in the alpha band. We speculate that this network modulation enhanced phasic gating in occipitoparietal cortex leading to increased variability of single-trial psychometric thresholds, measurable as a reduction of psychometric slope.

Effects of neural oscillation power and phase on discrimination performance in a visual tilt illusion

Neural oscillations reflect fluctuations in the relative excitation/inhibition of neural systems1,2,3,4,5 and are theorized to play a critical role in canonical neural computations6,7,8,9 and cognitive processes.10,11,12,13,14 These theories have been supported by findings that detection of visual stimuli fluctuates with the phase of oscillations prior to stimulus onset.15,16,17,18,19,20,21,22,23 However, null results have emerged in studies seeking to demonstrate these effects in visual discrimination tasks,24,25,26,27 raising questions about the generalizability of these phenomena to wider neural processes. Recently, we suggested that methodological limitations may mask effects of phase in higher-level sensory processing.28 To test the generality of phasic influences on perception requires a task that involves stimulus discrimination while also depending on early sensory processing. Here, we examined the influence of oscillation phase on the visual tilt illusion, in which a center grating has its perceived orientation biased away from the orientation of a surround grating29 due to lateral inhibitory interactions in early visual processing.30,31,32 We presented center gratings at participants' subjective vertical angle and had participants report whether the grating appeared tilted clockwise or counterclockwise from vertical on each trial while measuring their brain activity with electroencephalography (EEG). In addition to effects of alpha power and aperiodic slope, we observed robust associations between orientation perception and alpha and theta phase, consistent with fluctuating illusion magnitude across the oscillatory cycle. These results confirm that oscillation phase affects the complex processing involved in stimulus discrimination, consistent with its purported role in canonical computations that underpin cognition.

The role of parietal beta-band activity in the resolution of visual crowding

Visual crowding is the difficulty in identifying an object when surrounded by neighbouring flankers, representing a bottleneck for object perception. Crowding arises not only from the activity of visual areas but also from parietal areas and fronto-parietal network activity. Parietal areas would provide the dorsal-to-ventral guidance for object identification and the fronto-parietal network would modulate the attentional resolution. Several studies highlighted the relevance of beta oscillations (15-25 Hz) in these areas for visual crowding and other connatural visual phenomena. In the present study, we investigated the differential contribution of beta oscillations in the parietal cortex and fronto-parietal network in the resolution of visual crowding. During a crowding task with letter stimuli, high-definition transcranial Alternating Current Stimulation (tACS) in the beta band (18 Hz) was delivered bilaterally on parietal sites, on the right fronto-parietal network, and in a sham regime. Resting-state EEG was recorded before and after stimulation to measure tACS-induced aftereffects. The influence of crowding was reduced only when tACS was delivered bilaterally on parietal sites. In this condition, beta power was reduced after the stimulation. Furthermore, the magnitude of tACS-induced aftereffects varied as a function of individual differences in beta oscillations. Results corroborate the link between parietal beta oscillations and visual crowding, providing fundamental insights on brain rhythms underlying the dorsal-to-ventral guidance in visual perception and suggesting that beta tACS can induce plastic changes in these areas. Remarkably, these findings open new possibilities for neuromodulatory interventions for disorders characterised by abnormal crowding, such as dyslexia.

Oscillatory Waveform Shape and Temporal Spike Correlations Differ across Bat Frontal and Auditory Cortex

Neural oscillations are associated with diverse computations in the mammalian brain. The waveform shape of oscillatory activity measured in the cortex relates to local physiology and can be informative about aberrant or dynamically changing states. However, how waveform shape differs across distant yet functionally and anatomically related cortical regions is largely unknown. In this study, we capitalize on simultaneous recordings of local field potentials (LFPs) in the auditory and frontal cortices of awake, male Carollia perspicillata bats to examine, on a cycle-by-cycle basis, waveform shape differences across cortical regions. We find that waveform shape differs markedly in the fronto-auditory circuit even for temporally correlated rhythmic activity in comparable frequency ranges (i.e., in the delta and gamma bands) during spontaneous activity. In addition, we report consistent differences between areas in the variability of waveform shape across individual cycles. A conceptual model predicts higher spike-spike and spike-LFP correlations in regions with more asymmetric shapes, a phenomenon that was observed in the data: spike-spike and spike-LFP correlations were higher in the frontal cortex. The model suggests a relationship between waveform shape differences and differences in spike correlations across cortical areas. Altogether, these results indicate that oscillatory activity in the frontal and auditory cortex possesses distinct dynamics related to the anatomical and functional diversity of the fronto-auditory circuit.

Top-down generation of low-resolution representations improves visual perception and imagination

Perception or imagination requires top-down signals from high-level cortex to primary visual cortex (V1) to reconstruct or simulate the representations bottom-up stimulated by the seen images. Interestingly, top-down signals in V1 have lower spatial resolution than bottom-up representations. It is unclear why the brain uses low-resolution signals to reconstruct or simulate high-resolution representations. By modeling the top-down pathway of the visual system using the decoder of a variational auto-encoder (VAE), we reveal that low-resolution top-down signals can better reconstruct or simulate the information contained in the sparse activities of V1 simple cells, which facilitates perception and imagination. This advantage of low-resolution generation is related to facilitating high-level cortex to form geometry-respecting representations observed in experiments. Furthermore, we present two findings regarding this phenomenon in the context of AI-generated sketches, a style of drawings made of lines. First, we found that the quality of the generated sketches critically depends on the thickness of the lines in the sketches: thin-line sketches are harder to generate than thick-line sketches. Second, we propose a technique to generate high-quality thin-line sketches: instead of directly using original thin-line sketches, we use blurred sketches to train VAE or GAN (generative adversarial network), and then infer the thin-line sketches from the VAE- or GAN-generated blurred sketches. Collectively, our work suggests that low-resolution top-down generation is a strategy the brain uses to improve visual perception and imagination, which inspires new sketch-generation AI techniques.

Pathway-selective optogenetics reveals the functional anatomy of top-down attentional modulation in the macaque visual cortex

Spatial attention represents a powerful top-down influence on sensory responses in primate visual cortical areas. The frontal eye field (FEF) has emerged as a key candidate area for the source of this modulation. However, it is unclear whether the FEF exerts its effects via its direct axonal projections to visual areas or indirectly through other brain areas and whether the FEF affects both the enhancement of attended and the suppression of unattended sensory responses. We used pathway-selective optogenetics in rhesus macaques performing a spatial attention task to inhibit the direct input from the FEF to area MT, an area along the dorsal visual pathway specialized for the processing of visual motion information. Our results show that the optogenetic inhibition of the FEF input specifically reduces attentional modulation in MT by about a third without affecting the neurons' sensory response component. We find that the direct FEF-to-MT pathway contributes to both the enhanced processing of target stimuli and the suppression of distractors. The FEF, thus, selectively modulates firing rates in visual area MT, and it does so via its direct axonal projections.

Beta oscillations in vision: a (preconscious) neural mechanism for the dorsal visual stream?

Neural oscillations in alpha (8-12 Hz) and beta (13-30 Hz) frequency bands are thought to reflect feedback/reentrant loops and large-scale cortical interactions. In the last decades a main effort has been made in linking perception with alpha-band oscillations, with converging evidence showing that alpha oscillations have a key role in the temporal and featural binding of visual input, configuring the alpha rhythm a key determinant of conscious visual experience. Less attention has been historically dedicated to link beta oscillations and visual processing. Nonetheless, increasing studies report that task conditions that require to segregate/integrate stimuli in space, to disentangle local/global shapes, to spatially reorganize visual inputs, and to achieve motion perception or form-motion integration, rely on the activity of beta oscillations, with a main hub in parietal areas. In the present review, we summarize the evidence linking oscillations within the beta band and visual perception. We propose that beta oscillations represent a neural code that supports the functionality of the magnocellular-dorsal (M-D) visual pathway, serving as a fast primary neural code to exert top-down influences on the slower parvocellular-ventral visual pathway activity. Such M-D-related beta activity is proposed to act mainly pre-consciously, providing the spatial coordinates of vision and guiding the conscious extraction of objects identity that are achieved with slower alpha rhythms in ventral areas. Finally, within this new theoretical framework, we discuss the potential role of M-D-related beta oscillations in visuo-spatial attention, oculo-motor behavior and reading (dis)abilities.

Periodic attention deficits after frontoparietal lesions provide causal evidence for rhythmic attentional sampling

Contemporary models conceptualize spatial attention as a blinking spotlight that sequentially samples visual space. Hence, behavior fluctuates over time, even in states of presumed "sustained" attention. Recent evidence has suggested that rhythmic neural activity in the frontoparietal network constitutes the functional basis of rhythmic attentional sampling. However, causal evidence to support this notion remains absent. Using a lateralized spatial attention task, we addressed this issue in patients with focal lesions in the frontoparietal attention network. Our results revealed that frontoparietal lesions introduce periodic attention deficits, i.e., temporally specific behavioral deficits that are aligned with the underlying neural oscillations. Attention-guided perceptual sensitivity was on par with that of healthy controls during optimal phases but was attenuated during the less excitable sub-cycles. Theta-dependent sampling (3-8 Hz) was causally dependent on the prefrontal cortex, while high-alpha/low-beta sampling (8-14 Hz) emerged from parietal areas. Collectively, our findings reveal that lesion-induced high-amplitude, low-frequency brain activity is not epiphenomenal but has immediate behavioral consequences. More generally, these results provide causal evidence for the hypothesis that the functional architecture of attention is inherently rhythmic.

Spatiotemporal dynamics of self-generated imagery reveal a reverse cortical hierarchy from cue-induced imagery

Visual imagery allows for the construction of rich internal experience in our mental world. However, it has remained poorly understood how imagery experience derives volitionally as opposed to being cue driven. Here, using electroencephalography and functional magnetic resonance imaging, we systematically investigate the spatiotemporal dynamics of self-generated imagery by having participants volitionally imagining one of the orientations from a learned pool. We contrast self-generated imagery with cue-induced imagery, where participants imagined line orientations based on associative cues acquired previously. Our results reveal overlapping neural signatures of cue-induced and self-generated imagery. Yet, these neural signatures display substantially differential sensitivities to the two types of imagery: self-generated imagery is supported by an enhanced involvement of the anterior cortex in representing imagery contents. By contrast, cue-induced imagery is supported by enhanced imagery representations in the posterior visual cortex. These results jointly support a reverse cortical hierarchy in generating and maintaining imagery contents in self-generated versus externally cued imagery.

Prefrontal activity sharpens spatial sensitivity of extrastriate neurons

Prefrontal cortex is known to exert its control over representation of visual signals in extrastriate areas such as V4. Frontal Eye Field (FEF) is suggested to be the proxy for the prefrontal control of visual signals. However, it is not known which aspects of sensory representation within extrastriate areas are under the influence of FEF activity. We employed a causal manipulation to examine how FEF activity contributes to spatial sensitivity of extrastriate neurons. Finding FEF and V4 areas with overlapping response field (RF) in two macaque monkeys, we recorded V4 responses before and after inactivation of the overlapping FEF. We assessed spatial sensitivity of V4 neurons in terms of their response gain, RF spread, coding capacity, and spatial discriminability. Unexpectedly, we found that in the absence of FEF activity, spontaneous and visually-evoked activity of V4 neurons both increase and their RFs enlarge. However, assessing the spatial sensitivity within V4, we found that these changes were associated with a reduction in the ability of V4 neurons to represent spatial information: After FEF inactivation, V4 neurons showed a reduced response gain and a decrease in their spatial discriminability and coding capacity. These results show the necessity of FEF activity for shaping spatial responses of extrastriate neurons and indicates the importance of FEF inputs in sharpening the sensitivity of V4 responses.

Increasing associative plasticity in temporo-occipital back-projections improves visual perception of emotions

The posterior superior temporal sulcus (pSTS) is a critical node in a network specialized for perceiving emotional facial expressions that is reciprocally connected with early visual cortices (V1/V2). Current models of perceptual decision-making increasingly assign relevance to recursive processing for visual recognition. However, it is unknown whether inducing plasticity into reentrant connections from pSTS to V1/V2 impacts emotion perception. Using a combination of electrophysiological and neurostimulation methods, we demonstrate that strengthening the connectivity from pSTS to V1/V2 selectively increases the ability to perceive facial expressions associated with emotions. This behavior is associated with increased electrophysiological activity in both these brain regions, particularly in V1/V2, and depends on specific temporal parameters of stimulation that follow Hebbian principles. Therefore, we provide evidence that pSTS-to-V1/V2 back-projections are instrumental to perception of emotion from facial stimuli and functionally malleable via manipulation of associative plasticity.

Differential cortical and subcortical visual processing with eyes shut

Closing our eyes largely shuts down our ability to see. That said, our eyelids still pass some light, allowing our visual system to coarsely process information about visual scenes, such as changes in luminance. However, the specific impact of eye closure on processing within the early visual system remains largely unknown. To understand how visual processing is modulated when eyes are shut, we used functional magnetic resonance imaging (fMRI) to measure responses to a flickering visual stimulus at high (100%) and low (10%) temporal contrasts, while participants viewed the stimuli with their eyes open or closed. Interestingly, we discovered that eye closure produced a qualitatively distinct pattern of effects across the visual thalamus and visual cortex. We found that with eyes open, low temporal contrast stimuli produced smaller responses, across the lateral geniculate nucleus (LGN), primary (V1) and extrastriate visual cortex (V2). However, with eyes closed, we discovered that the LGN and V1 maintained similar BOLD responses as the eyes open condition, despite the suppressed visual input through the eyelid. In contrast, V2 and V3 had strongly attenuated BOLD response when eyes were closed, regardless of temporal contrast. Our findings reveal a qualitative distinct pattern of visual processing when the eyes are closed - one that is not simply an overall attenuation, but rather reflects distinct responses across visual thalamocortical networks, wherein the earliest stages of processing preserves information about stimuli but is then gated off downstream in visual cortex.

Frontal-occipital phase synchronization predicts occipital alpha power in perceptual decision-making

Numerous studies of perceptual decision-making have shown that lower prestimulus alpha power leads to a higher hit rate in visual detection, which is believed to correlate with the top-down control. However, whether frontal-occipital phase synchronization underlying the top-down control could impact the occipital alpha power that directly affects the perceptual performance remains unclear. In this study, we used analyses of the general linear mixed model (GLMM) and event-related potentials (ERPs) to show that the prestimulus alpha power over the occipital area directly affected visual perception. Using both the univariate and multivariate methods, we found that low-frequency (4-30 Hz) frontal-occipital phase synchronization predicted the prestimulus alpha power over the occipital area. Overall, our results suggested that frontal-occipital phase synchronization could predict occipital alpha power that directly affects perceptual decision-making.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11571-022-09862-7.

Personalized alpha-tACS targeting left posterior parietal cortex modulates visuo-spatial attention and posterior evoked EEG activity

BACKGROUND

Covert visuo-spatial attention is marked by the anticipatory lateralization of neuronal alpha activity in the posterior parietal cortex. Previous applications of transcranial alternating current stimulation (tACS) at the alpha frequency, however, were inconclusive regarding the causal contribution of oscillatory activity during visuo-spatial attention.

OBJECTIVE

Attentional shifts of behavior and electroencephalography (EEG) after-effects were assessed in a cued visuo-spatial attention paradigm. We hypothesized that parietal alpha-tACS shifts attention relative to the ipsilateral visual hemifield. Furthermore, we assumed that modulations of behavior and neurophysiology are related to individual electric field simulations.

METHODS

We applied personalized tACS at alpha and gamma frequencies to elucidate the role of oscillatory neuronal activity for visuo-spatial attention. Personalized tACS montages were algorithmically optimized to target individual left and right parietal regions that were defined by an EEG localizer.

RESULTS

Behavioral performance in the left hemifield was specifically increased by alpha-tACS compared to gamma-tACS targeting the left parietal cortex. This hemisphere-specific effect was observed despite the symmetry of simulated electric fields. In addition, visual event-related potential (ERP) amplitudes showed a reduced lateralization over posterior sites induced by left alpha-tACS. Neuronal sources of this effect were localized in the left premotor cortex. Interestingly, accuracy modulations induced by left parietal alpha-tACS were directly related to electric field magnitudes in the left premotor cortex.

CONCLUSION

Overall, results corroborate the notion that alpha lateralization plays a causal role in covert visuo-spatial attention and indicate an increased susceptibility of parietal and premotor brain regions of the left dorsal attention network to subtle tACS-neuromodulation.

Periodic and Aperiodic EEG Features as Potential Markers of Developmental Dyslexia

Developmental Dyslexia (DD) is a neurobiological condition affecting the ability to read fluently and/or accurately. Analyzing resting-state electroencephalographic (EEG) activity in DD may provide a deeper characterization of the underlying pathophysiology and possible biomarkers. So far, studies investigating resting-state activity in DD provided limited evidence and did not consider the aperiodic component of the power spectrum. In the present study, adults with (n = 26) and without DD (n = 31) underwent a reading skills assessment and resting-state EEG to investigate potential alterations in aperiodic activity, their impact on the periodic counterpart and reading performance. In parieto-occipital channels, DD participants showed a significantly different aperiodic activity as indexed by a flatter and lower power spectrum. These aperiodic measures were significantly related to text reading time, suggesting a link with individual differences in reading difficulties. In the beta band, the DD group showed significantly decreased aperiodic-adjusted power compared to typical readers, which was significantly correlated to word reading accuracy. Overall, here we provide evidence showing alterations of the endogenous aperiodic activity in DD participants consistently with the increased neural noise hypothesis. In addition, we confirm alterations of endogenous beta rhythms, which are discussed in terms of their potential link with magnocellular-dorsal stream deficit.

Oscillatory dynamics serving visual selective attention during a Simon task

Selective attention is an important component of cognitive control and is essential for day-to-day functioning. The Simon task is a common test of visual selective attention that has been widely used to probe response selection, inhibition and cognitive control. However, to date, there is a dearth of literature that has focused on the oscillatory dynamics serving task performance in the selective attention component of this task. In this study, 32 healthy adults (mean age: 33.09 years, SD: 7.27 years) successfully completed a modified version of the Simon task during magnetoencephalography. All magnetoencephalographic data were pre-processed and transformed into the time-frequency domain. Significant oscillatory brain responses were imaged using a beamforming approach, and peak task-related neural activity was extracted to examine the temporal dynamics. Across both congruent and Simon conditions, our results indicated robust decreases in alpha (8-12 Hz) activity in the bilateral occipital regions and cuneus during task performance, while increases in theta (3-6 Hz) oscillatory activity were detected in regions of the dorsal frontoparietal attention network, including the dorsolateral prefrontal cortex, frontal eye fields and insula. Lastly, whole-brain condition-wise analyses showed Simon interference effects in the theta range in the superior parietal region and the alpha range in the posterior cingulate and inferior frontal cortices. These findings provide network-specific insights into the oscillatory dynamics serving visual selective attention.

Saccadic modulation of neural excitability in auditory areas of the neocortex

In natural "active" vision, humans and other primates use eye movements (saccades) to sample bits of information from visual scenes. In the visual cortex, non-retinal signals linked to saccades shift visual cortical neurons into a high excitability state as each saccade ends. The extent of this saccadic modulation outside of the visual system is unknown. Here, we show that during natural viewing, saccades modulate excitability in numerous auditory cortical areas with a temporal pattern complementary to that seen in visual areas. Control somatosensory cortical recordings indicate that the temporal pattern is unique to auditory areas. Bidirectional functional connectivity patterns suggest that these effects may arise from regions involved in saccade generation. We propose that by using saccadic signals to yoke excitability states in auditory areas to those in visual areas, the brain can improve information processing in complex natural settings.

Spatiotemporal consistency of neural responses to repeatedly presented video stimuli accounts for population preferences

Population preferences for video advertisements vary across short video clips. What underlies these differences? Repeatedly watching a video clip may produce a consistent spatiotemporal pattern of neural activity that is dependent on the individual and the stimulus. Moreover, such consistency may be associated with the degree of engagement and memory of individual viewers. Since the population preferences are associated with the engagement and memory of the individual viewers, the consistency observed in a smaller group of viewers can be a predictor of population preferences. To test the hypothesis, we measured the degree of inter-trial consistency in participants' electroencephalographic (EEG) responses to repeatedly presented television commercials. We observed consistency in the neural activity patterns across repetitive views and found that the similarity in the spatiotemporal patterns of neural responses while viewing popular television commercials predicts population preferences obtained from a large audience. Moreover, a regression model that used two datasets, including two separate groups of participants viewing different stimulus sets, showed good predictive performance in a leave-one-out cross-validation. These findings suggest that universal spatiotemporal patterns in EEG responses can account for population-level human behaviours.

Altered functional connectivity and oscillatory dynamics in polysubstance and cannabis only users during visuospatial processing

RATIONALE AND OBJECTIVES

Cannabis use is often associated with the use of other psychoactive substances, which is subsequently linked to an increased risk for addiction. While there is a growing body of neuroimaging literature investigating the cognitive effect of long-term cannabis use, very little is known about the potential additive effects of cannabis polysubstance use.

METHODS

Fifty-six adults composed of 18 polysubstance users (i.e., cannabis plus at least one other illicit substance), 19 cannabis-only users, and 19 nonusers completed a visuospatial attention task while undergoing magnetoencephalography. A data-driven approach was used to identify oscillatory neural responses, which were imaged using a beamforming approach. The resulting cortical regions were probed for group differences and used as seeds for whole-brain connectivity analysis.

RESULTS

Participants exhibited robust theta, alpha, beta, and gamma responses during visuospatial processing. Statistical analyses indicated that the cannabis-only group had weaker occipital theta relative to the nonusers, and that both polysubstance and cannabis-only users had reduced spontaneous gamma in the occipital cortices during the pre-stimulus baseline period relative to nonusers. Finally, functional connectivity analyses revealed that polysubstance users had sharply reduced beta connectivity between occipital and prefrontal, as well as occipital and left temporal cortices.

CONCLUSIONS

Cannabis use should be considered in a polysubstance context, as our correlational design suggests differences in functional connectivity among those who reported cannabis-only versus polysubstance use in occipital to prefrontal pathways critical to visuospatial processing and attention function. Future work should distinguish the effect of different polysubstance combinations and use more causal designs.

Phase resets undermine measures of phase-dependent perception

As interest increases in the possible effects of the phase of neural oscillations on perception and cognition, new conceptual and methodological challenges arise. One prominent challenge is the stimulus-induced phase reset, which has the capacity to obscure the effects of phase in the postreset period.

Long-Range α-Synchronization as Control Signal for BCI: A Feasibility Study

Shifts in spatial attention are associated with variations in α band (α, 8-14 Hz) activity, specifically in interhemispheric imbalance. The underlying mechanism is attributed to local α-synchronization, which regulates local inhibition of neural excitability, and frontoparietal synchronization reflecting long-range communication. The direction-specific nature of this neural correlate brings forward its potential as a control signal in brain-computer interfaces (BCIs). In the present study, we explored whether long-range α-synchronization presents lateralized patterns dependent on voluntary attention orienting and whether these neural patterns can be picked up at a single-trial level to provide a control signal for active BCI. We collected electroencephalography (EEG) data from a cohort of healthy adults (n = 10) while performing a covert visuospatial attention (CVSA) task. The data show a lateralized pattern of α-band phase coupling between frontal and parieto-occipital regions after target presentation, replicating previous findings. This pattern, however, was not evident during the cue-to-target orienting interval, the ideal time window for BCI. Furthermore, decoding the direction of attention trial-by-trial from cue-locked synchronization with support vector machines (SVMs) was at chance level. The present findings suggest EEG may not be capable of detecting long-range α-synchronization in attentional orienting on a single-trial basis and, thus, highlight the limitations of this metric as a reliable signal for BCI control.

TMS combined with EEG: Recommendations and open issues for data collection and analysis

Transcranial magnetic stimulation (TMS) evokes neuronal activity in the targeted cortex and connected brain regions. The evoked brain response can be measured with electroencephalography (EEG). TMS combined with simultaneous EEG (TMS-EEG) is widely used for studying cortical reactivity and connectivity at high spatiotemporal resolution. Methodologically, the combination of TMS with EEG is challenging, and there are many open questions in the field. Different TMS-EEG equipment and approaches for data collection and analysis are used. The lack of standardization may affect reproducibility and limit the comparability of results produced in different research laboratories. In addition, there is controversy about the extent to which auditory and somatosensory inputs contribute to transcranially evoked EEG. This review provides a guide for researchers who wish to use TMS-EEG to study the reactivity of the human cortex. A worldwide panel of experts working on TMS-EEG covered all aspects that should be considered in TMS-EEG experiments, providing methodological recommendations (when possible) for effective TMS-EEG recordings and analysis. The panel identified and discussed the challenges of the technique, particularly regarding recording procedures, artifact correction, analysis, and interpretation of the transcranial evoked potentials (TEPs). Therefore, this work offers an extensive overview of TMS-EEG methodology and thus may promote standardization of experimental and computational procedures across groups.

Functional connectivity fingerprints of the frontal eye field and inferior frontal junction suggest spatial versus nonspatial processing in the prefrontal cortex

Neuroimaging evidence suggests that the frontal eye field (FEF) and inferior frontal junction (IFJ) govern the encoding of spatial and nonspatial (such as feature- or object-based) representations, respectively, both during visual attention and working memory tasks. However, it is still unclear whether such contrasting functional segregation is also reflected in their underlying functional connectivity patterns. Here, we hypothesized that FEF has predominant functional coupling with spatiotopically organized regions in the dorsal ('where') visual stream whereas IFJ has predominant functional connectivity with the ventral ('what') visual stream. We applied seed-based functional connectivity analyses to temporally high-resolving resting-state magnetoencephalography (MEG) recordings. We parcellated the brain according to the multimodal Glasser atlas and tested, for various frequency bands, whether the spontaneous activity of each parcel in the ventral and dorsal visual pathway has predominant functional connectivity with FEF or IFJ. The results show that FEF has a robust power correlation with the dorsal visual pathway in beta and gamma bands. In contrast, anterior IFJ (IFJa) has a strong power coupling with the ventral visual stream in delta, beta and gamma oscillations. Moreover, while FEF is phase-coupled with the superior parietal lobe in the beta band, IFJa is phase-coupled with the middle and inferior temporal cortex in delta and gamma oscillations. We argue that these intrinsic connectivity fingerprints are congruent with each brain region's function. Therefore, we conclude that FEF and IFJ have dissociable connectivity patterns that fit their respective functional roles in spatial versus nonspatial top-down attention and working memory control.

Functional characterization of correct and incorrect feature integration

Our sensory system constantly receives information from the environment and our own body. Despite our impression to the contrary, we remain largely unaware of this information and often cannot report it correctly. Although perceptual processing does not require conscious effort on the part of the observer, it is often complex, giving rise to errors such as incorrect integration of features (illusory conjunctions). In the present study, we use functional magnetic resonance imaging to study the neural bases of feature integration in a dual task that produced ~30% illusions. A distributed set of regions demonstrated increased activity for correct compared to incorrect (illusory) feature integration, with increased functional coupling between occipital and parietal regions. In contrast, incorrect feature integration (illusions) was associated with increased occipital (V1-V2) responses at early stages, reduced functional connectivity between right occipital regions and the frontal eye field at later stages, and an overall decrease in coactivation between occipital and parietal regions. These results underscore the role of parietal regions in feature integration and highlight the relevance of functional occipito-frontal interactions in perceptual processing.

Developmental maturation of causal signaling hubs in voluntary control of saccades and their functional controllability

The ability to adaptively respond to behaviorally relevant cues in the environment, including voluntary control of automatic but inappropriate responses and deployment of a goal-relevant alternative response, undergoes significant maturation from childhood to adulthood. Importantly, the maturation of voluntary control processes influences the developmental trajectories of several key cognitive domains, including executive function and emotion regulation. Understanding the maturation of voluntary control is therefore of fundamental importance, but little is known about the underlying causal functional circuit mechanisms. Here, we use state-space and control-theoretic modeling to investigate the maturation of causal signaling mechanisms underlying voluntary control over saccades. We demonstrate that directed causal interactions in a canonical saccade network undergo significant maturation between childhood and adulthood. Crucially, we show that the frontal eye field (FEF) is an immature causal signaling hub in children during control over saccades. Using control-theoretic analysis, we then demonstrate that the saccade network is less controllable in children and that greater energy is required to drive FEF dynamics in children compared to adults. Our findings provide novel evidence that strengthening of causal signaling hubs and controllability of FEF are key mechanisms underlying age-related improvements in the ability to plan and execute voluntary control over saccades.

Information-based multivariate decoding reveals imprecise neural encoding in children with attention deficit hyperactivity disorder during visual selective attention

Attention deficit hyperactivity disorder (ADHD) is a common neurodevelopmental disorder in school-age children. Attentional orientation is a potential clinical diagnostic marker to aid in the early diagnosis of ADHD. However, the underlying pathophysiological substrates of impaired attentional orienting in childhood ADHD remain unclear. Electroencephalography (EEG) was measured in 135 school-age children (70 with childhood ADHD and 65 matched typically developing children) to directly investigate target localization during spatial selective attention through univariate ERP analysis and information-based multivariate pattern machine learning analysis. Compared with children with typical development, a smaller N2pc was found in the ADHD group through univariate ERP analysis. Children with ADHD showed a lower parieto-occipital multivariate decoding accuracy approximately 240-340 ms after visual search onset, which predicts a slower reaction time and larger standard deviation of reaction time. Furthermore, a significant correlation was found between N2pc and decoding accuracy in typically developing children but not in children with ADHD. These observations reveal that impaired attentional orienting in ADHD may be due to inefficient neural encoding responses. By using a personalized information-based multivariate machine learning approach, we have advanced the understanding of cognitive deficits in neurodevelopmental disorders. Our study provides potential research directions for the early diagnosis and optimization of personalized intervention in children with ADHD.

Quantifying rhythmicity in perceptual reports

Several recent studies investigated the rhythmic nature of cognitive processes that lead to perception and behavioral report. These studies used different methods, and there has not yet been an agreement on a general standard. Here, we present a way to test and quantitatively compare these methods. We simulated behavioral data from a typical experiment and analyzed these data with several methods. We applied the main methods found in the literature, namely sine-wave fitting, the discrete Fourier transform (DFT) and the least square spectrum (LSS). DFT and LSS can be applied both on the average accuracy time course and on single trials. LSS is mathematically equivalent to DFT in the case of regular, but not irregular sampling - which is more common. LSS additionally offers the possibility to take into account a weighting factor which affects the strength of the rhythm, such as arousal. Statistical inferences were done either on the investigated sample (fixed-effects) or on the population (random-effects) of simulated participants. Multiple comparisons across frequencies were corrected using False Discovery Rate, Bonferroni, or the Max-Based approach. To perform a quantitative comparison, we calculated sensitivity, specificity and D-prime of the investigated analysis methods and statistical approaches. Within the investigated parameter range, single-trial methods had higher sensitivity and D-prime than the methods based on the average accuracy time course. This effect was further increased for a simulated rhythm of higher frequency. If an additional (observable) factor influenced detection performance, adding this factor as weight in the LSS further improved sensitivity and D-prime. For multiple comparison correction, the Max-Based approach provided the highest specificity and D-prime, closely followed by the Bonferroni approach. Given a fixed total amount of trials, the random-effects approach had higher D-prime when trials were distributed over a larger number of participants, even though this gave less trials per participant. Finally, we present the idea of using a dampened sinusoidal oscillator instead of a simple sinusoidal function, to further improve the fit to behavioral rhythmicity observed after a reset event.

Unrestricted eye movements strengthen effective connectivity from hippocampal to oculomotor regions during scene construction

Scene construction is a key component of memory recall, navigation, and future imagining, and relies on the medial temporal lobes (MTL). A parallel body of work suggests that eye movements may enable the imagination and construction of scenes, even in the absence of external visual input. There are vast structural and functional connections between regions of the MTL and those of the oculomotor system. However, the directionality of connections between the MTL and oculomotor control regions, and how it relates to scene construction, has not been studied directly in human neuroimaging. In the current study, we used dynamic causal modeling (DCM) to interrogate effective connectivity between the MTL and oculomotor regions using a scene construction task in which participants' eye movements were either restricted (fixed-viewing) or unrestricted (free-viewing). By omitting external visual input, and by contrasting free- versus fixed- viewing, the directionality of neural connectivity during scene construction could be determined. As opposed to when eye movements were restricted, allowing free-viewing during construction of scenes strengthened top-down connections from the MTL to the frontal eye fields, and to lower-level cortical visual processing regions, suppressed bottom-up connections along the visual stream, and enhanced vividness of the constructed scenes. Taken together, these findings provide novel, non-invasive evidence for the underlying, directional, connectivity between the MTL memory system and oculomotor system associated with constructing vivid mental representations of scenes.

Visual Attention in the Prefrontal Cortex

Voluntary attention selects behaviorally relevant signals for further processing while filtering out distracter signals. Neural correlates of voluntary visual attention have been reported across multiple areas of the primate visual processing streams, with the earliest and strongest effects isolated in the prefrontal cortex. In this article, I review evidence supporting the hypothesis that signals guiding the allocation of voluntary attention emerge in areas of the prefrontal cortex and reach upstream areas to modulate the processing of incoming visual information according to its behavioral relevance. Areas located anterior and dorsal to the arcuate sulcus and the frontal eye fields produce signals that guide the allocation of spatial attention. Areas located anterior and ventral to the arcuate sulcus produce signals for feature-based attention. Prefrontal microcircuits are particularly suited to supporting voluntary attention because of their ability to generate attentional template signals and implement signal gating and their extensive connectivity with the rest of the brain. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Periodic attention operates faster during more complex visual search

Attention has been found to sample visual information periodically, in a wide range of frequencies below 20 Hz. This periodicity may be supported by brain oscillations at corresponding frequencies. We propose that part of the discrepancy in periodic frequencies observed in the literature is due to differences in attentional demands, resulting from heterogeneity in tasks performed. To test this hypothesis, we used visual search and manipulated task complexity, i.e., target discriminability (high, medium, low) and number of distractors (set size), while electro-encephalography was simultaneously recorded. We replicated previous results showing that the phase of pre-stimulus low-frequency oscillations predicts search performance. Crucially, such effects were observed at increasing frequencies within the theta-alpha range (6–18 Hz) for decreasing target discriminability. In medium and low discriminability conditions, correct responses were further associated with higher post-stimulus phase-locking than incorrect ones, in increasing frequency and latency. Finally, the larger the set size, the later the post-stimulus effect peaked. Together, these results suggest that increased complexity (lower discriminability or larger set size) requires more attentional cycles to perform the task, partially explaining discrepancies between reports of attentional sampling. Low-frequency oscillations structure the temporal dynamics of neural activity and aid top-down, attentional control for efficient visual processing.

Perceptual filling-in dispels the veridicality problem of conscious perception research

Conscious perceptual experiences are expected to correlate with content-specific brain activity. A veridicality problem arises when attempting to disentangle unconscious and conscious brain processes if conscious perceptual contents accurately match the physical nature of the stimulus. We argue that perceptual filling-in, a phenomenon whereby visual information inaccurately spreads across visual space, is a promising approach to circumvent the veridicality problem. Filling-in generates non-veridical although unambiguous percepts dissociated from stimulus input. In particular, the radial uniformity illusion induces a filling-in experience between a central disk and the surrounding periphery. We discuss how this illusion facilitates both the detection of neurophysiological responses and subjective phenomenological monitoring. We report behavioral effects from a large-sample (n = 200) psychophysics study and examine key stimulus parameters that drive the conscious filling-in experience. We propose that these data underpin future hypothesis-driven studies of filling-in to further delineate the neural mechanisms of conscious perception.

Putative rhythms in attentional switching can be explained by aperiodic temporal structure

The neural and perceptual effects of attention were traditionally assumed to be sustained over time, but recent work suggests that covert attention rhythmically switches between objects at 3-8 Hz. Here I use simulations to demonstrate that the analysis approaches commonly used to test for rhythmic oscillations generate false positives in the presence of aperiodic temporal structure. I then propose two alternative analyses that are better able to discriminate between periodic and aperiodic structure in time series. Finally, I apply these alternative analyses to published datasets and find no evidence for behavioural rhythms in attentional switching after accounting for aperiodic temporal structure. The techniques presented here will help clarify the periodic and aperiodic dynamics of perception and of cognition more broadly.

Respiration aligns perception with neural excitability

Recent studies from the field of interoception have highlighted the link between bodily and neural rhythms during action, perception, and cognition. The mechanisms underlying functional body-brain coupling, however, are poorly understood, as are the ways in which they modulate behavior. We acquired respiration and human magnetoencephalography data from a near-threshold spatial detection task to investigate the trivariate relationship between respiration, neural excitability, and performance. Respiration was found to significantly modulate perceptual sensitivity as well as posterior alpha power (8-13 Hz), a well-established proxy of cortical excitability. In turn, alpha suppression prior to detected versus undetected targets underscored the behavioral benefits of heightened excitability. Notably, respiration-locked excitability changes were maximized at a respiration phase lag of around -30° and thus temporally preceded performance changes. In line with interoceptive inference accounts, these results suggest that respiration actively aligns sampling of sensory information with transient cycles of heightened excitability to facilitate performance.

The roles of the LpSTS and DLPFC in self-prioritization: A transcranial magnetic stimulation study

The Self‐Attention Network (SAN) has been proposed to describe the underlying neural mechanism of the self‐prioritization effect, yet the roles of the key nodes in the SAN—the left posterior superior temporal sulcus (LpSTS) and the dorsolateral prefrontal cortex (DLPFC)—still need to be clarified. One hundred and nine participants were randomly assigned into the LpSTS group, the DLPFC group, or the sham group. We used the transcranial magnetic stimulation (TMS) technique to selectively disrupt the functions of the corresponding targeted region, and observed its impacts on self‐prioritization effect based on the difference between the performance of the self‐matching task before and after the targeted stimulation. We analyzed both model‐free performance measures and HDDM‐based performance measures for the self‐matching task. The results showed that the inhibition of LpSTS could lead to reduced performance in processing self‐related stimuli, which establishes a causal role for the LpSTS in self‐related processing and provide direct evidence to support the SAN framework. However, the results of the DLPFC group from HDDM analysis were distinct from the results based on response efficiency. Our investigation further the understanding of the differentiated roles of key nodes in the SAN in supporting the self‐salience in information processing.

Transcranial magnetic stimulation entrains alpha oscillatory activity in occipital cortex

Parieto-occipital alpha rhythms (8-12 Hz) underlie cortical excitability and influence visual performance. Whether the synchrony of intrinsic alpha rhythms in the occipital cortex can be entrained by transcranial magnetic stimulation (TMS) is an open question. We applied 4-pulse, 10-Hz rhythmic TMS to entrain intrinsic alpha oscillators targeting right V1/V2, and tested four predictions with concurrent electroencephalogram (EEG): (1) progressive enhancement of entrainment across time windows, (2) output frequency specificity, (3) dependence on the intrinsic oscillation phase, and (4) input frequency specificity to individual alpha frequency (IAF) in the neural signatures. Two control conditions with an equal number of pulses and duration were arrhythmic-active and rhythmic-sham stimulation. The results confirmed the first three predictions. Rhythmic TMS bursts significantly entrained local neural activity. Near the stimulation site, evoked oscillation amplitude and inter-trial phase coherence (ITPC) were increased for 2 and 3 cycles, respectively, after the last TMS pulse. Critically, ITPC following entrainment positively correlated with IAF rather than with the degree of similarity between IAF and the input frequency (10 Hz). Thus, we entrained alpha-band activity in occipital cortex for ~ 3 cycles (~ 300 ms), and IAF predicts the strength of entrained occipital alpha phase synchrony indexed by ITPC.

Structure, function and connectivity fingerprints of the frontal eye field versus the inferior frontal junction: A comprehensive comparison

The human prefrontal cortex contains two prominent areas, the frontal eye field and the inferior frontal junction, that are crucially involved in the orchestrating functions of attention, working memory and cognitive control. Motivated by comparative evidence in non-human primates, we review the human neuroimaging literature, suggesting that the functions of these regions can be clearly dissociated. We found remarkable differences in how these regions relate to sensory domains and visual topography, top-down and bottom-up spatial attention, spatial versus non-spatial (i.e., feature- and object-based) attention and working memory and, finally, the multiple-demand system. Functional magnetic resonance imaging (fMRI) studies using multivariate pattern analysis reveal the selectivity of the frontal eye field and inferior frontal junction to spatial and non-spatial information, respectively. The analysis of functional and effective connectivity provides evidence of the modulation of the activity in downstream visual areas from the frontal eye field and inferior frontal junction and sheds light on their reciprocal influences. We therefore suggest that future studies should aim at disentangling more explicitly the role of these regions in the control of spatial and non-spatial selection. We propose that the analysis of the structural and functional connectivity (i.e., the connectivity fingerprints) of the frontal eye field and inferior frontal junction may be used to further characterize their involvement in a spatial ('where') and a non-spatial ('what') network, respectively, highlighting segregated brain networks that allow biasing visual selection and working memory performance to support goal-driven behaviour.

Cause or consequence? Alpha oscillations in visuospatial attention

A well-established finding in the literature of human studies is that alpha activity (rhythmical brain activity around 10 Hz) shows retinotopic amplitude modulation during shifts in visual attention. Thus, it has long been argued that alpha amplitude modulation might play a crucial role in attention-driven alterations in visual information processing. Recently, there has been a revival of the topic, driven in part by new studies directly investigating the possible causal relationship between alpha activity and responses to visual input, both neuronally and perceptually. Here, we discuss evidence for and against a causal role of alpha activity in visual attentional processing. We conclude with hypotheses regarding the mechanisms by which top-down-modulated alpha activity in the parietal cortex might select visual information for attentive processing.

The Radically Embodied Conscious Cybernetic Bayesian Brain: From Free Energy to Free Will and Back Again

Drawing from both enactivist and cognitivist perspectives on mind, I propose that explaining teleological phenomena may require reappraising both "Cartesian theaters" and mental homunculi in terms of embodied self-models (ESMs), understood as body maps with agentic properties, functioning as predictive-memory systems and cybernetic controllers. Quasi-homuncular ESMs are suggested to constitute a major organizing principle for neural architectures due to their initial and ongoing significance for solutions to inference problems in cognitive (and affective) development. Embodied experiences provide foundational lessons in learning curriculums in which agents explore increasingly challenging problem spaces, so answering an unresolved question in Bayesian cognitive science: what are biologically plausible mechanisms for equipping learners with sufficiently powerful inductive biases to adequately constrain inference spaces? Drawing on models from neurophysiology, psychology, and developmental robotics, I describe how embodiment provides fundamental sources of empirical priors (as reliably learnable posterior expectations). If ESMs play this kind of foundational role in cognitive development, then bidirectional linkages will be found between all sensory modalities and frontal-parietal control hierarchies, so infusing all senses with somatic-motoric properties, thereby structuring all perception by relevant affordances, so solving frame problems for embodied agents. Drawing upon the Free Energy Principle and Active Inference framework, I describe a particular mechanism for intentional action selection via consciously imagined (and explicitly represented) goal realization, where contrasts between desired and present states influence ongoing policy selection via predictive coding mechanisms and backward-chained imaginings (as self-realizing predictions). This embodied developmental legacy suggests a mechanism by which imaginings can be intentionally shaped by (internalized) partially-expressed motor acts, so providing means of agentic control for attention, working memory, imagination, and behavior. I further describe the nature(s) of mental causation and self-control, and also provide an account of readiness potentials in Libet paradigms wherein conscious intentions shape causal streams leading to enaction. Finally, I provide neurophenomenological handlings of prototypical qualia including pleasure, pain, and desire in terms of self-annihilating free energy gradients via quasi-synesthetic interoceptive active inference. In brief, this manuscript is intended to illustrate how radically embodied minds may create foundations for intelligence (as capacity for learning and inference), consciousness (as somatically-grounded self-world modeling), and will (as deployment of predictive models for enacting valued goals).