Probing feedforward and feedback contributions to awareness with visual masking and transcranial magnetic stimulation

Meta-analysis of experimental factors influencing single-pulse TMS effects on the early visual cortex

Background

Single-pulse transcranial magnetic stimulation (spTMS) applied to the Early Visual Cortex (EVC) has demonstrated the ability to suppress the perception on visual targets, akin to the effect of visual masking. However, the reported spTMS suppression effects across various studies have displayed inconsistency.

Objective

We aim to test if the heterogeneity of the spTMS effects can be attributable to variations in experimental factors.

Methods

We conducted a meta-analysis using data collected from the PubMed and Web of Science databases spanning from 1995 to March 2024. The meta-analysis encompassed a total of 40 independent experiments drawn from 33 original articles.

Results

The findings unveiled an overall significant spTMS suppression effect on visual perception. Nevertheless, there existed substantial heterogeneity among the experiments. Univariate analysis elucidated that the spTMS effects could be significantly influenced by TMS intensity, visual angle of the stimulus, coil type, and TMS stimulators from different manufacturers. Reliable spTMS suppression effects were observed within the time windows of -80 to 0 ms and 50 to 150 ms. Multivariate linear regression analyses, which included SOA, TMS intensity, visual angle of the stimulus, and coil type, identified SOA as the key factor influencing the spTMS effects. Within the 50 to 150 ms time window, optimal SOAs were identified as 112 ms and 98 ms for objective and subjective performance, respectively. Collectively, multiple experimental factors accounted for 22.9% (r = 0.3353) and 39.9% (r = 0.3724) of the variance in objective and subjective performance, respectively. Comparing univariate and multivariate analyses, it was evident that experimental factors had different impacts on objective performance and subjective performance.

Conclusion

The present study provided quantitative recommendations for future experiments involving the spTMS effects on visual targets, offering guidance on how to configure experimental factors to achieve the optimal masking effect.

Backward masking implicates cortico-cortical recurrent processes in convex figure context effects and cortico-thalamic recurrent processes in resolving figure-ground ambiguity

Introduction

Previous experiments purportedly showed that image-based factors like convexity were sufficient for figure assignment. Recently, however, we found that the probability of perceiving a figure on the convex side of a central border was only slightly higher than chance for two-region displays and increased with the number of display regions; this increase was observed only when the concave regions were homogeneously colored. These convex figure context effects (CEs) revealed that figure assignment in these classic displays entails more than a response to local convexity. A Bayesian observer replicated the convex figure CEs using both a convexity object prior and a new, homogeneous background prior and made the novel prediction that the classic displays in which both the convex and concave regions were homogeneous were ambiguous during perceptual organization.

Methods

Here, we report three experiments investigating the proposed ambiguity and examining how the convex figure CEs unfold over time with an emphasis on whether they entail recurrent processing. Displays were shown for 100 ms followed by pattern masks after ISIs of 0, 50, or 100 ms. The masking conditions were designed to add noise to recurrent processing and therefore to delay the outcome of processes in which they play a role. In Exp. 1, participants viewed two- and eight-region displays with homogeneous convex regions (homo-convex displays; the putatively ambiguous displays). In Exp. 2, participants viewed putatively unambiguous hetero-convex displays. In Exp. 3, displays and masks were presented to different eyes, thereby delaying mask interference in the thalamus for up to 100 ms.

Results and discussion

The results of Exps. 1 and 2 are consistent with the interpretation that recurrent processing is involved in generating the convex figure CEs and resolving the ambiguity of homo-convex displays. The results of Exp. 3 suggested that corticofugal recurrent processing is involved in resolving the ambiguity of homo-convex displays and that cortico-cortical recurrent processes play a role in generating convex figure CEs and these two types of recurrent processes operate in parallel. Our results add to evidence that perceptual organization evolves dynamically and reveal that stimuli that seem unambiguous can be ambiguous during perceptual organization.

Causal evidence for the role of the sensory visual cortex in visual short-term memory maintenance

The role of the sensory visual cortex during visual short-term memory (VSTM) remains controversial. This controversy is possibly due to methodological issues in previous attempts to investigate the effects of transcranial magnetic stimulation (TMS) on VSTM. The aim of this study was to use TMS, while covering previous methodological deficits. Sixty-four young adults were recruited to participate in two experiments (Experiment 1: n = 36; Experiment 2: n = 28) using a VSTM orientation change-detection task under TMS. Monocular vision was ensured using red-blue goggles combined with red-blue stimuli. Double-pulse TMS was delivered at different times (Experiment 1: 0, 200 or 1000 ms; Experiment 2: 200, 1000 ms) during a 2 s maintenance phase, on one side of the occipital hemisphere. In Experiment 2, a sham TMS condition was introduced. Decreased detection sensitivity (d') in the ipsilateral occipital hemisphere to visual hemifield, and in the real TMS (compared with sham TMS) condition indicated inhibitory TMS effects, and thus, a causal involvement of the sensory visual cortex during early (200 ms) and late (1000 ms) maintenance in VSTM. These findings are aligned with sensory recruitment, which proposes that both perceptual and memory processes rely upon the same neural substrates in the sensory visual cortex. The methods used in this study were preregistered and had received in-principle acceptance on 6 June 2022 (Stage 1 protocol can be found in: https://doi.org/10.17605/OSF.IO/EMPDT).

Human perceptual and metacognitive decision-making rely on distinct brain networks

Perceptual decisions depend on the ability to exploit available sensory information in order to select the most adaptive option from a set of alternatives. Such decisions depend on the perceptual sensitivity of the organism, which is generally accompanied by a corresponding level of certainty about the choice made. Here, by use of corticocortical paired associative transcranial magnetic stimulation protocol (ccPAS) aimed at inducing plastic changes, we shaped perceptual sensitivity and metacognitive ability in a motion discrimination task depending on the targeted network, demonstrating their functional dissociation. Neurostimulation aimed at boosting V5/MT+-to-V1/V2 back-projections enhanced motion sensitivity without impacting metacognition, whereas boosting IPS/LIP-to-V1/V2 back-projections increased metacognitive efficiency without impacting motion sensitivity. This double-dissociation provides causal evidence of distinct networks for perceptual sensitivity and metacognitive ability in humans.

Sensory recruitment in visual short-term memory: A systematic review and meta-analysis of sensory visual cortex interference using transcranial magnetic stimulation

Sensory visual areas are involved in encoding information in visual short-term memory (VSTM). Yet it remains unclear whether sensory visual cortex is a necessary component of the brain network for maintenance of information in VSTM. Here, we aimed to systematically review studies that have investigated the role of the sensory visual cortex in VSTM using transcranial magnetic stimulation (TMS) and to quantitatively explore these effects using meta-analyses. Fourteen studies were identified and reviewed. Eight studies provided sufficient data for meta-analysis. Two meta-analyses, one regarding the VSTM encoding phase (17 effect sizes) and one regarding the VSTM maintenance phase (15 effect sizes), two meta-regressions (32 effect sizes in each), and one exploratory meta-analysis were conducted. Our results indicate that the sensory visual cortex is similarly involved in both the encoding and maintenance VSTM phase. We suggest that some cases where evidence did not show significant TMS effects was due to low memory or perceptual task demands. Overall, these findings support the idea that sensory visual areas are part of the brain network responsible for successfully maintaining information in VSTM.

The perceived present: What is it, and what is it there for?

It is proposed that the perceived present is not a moment in time, but an information structure comprising an integrated set of products of perceptual processing. All information in the perceived present carries an informational time marker identifying it as "present". This marker is exclusive to information in the perceived present. There are other kinds of time markers, such as ordinality ("this stimulus occurred before that one") and duration ("this stimulus lasted for 50 ms"). These are different from the "present" time marker and may be attached to information regardless of whether it is in the perceived present or not. It is proposed that the perceived present is a very short-term and very high-capacity holding area for perceptual information. The maximum holding time for any given piece of information is ~100 ms: This is affected by the need to balance the value of informational persistence for further processing against the problem of obsolescence of the information. The main function of the perceived present is to facilitate access by other specialized, automatic processes.

Alpha Oscillations and Feedback Processing in Visual Cortex for Conscious Perception

Variability in perception between individuals may be a consequence of different inherent neural processing speeds. To assess whether alpha oscillations systematically reflect a feedback pacing mechanism for cortical processing during visual perception, comparisons were made between alpha oscillations, visual suppression from TMS, visual evoked responses, and metacontrast masking. Peak alpha oscillation frequencies, measured through scalp EEG recordings, significantly correlated with the optimum latencies for visual suppression from TMS of early visual cortex. Individuals with shorter alpha periods (i.e., higher peak alpha frequencies) processed visual information faster than those with longer alpha periods (i.e., lower peak alpha frequencies). Moreover, peak alpha oscillation periods and optimum TMS visual suppression latencies predicted the latencies of late but not early visual evoked responses. Together, these findings demonstrate an important role of alpha oscillatory and late feedback activity in visual cortex for conscious perception. They also show that the timing for visual awareness varies across individuals, depending on the pace of one's endogenous oscillatory cycling frequency.

Human-like perceptual masking is difficult to observe in rats performing an orientation discrimination task

Visual masking occurs when the perception of a brief target stimulus is affected by a preceding or succeeding mask. The uncoupling of the target and its perception allows an opportunity to investigate the neuronal mechanisms involved in sensory representation and visual perception. To determine whether rats are a suitable model for subsequent studies of the neuronal basis of visual masking, we first demonstrated that decoding of neuronal responses recorded in the primary visual cortex (V1) of anaesthetized rats predicted that orientation discrimination performance should decline when masking stimuli are presented immediately before or after oriented target stimuli. We then trained Long-Evans rats (n = 7) to discriminate between horizontal and vertical target Gabors or gratings. In some trials, a plaid mask was presented at varying stimulus onset asynchronies (SOAs) relative to the target. Spatially, the masks were presented either overlapping or surrounding the target location. In the absence of a mask, all animals could reliably discriminate orientation when stimulus durations were 16 ms or longer. In the presence of a mask, discrimination performance was impaired, but did not systematically vary with SOA as is typical of visual masking. In humans performing a similar task, we found visual masking impaired perception of the target at short SOAs regardless of the spatial or temporal configuration of stimuli. Our findings indicate that visual masking may be difficult to observe in rats as the stimulus parameters necessary to quantify masking will make the task so difficult that it prevents robust measurement of psychophysical performance. Thus, our results suggest that rats may not be an ideal model to investigate the effects of visual masking on perception.

Perceptual teleology: expectations of action efficiency bias social perception

Primates interpret conspecific behaviour as goal-directed and expect others to achieve goals by the most efficient means possible. While this teleological stance is prominent in evolutionary and developmental theories of social cognition, little is known about the underlying mechanisms. In predictive models of social cognition, a perceptual prediction of an ideal efficient trajectory would be generated from prior knowledge against which the observed action is evaluated, distorting the perception of unexpected inefficient actions. To test this, participants observed an actor reach for an object with a straight or arched trajectory on a touch screen. The actions were made efficient or inefficient by adding or removing an obstructing object. The action disappeared mid-trajectory and participants touched the last seen screen position of the hand. Judgements of inefficient actions were biased towards the efficient prediction (straight trajectories upward to avoid the obstruction, arched trajectories downward towards the target). These corrections increased when the obstruction's presence/absence was explicitly acknowledged, and when the efficient trajectory was explicitly predicted. Additional supplementary experiments demonstrated that these biases occur during ongoing visual perception and/or immediately after motion offset. The teleological stance is at least partly perceptual, providing an ideal reference trajectory against which actual behaviour is evaluated.

Ultra-Rapid serial visual presentation reveals dynamics of feedforward and feedback processes in the ventral visual pathway

Human visual recognition activates a dense network of overlapping feedforward and recurrent neuronal processes, making it hard to disentangle processing in the feedforward from the feedback direction. Here, we used ultra-rapid serial visual presentation to suppress sustained activity that blurs the boundaries of processing steps, enabling us to resolve two distinct stages of processing with MEG multivariate pattern classification. The first processing stage was the rapid activation cascade of the bottom-up sweep, which terminated early as visual stimuli were presented at progressively faster rates. The second stage was the emergence of categorical information with peak latency that shifted later in time with progressively faster stimulus presentations, indexing time-consuming recurrent processing. Using MEG-fMRI fusion with representational similarity, we localized recurrent signals in early visual cortex. Together, our findings segregated an initial bottom-up sweep from subsequent feedback processing, and revealed the neural signature of increased recurrent processing demands for challenging viewing conditions.

Differential Visual Processing of Animal Images, with and without Conscious Awareness

The human visual system can quickly and efficiently extract categorical information from a complex natural scene. The rapid detection of animals in a scene is one compelling example of this phenomenon, and it suggests the automatic processing of at least some types of categories with little or no attentional requirements (Li et al., 2002, 2005). The aim of this study is to investigate whether the remarkable capability to categorize complex natural scenes exist in the absence of awareness, based on recent reports that “invisible” stimuli, which do not reach conscious awareness, can still be processed by the human visual system (Pasley et al., 2004; Williams et al., 2004; Fang and He, 2005; Jiang et al., 2006, 2007; Kaunitz et al., 2011a). In two experiments, we recorded event-related potentials (ERPs) in response to animal and non-animal/vehicle stimuli in both aware and unaware conditions in a continuous flash suppression (CFS) paradigm. Our results indicate that even in the “unseen” condition, the brain responds differently to animal and non-animal/vehicle images, consistent with rapid activation of animal-selective feature detectors prior to, or outside of, suppression by the CFS mask.

Alpha suppression and connectivity modulations in left temporal and parietal cortices index partial awareness of words

The partial awareness hypothesis is a theoretical proposal that recently provided a reconciling solution to graded and dichotomous accounts of consciousness. It suggests that we can become conscious of distinct properties of an object independently, ranging from low-level features to complex forms of representation. We investigated this hypothesis using classic visual word masking adapted to a near-threshold paradigm. The masking intensity was adjusted to the individual perception threshold, at which individual alphabetical letters, but not words, could be perceived in approximately half of the trials. We confined perception to a pre-lexical stage of word processing that corresponded to a clear condition of partial awareness. At this level of representation, the stimulus properties began to emerge within consciousness, yet they did not escalate to full stimulus awareness. In other words, participants were able to perceive individual letters, while remaining unaware of the whole letter strings presented. Cortical activity measured with MEG was compared between physically identical trials that differed in perception (perceived, not perceived). We found that compared to no awareness, partial awareness of words was characterized by suppression of oscillatory alpha power in left temporal and parietal cortices. The analysis of functional connectivity with seeds based on the power effect in these two regions revealed sparse connections for the parietal seed, and strong connections between the temporal seed and other regions of the language network. We suggest that the engagement of language regions indexed by alpha power suppression is responsible for establishing and maintaining conscious representations of individual pre-lexical units.

•

Near-threshold visual masking is used to characterize partial awareness of words.

•

Partial awareness is indexed by left temporal and parietal alpha power suppression.

•

Functional connectivity dissociates nodes in temporal and parietal cortices.

Spatially specific vs. unspecific disruption of visual orientation perception using chronometric pre-stimulus TMS

Transcranial magnetic stimulation (TMS) over occipital cortex can impair visual processing. Such "TMS masking" has repeatedly been shown at several stimulus onset asynchronies (SOAs), with TMS pulses generally applied after the onset of a visual stimulus. Following increased interest in the neuronal state-dependency of visual processing, we recently explored the efficacy of TMS at "negative SOAs", when no visual processing can yet occur. We could reveal pre-stimulus TMS disruption, with results moreover hinting at two separate mechanisms in occipital cortex biasing subsequent orientation perception. Here we extended this work, including a chronometric design to map the temporal dynamics of spatially specific and unspecific mechanisms of state-dependent visual processing, while moreover controlling for TMS-induced pupil covering. TMS pulses applied 60-40 ms prior to a visual stimulus decreased orientation processing independent of stimulus location, while a local suppressive effect was found for TMS applied 30-10 ms pre-stimulus. These results contribute to our understanding of spatiotemporal mechanisms in occipital cortex underlying the state-dependency of visual processing, providing a basis for future work to link pre-stimulus TMS suppression effects to other known visual biasing mechanisms.