Repetition suppression of induced gamma band responses is eliminated by task switching

Induced oscillatory brain responses under virtual reality conditions in the context of repetition priming

In the human electroencephalogram (EEG), induced oscillatory responses in various frequency bands are regarded as valuable indices to examine the neural mechanisms underlying human memory. While the advent of virtual reality (VR) drives the investigation of mnemonic processing under more lifelike settings, the joint application of VR and EEG methods is still in its infancy (e.g., due to technical limitations impeding the signal acquisition). The objective of the present EEG study was twofold. First, we examined whether the investigation of induced oscillations under VR conditions yields equivalent results compared to standard paradigms. Second, we aimed at obtaining further insights into basic memory-related brain mechanisms in VR. To these ends, we relied on a standard implicit memory design, namely repetition priming, for which the to-be-expected effects are well-documented for conventional studies. Congruently, we replicated a suppression of the evoked potential after stimulus onset. Regarding the induced responses, we observed a modulation of induced alphaband in response to a repeated stimulus. Importantly, our results revealed a repetition-related suppression of the high-frequency induced gammaband response (>30 Hz), indicating the sharpening of a cortical object representation fostering behavioral priming effects. Noteworthy, the analysis of the induced gammaband responses required a number of measures to minimize the influence of external and internal sources of artefacts (i.e., the electrical shielding of the technical equipment and the control for miniature eye movements). In conclusion, joint VR-EEG studies with a particular focus on induced oscillatory responses offer a promising advanced understanding of mnemonic processing under lifelike conditions.

Comparing encoding mechanisms in realistic virtual reality and conventional 2D laboratory settings: Event-related potentials in a repetition suppression paradigm

Although the human brain is adapted to function within three-dimensional environments, conventional laboratory research commonly investigates cognitive mechanisms in a reductionist approach using two-dimensional stimuli. However, findings regarding mnemonic processes indicate that realistic experiences in Virtual Reality (VR) are stored in richer and more intertwined engrams than those obtained from the conventional laboratory. Our study aimed to further investigate the generalizability of laboratory findings and to differentiate whether the processes underlying memory formation differ between VR and the conventional laboratory already in early encoding stages. Therefore, we investigated the Repetition Suppression (RS) effect as a correlate of the earliest instance of mnemonic processes under conventional laboratory conditions and in a realistic virtual environment. Analyses of event-related potentials (ERPs) indicate that the ERP deflections at several electrode clusters were lower in VR compared to the PC condition. These results indicate an optimized distribution of cognitive resources in realistic contexts. The typical RS effect was replicated under both conditions at most electrode clusters for a late time window. Additionally, a specific RS effect was found in VR at anterior electrodes for a later time window, indicating more extensive encoding processes in VR compared to the laboratory. Specifically, electrotomographic results (VARETA) indicate multimodal integration involving a broad cortical network and higher cognitive processes during the encoding of realistic objects. Our data suggest that object perception under realistic conditions, in contrast to the conventional laboratory, requires multisensory integration involving an interconnected functional system, facilitating the formation of intertwined memory traces in realistic environments.

Effect of the side of presentation in the visual field on phase-locked and nonphase-locked alpha and gamma responses

Recent studies have suggested that nonphase-locked activity can reveal cognitive mechanisms that cannot be observed in phase-locked activity. In fact, we describe a concomitant decrease in nonphase-locked alpha activity (desynchronization) when stimuli were processed (alpha phase-locked modulation). This desynchronization may represent a reduction in "background activity" in the visual cortex that facilitates stimulus processing. Alternatively, nonphase-locked gamma activity has been hypothesized to be an index of shifts in attentional focus. In this study, our main aim was to confirm these potential roles for nonphase-locked alpha and gamma activities with a lateralized Go/NoGo paradigm. The results showed that nonphase-locked alpha modulation is bilaterally represented in the scalp compared to the contralateral distribution of the phase-locked response. This finding suggests that the decrease in background activity is not limited to neural areas directly involved in the visual processing of stimuli. Additionally, gamma activity showed a higher desynchronization of nonphase-locked activity in the ipsilateral hemisphere, where the phase-locked activity reached the minimum amplitude. This finding suggests that the possible functions of nonphase-locked gamma activity extend beyond shifts in attentional focus and could represent an attentional filter reducing the gamma representation in the visual area irrelevant to the task.

Oscillatory signatures of Repetition Suppression and Novelty Detection reveal altered induced visual responses in early deafness

The ability to differentiate between repeated and novel events represents a fundamental property of the visual system. Neural responses are typically reduced upon stimulus repetition, a phenomenon called Repetition Suppression (RS). On the contrary, following a novel visual stimulus, the neural response is generally enhanced, a phenomenon referred to as Novelty Detection (ND). Here, we aimed to investigate the impact of early deafness on the oscillatory signatures of RS and ND brain responses. To this aim, electrophysiological data were acquired in early deaf and hearing control individuals during processing of repeated and novel visual events unattended by participants. By studying evoked and induced oscillatory brain activities, as well as inter-trial phase coherence, we linked response modulations to feedback and/or feedforward processes. Results revealed selective experience-dependent changes on both RS and ND mechanisms. Compared to hearing controls, early deaf individuals displayed: (i) greater attenuation of the response following stimulus repetition, selectively in the induced theta-band (4-7 Hz); (ii) reduced desynchronization following the onset of novel visual stimuli, in the induced alpha and beta bands (8-12 and 13-25 Hz); (iii) comparable modulation of evoked responses and inter-trial phase coherence. The selectivity of the effects in the induced responses parallels findings observed in the auditory cortex of deaf animal models following intracochlear electric stimulation. The present results support the idea that early deafness alters induced oscillatory activity and the functional tuning of basic visual processing.

Timing of repetition suppression of event-related potentials to unattended objects

Current theories of object perception emphasize the automatic nature of perceptual inference. Repetition suppression (RS), the successive decrease of brain responses to repeated stimuli, is thought to reflect the optimization of perceptual inference through neural plasticity. While functional imaging studies revealed brain regions that show suppressed responses to the repeated presentation of an object, little is known about the intra-trial time course of repetition effects to everyday objects. Here, we used event-related potentials (ERPs) to task-irrelevant line-drawn objects, while participants engaged in a distractor task. We quantified changes in ERPs over repetitions using three general linear models that modeled RS by an exponential, linear, or categorical "change detection" function in each subject. Our aim was to select the model with highest evidence and determine the within-trial time-course and scalp distribution of repetition effects using that model. Model comparison revealed the superiority of the exponential model indicating that repetition effects are observable for trials beyond the first repetition. Model parameter estimates revealed a sequence of RS effects in three time windows (86-140, 322-360, and 400-446 ms) and with occipital, temporoparietal, and frontotemporal distribution, respectively. An interval of repetition enhancement (RE) was also observed (320-340 ms) over occipitotemporal sensors. Our results show that automatic processing of task-irrelevant objects involves multiple intervals of RS with distinct scalp topographies. These sequential intervals of RS and RE might reflect the short-term plasticity required for optimization of perceptual inference and the associated changes in prediction errors and predictions, respectively, over stimulus repetitions during automatic object processing.

Rapid processing of neutral and angry expressions within ongoing facial stimulus streams: Is it all about isolated facial features?

Our visual system extracts the emotional meaning of human facial expressions rapidly and automatically. Novel paradigms using fast periodic stimulations have provided insights into the electrophysiological processes underlying emotional content extraction: the regular occurrence of specific identities and/or emotional expressions alone can drive diagnostic brain responses. Consistent with a processing advantage for social cues of threat, we expected angry facial expressions to drive larger responses than neutral expressions. In a series of four EEG experiments, we studied the potential boundary conditions of such an effect: (i) we piloted emotional cue extraction using 9 facial identities and a fast presentation rate of 15 Hz (N = 16); (ii) we reduced the facial identities from 9 to 2, to assess whether (low or high) variability across emotional expressions would modulate brain responses (N = 16); (iii) we slowed the presentation rate from 15 Hz to 6 Hz (N = 31), the optimal presentation rate for facial feature extraction; (iv) we tested whether passive viewing instead of a concurrent task at fixation would play a role (N = 30). We consistently observed neural responses reflecting the rate of regularly presented emotional expressions (5 Hz and 2 Hz at presentation rates of 15 Hz and 6 Hz, respectively). Intriguingly, neutral expressions consistently produced stronger responses than angry expressions, contrary to the predicted processing advantage for threat-related stimuli. Our findings highlight the influence of physical differences across facial identities and emotional expressions.

Repetition and ERPs during emotional scene processing: A selective review

A set of studies are reviewed that investigate the effects of repetition during scene perception on event-related potentials, elucidating perceptual, memory and emotional processes. Repetition suppression was consistently found for the amplitude of early frontal N2 and posterior P2 components, which was greatly enhanced for massed, compared to distributed, repetition. Both repetition suppression and enhancement of the amplitude of a centro-parietal positive potential (LPP) were found in specific contexts. Suppression was reliably found following a massive number of repetitions of few items, whereas enhancement is found when repetitions are spaced; enhancement was apparent both during simple free viewing as well as on an explicit recognition test. Regardless of repetition, an enhanced LPP was always found for emotional, compared to neutral, scenes. Taken together, the data suggest that different effects of massed and distributed repetitions on specific ERP components index perceptual priming, habituation, and spontaneous episodic retrieval.

GABAB receptor-mediated, layer-specific synaptic plasticity reorganizes gamma-frequency neocortical response to stimulation

Repeated presentations of sensory stimuli generate transient gamma-frequency (30-80 Hz) responses in neocortex that show plasticity in a task-dependent manner. Complex relationships between individual neuronal outputs and the mean, local field potential (population activity) accompany these changes, but little is known about the underlying mechanisms responsible. Here we show that transient stimulation of input layer 4 sufficient to generate gamma oscillations induced two different, lamina-specific plastic processes that correlated with lamina-specific changes in responses to further, repeated stimulation: Unit rates and recruitment showed overall enhancement in supragranular layers and suppression in infragranular layers associated with excitatory or inhibitory synaptic potentiation onto principal cells, respectively. Both synaptic processes were critically dependent on activation of GABAB receptors and, together, appeared to temporally segregate the cortical representation. These data suggest that adaptation to repetitive sensory input dramatically alters the spatiotemporal properties of the neocortical response in a manner that may both refine and minimize cortical output simultaneously.

Configural processing advantage for Mongoloid than Caucasian faces during the structure coding stage

Configural processing is considered to be the hallmark of face expertise, which has been widely investigated by face global inversion (inversion effect) and local inversion (Thatcher effect). Using a passive detection task in which face stimuli are task-irrelevant, both the face inversion effect and the Thatcher effect on race perception of faces were investigated. We found that although the N170 inversion effect (enhanced and delayed N 170 for inverted than upright condition) was similar across races of faces, Chinese participants showed a larger N 170 Thatcher effect (enhanced N 170 to Thatcherized faces than normal faces) for Mongoloid faces. The present data indicates the perceptual advantage of configural changes for in-group than out-group faces.

Neural processes in pseudo perceptual rivalry: an ERP and time-frequency approach

Necker cube is one of the ambiguous figures that is physically a static image but can be alternately perceived in two different perspectives. A great deal of debate exists regarding ambiguous figures that induce spontaneous switching between rival percepts. To investigate the time course of neural processes underlying such perceptual rivalry, we recorded electroencephalograms associated with participants' perceptions of a Necker cube under ambiguous and unambiguous conditions, using a modified discontinuous-presentation method. Each condition consisted of two stimuli presented consecutively, starting with an unambiguous stimulus in both conditions. The second stimulus was either ambiguous (ambiguous condition) or unambiguous (control condition). We compared endogenous reversal activity of ambiguous stimuli with exogenous reversals. As a result, we found that the right-occipital beta-band activity (16-26 Hz) increased 100-150 ms and 350-450 ms after the onset of the ambiguous stimulus only when the perception of the ambiguous stimulus differed from that of the first stimulus. These results indicate that activity in the right-occipital total beta band reflects endogenous switching between rivaling percepts.

Decreased beta-band activity is correlated with disambiguation of hidden figures

Insight is commonly described as sudden comprehension, sometimes called an "Aha! moment." In everyday life, we apply the process of insight to problems that are difficult to solve at first glance or that we perceive as ambiguous; however the brain dynamics underlying the disambiguation process remains elusive. Beta-band oscillatory brain activity has been hypothesized to reflect the transition of cognitive states. To elucidate the neural mechanism of insight, we recorded electroencephalograms while subjects were presented with hidden figures followed by unambiguous, gray images. We identified oscillatory activity to detect temporal changes, and compared brain activity that occurred during a perceptual transition with activity that occurred when no perceptual transition occurred. Statistical comparison confirmed stronger beta-power decrease during perceptual transition. Source analysis indicated that the beta-power decrease was around the parietal-posterior regions, mainly in the precuneus. We propose that beta-band desynchronization in the parietal-posterior regions reflects the disambiguation process, and our findings provide additional support for the theory that beta-band activity is related to the transition of cognitive state.

Repeated stimuli elicit diminished high-gamma electrocorticographic responses

In the phenomenon of repetition suppression (RS), when a person views a stimulus, the neural activity involved in processing that item is relatively diminished if that stimulus had been previously viewed. Previous noninvasive imaging studies mapped the prevalence of RS for different stimulus types to identify brain regions involved in representing a range of cognitive information. However, these noninvasive findings are challenging to interpret because they do not provide information on how RS relates to the brain's electrophysiological activity. We examined the electrophysiological basis of RS directly using brain recordings from implanted electrocorticographic (ECoG) electrodes in neurosurgical patients. Patients performed a memory task during ECoG recording and we identified high-gamma signals (65-128 Hz) that distinguished the neuronal representation of specific memory items. We then compared the neural representation of each item between novel and repeated viewings. This revealed the presence of RS, in which the neuronal representation of a repeated item had a significantly decreased amplitude and duration compared with novel stimuli. Furthermore, the magnitude of RS was greatest for the stimuli that initially elicited the largest activation at each site. These results have implications for understanding the neural basis of RS and human memory by showing that individual cortical sites exhibit the largest RS for the stimuli that they most actively represent.

Induced gamma band responses in human EEG after the control of miniature saccadic artifacts

Induced gamma band responses (iGBRs) in the human electroencephalogram (EEG) have been ascribed to the activation of cortical object representations. Recently, this claim was challenged and it was stated that iGBRs occurring in the time window between 200 and 350 ms after stimulus onset are, to a great extent, generated by an electromyogenic artifact caused by miniature saccades (MS). In the present paper we focus on the characterization of iGBRs during the activation of cortical object representations, when recordings have been controlled for saccade-related transient potentials. For this we present an algorithm for the correction of saccade-related transient potentials (COSTRAP) which identifies and notably suppresses transient spike potentials (TSPs) that are likely to be linked to MSs. Furthermore, we conducted an EEG study to demonstrate (1) the feasibility of the algorithm, (2) the cortical origin iGBRs and (3) their relation to cortical object representations. Our results revealed that (i) it is possible to isolate TSPs, (ii) the morphology of the cleansed iGBR cannot be explained by an underlying myogenic artifact and (iii) the remaining iGBRs are sensitive to object recognition. Therefore we conclude that, with saccadic artifacts being controlled, high-frequency oscillations in human EEG are reliable electrophysiological correlates of cognitive processes.

Remembering perceptual features unequally bound in object and episodic tokens: Neural mechanisms and their electrophysiological correlates

We present a neurocognitive model of long-term object memory. We propose that perceptual priming and episodic recognition are phenomena based on three distinct kinds of representations. We label these representations types and tokens. Types are prototypical representations needed for object identification. The network of non-arbitrary features necessary for object categorization is sharpened in the course of repeated identification, an effect that we call type trace and which causes perceptual priming. Tokens, on the other hand, support episodic recognition. Perirhinal structures are proposed to bind intrinsic within-object features into an object token that can be thought of as a consolidated perceptual object file. Hippocampal structures integrate object- with contextual information in an episodic token. The reinstatement of an object token is assumed to generate a feeling of familiarity, whereas recollection occurs when the reinstatement of an episodic token occurs. Retrieval mode and retrieval orientation dynamically modulate access to these representations. In this review, we apply the model to recent empirical research (behavioral, fMRI, and ERP data) including a series of studies from our own lab. We put specific emphasis on the effects that sensory features and their study-test match have on familiarity. The type-token approach fits the data and additionally provides a framework for the analysis of concepts like unitization and associative reinstatement.

Dynamic causal modeling for EEG and MEG

We present a review of dynamic causal modeling (DCM) for magneto- and electroencephalography (M/EEG) data. DCM is based on a spatiotemporal model, where the temporal component is formulated in terms of neurobiologically plausible dynamics. Following an intuitive description of the model, we discuss six recent studies, which use DCM to analyze M/EEG and local field potentials. These studies illustrate how DCM can be used to analyze evoked responses (average response in time), induced responses (average response in time-frequency), and steady-state responses (average response in frequency). Bayesian model comparison plays a critical role in these analyses, by allowing one to compare equally plausible models in terms of their model evidence. This approach might be very useful in M/EEG research; where correlations among spatial and neuronal model parameter estimates can cause uncertainty about which model best explains the data. Bayesian model comparison resolves these uncertainties in a principled and formal way. We suggest that DCM and Bayesian model comparison provides a useful way to test hypotheses about distributed processing in the brain, using electromagnetic data.

Priming of object categorization within and across levels of specificity

Identification of objects can occur at different levels of specificity. Depending on task and context, an object can be classified at the superordinate level (as an animal), at the basic level (a bird) or at the subordinate level (a sparrow). What are the interactions between these representational levels and do they rely on the same sequential processes that lead to successful object identification? In this electroencephalogram study, a task-switching paradigm (covert naming or living/non-living judgment) was used. Images of objects were repeated either within the same task, or with a switch from a covert naming task to a living or non-living judgment and vice versa. While covert naming accesses entrylevel (basic or subordinate), living/non-living judgments rely on superordinate classification. Our behavioral results demonstrated clear priming effects within both tasks. However, asymmetries were found when task-switching had occurred, with facilitation for covert naming but not for categorization. We also found lower accuracy and early-starting and persistent enhancements of event-related potentials (ERPs) for covert naming, indicating that this task was more difficult and involved more intense perceptual and semantic processing. Perceptual priming was marked by consistent reductions of the ERP component L1 for repeated presentations, both with and without task switching. Additional repetition effects were found in early event-related activity between 150-190 ms (N1) when a repeated image had been named at initial presentation. We conclude that differences in N1 indicate task-related changes in the identification process itself. Such enhancements for covert naming again emerge in a later time window associated with depth of semantic processing. Meanwhile, L1 reflects modulations due to implicit memory of objects. In conclusion, evidence was found for representational overlap; changes in ERP markers started early and revealed cross-task priming at the level of object structure analysis and more intense perceptual and semantic processing for covert naming.

Induced Electroencephalogram Oscillations during Source Memory: Familiarity is Reflected in the Gamma Band, Recollection in the Theta Band

Modulations of oscillatory electroencephalogram (EEG) activity in the induced gamma and theta frequency ranges (induced gamma and theta band responses; iGBRs: >30 Hz; iTBRs: ∼6 Hz) have been associated with retrieval of information from long-term memory. However, the specific functional role of these two forms of oscillatory activity remains unclear. The present study examines theta- and gamma-oscillations within a dual-process framework, which defines “familiarity” and “recollection” as the two component processes of recognition memory. During encoding, participants were instructed to make “bigger/smaller than a shoebox” or “living/nonliving” decisions for different object pictures. During retrieval “old/new” recognition was followed (for items judged old) by a source discrimination task regarding the decision made for each item at encoding. iGBRs (35–80 Hz; 210–330 msec) were higher for correctly identified “old” relative to “new” objects. Importantly, they did not distinguish between successful and unsuccessful source judgments. In contrast, iTBRs (4–7.5 Hz; 600–1200 msec) were sensitive to source discrimination. We propose that iGBRs mirror early associative processes linked to familiarity-related retrieval processes, whereas iTBRs reflect later onsetting, episodic, recollection-related mechanisms.

Sources of synchronized induced Gamma-Band responses during a simple object recognition task: a replication study in human MEG

Natural stimuli are compiled of numerous features, which are cortically represented in dispersed structures. Synchronized oscillations in the Gamma-Band (>30 Hz; induced Gamma-Band Responses, iGBRs), are regarded as a plausible mechanism to re-integrate these regions into a meaningful cortical object representation. Using electroencephalography (EEG) it was demonstrated that the generators of iGBRs can be localized to temporal, parietal, posterior, and frontal areas. The present magnetoencephalogram (MEG) study intended to replicate these findings in order contribute to the ongoing debate regarding the possible functional difference of high-frequency signals as measured by both techniques. During a standard object recognition task we found an augmentation of the iGBR after the presentation of meaningful as opposed to meaningless stimuli at approximately 160-440 ms after stimulus onset. This peak was localized to inferior temporal gyri, superior parietal lobules and the right middle frontal gyrus. Importantly, most of these brain structures were significantly phase-locked to each other. The implications of these results are twofold: (1) they present further evidence for the view that iGBRs signify neuronal activity in a broadly distributed network during object recognition. (2) MEG is well suited to detect induced high-frequency oscillations with a very similar morphology as revealed by EEG recordings, thereby eliminating known problems with electroencephalographical methods (e.g. reference confounds). In contrast to the iGBR, the localization of event-related fields (ERFs) and evoked Gamma-Band Response (eGBRs) revealed generators in focal visual areas, and thus, seem to mirror early sensory processing.

Directed cortical information flow during human object recognition: analyzing induced EEG gamma-band responses in brain's source space

The increase of induced gamma-band responses (iGBRs; oscillations >30 Hz) elicited by familiar (meaningful) objects is well established in electroencephalogram (EEG) research. This frequency-specific change at distinct locations is thought to indicate the dynamic formation of local neuronal assemblies during the activation of cortical object representations. As analytically power increase is just a property of a single location, phase-synchrony was introduced to investigate the formation of large-scale networks between spatially distant brain sites. However, classical phase-synchrony reveals symmetric, pair-wise correlations and is not suited to uncover the directionality of interactions. Here, we investigated the neural mechanism of visual object processing by means of directional coupling analysis going beyond recording sites, but rather assessing the directionality of oscillatory interactions between brain areas directly. This study is the first to identify the directionality of oscillatory brain interactions in source space during human object recognition and suggests that familiar, but not unfamiliar, objects engage widespread reciprocal information flow. Directionality of cortical information-flow was calculated based upon an established Granger-Causality coupling-measure (partial-directed coherence; PDC) using autoregressive modeling. To enable comparison with previous coupling studies lacking directional information, phase-locking analysis was applied, using wavelet-based signal decompositions. Both, autoregressive modeling and wavelet analysis, revealed an augmentation of iGBRs during the presentation of familiar objects relative to unfamiliar controls, which was localized to inferior-temporal, superior-parietal and frontal brain areas by means of distributed source reconstruction. The multivariate analysis of PDC evaluated each possible direction of brain interaction and revealed widespread reciprocal information-transfer during familiar object processing. In contrast, unfamiliar objects entailed a sparse number of only unidirectional connections converging to parietal areas. Considering the directionality of brain interactions, the current results might indicate that successful activation of object representations is realized through reciprocal (feed-forward and feed-backward) information-transfer of oscillatory connections between distant, functionally specific brain areas.