Functional-anatomic correlates of object priming in humans revealed by rapid presentation event-related fMRI

Improving electrotactile communication with a multi-pad electrode under cognitive load

BACKGROUND

Electrotactile systems are compact interfaces that can be used to convey information through the skin by producing a range of haptic sensations. In many applications, however, the user needs to perceive and interpret haptic stimulation while being engaged in parallel activities. Developing methods that ensure reliable recognition of electrotactile messages despite additional cognitive load is, therefore, an important step for the practical application of electrotactile displays.

METHODS

This study investigated if a simple strategy of repeating electrotactile messages can improve message identification during multitasking. Ten participants identified 36 spatiotemporal electrotactile messages delivered through a 3 × 2 pad-matrix electrode placed on the torso while performing a concomitant cognitive task in three conditions: the messages were presented once (No-REP), and each message was repeated three (REP3) and five (REP5) times. The main outcome measure was the success rate (SR) of message identification.

RESULTS

During multitasking, in the No-REP condition, the SR (median (IQR)) dropped to 56.25% (22.62%), demonstrating that the cognitive task decreased performance. However, the SR significantly improved with message repetitions, reaching 72.92% (21.87%) and 81.25% (18.66%) in REP3 and REP5 conditions respectively, without a statistically significant difference between REP3 and REP5.

CONCLUSIONS

Multitasking affected the efficacy of haptic communication, but message repetition was shown to be an effective strategy for improving performance. Additionally, only three repetitions were enough, as an additional increase in the duration of message transmission (5 repetitions) did not lead to further improvement. This study is an important step toward delivering electrotactile communication that can cope with the demands of real-world applications.

What Does the Human Olfactory System Do, and How Does It Do It?

Historically, the human sense of smell has been regarded as the odd stepchild of the senses, especially compared to the sensory bravado of seeing, touching, and hearing. The idea that the human olfaction has little to contribute to our experience of the world is commonplace, though with the emergence of COVID-19 there has rather been a sea change in this understanding. An ever increasing body of work has convincingly highlighted the keen capabilities of the human nose and the sophistication of the human olfactory system. Here, we provide a concise overview of the neuroscience of human olfaction spanning the last 10-15 years, with focus on the peripheral and central mechanisms that underlie how odor information is processed, packaged, parceled, predicted, and perturbed to serve odor-guided behaviors. We conclude by offering some guideposts for harnessing the next decade of olfactory research in all its shapes and forms.

Event Probabilities Have a Different Impact on Early and Late Electroencephalographic Measures Regarded as Metrics of Prediction

The oddball protocol has been used to study the neural and perceptual consequences of implicit predictions in the human brain. The protocol involves presenting a sequence of identical repeated events that are eventually broken by a novel "oddball" presentation. Oddball presentations have been linked to increased neural responding and to an exaggeration of perceived duration relative to repeated events. Because the number of repeated events in such protocols is circumscribed, as more repeats are encountered, the conditional probability of a further repeat decreases-whereas the conditional probability of an oddball increases. These facts have not been appreciated in many analyses of oddballs; repeats and oddballs have rather been treated as binary event categories. Here, we show that the human brain is sensitive to conditional event probabilities in an active, visual oddball paradigm. P300 responses (a relatively late component of visually evoked potentials measured with EEG) tended to be greater for less likely oddballs and repeats. By contrast, P1 responses (an earlier component) increased for repeats as a goal-relevant target presentation neared, but this effect occurred even when repeat probabilities were held constant, and oddball P1 responses were invariant. We also found that later, more likely oddballs seemed to last longer, and this effect was largely independent of the number of preceding repeats. These findings speak against a repetition suppression account of the temporal oddball effect. Overall, our data highlight an impact of event probability on later, rather than earlier, electroencephalographic measures previously related to predictive processes-and the importance of considering conditional probabilities in sequential presentation paradigms.

Generative replay underlies compositional inference in the hippocampal-prefrontal circuit

Human reasoning depends on reusing pieces of information by putting them together in new ways. However, very little is known about how compositional computation is implemented in the brain. Here, we ask participants to solve a series of problems that each require constructing a whole from a set of elements. With fMRI, we find that representations of novel constructed objects in the frontal cortex and hippocampus are relational and compositional. With MEG, we find that replay assembles elements into compounds, with each replay sequence constituting a hypothesis about a possible configuration of elements. The content of sequences evolves as participants solve each puzzle, progressing from predictable to uncertain elements and gradually converging on the correct configuration. Together, these results suggest a computational bridge between apparently distinct functions of hippocampal-prefrontal circuitry and a role for generative replay in compositional inference and hypothesis testing.

The temporal visual oddball effect is not caused by repetition suppression

The oddball paradigm is commonly used to investigate human time perception. Trains of identical repeated events ('standards') are presented, only to be interrupted by a different 'oddball' that seems to have a relatively protracted duration. One theoretical account has been that this effect is driven by repetition suppression for repeated standards. The idea is that repeated events seem shorter as they incur a progressively reduced neural response, which is supported by the finding that oddball perceived duration increases linearly with the number of preceding repeated standards. However, typical oddball paradigms confound the probability of oddball presentations with variable numbers of standard repetitions on each trial, allowing people to increasingly anticipate an oddball presentation as more standards are presented. We eliminated this by making participants aware of what fixed number of standards they would encounter before a final test input and tested different numbers of standards in separate experimental sessions. The final event of sequences, the test event, was equally likely to be an oddball or another repeat. We found a positive linear relationship between the number of preceding repeated standards and the perceived duration of oddball test events. However, we also found this for repeat tests events, which speaks against the repetition suppression account of the temporal oddball effect.

Longitudinal fNIRS and EEG metrics of habituation and novelty detection are correlated in 1-18-month-old infants

INTRODUCTION

. Habituation and novelty detection are two fundamental and widely studied neurocognitive processes. Whilst neural responses to repetitive and novel sensory input have been well-documented across a range of neuroimaging modalities, it is not yet fully understood how well these different modalities are able to describe consistent neural response patterns. This is particularly true for infants and young children, as different assessment modalities might show differential sensitivity to underlying neural processes across age. Thus far, many neurodevelopmental studies are limited in either sample size, longitudinal scope or breadth of measures employed, impeding investigations of how well common developmental trends can be captured via different methods.

METHOD

. This study assessed habituation and novelty detection in N = 204 infants using EEG and fNIRS measured in two separate paradigms, but within the same study visit, at 1, 5 and 18 months of age in an infant cohort in rural Gambia. EEG was acquired during an auditory oddball paradigm during which infants were presented with Frequent, Infrequent and Trial Unique sounds. In the fNIRS paradigm, infants were familiarised to a sentence of infant-directed speech, novelty detection was assessed via a change in speaker. Indices for habituation and novelty detection were extracted for both EEG and NIRS RESULTS: . We found evidence for weak to medium positive correlations between responses on the fNIRS and the EEG paradigms for indices of both habituation and novelty detection at most age points. Habituation indices correlated across modalities at 1 month and 5 months but not 18 months of age, and novelty responses were significantly correlated at 5 months and 18 months, but not at 1 month. Infants who showed robust habituation responses also showed robust novelty responses across both assessment modalities.

DISCUSSION

. This study is the first to examine concurrent correlations across two neuroimaging modalities across several longitudinal age points. Examining habituation and novelty detection, we show that despite the use of two different testing modalities, stimuli and timescale, it is possible to extract common neural metrics across a wide age range in infants. We suggest that these positive correlations might be strongest at times of greatest developmental change.

Episodic Memory and Recollection Network Disruptions Following Chemotherapy Treatment in Breast Cancer Survivors: A Review of Neuroimaging Findings

Simple Summary

Memory disturbances are amongst the most common and disruptive symptoms of chemotherapy-related cognitive impairment. Chemotherapy treatments commonly cause neurotoxicity within the hippocampus, creating a vulnerability to memory impairment. Most clinical assessments of long-term memory in breast cancer survivors assess basic verbal and visual memory processing, and do not capture the complexities of everyday event memories, including episodic and autobiographical memory. This review focuses on structural and functional neuroimaging studies identifying disruptions in the hippocampus and recollection network, and related episodic memory impairments in chemotherapy-treated breast cancer survivors. We argue for the need to better characterize memory dysfunction following chemotherapy treatments. Given the importance of episodic and autobiographical memory to a person’s personal history and quality of life, an under-appreciation of how this memory domain is impacted by standard cancer treatments potentially diminishes the negative experiences of breast cancer survivors, and neglects cognitive problems that could benefit from intervention strategies.

Abstract

Long-term memory disturbances are amongst the most common and disruptive cognitive symptoms experienced by breast cancer survivors following chemotherapy. To date, most clinical assessments of long-term memory dysfunction in breast cancer survivors have utilized basic verbal and visual memory tasks that do not capture the complexities of everyday event memories. Complex event memories, including episodic memory and autobiographical memory, critically rely on hippocampal processing for encoding and retrieval. Systemic chemotherapy treatments used in breast cancer commonly cause neurotoxicity within the hippocampus, thereby creating a vulnerability to memory impairment. We review structural and functional neuroimaging studies that have identified disruptions in the recollection network and related episodic memory impairments in chemotherapy-treated breast cancer survivors, and argue for the need to better characterize hippocampally mediated memory dysfunction following chemotherapy treatments. Given the importance of autobiographical memory for a person’s sense of identity, ability to plan for the future, and general functioning, under-appreciation of how this type of memory is impacted by cancer treatment can lead to overlooking or minimizing the negative experiences of breast cancer survivors, and neglecting a cognitive domain that may benefit from intervention strategies.

Combining Repetition Suppression and Pattern Analysis Provides New Insights into the Role of M1 and Parietal Areas in Skilled Sequential Actions

How does the brain change during learning? In functional magnetic resonance imaging (fMRI) studies, both multivariate pattern analysis (MVPA) and repetition suppression (RS) have been used to detect changes in neuronal representations. In the context of motor sequence learning, the two techniques have provided discrepant findings: pattern analysis showed that only premotor and parietal regions, but not primary motor cortex (M1), develop a representation of trained sequences. In contrast, RS suggested trained sequence representations in all these regions. Here, we applied both analysis techniques to a five-week finger sequence training study, in which participants executed each sequence twice before switching to a different sequence. Both RS and pattern analysis indicated learning-related changes for parietal areas, but only RS showed a difference between trained and untrained sequences in M1. A more fine-grained analysis, however, revealed that the RS effect in M1 reflects a fundamentally different process than in parietal areas. On the first execution, M1 represents especially the first finger of each sequence, likely reflecting preparatory processes. This effect dramatically reduces during the second execution. In contrast, parietal areas represent the identity of a sequence, and this representation stays relatively stable on the second execution. These results suggest that the RS effect does not reflect a trained sequence representation in M1, but rather a preparatory signal for movement initiation. More generally, our study demonstrates that across regions RS can reflect different representational changes in the neuronal population code, emphasizing the importance of combining pattern analysis and RS techniques.SIGNIFICANCE STATEMENT Previous studies using pattern analysis have suggested that primary motor cortex (M1) does not represent learnt sequential actions. However, a study using repetition suppression (RS) has reported M1 changes during motor sequence learning. Combining both techniques, we first replicate the discrepancy between them, with learning-related changes in M1 in RS, but not pattern dissimilarities. We further analyzed the representational changes with repetition, and found that the RS effects differ across regions. M1's activity represents the starting finger of the sequence, an effect that vanishes with repetition. In contrast, activity patterns in parietal areas exhibit sequence dependency, which persists with repetition. These results demonstrate the importance of combining RS and pattern analysis to understand the function of brain regions.

Stimulus valence, episodic memory, and the priming of brain activation profiles in borderline personality disorder

BACKGROUND

Borderline personality disorder (BPD) is characterized by instability in affective regulation that can result in a loss of cognitive control. Triggers may be neuronal responses to emotionally valenced context and/or stimuli. 'Neuronal priming' indexes the familiarity of stimuli, and may capture the obligatory effects of affective valence on the brain's processing system, and how such valence mediates responses to the repeated presentation of stimuli. We investigated the effects of affective valence of stimuli on neuronal priming (i.e. changes in activation to repeated presentation of stimuli), and if these effects distinguished BPD patients from controls.

METHODS

Forty BPD subjects and 25 control subjects (age range: 18-44) participated in an episodic memory task during fMRI. Stimuli were presented in alternating epochs of encoding (six images of positive, negative, and neutral valence) and recognition (six images for 'old' v. 'new' recognition). Analyses focused on inter-group differences in the change in activation to repeated stimuli (presented during Encoding and Recognition).

RESULTS

Relative to controls, BPD showed greater priming (generally greater decrease from encoding to recognition) for negatively valenced stimuli. Conversely, BPD showed less priming for positively valenced stimuli (generally greater increase from encoding to recognition).

CONCLUSION

Plausibly, the relative familiarity of negative valence to patients with BPD exerts an influence on obligatory responses to repeated stimuli leading to repetition priming of neuronal profiles. The specific effects of valence on memory and/or attention, and consequently on priming can inform the understanding of mechanisms of altered salience for affective stimuli in BPD.

Continuity in intuition and insight: from real to naturalistic virtual environment

Intuition and insight can be deployed on the same continuum. Intuition is the unconscious ability to create links between information; insight is a process by which a sudden comprehension and resolution of a situation arises (i.e. euréka). In the present study, real and virtual environments were used to trigger intuition and insight. The study hypothesised that immersion in real primed environments would facilitate the emergence of intuition and insight in a virtual environment. Forty nine healthy participants were randomly assigned to two groups: “primed” and “non primed.” “Primed” participants were immersed in a real environment with olfactory and visual cues; “non primed” participants did not receive any cues. All participants were exposed to a 3D naturalistic virtual environment which represented a district in Paris via a Head Mounted Display (HMD). Locations presented in the virtual scene (i.e. café places) were related to both olfactory and visual primes (i.e. café) and were based on the continuity between real and virtual environments. Once immersed in the virtual environment, all participants were instructed to use their intuition to envision the selected locations during which Skin Conductance Responses (SCRs) and verbal declarations were recorded. When initiation (a) and immersion (b) phases in the virtual environment were considered, “primed” participants had higher SCRs during the immersion phase than the initiation phase in the virtual environment. They showed higher SRCs during the first part of the virtual immersion than “non primed” participants. During the phenomenological interview, “primed” participants reported a higher number of correct intuitive answers than “non primed” participants. Moreover, “primed” participants “with” insight had higher SCRs during real environment immersion than “primed” participants “without” insight. The findings are consistent with the idea that intuitive decisions in various tasks are based on the activation of pre-existing knowledge, which is unconsciously retrieved, but nevertheless can elicit an intuitive impression of coherence and can generate insight.

Rapid event-related, BOLD fMRI, non-human primates (NHP): choose two out of three

Human functional magnetic resonance imaging (fMRI) typically employs the blood-oxygen-level-dependent (BOLD) contrast mechanism. In non-human primates (NHP), contrast enhancement is possible using monocrystalline iron-oxide nanoparticles (MION) contrast agent, which has a more temporally extended response function. However, using BOLD fMRI in NHP is desirable for interspecies comparison, and the BOLD signal’s faster response function promises to be beneficial for rapid event-related (rER) designs. Here, we used rER BOLD fMRI in macaque monkeys while viewing real-world images, and found visual responses and category selectivity consistent with previous studies. However, activity estimates were very noisy, suggesting that the lower contrast-to-noise ratio of BOLD, suboptimal behavioural performance, and motion artefacts, in combination, render rER BOLD fMRI challenging in NHP. Previous studies have shown that rER fMRI is possible in macaques with MION, despite MION’s prolonged response function. To understand this, we conducted simulations of the BOLD and MION response during rER, and found that no matter how fast the design, the greater amplitude of the MION response outweighs the contrast loss caused by greater temporal smoothing. We conclude that although any two of the three elements (rER, BOLD, NHP) have been shown to work well, the combination of all three is particularly challenging.

Parallel distributed networks dissociate episodic and social functions within the individual

Association cortex is organized into large-scale distributed networks. One such network, the default network (DN), is linked to diverse forms of internal mentation, opening debate about whether shared or distinct anatomy supports multiple forms of cognition. Using within-individual analysis procedures that preserve idiosyncratic anatomical details, we probed whether multiple tasks from two domains, episodic projection and theory of mind (ToM), rely on the same or distinct networks. In an initial experiment (6 subjects, each scanned 4 times), we found evidence that episodic projection and ToM tasks activate separate regions distributed throughout the cortex, with adjacent regions in parietal, temporal, prefrontal, and midline zones. These distinctions were predicted by the hypothesis that the DN comprises two parallel, interdigitated networks. One network, linked to parahippocampal cortex (PHC), is preferentially recruited during episodic projection, including both remembering and imagining the future. A second juxtaposed network, which includes the temporoparietal junction (TPJ), is differentially engaged during multiple forms of ToM. In two prospectively acquired independent experiments, we replicated and triplicated the dissociation (each with 6 subjects scanned 4 times). Furthermore, the dissociation was found in all zones when analyzed independently, including robustly in midline regions previously described as hubs. The TPJ-linked network is interwoven with the PHC-linked network across the cortex, making clear why it is difficult to fully resolve the two networks in group-averaged or lower-resolution data. These results refine our understanding of the functional-anatomical organization of association cortex and raise fundamental questions about how specialization might arise in parallel, juxtaposed association networks.NEW & NOTEWORTHY Two distributed, interdigitated networks exist within the bounds of the canonical default network. Here we used repeated scanning of individuals, across three independent samples, to provide evidence that tasks requiring episodic projection or theory of mind differentially recruit the two networks across multiple cortical zones. The two distributed networks thus appear to preferentially subserve distinct functions.

A MEG Study of Visual Repetition Priming in Schizophrenia: Evidence for Impaired High-Frequency Oscillations and Event-Related Fields in Thalamo-Occipital Cortices

Background: Cognitive dysfunctions represent a core feature of schizophrenia and a predictor for clinical outcomes. One possible mechanism for cognitive impairments could involve an impairment in the experience-dependent modifications of cortical networks. Methods: To address this issue, we employed magnetoencephalography (MEG) during a visual priming paradigm in a sample of chronic patients with schizophrenia (n = 14), and in a group of healthy controls (n = 14). We obtained MEG-recordings during the presentation of visual stimuli that were presented three times either consecutively or with intervening stimuli. MEG-data were analyzed for event-related fields as well as spectral power in the 1-200 Hz range to examine repetition suppression and repetition enhancement. We defined regions of interest in occipital and thalamic regions and obtained virtual-channel data. Results: Behavioral priming did not differ between groups. However, patients with schizophrenia showed prominently reduced oscillatory response to novel stimuli in the gamma-frequency band as well as significantly reduced repetition suppression of gamma-band activity and reduced repetition enhancement of beta-band power in occipital cortex to both consecutive repetitions as well as repetitions with intervening stimuli. Moreover, schizophrenia patients were characterized by a significant deficit in suppression of the C1m component in occipital cortex and thalamus as well as of the late positive component (LPC) in occipital cortex. Conclusions: These data provide novel evidence for impaired repetition suppression in cortical and subcortical circuits in schizophrenia. Although behavioral priming was preserved, patients with schizophrenia showed deficits in repetition suppression as well as repetition enhancement in thalamic and occipital regions, suggesting that experience-dependent modification of neural circuits is impaired in the disorder.

Mapping brain function during naturalistic viewing using high-density diffuse optical tomography

Naturalistic stimuli, such as movies, more closely recapitulate "real life" sensory processing and behavioral demands relative to paradigms that rely on highly distilled and repetitive stimulus presentations. The rich complexity inherent in naturalistic stimuli demands an imaging system capable of measuring spatially distributed brain responses, and analysis tools optimized for unmixing responses to concurrently presented features. In this work, the combination of passive movie viewing with high-density diffuse optical tomography (HD-DOT) is developed as a platform for naturalistic brain mapping. We imaged healthy young adults during free viewing of a feature film using HD-DOT and observed reproducible, synchronized cortical responses across a majority of the field-of-view, most prominently in hierarchical cortical areas related to visual and auditory processing, both within and between individuals. In order to more precisely interpret broad patterns of cortical synchronization, we extracted visual and auditory features from the movie stimulus and mapped the cortical responses to the features. The results demonstrate the sensitivity of HD-DOT to evoked responses during naturalistic viewing, and that feature-based decomposition strategies enable functional mapping of naturalistic stimulus processing, including human-generated speech.

Task-related hemodynamic responses are modulated by reward and task engagement

Hemodynamic recordings from visual cortex contain powerful endogenous task-related responses that may reflect task-related arousal, or "task engagement" distinct from attention. We tested this hypothesis with hemodynamic measurements (intrinsic-signal optical imaging) from monkey primary visual cortex (V1) while the animals' engagement in a periodic fixation task over several hours was varied through reward size and as animals took breaks. With higher rewards, animals appeared more task-engaged; task-related responses were more temporally precise at the task period (approximately 10-20 seconds) and modestly stronger. The 2-5 minute blocks of high-reward trials led to ramp-like decreases in mean local blood volume; these reversed with ramp-like increases during low reward. The blood volume increased even more sharply when the animal shut his eyes and disengaged completely from the task (5-10 minutes). We propose a mechanism that controls vascular tone, likely along with local neural responses in a manner that reflects task engagement over the full range of timescales tested.

Characterization of the hemodynamic response function in white matter tracts for event-related fMRI

Accurate estimates of the BOLD hemodynamic response function (HRF) are crucial for the interpretation and analysis of event-related functional MRI data. To date, however, there have been no comprehensive measurements of the HRF in white matter (WM) despite increasing evidence that BOLD signals in WM change after a stimulus. We performed an event-related cognitive task (Stroop color-word interference) to measure the HRF in selected human WM pathways. The task was chosen in order to produce robust, distributed centers of activity throughout the cortex. To measure the HRF in WM, fiber tracts were reconstructed between each pair of activated cortical areas. We observed clear task-specific HRFs with reduced magnitudes, delayed onsets and prolonged initial dips in WM tracts compared with activated grey matter, thus calling for significant changes to current standard models for accurately characterizing the HRFs in WM and for modifications of standard methods of analysis of functional imaging data.

The Intensity of Early Attentional Processing, but Not Conflict Monitoring, Determines the Size of Subliminal Response Conflicts

Response conflicts hamper goal-directed behavior and may be evoked by both consciously and subliminally (unconsciously) processed information. Yet, not much is known about the mechanisms and brain regions driving the size of subliminally induced conflicts. We hence combined a response conflict paradigm featuring subliminal primes and conscious flankers with in-depth neurophysiological (EEG) analyses, including source localization in a sample of N = 243 healthy subjects. Intra-individual differences in the size of subliminal conflicts were reflected both during early attentional stimulus processing (prime-associated N1 and target-associated P1 and N1 amplitudes) and conflict monitoring (N2 amplitudes). On the neuroanatomical level, this was reflected by activity modulations in the TPJ (BA39, BA40) and V2 (BA18), which are known to be involved in attentional stimulus processing and task set maintenance. In addition to a "standard" analysis of event-related potentials, we also conducted a purely data-driven machine learning approach using support vector machines (SVM) in order to identify neurophysiological features which do not only reflect the size of subliminal conflict, but actually allow to classify/predict it. This showed that only extremely early information processing (about 65 ms after the onset of the prime) was predictive of subliminal conflict size. Importantly, this predictive feature occurred before target information could even be processed and was reflected by activity in the left middle frontal gyrus (BA6) and insula (BA13). We conclude that differences in task set maintenance and potentially also in subliminal attentional processing of task-relevant features, but not conflict monitoring, determine the size of subliminally induced response conflicts.

Identifying task-general effects of stimulus familiarity in the parietal memory network

Studies of human memory have implicated a "parietal memory network" in the recognition of familiar stimuli. However, the automatic vs. top-down nature of information processing within this network is not yet understood. If the network processes stimuli automatically, one can expect repetition-related changes both when familiarity is central to an ongoing task and when it is task-irrelevant. Here, we tested this prediction in a group of 40 human subjects using fMRI. Subjects initially named 100 objects aloud in the scanner. They then repeated the same task with novel and previously-named objects intermixed (where familiarity was not task-relevant) and separately were asked to make old/new recognition decisions in response to pictures of novel and previously-named objects (where familiarity was central to task completion). Accuracy was matched across conditions, and voice reaction times reflected typical behavioral priming effects. Repetition enhancement effects were restricted primarily to parietal cortex-and in particular, the parietal memory network-and were task-general in nature, whereas repetition suppression effects were task-dependent and occurred primarily in frontal and ventral temporal cortex. Task context effects were also present in the parietal memory network and impacted responses to both novel and familiar items. We conclude by discussing implications of these findings with respect to current hypotheses regarding parietal contributions to memory retrieval.

Individuals with 22q11.2 deletion syndrome show intact prediction but reduced adaptation in responses to repeated sounds: Evidence from Bayesian mapping

One of the most common copy number variants, the 22q11.2 microdeletion, confers an increased risk for schizophrenia. Since schizophrenia has been associated with an aberrant neural response to repeated stimuli through both reduced adaptation and prediction, we here hypothesized that this may also be the case in nonpsychotic individuals with a 22q11.2 deletion. We recorded high-density EEG from 19 individuals with 22q11.2 deletion syndrome (12-25 years), as well as 27 healthy volunteers with comparable age and sex distribution, while they listened to a sequence of sounds arranged in a roving oddball paradigm. Using posterior probability maps and dynamic causal modelling we tested three different models accounting for repetition dependent changes in cortical responses as well as in effective connectivity; namely an adaptation model, a prediction model, and a model including both adaptation and prediction. Repetition-dependent changes were parametrically modulated by a combination of adaptation and prediction and were apparent in both cortical responses and in the underlying effective connectivity. This effect was reduced in individuals with a 22q11.2 deletion and was negatively correlated with negative symptom severity. Follow-up analysis showed that the reduced effect of the combined adaptation and prediction model seen in individuals with 22q11.2 deletion was driven by reduced adaptation rather than prediction failure. Our findings suggest that adaptation is reduced in individuals with a 22q11.2 deletion, which can be interpreted in light of the framework of predictive coding as a failure to suppress prediction errors.

Prediction error and repetition suppression have distinct effects on neural representations of visual information

Predictive coding theories argue that recent experience establishes expectations in the brain that generate prediction errors when violated. Prediction errors provide a possible explanation for repetition suppression, where evoked neural activity is attenuated across repeated presentations of the same stimulus. The predictive coding account argues repetition suppression arises because repeated stimuli are expected, whereas non-repeated stimuli are unexpected and thus elicit larger neural responses. Here, we employed electroencephalography in humans to test the predictive coding account of repetition suppression by presenting sequences of visual gratings with orientations that were expected either to repeat or change in separate blocks of trials. We applied multivariate forward modelling to determine how orientation selectivity was affected by repetition and prediction. Unexpected stimuli were associated with significantly enhanced orientation selectivity, whereas selectivity was unaffected for repeated stimuli. Our results suggest that repetition suppression and expectation have separable effects on neural representations of visual feature information.

Exploring lateralization during memory through hemispheric pre-activation: Differences based on the stimulus type

The original approach of the Hemispheric Encoding/Retrieval Asymmetry model (HERA) was aimed at the operations of encoding and retrieving episodic memories. However, whether HERA presumptions can apply to different types of stimuli (e.g., words and pictures) continues to be a matter of debate. Therefore, in order to analyse the effects of brain pre-activation on subsequent memory, HERA was tested through a hand-clenching paradigm using four types of stimuli: words, fractal images, silhouettes of common objects, and pseudowords. Results revealed that only the memory of words and pseudowords was enhanced by hand-clenching pre-activation, according to HERA predictions. Since the cognitive processes underlying recognition of verbal stimuli are considered to follow a cognitive route involving grapheme-morpheme conversion, it could be hypothesized that hand-clenching pre-activation might be associated with a selective pre-activation of the brain circuits participating in that pathway. Hence, the present work broadens possible interpretations behind the effects of hand-clenching on memory, based on the process engaged and the type of stimulus to be remembered.

Two-Stage Processing of Aesthetic Information in the Human Brain Revealed by Neural Adaptation Paradigm

Some researchers in aesthetics assume visual features related to aesthetic perception (e.g. golden ratio and symmetry) commonly embedded in masterpieces. If this is true, an intriguing hypothesis is that the human brain has neural circuitry specialized for the processing of visual beauty. We presently tested this hypothesis by combining a neuroimaging technique with the repetition suppression (RS) paradigm. Subjects (non-experts in art) viewed two images of sculptures sequentially presented. Some sculptures obeyed the golden ratio (canonical images), while the golden proportion were impaired in other sculptures (deformed images). We found that the occipito-temporal cortex in the right hemisphere showed the RS when a canonical sculpture (e.g. Venus de Milo) was repeatedly presented, but not when its deformed version was repeated. Furthermore, the right parietal cortex showed the RS to the canonical proportion even when two sculptures had different identities (e.g. Venus de Milo as the first stimulus and David di Michelangelo as the second), indicating that this region encodes the golden ratio as an abstract rule shared by different sculptures. Those results suggest two separate stages of neural processing for aesthetic information (one in the occipito-temporal and another in the parietal regions) that are hierarchically arranged in the human brain.

Altered Brain Activities Associated with Neural Repetition Effects in Mild Cognitive Impairment Patients

Older adults with mild cognitive impairment (MCI) manifest impaired explicit memory. However, studies on implicit memory such as repetition effects in persons with MCI have been limited. In the present study, 17 MCI patients and 16 healthy normal controls (NC) completed a modified delayed-match-to-sample task while undergoing functional magnetic resonance imaging. We aim to examine the neural basis of repetition; specifically, to elucidate whether and how repetition-related brain responses are altered in participants with MCI. When repeatedly rejecting distracters, both NC and MCI showed similar behavioral repetition effects; however, in both whole-brain and region-of-interest analyses of functional data, persons with MCI showed reduced repetition-driven suppression in the middle occipital and middle frontal gyrus. Further, individual difference analysis found that activation in the left middle occipital gyrus was positively correlated with rejecting reaction time and negatively correlated with accuracy rate, suggesting a predictor of repetition behavioral performance. These findings provide new evidence to support the view that neural mechanisms of repetition effect are altered in MCI who manifests compensatory repetition-related brain activities along with their neuropathology.

Repetition suppression: a means to index neural representations using BOLD?

Understanding how the human brain gives rise to complex cognitive processes remains one of the biggest challenges of contemporary neuroscience. While invasive recording in animal models can provide insight into neural processes that are conserved across species, our understanding of cognition more broadly relies upon investigation of the human brain itself. There is therefore an imperative to establish non-invasive tools that allow human brain activity to be measured at high spatial and temporal resolution. In recent years, various attempts have been made to refine the coarse signal available in functional magnetic resonance imaging (fMRI), providing a means to investigate neural activity at the meso-scale, i.e. at the level of neural populations. The most widely used techniques include repetition suppression and multivariate pattern analysis. Human neuroscience can now use these techniques to investigate how representations are encoded across neural populations and transformed by relevant computations. Here, we review the physiological basis, applications and limitations of fMRI repetition suppression with a brief comparison to multivariate techniques. By doing so, we show how fMRI repetition suppression holds promise as a tool to reveal complex neural mechanisms that underlie human cognitive function.

This article is part of the themed issue ‘Interpreting BOLD: a dialogue between cognitive and cellular neuroscience’.

Estimating Dynamic Signals From Trial Data With Censored Values

Censored data occur commonly in trial-structured behavioral experiments and many other forms of longitudinal data. They can lead to severe bias and reduction of statistical power in subsequent analyses. Principled approaches for dealing with censored data, such as data imputation and methods based on the complete data's likelihood, work well for estimating fixed features of statistical models but have not been extended to dynamic measures, such as serial estimates of an underlying latent variable over time. Here we propose an approach to the censored-data problem for dynamic behavioral signals. We developed a state-space modeling framework with a censored observation process at the trial timescale. We then developed a filter algorithm to compute the posterior distribution of the state process using the available data. We showed that special cases of this framework can incorporate the three most common approaches to censored observations: ignoring trials with censored data, imputing the censored data values, or using the full information available in the data likelihood. Finally, we derived a computationally efficient approximate Gaussian filter that is similar in structure to a Kalman filter, but that efficiently accounts for censored data. We compared the performances of these methods in a simulation study and provide recommendations of approaches to use, based on the expected amount of censored data in an experiment. These new techniques can broadly be applied in many research domains in which censored data interfere with estimation, including survival analysis and other clinical trial applications.

Representations of Novelty and Familiarity in a Mushroom Body Compartment

Animals exhibit a behavioral response to novel sensory stimuli about which they have no prior knowledge. We have examined the neural and behavioral correlates of novelty and familiarity in the olfactory system of Drosophila. Novel odors elicit strong activity in output neurons (MBONs) of the α'3 compartment of the mushroom body that is rapidly suppressed upon repeated exposure to the same odor. This transition in neural activity upon familiarization requires odor-evoked activity in the dopaminergic neuron innervating this compartment. Moreover, exposure of a fly to novel odors evokes an alerting response that can also be elicited by optogenetic activation of α'3 MBONs. Silencing these MBONs eliminates the alerting behavior. These data suggest that the α'3 compartment plays a causal role in the behavioral response to novel and familiar stimuli as a consequence of dopamine-mediated plasticity at the Kenyon cell-MBONα'3 synapse.

Effect of confounding variables on hemodynamic response function estimation using averaging and deconvolution analysis: An event-related NIRS study

Slow and rapid event-related designs are used in fMRI and functional near-infrared spectroscopy (fNIRS) experiments to temporally characterize the brain hemodynamic response to discrete events. Conventional averaging (CA) and the deconvolution method (DM) are the two techniques commonly used to estimate the Hemodynamic Response Function (HRF) profile in event-related designs. In this study, we conducted a series of simulations using synthetic and real NIRS data to examine the effect of the main confounding factors, including event sequence timing parameters, different types of noise, signal-to-noise ratio (SNR), temporal autocorrelation and temporal filtering on the performance of these techniques in slow and rapid event-related designs. We also compared systematic errors in the estimates of the fitted HRF amplitude, latency and duration for both techniques. We further compared the performance of deconvolution methods based on Finite Impulse Response (FIR) basis functions and gamma basis sets. Our results demonstrate that DM was much less sensitive to confounding factors than CA. Event timing was the main parameter largely affecting the accuracy of CA. In slow event-related designs, deconvolution methods provided similar results to those obtained by CA. In rapid event-related designs, our results showed that DM outperformed CA for all SNR, especially above -5 dB regardless of the event sequence timing and the dynamics of background NIRS activity. Our results also show that periodic low-frequency systemic hemodynamic fluctuations as well as phase-locked noise can markedly obscure hemodynamic evoked responses. Temporal autocorrelation also affected the performance of both techniques by inducing distortions in the time profile of the estimated hemodynamic response with inflated t-statistics, especially at low SNRs. We also found that high-pass temporal filtering could substantially affect the performance of both techniques by removing the low-frequency components of HRF profiles. Our results emphasize the importance of characterization of event timing, background noise and SNR when estimating HRF profiles using CA and DM in event-related designs.

I know I've seen you before: Distinguishing recent-single-exposure-based familiarity from pre-existing familiarity

This study examines how individuals differentiate recent-single-exposure-based familiarity from pre-existing familiarity. If these are two distinct cognitive processes, are they supported by the same neural bases? This study examines how recent-single-exposure-based familiarity and multiple-previous-exposure-based familiarity are supported and represented in the brain using functional MRI. In a novel approach, we first behaviorally show that subjects can divide retrieval of items in pre-existing memory into judgments of recollection and familiarity. Then, using functional magnetic resonance imaging, we examine the differences in blood oxygen level dependent activity and regional connectivity during judgments of recent-single-exposure-based and pre-existing familiarity. Judgments of these two types of familiarity showed distinct regions of activation in a whole-brain analysis, in medial temporal lobe (MTL) substructures, and in MTL substructure functional-correlations with other brain regions. Specifically, within the MTL, perirhinal cortex showed increased activation during recent-single-exposure-based familiarity while parahippocampal cortex showed increased activation during judgments of pre-existing familiarity. We find that recent-single-exposure-based and pre-existing familiarity are represented as distinct neural processes in the brain; this is supported by differing patterns of brain activation and regional correlations. This spatially distinct regional brain involvement suggests that the two separate experiences of familiarity, recent-exposure-based familiarity and pre-existing familiarity, may be cognitively distinct.

Modulation of Auditory Evoked Magnetic Fields Elicited by Successive Frequency-Modulated (FM) Sweeps

In our daily life, we are successively exposed to frequency-modulated (FM) sounds that play an important role in speech and species-specific communication. Previous studies demonstrated that repetitive exposure to identical pure tones resulted in decreased neural activity. However, the effects of repetitively presented FM sounds on neural activity in the human auditory cortex remain unclear. In the present study, we used magnetoencephalography to investigate auditory evoked N1m responses elicited by four successive temporally repeated and superimposed FM sweeps in three sequences: (1) four FM sweeps were identical, (2) four FM sweeps had the same FM direction and rate, but different carrier frequencies, (3) four FM sweeps differed with respect to the FM rate and/or direction and their carrier frequencies. In contrast to our expectations, the results obtained demonstrated that N1m responses were maximal when the four FM sweeps were identical and minimal when they were distinct. These results suggest that the neural processing of repetitive FM sweeps in the human auditory cortex may differ from that of repetitive pure tones.

Failure to mobilize cognitive control for challenging tasks correlates with symptom severity in schizophrenia

Deficits in the adaptive, flexible control of behavior contribute to the clinical manifestations of schizophrenia. We used functional MRI and an antisaccade paradigm to examine the neural correlates of cognitive control deficits and their relations to symptom severity. Thirty-three chronic medicated outpatients with schizophrenia and 31 healthy controls performed an antisaccade paradigm. We examined differences in recruitment of the cognitive control network and task performance for Hard (high control) versus Easy (low control) antisaccade trials within and between groups. We focused on the key regions involved in ‘top-down’ control of ocular motor structures – dorsal anterior cingulate cortex, dorsolateral and ventrolateral prefrontal cortex. In patients, we examined whether difficulty implementing cognitive control correlated with symptom severity. Patients made more errors overall, and had shorter saccadic latencies than controls on correct Hard vs. Easy trials. Unlike controls, patients failed to increase activation in the cognitive control network for Hard vs. Easy trials. Reduced activation for Hard vs. Easy trials predicted higher error rates in both groups and increased symptom severity in schizophrenia. These findings suggest that patients with schizophrenia are impaired in mobilizing cognitive control when presented with challenges and that this contributes to deficits suppressing prepotent but contextually inappropriate responses, to behavior that is stimulus-bound and error-prone rather than flexibly guided by context, and to symptom expression. Therapies aimed at increasing cognitive control may improve both cognitive flexibility and reduce the impact of symptoms.

•

Patients with schizophrenia fail to mobilize the cognitive control network during a challenging cognitive task.

•

This deficit results in behavior that is stimulus-bound and error-prone rather than flexibly guided by context.

•

Therapies aimed at increasing cognitive control may improve both cognitive flexibility and reduce the impact of symptoms.

Repetition Enhancement of Amygdala and Visual Cortex Functional Connectivity Reflects Nonconscious Memory for Negative Visual Stimuli

Most studies using a recognition memory paradigm examine the neural processes that support the ability to consciously recognize past events. However, there can also be nonconscious influences from the prior study episode that reflect repetition suppression effects-a reduction in the magnitude of activity for repeated presentations of stimuli-that are revealed by comparing neural activity associated with forgotten items to correctly rejected novel items. The present fMRI study examined the effect of emotional valence (positive vs. negative) on repetition suppression effects. Using a standard recognition memory task, 24 participants viewed line drawings of previously studied negative, positive, and neutral photos intermixed with novel line drawings. For each item, participants made an old-new recognition judgment and a sure-unsure confidence rating. Collapsed across valence, repetition suppression effects were found in ventral occipital-temporal cortex and frontal regions. Activity levels in the majority of these regions were not modulated by valence. However, repetition enhancement of the amygdala and ventral occipital-temporal cortex functional connectivity reflected nonconscious memory for negative items. In this study, valence had little effect on activation patterns but had a larger effect on functional connectivity patterns that were markers of nonconscious memory. Beyond memory and emotion, these findings are relevant to other cognitive and social neuroscientists that utilize fMRI repetition effects to investigate perception, attention, social cognition, and other forms of learning and memory.

Visual Memory and Visual Perception Recruit Common Neural Substrates

This human neuroimaging review aims to determine the degree to which visual memory evokes activity in neural regions that have been associated with visual perception. A visual perception framework is proposed to identify cortical regions associated with modality-specific processing (i.e., visual, auditory, motor, or olfactory), visual domain-specific processing (i.e., “what” versus “where,” or face versus visual context), and visual feature-specific processing (i.e., color, motion, or spatial location). Independent assessments of visual item memory studies and visual working memory studies revealed activity in the appropriate cortical regions associated with each of the three levels of visual perception processing. These results provide compelling evidence that visual memory and visual perception are associated with common neural substrates. Furthermore, as with visual perception, they support the view that visual memory is a constructive process, in which features or components from disparate cortical regions bind together to form a coherent whole.

Dissociable Neural Subsystems Underlie Abstract and Specific Object Recognition

Participants named objects presented in the left or right visual field during a test phase, after viewing centrally presented same-exemplar objects, different-exemplar objects, and words that name objects during an initial encoding phase. In two experiments, repetition priming was exemplar-abstract yet visual when test objects were presented directly to the left cerebral hemisphere, but exemplar-specific when test objects were presented directly to the right cerebral hemisphere, contrary to predictions from single-system theories of object recognition. In two other experiments, stimulus degradation during encoding and task demands during test modulated these results in predicted ways. The results support the theory that dissociable neural subsystems operate in parallel (not in sequence) to underlie visual object recognition: An abstract-category subsystem operates more effectively than a specific-exemplar subsystem in the left hemisphere, and a specific-exemplar subsystem operates more effectively than an abstract-category subsystem in the right hemisphere.

Intuitive decision making as a gradual process: investigating semantic intuition-based and priming-based decisions with fMRI

INTRODUCTION

Intuition has been defined as the instantaneous, experience-based impression of coherence elicited by cues in the environment. In a context of discovery, intuitive decision-making processes can be conceptualized as occurring within two stages, the first of which comprises an implicit perception of coherence that is not (yet) verbalizable. Through a process of spreading activation, this initially non-conscious perception gradually crosses over a threshold of awareness and thereby becomes explicable. Because of its experiential basis, intuition shares conceptual similarities with implicit memory processes. Based on these, the study addresses two research questions: (1) Is the gradual nature of intuitive processes reflected on a neural level? (2) Do intuition-based decisions differ neurally from priming-based decisions?

METHODS

To answer these questions, we conducted an fMRI study using the triads task and presented participants with coherent word triads that converge on a common fourth concept, and incoherent word triads that do not converge on a common fourth concept. Participants had to perform semantic coherence judgments as well as to indicate whether they immediately knew the fourth concept. To enable investigating intuition-based and priming-based decisions within the same task and with the same participants, we implemented a conceptual priming procedure into the coherence judgment task. We realized this by priming participants with concepts associated with incoherent triads in separate priming blocks prior to the coherence judgments.

RESULTS

For intuition-based decisions, imaging results mainly revealed activity within the orbitofrontal cortex, within the inferior frontal gyrus and the middle temporal gyrus. Activity suppression in the right temporo-occipital complex was observed for priming-based decisions.

CONCLUSIONS

With respect to research question 1, our data support a continuity model of intuition because the two intuitive stages show quantitatively distinct brain activation patterns. Regarding research question 2, we can draw the preliminary conclusion of a qualitative difference between intuition-based and priming-based decisions.

The Visual Priming of Motion-Defined 3D Objects

The perception of a stimulus can be influenced by previous perceptual experience, a phenomenon known as perceptual priming. However, there has been limited investigation on perceptual priming of shape perception of three-dimensional object structures defined by moving dots. Here we examined the perceptual priming of a 3D object shape defined purely by motion-in-depth cues (i.e., Shape-From-Motion, SFM) using a classic prime-target paradigm. The results from the first two experiments revealed a significant increase in accuracy when a “cloudy” SFM stimulus (whose object structure was difficult to recognize due to the presence of strong noise) was preceded by an unambiguous SFM that clearly defined the same transparent 3D shape. In contrast, results from Experiment 3 revealed no change in accuracy when a “cloudy” SFM stimulus was preceded by a static shape or a semantic word that defined the same object shape. Instead, there was a significant decrease in accuracy when preceded by a static shape or a semantic word that defined a different object shape. These results suggested that the perception of a noisy SFM stimulus can be facilitated by a preceding unambiguous SFM stimulus—but not a static image or a semantic stimulus—that defined the same shape. The potential neural and computational mechanisms underlying the difference in priming are discussed.

How the brain learns how few are "many": An fMRI study of the flexibility of quantifier semantics

Previous work has shown that the meaning of a quantifier such as "many" or "few" depends in part on quantity. However, the meaning of a quantifier may vary depending on the context, e.g. in the case of common entities such as "many ants" (perhaps several thousands) compared to endangered species such as "many pandas" (perhaps a dozen). In a recent study (Heim et al., 2015 Front. Psychol.) we demonstrated that the relative meaning of "many" and "few" may be changed experimentally. In a truth value judgment task, displays with 40% of circles in a named color initially had a low probability of being labeled "many". After a training phase, the likelihood of acceptance 40% as "many" increased. Moreover, the semantic learning effect also generalized to the related quantifier "few" which had not been mentioned in the training phase. Thus, fewer 40% arrays were considered "few." In the present study, we tested the hypothesis that this semantic adaptation effect was supported by cytoarchitectonic Brodmann area (BA) 45 in Broca's region which may contribute to semantic evaluation in the context of language and quantification. In an event-related fMRI study, 17 healthy volunteers performed the same paradigm as in the previous behavioral study. We found a relative signal increase when comparing the critical, trained proportion to untrained proportions. This specific effect was found in left BA 45 for the trained quantifier "many", and in left BA 44 for both quantifiers, reflecting the semantic adjustment for the untrained but related quantifier "few." These findings demonstrate the neural basis for processing the flexible meaning of a quantifier, and illustrate the neuroanatomical structures that contribute to variable meanings that can be associated with a word when used in different contexts.

Distinct representations of syllables and phonemes in Chinese production: Evidence from fMRI adaptation

Existing linguistic theories have converged on the fundamental role of syllable and phoneme as the phonological production units that drive articulation in most alphabetic languages, while much remains controversial concerning the logographic Chinese because there is no conclusive evidence of the neural correlates of syllabic and phonemic processing during Chinese speech production. Here, fMRI adaptation paradigm was used to explore the possibility of distinctive neural representations of phonemes and syllables when native Chinese speakers pronounced Chinese pseudowords. We found that bilateral basal ganglia (BG) exhibited evident neural adaptation effect for phonemic repetition, indicating independent neural representation of phonemes in the speech production network in Chinese speakers. Moreover, neural adaptation effect for syllabic repetition was found in bilateral superior temporal gyrus (STg). These findings thus suggest that, similar to alphabetic languages, both phonemes and syllables are phonological production units associated with distinctive neural representations in Mandarin Chinese and further implicate the universality of hierarchical phonological coding across different linguistic systems.

How Attention Changes in Response to Incentives

Although the performance of simple cognitive tasks can be enhanced if an incentive is provided, the mechanisms enabling such motivational control are not known. This study sought to uncover how mechanisms of attention and readiness are altered by reward-associated incentive stimuli. We measured EEG/ERP activity as human adults viewed a high- or low-incentive cue, experienced a short preparation interval, and then performed a simple visual search task to gain the predicted reward. Search performance was faster with high versus low incentives, and this was accompanied by distinct incentive-related EEG/ERP patterns at each phase of the task (incentive, preparation, and search). First, and most surprisingly, attention to high but not low incentive cues was actively suppressed, as indexed by a PD component in response to the incentive display. During the subsequent preparation interval, neural oscillations in the alpha frequency range were reduced after high-incentive cues, indicating heightened visual readiness. Finally, attentional orienting to the target in the search array was deployed with relatively little effort on high-incentive trials, as indexed by a reduced N2pc component. These results reveal the chain of events by which the brain's executive control mechanisms respond to incentives by altering the operation of multiple processing systems to produce optimal performance.

Learning-induced plasticity in medial prefrontal cortex predicts preference malleability

Learning induces plasticity in neuronal networks. As neuronal populations contribute to multiple representations, we reasoned plasticity in one representation might influence others. We used human fMRI repetition suppression to show that plasticity induced by learning another individual’s values impacts upon a value representation for oneself in medial prefrontal cortex (mPFC), a plasticity also evident behaviorally in a preference shift. We show this plasticity is driven by a striatal “prediction error,” signaling the discrepancy between the other’s choice and a subject’s own preferences. Thus, our data highlight that mPFC encodes agent-independent representations of subjective value, such that prediction errors simultaneously update multiple agents’ value representations. As the resulting change in representational similarity predicts interindividual differences in the malleability of subjective preferences, our findings shed mechanistic light on complex human processes such as the powerful influence of social interaction on beliefs and preferences.

•

Learning the values of another causes plasticity in a mPFC value representation

•

This plasticity predicts how much subjects’ own preferences change

•

Plasticity is explained by a striatal surprise signal

•

Value coding in mPFC occurs independently of the agent for whom a decision is made

Skill dependent audiovisual integration in the fusiform induces repetition suppression

Learning to read entails mapping existing phonological representations to novel orthographic representations and is thus an ideal context for investigating experience driven audiovisual integration. Because two dominant brain-based theories of reading development hinge on the sensitivity of the visual-object processing stream to phonological information, we were interested in how reading skill relates to audiovisual integration in this area. Thirty-two children between 8 and 13 years of age spanning a range of reading skill participated in a functional magnetic resonance imaging experiment. Participants completed a rhyme judgment task to word pairs presented unimodally (auditory- or visual-only) and cross-modally (auditory followed by visual). Skill-dependent sub-additive audiovisual modulation was found in left fusiform gyrus, extending into the putative visual word form area, and was correlated with behavioral orthographic priming. These results suggest learning to read promotes facilitatory audiovisual integration in the ventral visual-object processing stream and may optimize this region for orthographic processing.

A designated odor-language integration system in the human brain

Odors are surprisingly difficult to name, but the mechanism underlying this phenomenon is poorly understood. In experiments using event-related potentials (ERPs) and functional magnetic resonance imaging (fMRI), we investigated the physiological basis of odor naming with a paradigm where olfactory and visual object cues were followed by target words that either matched or mismatched the cue. We hypothesized that word processing would not only be affected by its semantic congruency with the preceding cue, but would also depend on the cue modality (olfactory or visual). Performance was slower and less precise when linking a word to its corresponding odor than to its picture. The ERP index of semantic incongruity (N400), reflected in the comparison of nonmatching versus matching target words, was more constrained to posterior electrode sites and lasted longer on odor-cue (vs picture-cue) trials. In parallel, fMRI cross-adaptation in the right orbitofrontal cortex (OFC) and the left anterior temporal lobe (ATL) was observed in response to words when preceded by matching olfactory cues, but not by matching visual cues. Time-series plots demonstrated increased fMRI activity in OFC and ATL at the onset of the odor cue itself, followed by response habituation after processing of a matching (vs nonmatching) target word, suggesting that predictive perceptual representations in these regions are already established before delivery and deliberation of the target word. Together, our findings underscore the modality-specific anatomy and physiology of object identification in the human brain.

Fractionating the neural substrates of incidental recognition memory

Familiar stimuli are typically accompanied by decreases in neural response relative to the presentation of novel items, but these studies often include explicit instructions to discriminate old and new items; this creates difficulties in partialling out the contribution of top-down intentional orientation to the items based on recognition goals. Here, we used an incidental recognition functional MRI paradigm to compare response to repetition of novel and familiar stimuli in the absence of any ongoing memory task demand. The inferior frontal gyrus and hippocampus both displayed enhanced response to novelty and suppressed response to familiar stimuli, notably, under conditions which did not encourage intentional orientation to recognize novel or old items. Functional connectivity analyses additionally suggested that familiarity processing is associated with a network incorporating the hippocampus and prefrontal cortex. We conclude that recognition memory substrates can be fractionated even in the absence of memory goals.

Reduced repetition suppression in the occipital visual cortex during repeated negative Chinese personality-trait word processing

Reduced neural activation have been consistently observed during repeated items processing, a phenomenon termed repetition suppression. The present study used functional magnetic resonance imaging (fMRI) to investigate whether and how stimuli of emotional valence affects repetition suppression by adopting Chinese personality-trait words as materials. Seventeen participants were required to read the negative and neutral Chinese personality-trait words silently. And then they were presented with repeated and novel items during scanning. Results showed significant repetition suppression in the inferior occipital gyrus only for neutral personality-trait words, whereas similar repetition suppression in the left inferior temporal gyrus and left middle temporal gyrus was revealed for both the word types. These results indicated common and distinct neural substrates during processing Chinese repeated negative and neutral personality-trait words.

Set-relevance Determines the Impact of Distractors on Episodic Memory Retrieval

We investigated the interplay between stimulus-driven attention and memory retrieval with a novel interference paradigm that engaged both systems concurrently on each trial. Participants encoded a 45-min movie on Day 1 and, on Day 2, performed a temporal order judgment task during fMRI. Each retrieval trial comprised three images presented sequentially, and the task required participants to judge the temporal order of the first and the last images (“memory probes”) while ignoring the second image, which was task irrelevant (“attention distractor”). We manipulated the content relatedness and the temporal proximity between the distractor and the memory probes, as well as the temporal distance between two probes. Behaviorally, short temporal distances between the probes led to reduced retrieval performance. Distractors that at encoding were temporally close to the first probe image reduced these costs, specifically when the distractor was content unrelated to the memory probes. The imaging results associated the distractor probe temporal proximity with activation of the right ventral attention network. By contrast, the precuneus was activated for high-content relatedness between distractors and probes and in trials including a short distance between the two memory probes. The engagement of the right ventral attention network by specific types of distractors suggests a link between stimulus-driven attention control and episodic memory retrieval, whereas the activation pattern of the precuneus implicates this region in memory search within knowledge/content-based hierarchies.