Sensory Deviancy Detection Measured Directly Within the Human Nucleus Accumbens

Predictable and unpredictable deviance detection in the human hippocampus and amygdala

Our brains extract structure from the environment and form predictions given past experience. Predictive circuits have been identified in wide-spread cortical regions. However, the contribution of medial temporal structures in predictions remains under-explored. The hippocampus underlies sequence detection and is sensitive to novel stimuli, sufficient to gain access to memory, while the amygdala to novelty. Yet, their electrophysiological profiles in detecting predictable and unpredictable deviant auditory events remain unknown. Here, we hypothesized that the hippocampus would be sensitive to predictability, while the amygdala to unexpected deviance. We presented epileptic patients undergoing presurgical monitoring with standard and deviant sounds, in predictable or unpredictable contexts. Onsets of auditory responses and unpredictable deviance effects were detected earlier in the temporal cortex compared with the amygdala and hippocampus. Deviance effects in 1-20 Hz local field potentials were detected in the lateral temporal cortex, irrespective of predictability. The amygdala showed stronger deviance in the unpredictable context. Low-frequency deviance responses in the hippocampus (1-8 Hz) were observed in the predictable but not in the unpredictable context. Our results reveal a distributed network underlying the generation of auditory predictions and suggest that the neural basis of sensory predictions and prediction error signals needs to be extended.

Automatic Sensory Predictions: A Review of Predictive Mechanisms in the Brain and Their Link to Conscious Processing

The human brain has the astonishing capacity of integrating streams of sensory information from the environment and forming predictions about future events in an automatic way. Despite being initially developed for visual processing, the bulk of predictive coding research has subsequently focused on auditory processing, with the famous mismatch negativity signal as possibly the most studied signature of a surprise or prediction error (PE) signal. Auditory PEs are present during various consciousness states. Intriguingly, their presence and characteristics have been linked with residual levels of consciousness and return of awareness. In this review we first give an overview of the neural substrates of predictive processes in the auditory modality and their relation to consciousness. Then, we focus on different states of consciousness - wakefulness, sleep, anesthesia, coma, meditation, and hypnosis - and on what mysteries predictive processing has been able to disclose about brain functioning in such states. We review studies investigating how the neural signatures of auditory predictions are modulated by states of reduced or lacking consciousness. As a future outlook, we propose the combination of electrophysiological and computational techniques that will allow investigation of which facets of sensory predictive processes are maintained when consciousness fades away.

Prediction error signaling explains neuronal mismatch responses in the medial prefrontal cortex

The mismatch negativity (MMN) is a key biomarker of automatic deviance detection thought to emerge from 2 cortical sources. First, the auditory cortex (AC) encodes spectral regularities and reports frequency-specific deviances. Then, more abstract representations in the prefrontal cortex (PFC) allow to detect contextual changes of potential behavioral relevance. However, the precise location and time asynchronies between neuronal correlates underlying this frontotemporal network remain unclear and elusive. Our study presented auditory oddball paradigms along with "no-repetition" controls to record mismatch responses in neuronal spiking activity and local field potentials at the rat medial PFC. Whereas mismatch responses in the auditory system are mainly induced by stimulus-dependent effects, we found that auditory responsiveness in the PFC was driven by unpredictability, yielding context-dependent, comparatively delayed, more robust and longer-lasting mismatch responses mostly comprised of prediction error signaling activity. This characteristically different composition discarded that mismatch responses in the PFC could be simply inherited or amplified downstream from the auditory system. Conversely, it is more plausible for the PFC to exert top-down influences on the AC, since the PFC exhibited flexible and potent predictive processing, capable of suppressing redundant input more efficiently than the AC. Remarkably, the time course of the mismatch responses we observed in the spiking activity and local field potentials of the AC and the PFC combined coincided with the time course of the large-scale MMN-like signals reported in the rat brain, thereby linking the microscopic, mesoscopic, and macroscopic levels of automatic deviance detection.

Neuronal activation in the human centromedian-parafascicular complex predicts cortical responses to behaviorally significant auditory events

Studies with non-human primates have suggested an excitatory influence of the thalamus on the cerebral cortex, with the centromedian-parafascicular complex (CM-Pf) being particularly involved in processes of sensory event-driven attention and arousal. To define the involvement of the human CM-Pf in bottom-up and top-down auditory attention, we simultaneously recorded cortical EEG activity and intracranial local field potentials (LFPs) via electrodes implanted for deep brain stimulation for the treatment of neuropathic pain. The patients (N ​= ​6) performed an auditory three-class oddball paradigm with frequent standard stimuli and two types of infrequent deviant stimuli (target and distractor). We found a parietal P3b to targets and a central P3a to distractors at the scalp level. Subcortical recordings in the CM-Pf revealed enhanced activation to targets compared to standards. Interarea-correlation analyses showed that activation in the CM-Pf predicted the generation of longer latency P3b scalp potentials specifically in the target condition. Our results provide first direct human evidence for a functional temporal relationship between target-related activation in the CM-Pf and an enhanced cortical target response. These results corroborate the hypothetical model of a cortico-basal ganglia loop system that switches from top-down to bottom-up mode in response to salient, task-relevant external events that are not predictable.

Auditory deviance detection in the human insula: An intracranial EEG study

The human insula is known to be involved in auditory processing, but knowledge about its precise functional role and the underlying electrophysiology is limited. To assess its role in automatic auditory deviance detection we analyzed the EEG high frequency activity (HFA; 75-145 Hz) and ERPs from 90 intracranial insular channels across 16 patients undergoing pre-surgical intracranial monitoring for epilepsy treatment. Subjects passively listened to a stream of standard and deviant tones differing in four physical dimensions: intensity, frequency, location or time. HFA responses to auditory stimuli were found in the short and long gyri, and the anterior, superior, and inferior segments of the circular sulcus of the insular cortex. Only a subset of channels in the inferior segment of the circular sulcus of the insula showed HFA deviance detection responses, i.e., a greater and longer latency response to specific deviants relative to standards. Auditory deviancy processing was also later in the insula when compared with the superior temporal cortex. ERP results were more widespread and supported the HFA insular findings. These results provide evidence that the human insula is engaged during auditory deviance detection.

Medial Orbitofrontal Cortex, Dorsolateral Prefrontal Cortex, and Hippocampus Differentially Represent the Event Saliency

Two primary functions attributed to the hippocampus and prefrontal cortex (PFC) network are retaining the temporal and spatial associations of events and detecting deviant events. It is unclear, however, how these two functions converge into one mechanism. Here, we tested whether increased activity with perceiving salient events is a deviant detection signal or contains information about the event associations by reflecting the magnitude of deviance (i.e., event saliency). We also tested how the deviant detection signal is affected by the degree of anticipation. We studied regional neural activity when people watched a movie that had varying saliency of a novel or an anticipated flow of salient events. Using intracranial electroencephalography from 10 patients, we observed that high-frequency activity (50-150 Hz) in the hippocampus, dorsolateral PFC, and medial OFC tracked event saliency. We also observed that medial OFC activity was stronger when the salient events were anticipated than when they were novel. These results suggest that dorsolateral PFC and medial OFC, as well as the hippocampus, signify the saliency magnitude of events, reflecting the hierarchical structure of event associations.

A Comparison of Auditory Oddball Responses in Dorsolateral Prefrontal Cortex, Basolateral Amygdala, and Auditory Cortex of Macaque

The mismatch negativity (MMN) is an ERP component seen in response to unexpected "novel" stimuli, such as in an auditory oddball task. The MMN is of wide interest and application, but the neural responses that generate it are poorly understood. This is in part due to differences in design and focus between animal and human oddball paradigms. For example, one of the main explanatory models, the "predictive error hypothesis", posits differences in timing and selectivity between signals carried in auditory and prefrontal cortex (PFC). However, these predictions have not been fully tested because (1) noninvasive techniques used in humans lack the combined spatial and temporal precision necessary for these comparisons and (2) single-neuron studies in animal models, which combine necessary spatial and temporal precision, have not focused on higher order contributions to novelty signals. In addition, accounts of the MMN traditionally do not address contributions from subcortical areas known to be involved in novelty detection, such as the amygdala. To better constrain hypotheses and to address methodological gaps between human and animal studies, we recorded single neuron activity from the auditory cortex, dorsolateral PFC, and basolateral amygdala of two macaque monkeys during an auditory oddball paradigm modeled after that used in humans. Consistent with predictions of the predictive error hypothesis, novelty signals in PFC were generally later than in auditory cortex and were abstracted from stimulus-specific effects seen in auditory cortex. However, we found signals in amygdala that were comparable in magnitude and timing to those in PFC, and both prefrontal and amygdala signals were generally much weaker than those in auditory cortex. These observations place useful quantitative constraints on putative generators of the auditory oddball-based MMN and additionally indicate that there are subcortical areas, such as the amygdala, that may be involved in novelty detection in an auditory oddball paradigm.

Enhanced transformation of incidentally learned knowledge into explicit memory by dopaminergic modulation

During incidental learning statistical regularities are extracted from the environment without the intention to learn. Acquired implicit memory of these regularities can affect behavior in the absence of awareness. However, conscious insight in the underlying regularities can also develop during learning. Such emergence of explicit memory is an important learning mechanism that is assumed to involve prediction errors in the striatum and to be dopamine-dependent. Here we directly tested this hypothesis by manipulating dopamine levels during incidental learning in a modified serial reaction time task (SRTT) featuring a hidden regular sequence of motor responses in a placebo-controlled between-group study. Awareness for the sequential regularity was subsequently assessed using cued generation and additionally verified using free recall. The results demonstrated that dopaminergic modulation nearly doubled the amount of explicit sequence knowledge emerged during learning in comparison to the placebo group. This strong effect clearly argues for a causal role of dopamine-dependent processing for the development of awareness for sequential regularities during learning.

The emotional power of poetry: neural circuitry, psychophysiology and compositional principles

It is a common experience-and well established experimentally-that music can engage us emotionally in a compelling manner. The mechanisms underlying these experiences are receiving increasing scrutiny. However, the extent to which other domains of aesthetic experience can similarly elicit strong emotions is unknown. Using psychophysiology, neuroimaging and behavioral responses, we show that recited poetry can act as a powerful stimulus for eliciting peak emotional responses, including chills and objectively measurable goosebumps that engage the primary reward circuitry. Importantly, while these responses to poetry are largely analogous to those found for music, their neural underpinnings show important differences, specifically with regard to the crucial role of the nucleus accumbens. We also go beyond replicating previous music-related studies by showing that peak aesthetic pleasure can co-occur with physiological markers of negative affect. Finally, the distribution of chills across the trajectory of poems provides insight into compositional principles of poetry.

Deep brain stimulation of the nucleus basalis of Meynert attenuates early EEG components associated with defective sensory gating in patients with Alzheimer disease - a two-case study

Alzheimer's disease (AD) is associated with deterioration of memory and cognitive function and a degeneration of neurons of the nucleus basalis of Meynert (NBM). The NBM is the major input source of acetylcholine (ACh) to the cortex. The decreasing cholinergic innervation of the cortex due to degeneration of the NBM might be the cause of loss of memory function. NBM-Deep brain stimulation (NBM-DBS) is considered to serve as a potential therapeutic option for patients with AD by supporting residual cholinergic transmission to stabilize oscillatory activity in memory-relevant circuits. However, whether DBS could improve sensory memory functions in patients with AD is not clear. Here, in a passive auditory oddball paradigm, patients with AD (N = 2) listened to repetitive background tones (standard tones) randomly interrupted by frequency deviants in two blocks with NBM-DBS OFF and then NBM-DBS ON, while age-matched healthy controls (N = 6) repeated the experiment twice. The mismatch negativity in NBM-DBS OFF significantly differed from controls in both blocks, but not under NBM-DBS, which was likely due to a pronounced P50 increase overlapping with the N1 in NBM-DBS OFF. This early complex of EEG components recovered under stimulation to a normal level as defined by responses in controls. In this temporal interval, we found in patients with NBM-DBS ON (but not with NBM-DBS OFF) and in controls a strong repetition suppression effect to standard tones - with more attenuated responses to frequently repeated standard tones. This highlights the role of NBM-DBS for sensory gating of familiar auditory information into sensory memory.

Thalamic and basal ganglia regions are involved in attentional processing of behaviorally significant events: evidence from simultaneous depth and scalp EEG

Extensive descriptions exist on cortical responses to change in the acoustic environment. However, the involvement of subcortical regions is not well understood. Here we present simultaneous recordings of cortical and subcortical event-related potentials (ERPs) to different pure tones in patients undergoing surgery for deep brain stimulation (DBS). These patients had externalized electrodes in the subthalamic nucleus (STN), the ventrolateral posterior thalamus (VLp) or the globus pallidus internus (GPi). Subcortical and cortical ERPs were analyzed upon presentation of one frequent non-target stimulus and two infrequent stimuli, either being a target or a distractor stimulus. The results revealed that amplitudes of scalp-recorded P3 and subcortical late attention-modulated responses (AMR) were largest upon presentation of target stimuli compared with distractor stimuli. This suggests that thalamic and basal ganglia regions are sensitive to behaviorally relevant auditory events. Comparison of the subcortical structures showed that responses in VLp have shorter latency than in GPi and STN. Further, the subcortical responses in VLp and STN emerged significantly prior to the cortical P3 response. Our findings point to higher-order cognitive functions already at a subcortical level. Auditory events are categorized as behaviorally relevant in subcortical loops involving basal ganglia and thalamic regions. This label is then distributed to cortical regions by ascending projections.

Human subthalamic nucleus - Automatic auditory change detection as a basis for action selection

The subthalamic nucleus (STN) shapes motor behavior and is important for the initiation and termination of movements. Here we ask whether the STN takes aggregated sensory information into account, in order to exert this function. To this end, local field potentials (LFP) were recorded in eight patients suffering from Parkinson's disease and receiving deep-brain stimulation of the STN bilaterally. Bipolar recordings were obtained postoperatively from the externalized electrode leads. Patients were passively exposed to trains of auditory stimuli containing global deviants, local deviants or combined global/local deviants. The surface event-related potentials of the Parkinson's patients as well as those of 19 age-matched healthy controls were characterized by a mismatch negativity (MMN) that was most pronounced for the global/local double deviants and less prominent for the other deviant conditions. The left and right STN LFPs similarly were modulated by stimulus deviance starting at about 100ms post-stimulus onset. The MMN has been viewed as an index of an automatic auditory change detection system, more recently phrased in terms of predictive coding theory, which prepares the organism for attention shifts and for action. The LFP-data from the STN clearly demonstrate that the STN receives information on stimulus deviance, possibly as a means to bias the system to interrupt ongoing and to allow alternative actions.

Brain and Emotion

Progress in understanding the relation between brain profiles and emotions is being slowed by the belief in a collection of basic emotional states, with the names: fear, anger, joy, disgust, and sadness, that do not specify the species or age of the experiencing agent, the origin of the state, or the evidence used to infer it. This article evaluates critically the premise that decontextualized emotional words refer to natural kinds. It also suggests that investigators set aside the currently popular words and search for relations, in humans and animals, between patterns of measures to varied incentives presented in distinctive contexts.

Contributions of the Ventral Striatum to Conscious Perception: An Intracranial EEG Study of the Attentional Blink

The brain is limited in its capacity to consciously process information, necessitating gating of information. While conscious perception is robustly associated with sustained, recurrent interactions between widespread cortical regions, subcortical regions, including the striatum, influence cortical activity. Here, we examined whether the ventral striatum, given its ability to modulate cortical information flow, contributes to conscious perception. Using intracranial EEG, we recorded ventral striatum activity while 7 patients performed an attentional blink task in which they had to detect two targets (T1 and T2) in a stream of distractors. Typically, when T2 follows T1 within 100-500 ms, it is often not perceived (i.e., the attentional blink). We found that conscious T2 perception was influenced and signaled by ventral striatal activity. Specifically, the failure to perceive T2 was foreshadowed by a T1-induced increase in α and low β oscillatory activity as early as 80 ms after T1, indicating that the attentional blink to T2 may be due to very early T1-driven attentional capture. Moreover, only consciously perceived targets were associated with an increase in θ activity between 200 and 400 ms. These unique findings shed new light on the mechanisms that give rise to the attentional blink by revealing that conscious target perception may be determined by T1 processing at a much earlier processing stage than traditionally believed. More generally, they indicate that ventral striatum activity may contribute to conscious perception, presumably by gating cortical information flow.

SIGNIFICANCE STATEMENT

What determines whether we become aware of a piece of information or not? Conscious access has been robustly associated with activity within a distributed network of cortical regions. Using intracranial electrophysiological recordings during an attentional blink task, we tested the idea that the ventral striatum, because of its ability to modulate cortical information flow, may contribute to conscious perception. We find that conscious perception is influenced and signaled by ventral striatal activity. Short-latency (80-140 ms) striatal responses to a first target determined conscious perception of a second target. Moreover, conscious perception of the second target was signaled by longer-latency (200-400 ms) striatal activity. These results suggest that the ventral striatum may be part of a subcortical network that influences conscious experience.