Flexible information coding in human auditory cortex during perception, imagery, and STM of complex sounds

Decoding reveals the neural representation of held and manipulated musical thoughts

Imagine a song you know by heart. With little effort you could sing it or play it vividly in your mind. However, we are only beginning to understand how the brain represents, holds, and manipulates these musical "thoughts". Here, we decoded listened and imagined melodies from MEG brain data (N = 71) to show that auditory regions represent the sensory properties of individual sounds, whereas cognitive control (prefrontal cortex, basal nuclei, thalamus) and episodic memory areas (inferior and medial temporal lobe, posterior cingulate, precuneus) hold and manipulate the melody as an abstract unit. Furthermore, the mental manipulation of a melody systematically changes its neural representation, reflecting the volitional control of auditory images. Our work sheds light on the nature and dynamics of auditory representations and paves the way for future work on neural decoding of auditory imagination.

Humans, fish, spiders and bees inherited working memory and attention from their last common ancestor

All brain processes that generate behaviour, apart from reflexes, operate with information that is in an "activated" state. This activated information, which is known as working memory (WM), is generated by the effect of attentional processes on incoming information or information previously stored in short-term or long-term memory (STM or LTM). Information in WM tends to remain the focus of attention; and WM, attention and STM together enable information to be available to mental processes and the behaviours that follow on from them. WM and attention underpin all flexible mental processes, such as solving problems, making choices, preparing for opportunities or threats that could be nearby, or simply finding the way home. Neither WM nor attention are necessarily conscious, and both may have evolved long before consciousness. WM and attention, with similar properties, are possessed by humans, archerfish, and other vertebrates; jumping spiders, honey bees, and other arthropods; and members of other clades, whose last common ancestor (LCA) is believed to have lived more than 600 million years ago. It has been reported that very similar genes control the development of vertebrate and arthropod brains, and were likely inherited from their LCA. Genes that control brain development are conserved because brains generate adaptive behaviour. However, the neural processes that generate behaviour operate with the activated information in WM, so WM and attention must have existed prior to the evolution of brains. It is proposed that WM and attention are widespread amongst animal species because they are phylogenetically conserved mechanisms that are essential to all mental processing, and were inherited from the LCA of vertebrates, arthropods, and some other animal clades.

The confound of head position in within-session connectome fingerprinting in infants

Individuals differ in their functional connectome, which can be demonstrated using a "fingerprinting" analysis in which the connectome from an individual in one dataset is used to identify the same person from an independent dataset. Recently, the origin of these fingerprints has been studied by examining if they are present in infants. The results have varied considerably, with identification rates from 10 to 90%. When fingerprinting has been performed by splitting a single imaging session into two split-sessions (within session), identification rates were higher than when two full-sessions (between sessions) were compared. This study examined whether a methodological difference could account for this variation. It was hypothesized that the infant's exact head position in the head coil may affect the measured connectome, due to the gradual inhomogeneity of signal-to-noise in phased-array coils and the breadth of possible positions for a small infant head in a head coil. This study examined the impact of this using resting state functional MRI data from the Developing Human Connectome Project second release. Using functional timeseries, fingerprinting identification was high (84-91%) within a session while between sessions it was low (7%).Using N = 416 infants' head positions, a map of the average signal-to-noise across the physical volume of the head coil was calculated and was used (independent group of 44 infants with two scan sessions) to demonstrate a significant relationship between head position in the head coil and functional connectivity. Using only the head positions (signal-to-noise values extrapolated from the group average map) of the independent group of 44 infants, high identification success was achieved across split-sessions (within session) but not full-sessions (between sessions). Using a model examining factors influencing the stability of the functional connectome, head position was seen as the strongest of the explanatory variables. We conclude within-session fingerprinting is affected by head position and future infant functional fingerprint analyses must use a different strategy or account for this impact.

The neural coding of tonal working memory load: An functional magnetic resonance imaging study

Tonal working memory load refers to the number of pitches held in working memory. It has been found that different verbal working memory loads have different neural coding (local neural activity pattern). However, whether there exists a comparable phenomenon for tonal working memory load remains unclear. In this study, we used a delayed match-to-sample paradigm to evoke tonal working memory. Neural coding of different tonal working memory loads was studied with a surface space and convolution neural network (CNN)-based multivariate pattern analysis (SC-MVPA) method. We found that first, neural coding of tonal working memory was significantly different from that of the control condition in the bilateral superior temporal gyrus (STG), supplement motor area (SMA), and precentral gyrus (PCG). Second, neural coding of nonadjacent tonal working memory loads was distinguishable in the bilateral STG and PCG. Third, neural coding is gradually enhanced as the memory load increases. Finally, neural coding of tonal working memory was encoded in the bilateral STG in the encoding phase and shored in the bilateral PCG and SMA in the maintenance phase.

Distributed networks for auditory memory differentially contribute to recall precision

Re-directing attention to objects in working memory can enhance their representational fidelity. However, how this attentional enhancement of memory representations is implemented across distinct, sensory and cognitive-control brain network is unspecified. The present fMRI experiment leverages psychophysical modelling and multivariate auditory-pattern decoding as behavioral and neural proxies of mnemonic fidelity. Listeners performed an auditory syllable pitch-discrimination task and received retro-active cues to selectively attend to a to-be-probed syllable in memory. Accompanied by increased neural activation in fronto-parietal and cingulo-opercular networks, valid retro-cues yielded faster and more perceptually sensitive responses in recalling acoustic detail of memorized syllables. Information about the cued auditory object was decodable from hemodynamic response patterns in superior temporal sulcus (STS), fronto-parietal, and sensorimotor regions. However, among these regions retaining auditory memory objects, neural fidelity in the left STS and its enhancement through attention-to-memory best predicted individuals' gain in auditory memory recall precision. Our results demonstrate how functionally discrete brain regions differentially contribute to the attentional enhancement of memory representations.

Mapping Specific Mental Content during Musical Imagery

Humans can mentally represent auditory information without an external stimulus, but the specificity of these internal representations remains unclear. Here, we asked how similar the temporally unfolding neural representations of imagined music are compared to those during the original perceived experience. We also tested whether rhythmic motion can influence the neural representation of music during imagery as during perception. Participants first memorized six 1-min-long instrumental musical pieces with high accuracy. Functional MRI data were collected during: 1) silent imagery of melodies to the beat of a visual metronome; 2) same but while tapping to the beat; and 3) passive listening. During imagery, inter-subject correlation analysis showed that melody-specific temporal response patterns were reinstated in right associative auditory cortices. When tapping accompanied imagery, the melody-specific neural patterns were reinstated in more extensive temporal-lobe regions bilaterally. These results indicate that the specific contents of conscious experience are encoded similarly during imagery and perception in the dynamic activity of auditory cortices. Furthermore, rhythmic motion can enhance the reinstatement of neural patterns associated with the experience of complex sounds, in keeping with models of motor to sensory influences in auditory processing.

Motor Planning Modulates Neural Activity Patterns in Early Human Auditory Cortex

It is well established that movement planning recruits motor-related cortical brain areas in preparation for the forthcoming action. Given that an integral component to the control of action is the processing of sensory information throughout movement, we predicted that movement planning might also modulate early sensory cortical areas, readying them for sensory processing during the unfolding action. To test this hypothesis, we performed 2 human functional magnetic resonance imaging studies involving separate delayed movement tasks and focused on premovement neural activity in early auditory cortex, given the area's direct connections to the motor system and evidence that it is modulated by motor cortex during movement in rodents. We show that effector-specific information (i.e., movements of the left vs. right hand in Experiment 1 and movements of the hand vs. eye in Experiment 2) can be decoded, well before movement, from neural activity in early auditory cortex. We find that this motor-related information is encoded in a separate subregion of auditory cortex than sensory-related information and is present even when movements are cued visually instead of auditorily. These findings suggest that action planning, in addition to preparing the motor system for movement, involves selectively modulating primary sensory areas based on the intended action.

The causal role of auditory cortex in auditory working memory

Working memory (WM), the ability to actively hold information in memory over a delay period of seconds, is a fundamental constituent of cognition. Delay-period activity in sensory cortices has been observed in WM tasks, but whether and when the activity plays a functional role for memory maintenance remains unclear. Here, we investigated the causal role of auditory cortex (AC) for memory maintenance in mice performing an auditory WM task. Electrophysiological recordings revealed that AC neurons were active not only during the presentation of the auditory stimulus but also early in the delay period. Furthermore, optogenetic suppression of neural activity in AC during the stimulus epoch and early delay period impaired WM performance, whereas suppression later in the delay period did not. Thus, AC is essential for information encoding and maintenance in auditory WM task, especially during the early delay period.

Decoding Spatial Versus Non-spatial Processing in Auditory Working Memory

Objective

Research on visual working memory has shown that individual stimulus features are processed in both specialized sensory regions and higher cortical areas. Much less evidence exists for auditory working memory. Here, a main distinction has been proposed between the processing of spatial and non-spatial sound features. Our aim was to examine feature-specific activation patterns in auditory working memory.

Methods

We collected fMRI data while 28 healthy adults performed an auditory delayed match-to-sample task. Stimuli were abstract sounds characterized by both spatial and non-spatial information, i.e., interaural time delay and central frequency, respectively. In separate recording blocks, subjects had to memorize either the spatial or non-spatial feature, which had to be compared with a probe sound presented after a short delay. We performed both univariate and multivariate comparisons between spatial and non-spatial task blocks.

Results

Processing of spatial sound features elicited a higher activity in a small cluster in the superior parietal lobe than did sound pattern processing, whereas there was no significant activation difference for the opposite contrast. The multivariate analysis was applied using a whole-brain searchlight approach to identify feature-selective processing. The task-relevant auditory feature could be decoded from multiple brain regions including the auditory cortex, posterior temporal cortex, middle occipital gyrus, and extended parietal and frontal regions.

Conclusion

In summary, the lack of large univariate activation differences between spatial and non-spatial processing could be attributable to the identical stimulation in both tasks. In contrast, the whole-brain multivariate analysis identified feature-specific activation patterns in widespread cortical regions. This suggests that areas beyond the auditory dorsal and ventral streams contribute to working memory processing of auditory stimulus features.

Decoding verbal working memory representations of Chinese characters from Broca's area

Representations of sensory working memory can be found across the entire neocortex. But how are verbal working memory (VWM) contents retained in the human brain? Here we used fMRI and multi-voxel pattern analyses to study Chinese native speakers (15 males, 13 females) memorizing Chinese characters. Chinese characters are uniquely suitable to study VWM because verbal encoding is encouraged by their complex visual appearance and monosyllabic pronunciation. We found that activity patterns in Broca's area and left premotor cortex carried information about the memorized characters. These language-related areas carried (1) significantly more information about cued characters than those not cued for memorization, (2) significantly more information on the left than the right hemisphere and (3) significantly more information about Chinese symbols than complex visual patterns which are hard to verbalize. In contrast, early visual cortex carries a comparable amount of information about cued and uncued stimuli and is thus unlikely to be involved in memory retention. This study provides evidence for verbal working memory maintenance in a distributed network of language-related brain regions, consistent with distributed accounts of WM. The results also suggest that Broca's area and left premotor cortex form the articulatory network which serves articulatory rehearsal in the retention of verbal working memory contents.

Oscillatory correlates of auditory working memory examined with human electrocorticography

This work examines how sounds are held in auditory working memory (AWM) in humans by examining oscillatory local field potentials (LFPs) in candidate brain regions. Previous fMRI studies by our group demonstrated blood oxygenation level-dependent (BOLD) response increases during maintenance in auditory cortex, inferior frontal cortex and the hippocampus using a paradigm with a delay period greater than 10s. The relationship between such BOLD changes and ensemble activity in different frequency bands is complex, and the long delay period raised the possibility that long-term memory mechanisms were engaged. Here we assessed LFPs in different frequency bands in six subjects with recordings from all candidate brain regions using a paradigm with a short delay period of 3 s. Sustained delay activity was demonstrated in all areas, with different patterns in the different areas. Enhancement in low frequency (delta) power and suppression across higher frequencies (beta/gamma) were demonstrated in primary auditory cortex in medial Heschl’s gyrus (HG) whilst non-primary cortex showed patterns of enhancement and suppression that altered at different levels of the auditory hierarchy from lateral HG to superior- and middle-temporal gyrus. Inferior frontal cortex showed increasing suppression with increasing frequency. The hippocampus and parahippocampal gyrus showed low frequency increases and high frequency decreases in oscillatory activity. This work demonstrates sustained activity patterns during AWM maintenance, with prominent low-frequency increases in medial temporal lobe regions.

•

Local field potentials recorded in humans while they keep sound in working memory.

•

Sustained increase in delta power observed in primary auditory cortex.

•

Pattern of change in power in non-primary cortex depends on the hierarchical level.

•

Hippocampus and parahippocampus showed increase in low frequency power.

Structural Neural Correlates of Double Decision Performance in Older Adults

Speed of processing is a cognitive domain that encompasses the speed at which an individual can perceive a given stimulus, interpret the information, and produce a correct response. Speed of processing has been shown to decline more rapidly than other cognitive domains in an aging population, suggesting that this domain is particularly vulnerable to cognitive aging (Chee et al., 2009). However, given the heterogeneity of neuropsychological measures used to assess the domains underpinning speed of processing, a diffuse pattern of brain regions has been implicated. The current study aims to investigate the structural neural correlates of speed of processing by assessing cortical volume and speed of processing scores on the POSIT Double Decision task within a healthy older adult population (N = 186; mean age = 71.70 ± 5.32 years). T1-weighted structural images were collected via a 3T Siemens scanner. The current study shows that less cortical thickness in right temporal, posterior frontal, parietal and occipital lobe structures were significantly associated with poorer Double Decision scores. Notably, these include the lateral orbitofrontal gyrus, precentral gyrus, superior, transverse, and inferior temporal gyrus, temporal pole, insula, parahippocampal gyrus, fusiform gyrus, lingual gyrus, superior and inferior parietal gyrus and lateral occipital gyrus. Such findings suggest that speed of processing performance is associated with a wide array of cortical regions that provide unique contributions to performance on the Double Decision task.

An investigation of the neural association between auditory imagery and perception of complex sounds

Neuroimaging studies have demonstrated that mental imagery and perception share similar neural substrates, however, there are still ambiguities according to different auditory imagery content. In addition, there is still a lack of information regarding the underlying neural correlation between the two modalities. In the present study, we adopted functional magnetic resonance imaging to explore the neural representation during imagery and perception of actual sounds in our surroundings. Univariate analysis was used to assess the differences between the modalities of average activation intensity, and stronger imagery activation was found in sensorimotor regions but weaker activation in auditory association cortices. Additionally, multi-voxel pattern analysis with a support vector machine classifier was implemented to decode environmental sounds within- or cross-modality. Significant above-chance accuracies were found in all overlapping regions in the classification of within-modality, while successful cross-modality classification only was found in sensorimotor regions. Both univariate and multivariate analyses found distinct representation between auditory imagery and perception in the overlapping regions, including superior temporal gyrus and inferior frontal sulcus as well as the precentral cortex and pre-supplementary motor area. Our results confirm the overlapping activation regions between auditory imagery and perception reported by previous studies and suggest that activation regions showed dissociable representation pattern in imagery and perception of sound categories.

Interaction of the effects associated with auditory-motor integration and attention-engaging listening tasks

A number of previous studies have implicated regions in posterior auditory cortex (AC) in auditory-motor integration during speech production. Other studies, in turn, have shown that activation in AC and adjacent regions in the inferior parietal lobule (IPL) is strongly modulated during active listening and depends on task requirements. The present fMRI study investigated whether auditory-motor effects interact with those related to active listening tasks in AC and IPL. In separate task blocks, our subjects performed either auditory discrimination or 2-back memory tasks on phonemic or nonphonemic vowels. They responded to targets by either overtly repeating the last vowel of a target pair, overtly producing a given response vowel, or by pressing a response button. We hypothesized that the requirements for auditory-motor integration, and the associated activation, would be stronger during repetition than production responses and during repetition of nonphonemic than phonemic vowels. We also hypothesized that if auditory-motor effects are independent of task-dependent modulations, then the auditory-motor effects should not differ during discrimination and 2-back tasks. We found that activation in AC and IPL was significantly modulated by task (discrimination vs. 2-back), vocal-response type (repetition vs. production), and motor-response type (vocal vs. button). Motor-response and task effects interacted in IPL but not in AC. Overall, the results support the view that regions in posterior AC are important in auditory-motor integration. However, the present study shows that activation in wide AC and IPL regions is modulated by the motor requirements of active listening tasks in a more general manner. Further, the results suggest that activation modulations in AC associated with attention-engaging listening tasks and those associated with auditory-motor performance are mediated by independent mechanisms.

Content-specific codes of parametric auditory working memory in humans

Brain activity in frontal regions has been found to represent frequency information with a parametric code during working memory delay phases. The mental representation of frequencies has furthermore been shown to be modality independent in non-human primate electrophysiology and human EEG studies, suggesting frontal regions encoding quantitative information in a supramodal manner. A recent fMRI study using multivariate pattern analysis (MVPA) supports an overlapping multimodal network for the maintenance of visual and tactile frequency information over frontal and parietal brain regions. The present study extends the investigation of working memory representation of frequency information to the auditory domain. To this aim, we used MVPA on fMRI data recorded during an auditory frequency maintenance task. A support vector regression analysis revealed working memory information in auditory association areas and, consistent with earlier findings of parametric working memory, in a frontoparietal network. A direct comparison to an analogous dataset of vibrotactile parametric working memory revealed an overlap of information coding in prefrontal regions, particularly in the right inferior frontal gyrus. Therefore, our findings indicate that the prefrontal cortex represents frequency-specific working memory content irrespective of the modality as has been now also revealed for the auditory modality.

Temporal Expectation Modulates the Cortical Dynamics of Short-Term Memory

Increased memory load is often signified by enhanced neural oscillatory power in the alpha range (8-13 Hz), which is taken to reflect inhibition of task-irrelevant brain regions. The corresponding neural correlates of memory decay, however, are not yet well understood. In the current study, we investigated auditory short-term memory decay in humans using a delayed matching-to-sample task with pure-tone sequences. First, in a behavioral experiment, we modeled memory performance over six different delay-phase durations. Second, in a MEG experiment, we assessed alpha-power modulations over three different delay-phase durations. In both experiments, the temporal expectation for the to-be-remembered sound was manipulated so that it was either temporally expected or not. In both studies, memory performance declined over time, but this decline was weaker when the onset time of the to-be-remembered sound was expected. Similarly, patterns of alpha power in and alpha-tuned connectivity between sensory cortices changed parametrically with delay duration (i.e., decrease in occipitoparietal regions, increase in temporal regions). Temporal expectation not only counteracted alpha-power decline in heteromodal brain areas (i.e., supramarginal gyrus), but also had a beneficial effect on memory decay, counteracting memory performance decline. Correspondingly, temporal expectation also boosted alpha connectivity within attention networks known to play an active role during memory maintenance. The present data show how patterns of alpha power orchestrate short-term memory decay and encourage a more nuanced perspective on alpha power across brain space and time beyond its inhibitory role.SIGNIFICANCE STATEMENT Our sensory memories of the physical world fade quickly. We show here that this decay of short-term memory can be counteracted by so-called temporal expectation; that is, knowledge of when to expect a sensory event that an individual must remember. We also show that neural oscillations in the "alpha" (8-13 Hz) range index both the degree of memory decay (for brief sound patterns) and the respective memory benefit from temporal expectation. Spatially distributed cortical patterns of alpha power show opposing effects in auditory versus visual sensory cortices. Moreover, alpha-tuned connectivity changes within supramodal attention networks reflect the allocation of neural resources as short-term memory representations fade.

Evidence for a neural signature of musical preference during silence

One of the most basic and person-specific affective responses to music is liking. The present investigation sought to determine whether liking was preserved during spontaneous auditory imagery. To this purpose, we inserted two-second silent intervals into liked and disliked songs, a method known to automatically recreate a mental image of these songs. Neural correlates of musical preference were measured by high-density electroencephalography in twenty subjects who had to listen to a set of five pre-selected unknown songs the same number of times for two weeks. Time frequency analysis of the two most liked and the two most disliked songs confirmed the presence of neural responses related to liking. At the beginning of silent intervals (400-900 ms and 1000-1300 ms), significant differences in theta activity were originating from the inferior frontal and superior temporal gyrus. These two brain structures are known to work together to process various aspects of music and are also activated when measuring liking while listening to music. At the end of silent intervals (1400-1900 ms), significant alpha activity differences originating from the insula were observed, whose exact role remains to be explored. Although exposure was controlled for liked and disliked songs, liked songs were rated as more familiar, underlying the strong relationship that exists between liking, exposure, and familiarity.

Musical Imagery Involves Wernicke's Area in Bilateral and Anti-Correlated Network Interactions in Musicians

Musical imagery is the human experience of imagining music without actually hearing it. The neural basis of this mental ability is unclear, especially for musicians capable of engaging in accurate and vivid musical imagery. Here, we created a visualization of an 8-minute symphony as a silent movie and used it as real-time cue for musicians to continuously imagine the music for repeated and synchronized sessions during functional magnetic resonance imaging (fMRI). The activations and networks evoked by musical imagery were compared with those elicited by the subjects directly listening to the same music. Musical imagery and musical perception resulted in overlapping activations at the anterolateral belt and Wernicke’s area, where the responses were correlated with the auditory features of the music. Whereas Wernicke’s area interacted within the intrinsic auditory network during musical perception, it was involved in much more complex networks during musical imagery, showing positive correlations with the dorsal attention network and the motor-control network and negative correlations with the default-mode network. Our results highlight the important role of Wernicke’s area in forming vivid musical imagery through bilateral and anti-correlated network interactions, challenging the conventional view of segregated and lateralized processing of music versus language.

Spatiotemporal brain dynamics supporting the immediate automatization of inhibitory control by implementation intentions

While cognitive interventions aiming at reinforcing intentional executive control of unwanted response showed only modest effects on impulse control disorders, the establishment of fast automatic, stimulus-driven inhibition of responses to specific events with implementation intention self-regulation strategies has proven to be an effective remediation approach. However, the neurocognitive mechanisms underlying implementation intentions remain largely unresolved. We addressed this question by comparing electrical neuroimaging analyses of event-related potentials recorded during a Go/NoGo task between groups of healthy participants receiving either standard or implementation intentions instructions on the inhibition stimuli. Inhibition performance improvements with implementation intentions were associated with a Group by Stimulus interaction 200–250 ms post-stimulus onset driven by a selective decrease in response to the inhibition stimuli within the left superior temporal gyrus, the right precuneus and the right temporo-parietal junction. We further observed that the implementation intentions group showed already at the beginning of the task the pattern of task-related functional activity reached after practice in the group having received standard instructions. We interpret our results in terms of an immediate establishment of an automatic, bottom-up form of inhibitory control by implementation intentions, supported by stimulus-driven retrieval of verbally encoded stimulus-response mapping rules, which in turn triggered inhibitory processes.

A roadmap for the study of conscious audition and its neural basis

How and which aspects of neural activity give rise to subjective perceptual experience-i.e. conscious perception-is a fundamental question of neuroscience. To date, the vast majority of work concerning this question has come from vision, raising the issue of generalizability of prominent resulting theories. However, recent work has begun to shed light on the neural processes subserving conscious perception in other modalities, particularly audition. Here, we outline a roadmap for the future study of conscious auditory perception and its neural basis, paying particular attention to how conscious perception emerges (and of which elements or groups of elements) in complex auditory scenes. We begin by discussing the functional role of the auditory system, particularly as it pertains to conscious perception. Next, we ask: what are the phenomena that need to be explained by a theory of conscious auditory perception? After surveying the available literature for candidate neural correlates, we end by considering the implications that such results have for a general theory of conscious perception as well as prominent outstanding questions and what approaches/techniques can best be used to address them.This article is part of the themed issue 'Auditory and visual scene analysis'.

Language in Context: MEG Evidence for Modality-General and -Specific Responses to Reference Resolution

Successful language comprehension critically depends on our ability to link linguistic expressions to the entities they refer to. Without reference resolution, newly encountered language cannot be related to previously acquired knowledge. The human experience includes many different types of referents, some visual, some auditory, some very abstract. Does the neural basis of reference resolution depend on the nature of the referents, or do our brains use a modality-general mechanism for linking meanings to referents? Here we report evidence for both. Using magnetoencephalography (MEG), we varied both the modality of referents, which consisted either of visual or auditory objects, and the point at which reference resolution was possible within sentences. Source-localized MEG responses revealed brain activity associated with reference resolution that was independent of the modality of the referents, localized to the medial parietal lobe and starting ∼415 ms after the onset of reference resolving words. A modality-specific response to reference resolution in auditory domains was also found, in the vicinity of auditory cortex. Our results suggest that referential language processing cannot be reduced to processing in classical language regions and representations of the referential domain in modality-specific neural systems. Instead, our results suggest that reference resolution engages medial parietal cortex, which supports a mechanism for referential processing regardless of the content modality.

Uses, misuses, new uses and fundamental limitations of magnetic resonance imaging in cognitive science

When blood oxygenation level-dependent (BOLD) contrast functional magnetic resonance imaging (fMRI) was discovered in the early 1990s, it provoked an explosion of interest in exploring human cognition, using brain mapping techniques based on MRI. Standards for data acquisition and analysis were rapidly put in place, in order to assist comparison of results across laboratories. Recently, MRI data acquisition capabilities have improved dramatically, inviting a rethink of strategies for relating functional brain activity at the systems level with its neuronal substrates and functional connections. This paper reviews the established capabilities of BOLD contrast fMRI, the perceived weaknesses of major methods of analysis, and current results that may provide insights into improved brain modelling. These results have inspired the use of in vivo myeloarchitecture for localizing brain activity, individual subject analysis without spatial smoothing and mapping of changes in cerebral blood volume instead of BOLD activation changes. The apparent fundamental limitations of all methods based on nuclear magnetic resonance are also discussed.This article is part of the themed issue 'Interpreting BOLD: a dialogue between cognitive and cellular neuroscience'.

A Brain System for Auditory Working Memory

The brain basis for auditory working memory, the process of actively maintaining sounds in memory over short periods of time, is controversial. Using functional magnetic resonance imaging in human participants, we demonstrate that the maintenance of single tones in memory is associated with activation in auditory cortex. In addition, sustained activation was observed in hippocampus and inferior frontal gyrus. Multivoxel pattern analysis showed that patterns of activity in auditory cortex and left inferior frontal gyrus distinguished the tone that was maintained in memory. Functional connectivity during maintenance was demonstrated between auditory cortex and both the hippocampus and inferior frontal cortex. The data support a system for auditory working memory based on the maintenance of sound-specific representations in auditory cortex by projections from higher-order areas, including the hippocampus and frontal cortex.

SIGNIFICANCE STATEMENT

In this work, we demonstrate a system for maintaining sound in working memory based on activity in auditory cortex, hippocampus, and frontal cortex, and functional connectivity among them. Specifically, our work makes three advances from the previous work. First, we robustly demonstrate hippocampal involvement in all phases of auditory working memory (encoding, maintenance, and retrieval): the role of hippocampus in working memory is controversial. Second, using a pattern classification technique, we show that activity in the auditory cortex and inferior frontal gyrus is specific to the maintained tones in working memory. Third, we show long-range connectivity of auditory cortex to hippocampus and frontal cortex, which may be responsible for keeping such representations active during working memory maintenance.

Persistent neural activity in auditory cortex is related to auditory working memory in humans and nonhuman primates

Working memory is the cognitive capacity of short-term storage of information for goal-directed behaviors. Where and how this capacity is implemented in the brain are unresolved questions. We show that auditory cortex stores information by persistent changes of neural activity. We separated activity related to working memory from activity related to other mental processes by having humans and monkeys perform different tasks with varying working memory demands on the same sound sequences. Working memory was reflected in the spiking activity of individual neurons in auditory cortex and in the activity of neuronal populations, that is, in local field potentials and magnetic fields. Our results provide direct support for the idea that temporary storage of information recruits the same brain areas that also process the information. Because similar activity was observed in the two species, the cellular bases of some auditory working memory processes in humans can be studied in monkeys.

Auditory short-term memory in the primate auditory cortex

Sounds are fleeting, and assembling the sequence of inputs at the ear into a coherent percept requires auditory memory across various time scales. Auditory short-term memory comprises at least two components: an active ׳working memory' bolstered by rehearsal, and a sensory trace that may be passively retained. Working memory relies on representations recalled from long-term memory, and their rehearsal may require phonological mechanisms unique to humans. The sensory component, passive short-term memory (pSTM), is tractable to study in nonhuman primates, whose brain architecture and behavioral repertoire are comparable to our own. This review discusses recent advances in the behavioral and neurophysiological study of auditory memory with a focus on single-unit recordings from macaque monkeys performing delayed-match-to-sample (DMS) tasks. Monkeys appear to employ pSTM to solve these tasks, as evidenced by the impact of interfering stimuli on memory performance. In several regards, pSTM in monkeys resembles pitch memory in humans, and may engage similar neural mechanisms. Neural correlates of DMS performance have been observed throughout the auditory and prefrontal cortex, defining a network of areas supporting auditory STM with parallels to that supporting visual STM. These correlates include persistent neural firing, or a suppression of firing, during the delay period of the memory task, as well as suppression or (less commonly) enhancement of sensory responses when a sound is repeated as a ׳match' stimulus. Auditory STM is supported by a distributed temporo-frontal network in which sensitivity to stimulus history is an intrinsic feature of auditory processing. This article is part of a Special Issue entitled SI: Auditory working memory.

Don't forget the lyrics! Spatiotemporal dynamics of neural mechanisms spontaneously evoked by gaps of silence in familiar and newly learned songs

The vast majority of people experience musical imagery, the sensation of reliving a song in absence of any external stimulation. Internal perception of a song can be deliberate and effortful, but also may occur involuntarily and spontaneously. Moreover, musical imagery is also involuntarily used for automatically completing missing parts of music or lyrics from a familiar song. The aim of our study was to explore the onset of musical imagery dynamics that leads to the automatic completion of missing lyrics. High-density electroencephalography was used to record the cerebral activity of twenty healthy volunteers while they were passively listening to unfamiliar songs, very familiar songs, and songs previously listened to for two weeks. Silent gaps inserted into these songs elicited a series of neural activations encompassing perceptual, attentional and cognitive mechanisms (range 100-500ms). Familiarity and learning effects emerged as early as 100ms and lasted 400ms after silence occurred. Although participants reported more easily mentally imagining lyrics in familiar rather than passively learnt songs, the onset of neural mechanisms and the power spectrum underlying musical imagery were similar for both types of songs. This study offers new insights into the musical imagery dynamics evoked by gaps of silence and on the role of familiarity and learning processes in the generation of these dynamics. The automatic and effortless method presented here is a potentially useful tool to understand failure in the familiarity and learning processes of pathological populations.