The retention of simultaneous tones in auditory short-term memory: a magnetoencephalography study

Resting-state functional connectivity in an auditory network differs between aspiring professional and amateur musicians and correlates with performance

Auditory experience-dependent plasticity is often studied in the domain of musical expertise. Available evidence suggests that years of musical practice are associated with structural and functional changes in auditory cortex and related brain regions. Resting-state functional magnetic resonance imaging (MRI) can be used to investigate neural correlates of musical training and expertise beyond specific task influences. Here, we compared two groups of musicians with varying expertise: 24 aspiring professional musicians preparing for their entrance exam at Universities of Arts versus 17 amateur musicians without any such aspirations but who also performed music on a regular basis. We used an interval recognition task to define task-relevant brain regions and computed functional connectivity and graph-theoretical measures in this network on separately acquired resting-state data. Aspiring professionals performed significantly better on all behavioral indicators including interval recognition and also showed significantly greater network strength and global efficiency than amateur musicians. Critically, both average network strength and global efficiency were correlated with interval recognition task performance assessed in the scanner, and with an additional measure of interval identification ability. These findings demonstrate that task-informed resting-state fMRI can capture connectivity differences that correspond to expertise-related differences in behavior.

Neural dynamics underlying successful auditory short-term memory performance

Listeners often operate in complex acoustic environments, consisting of many concurrent sounds. Accurately encoding and maintaining such auditory objects in short-term memory is crucial for communication and scene analysis. Yet, the neural underpinnings of successful auditory short-term memory (ASTM) performance are currently not well understood. To elucidate this issue, we presented a novel, challenging auditory delayed match-to-sample task while recording MEG. Human participants listened to 'scenes' comprising three concurrent tone pip streams. The task was to indicate, after a delay, whether a probe stream was present in the just-heard scene. We present three key findings: First, behavioural performance revealed faster responses in correct versus incorrect trials as well as in 'probe present' versus 'probe absent' trials, consistent with ASTM search. Second, successful compared with unsuccessful ASTM performance was associated with a significant enhancement of event-related fields and oscillatory activity in the theta, alpha and beta frequency ranges. This extends previous findings of an overall increase of persistent activity during short-term memory performance. Third, using distributed source modelling, we found these effects to be confined mostly to sensory areas during encoding, presumably related to ASTM contents per se. Parietal and frontal sources then became relevant during the maintenance stage, indicating that effective STM operation also relies on ongoing inhibitory processes suppressing task-irrelevant information. In summary, our results deliver a detailed account of the neural patterns that differentiate successful from unsuccessful ASTM performance in the context of a complex, multi-object auditory scene.

The neural coding of tonal working memory load: An functional magnetic resonance imaging study

Tonal working memory load refers to the number of pitches held in working memory. It has been found that different verbal working memory loads have different neural coding (local neural activity pattern). However, whether there exists a comparable phenomenon for tonal working memory load remains unclear. In this study, we used a delayed match-to-sample paradigm to evoke tonal working memory. Neural coding of different tonal working memory loads was studied with a surface space and convolution neural network (CNN)-based multivariate pattern analysis (SC-MVPA) method. We found that first, neural coding of tonal working memory was significantly different from that of the control condition in the bilateral superior temporal gyrus (STG), supplement motor area (SMA), and precentral gyrus (PCG). Second, neural coding of nonadjacent tonal working memory loads was distinguishable in the bilateral STG and PCG. Third, neural coding is gradually enhanced as the memory load increases. Finally, neural coding of tonal working memory was encoded in the bilateral STG in the encoding phase and shored in the bilateral PCG and SMA in the maintenance phase.

The bottom-up information transfer process and top-down attention control underlying tonal working memory

Tonal working memory has been less investigated by neuropsychological and neuroimaging studies and even less in terms of tonal working memory load. In this study, we analyzed the dynamic cortical processing process of tonal working memory with an original surface-space-based multivariate pattern analysis (sf-MVPA) method and found that this process constituted a bottom-up information transfer process. Then, the local cortical activity pattern, local cortical response strength, and cortical functional connectivity under different tonal working memory loads were investigated. No brain area’s local activity pattern or response strength was significantly different under different memory loads. Meanwhile, the interactions between the auditory cortex (AC) and an attention control network were linearly correlated with the memory load. This finding shows that the neural mechanism underlying the tonal working memory load does not arise from changes in local activity patterns or changes in the local response strength, but from top-down attention control. Our results indicate that the implementation of tonal working memory is based on the cooperation of the bottom-up information transfer process and top-down attention control.

Comparisons between short-term memory systems for verbal and rhythmic stimuli

Auditory short-term memory is often conceived of as a unitary capacity, with memory for different auditory materials (such as syllables, pitches, rhythms) posited to rely on similar neural mechanisms. One spontaneous behavior observed in short-term memory studies is 'chunking'. For example, individuals often recount digit sequences in groups, or chunks, of 3-4 digits, and chunking is associated with better performance. Chunking may also operate in musical rhythm, with beats acting as potential chunk boundaries for tones in rhythmic sequences. Similar to chunking, beat-based structure in rhythms also improves performance. Thus, it is possible that beat processing relies on the same mechanisms that underlie chunking of verbal material. The current fMRI study examined whether beat perception is indeed a type of chunking, measuring brain responses to chunked and 'unchunked' letter sequences relative to beat-based and non-beat-based rhythmic sequences. Participants completed a sequence discrimination task, and comparisons between stimulus encoding, maintenance, and discrimination were made for both rhythmic and verbal sequences. Overall, rhythm and verbal short-term memory networks overlapped substantially. When contrasting rhythmic and verbal conditions, rhythms activated basal ganglia, supplementary motor area, and anterior insula more than letter strings did, during both encoding and discrimination. Verbal letter strings activated bilateral auditory cortex more than rhythms did during encoding, and parietal cortex, precuneus, and middle frontal gyri more than rhythms did during discrimination. Importantly, there was a significant interaction in the basal ganglia during encoding: activation for beat-based rhythms was greater than for non-beat-based rhythms, but verbal chunked and unchunked conditions did not differ. The interaction indicates that beat perception is not simply a case of chunking, suggesting a dissociation between beat processing and chunking-based grouping mechanisms.

The influence of anodal transcranial direct current stimulation over the right auditory cortex on interference effects in memory for melodies

The study investigates how transcranial direct current stimulation (tDCS) over the auditory cortex (AC) modulates memory for melodies under different noise conditions, whilst also considering cumulative disruptive interference effects. Forty-one participants completed a continuous recognition melody task, as well as a visual control task, which included four noise conditions for which noise was either present only during encoding (N-C), only during retrieval (C-N), during both (N-N) or not at all (C-C) and completed the tasks after receiving anodal or sham tDCS over the right AC. The results of the sham session replicate previous findings by revealing that memory for melodies is worse when noise in added to the encoding phase (N-C) whereas the N-N condition shows good performance, highlighting a context effect, and that cumulative disruptive interference is not present in memory for melodies except in the N-C condition. After anodal stimulation the memory pattern differs such as that memory performance is best in the C-C condition and furthermore the cumulative disruptive interference effect in the N-C condition is diminished. In sum, the study highlights the involvement of the right AC for memory for melodies and the results indicate an association of the AC for creating context effects.

Altered event-related potentials and theta oscillations index auditory working memory deficits in healthy aging

Speech comprehension deficits constitute a major issue for an increasingly aged population, as they may lead older individuals to social isolation. Since conversation requires constant monitoring, updating and selecting information, auditory working memory decline, rather than impoverished hearing acuity, has been suggested a core factor. However, in stark contrast to the visual domain, the neurophysiological mechanisms underlying auditory working memory deficits in healthy aging remain poorly understood, especially those related to on-the-fly information processing under increasing load. Therefore, we investigated the behavioral costs and electrophysiological differences associated with healthy aging and working memory load during continuous auditory processing. We recorded EEG activity from 27 younger (∼25 years) and 29 older (∼70 years) participants during their performance on an auditory version of the n-back task with speech syllables and 2 workload levels (1-back; 2-back). Behavioral measures were analyzed as indices of function; event-related potentials as proxies for sensory and cognitive processes; and theta oscillatory power as a reflection of memory and central executive function. Our results show age-related differences in auditory information processing within a latency range that is consistent with a series of impaired functions, from sensory gating to cognitive resource allocation during constant information updating, especially under high load.

Signal informativeness for sequence structure modulates human auditory cortical responses

We observed how information about the structure of tone sequences modulates cortical responses in the context of a standard short-term memory (STM) task. Participants heard two sequences of one, three, or five tones (203 ms on, 203 ms off) interspersed by a silent interval (2 s) and decided whether the sequences were the same or different. In experiment 1, sequence length was randomized between trials. During the first sequence, the amplitude of the auditory P2 was larger for the second tone in trials with three tones, and for the second and fourth tone in trials with five tones. We hypothesize the increase in P2 reflected a dynamic disambiguation process because these tones were predictive of a sequence longer than one or three tones. This hypothesis was supported by the absence of P2 amplitude modulation during the second sequence (when sequence length was known). In experiment 2, we blocked trials by sequence length to ensure the effects were not caused by some process related to encoding in STM. There was no P2 amplitude modulation in either the first or second sequences. Thus, tones 2 and 4 had a larger amplitude only when they provided new information about the length of the current tone sequence. To some extent, the auditory N1 also showed those modulations. Independent Component Analysis of the ERPs provided evidence the modulations in P2 amplitude could originate in auditory cortex. These results suggest a rapid dynamic adaptation of auditory cortical responses based on the local informativeness of auditory signals.

Lingering Sound: Event-Related Phase-Amplitude Coupling and Phase-Locking in Fronto-Temporo-Parietal Functional Networks During Memory Retrieval of Music Melodies

Brain oscillations and connectivity have emerged as promising measures of evaluating memory processes, including encoding, maintenance, and retrieval, as well as the related executive function. Although many studies have addressed the neural mechanisms underlying working memory, most of these studies have focused on the visual modality. Neurodynamics and functional connectivity related to auditory working memory are yet to be established. In this study, we explored the dynamic of high density (128-channel) electroencephalography (EEG) in a musical delayed match-to-sample task (DMST), in which 36 participants were recruited and were instructed to recognize and distinguish the target melodies from similar distractors. Event-related spectral perturbations (ERSPs), event-related phase-amplitude couplings (ERPACs), and phase-locking values (PLVs) were used to determine the corresponding brain oscillations and connectivity. First, we observed that low-frequency oscillations in the frontal, temporal, and parietal regions were increased during the processing of both target and distracting melodies. Second, the cross-frequency coupling between low-frequency phases and high-frequency amplitudes was elevated in the frontal and parietal regions when the participants were distinguishing between the target from distractor, suggesting that the phase-amplitude coupling could be an indicator of neural mechanisms underlying memory retrieval. Finally, phase-locking, an index evaluating brain functional connectivity, revealed that there was fronto-temporal phase-locking in the theta band and fronto-parietal phase-locking in the alpha band during the recognition of the two stimuli. These findings suggest the existence of functional connectivity and the phase-amplitude coupling in the neocortex during musical memory retrieval, and provide a highly resolved timeline to evaluate brain dynamics. Furthermore, the inter-regional phase-locking and phase-amplitude coupling among the frontal, temporal and parietal regions occurred at the very beginning of musical memory retrieval, which might reflect the precise timing when cognitive resources were involved in the retrieval of targets and the rejection of similar distractors. To the best of our knowledge, this is the first EEG study employing a naturalistic task to study auditory memory processes and functional connectivity during memory retrieval, results of which can shed light on the use of natural stimuli in studies that are closer to the real-life applications of cognitive evaluations, mental treatments, and brain-computer interface.

The effect of distraction on change detection in crowded acoustic scenes

In this series of behavioural experiments we investigated the effect of distraction on the maintenance of acoustic scene information in short-term memory. Stimuli are artificial acoustic ‘scenes’ composed of several (up to twelve) concurrent tone-pip streams (‘sources’). A gap (1000 ms) is inserted partway through the ‘scene’; Changes in the form of an appearance of a new source or disappearance of an existing source, occur after the gap in 50% of the trials. Listeners were instructed to monitor the unfolding ‘soundscapes’ for these events. Distraction was measured by presenting distractor stimuli during the gap. Experiments 1 and 2 used a dual task design where listeners were required to perform a task with varying attentional demands (‘High Demand’ vs. ‘Low Demand’) on brief auditory (Experiment 1a) or visual (Experiment 1b) signals presented during the gap. Experiments 2 and 3 required participants to ignore distractor sounds and focus on the change detection task. Our results demonstrate that the maintenance of scene information in short-term memory is influenced by the availability of attentional and/or processing resources during the gap, and that this dependence appears to be modality specific. We also show that these processes are susceptible to bottom up driven distraction even in situations when the distractors are not novel, but occur on each trial. Change detection performance is systematically linked with the, independently determined, perceptual salience of the distractor sound. The findings also demonstrate that the present task may be a useful objective means for determining relative perceptual salience.

•

Distraction is measured by presenting distractor stimuli during a scene gap.

•

Scene maintenance in memory depends on availability of resources during the gap.

•

This dependence appears to be modality specific.

•

Scene maintenance also prone to bottom up distraction even when distractors not novel.

•

Performance depends on the perceptual salience of the distractor sound.

Persistent neural activity in auditory cortex is related to auditory working memory in humans and nonhuman primates

Working memory is the cognitive capacity of short-term storage of information for goal-directed behaviors. Where and how this capacity is implemented in the brain are unresolved questions. We show that auditory cortex stores information by persistent changes of neural activity. We separated activity related to working memory from activity related to other mental processes by having humans and monkeys perform different tasks with varying working memory demands on the same sound sequences. Working memory was reflected in the spiking activity of individual neurons in auditory cortex and in the activity of neuronal populations, that is, in local field potentials and magnetic fields. Our results provide direct support for the idea that temporary storage of information recruits the same brain areas that also process the information. Because similar activity was observed in the two species, the cellular bases of some auditory working memory processes in humans can be studied in monkeys.

Nonverbal auditory working memory: Can music indicate the capacity?

Different working memory (WM) mechanisms that underlie words, tones, and timbres have been proposed in previous studies. In this regard, the present study developed a WM test with nonverbal sounds and compared it to the conventional verbal WM test. A total of twenty-five, non-music major, right-handed college students were presented with four different types of sounds (words, syllables, pitches, timbres) that varied from two to eight digits in length. Both accuracy and oxygenated hemoglobin (oxyHb) were measured. The results showed significant effects of number of targets on accuracy and sound type on oxyHb. A further analysis showed prefrontal asymmetry with pitch being processed by the right hemisphere (RH) and timbre by the left hemisphere (LH). These findings suggest a potential for employing musical sounds (i.e., pitch and timbre) as a complementary stimuli for conventional nonverbal WM tests, which can additionally examine its asymmetrical roles in the prefrontal regions.

Memory for pure tone sequences without contour

We presented pure tones interspersed with white noise sounds to disrupt contour perception in an acoustic short-term memory (ASTM) experiment during which we recorded the electroencephalogram. The memory set consisted of seven stimuli, 0, 1, 2, 3, or 4 of which were to-be-remembered tones. We estimated each participant׳s capacity, K, for each set size and measured the amplitude of the SAN (sustained anterior negativity, an ERP related to acoustic short-term memory). We correlated their K slopes with their SAN amplitude slopes as a function of set size, and found a significant link between performance and the SAN: a larger increase in SAN amplitude was linked with a larger number of stimuli maintained in ASTM. The SAN decreased in amplitude in the later portion of the silent retention interval, but the correlation between the SAN and capacity remained strong. These results show the SAN is not an index of contour but rather an index of the maintenance of individual objects in STM. This article is part of a Special Issue entitled SI: Auditory working memory.

Right parietal cortex mediates recognition memory for melodies

Functional brain imaging studies have highlighted the significance of right‐lateralized temporal, frontal and parietal brain areas for memory for melodies. The present study investigated the involvement of bilateral posterior parietal cortices (PPCs) for the recognition memory of melodies using transcranial direct current stimulation (tDCS). Participants performed a recognition task before and after tDCS. The task included an encoding phase (12 melodies), a retention period, as well as a recognition phase (24 melodies). Experiment 1 revealed that anodal tDCS over the right PPC led to a deterioration of overall memory performance compared with sham. Experiment 2 confirmed the results of Experiment 1 and further showed that anodal tDCS over the left PPC did not show a modulatory effect on memory task performance, indicating a right lateralization for musical memory. Furthermore, both experiments revealed that the decline in memory for melodies can be traced back to an interference of anodal stimulation on the recollection process (remember judgements) rather than to familiarity judgements. Taken together, this study revealed a causal involvement of the right PPC for memory for melodies and demonstrated a key role for this brain region in the recollection process of the memory task.

Spatiotemporal oscillatory dynamics during the encoding and maintenance phases of a visual working memory task

Many electrophysiology studies have examined neural oscillatory activity during the encoding, maintenance, and/or retrieval phases of various working memory tasks. Together, these studies have helped illuminate the underlying neural dynamics, although much remains to be discovered and some findings have not replicated in subsequent work. In this study, we examined the oscillatory dynamics that serve visual working memory operations using high-density magnetoencephalography (MEG) and advanced time-frequency and beamforming methodology. Specifically, we recorded healthy adults while they performed a high-load, Sternberg-type working memory task, and focused on the encoding and maintenance phases. We found significant 9-16 Hz desynchronizations in the bilateral occipital cortices, left dorsolateral prefrontal cortex (DLPFC), and left superior temporal areas throughout the encoding phase. Our analysis of the dynamics showed that the left DLPFC and superior temporal desynchronization became stronger as a function of time during the encoding period, and was sustained throughout most of the maintenance phase until sharply decreasing in the milliseconds preceding retrieval. In contrast, desynchronization in occipital areas became weaker as a function of time during encoding and eventually evolved into a strong synchronization during the maintenance period, consistent with previous studies. These results provide clear evidence of dynamic network-level processes during the encoding and maintenance phases of working memory, and support the notion of a dynamic pattern of functionally-discrete subprocesses within each working memory phase. The presence of such dynamic oscillatory networks may be a potential source of inconsistent findings in this literature, as neural activity within these networks changes dramatically with time.