1
|
Ringer H, Schröger E, Grimm S. Neural signatures of automatic repetition detection in temporally regular and jittered acoustic sequences. PLoS One 2023; 18:e0284836. [PMID: 37948467 PMCID: PMC10637696 DOI: 10.1371/journal.pone.0284836] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2023] [Accepted: 10/20/2023] [Indexed: 11/12/2023] Open
Abstract
Detection of repeating patterns within continuous sound streams is crucial for efficient auditory perception. Previous studies demonstrated a remarkable sensitivity of the human auditory system to periodic repetitions in unfamiliar, meaningless sounds. Automatic repetition detection was reflected in different EEG markers, including sustained activity, neural synchronisation, and event-related responses to pattern occurrences. The current study investigated how listeners' attention and the temporal regularity of a sound modulate repetition perception, and how this influence is reflected in different EEG markers that were previously suggested to subserve dissociable functions. We reanalysed data of a previous study in which listeners were presented with sequences of unfamiliar artificial sounds that either contained repetitions of a certain sound segment or not. Repeating patterns occurred either regularly or with a temporal jitter within the sequences, and participants' attention was directed either towards the pattern repetitions or away from the auditory stimulation. Across both regular and jittered sequences during both attention and in-attention, pattern repetitions led to increased sustained activity throughout the sequence, evoked a characteristic positivity-negativity complex in the event-related potential, and enhanced inter-trial phase coherence of low-frequency oscillatory activity time-locked to repeating pattern onsets. While regularity only had a minor (if any) influence, attention significantly strengthened pattern repetition perception, which was consistently reflected in all three EEG markers. These findings suggest that the detection of pattern repetitions within continuous sounds relies on a flexible mechanism that is robust against in-attention and temporal irregularity, both of which typically occur in naturalistic listening situations. Yet, attention to the auditory input can enhance processing of repeating patterns and improve repetition detection.
Collapse
Affiliation(s)
- Hanna Ringer
- International Max Planck Research School on Neuroscience of Communication (IMPRS NeuroCom), Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Cognitive and Biological Psychology, Wilhelm Wundt Institute for Psychology, Leipzig University, Leipzig, Germany
- Research Group Neurocognition of Music and Language, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
| | - Erich Schröger
- Cognitive and Biological Psychology, Wilhelm Wundt Institute for Psychology, Leipzig University, Leipzig, Germany
| | - Sabine Grimm
- Physics of Cognition Lab, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
- Cognitive Systems Lab, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
| |
Collapse
|
2
|
Hodapp A, Grimm S. Neural signatures of temporal regularity and recurring patterns in random tonal sound sequences. Eur J Neurosci 2021; 53:2740-2754. [PMID: 33481296 DOI: 10.1111/ejn.15123] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2020] [Revised: 12/18/2020] [Accepted: 01/18/2021] [Indexed: 11/27/2022]
Abstract
The auditory system is highly sensitive to recurring patterns in the acoustic input - even in otherwise unstructured material, such as white noise or random tonal sequences. Electroencephalography (EEG) research revealed a characteristic negative potential to periodically recurring auditory patterns - a response, which has been interpreted as memory trace-related and specific, rather than as a sign of periodicity-driven entrainment. Here, we aim to disentangle these two possible contributions by investigating the influence of a periodic sound sequence's inherent temporal regularity on event-related potentials. Participants were presented continuous sequences of short tones of random pitch, with some sequences containing a recurring pattern, and asked to indicate whether they heard a repetition. Patterns were either spaced equally across the random sequence (isochronous condition) or with a temporal jitter (jittered condition), which enabled us to differentiate between event-related potentials (and thus processing operations associated with a memory trace for a repeated pattern) and the periodic nature of the repetitions. A negative recurrence-related component could be observed independently of temporal regularity, was pattern-specific, and modulated by across trial repetition of the pattern. Critically, isochronous pattern repetition induced an additional early periodicity-related positive component, which started to build up already before the pattern onset and which was elicited undampedly even when the repeated pattern was occasionally not presented. This positive component likely reflects a sensory driven entrainment process that could be the foundation of a behavioural benefit in detecting temporally regular repetitions.
Collapse
Affiliation(s)
- Alice Hodapp
- Institute of Psychology, University of Leipzig, Leipzig, Germany.,Department of Psychology, University of Potsdam, Potsdam, Germany
| | - Sabine Grimm
- Institute of Psychology, University of Leipzig, Leipzig, Germany
| |
Collapse
|
3
|
Abstract
Background Auditory sustained responses have been recently suggested to reflect neural processing of speech sounds in the auditory cortex. As periodic fluctuations below the pitch range are important for speech perception, it is necessary to investigate how low frequency periodic sounds are processed in the human auditory cortex. Auditory sustained responses have been shown to be sensitive to temporal regularity but the relationship between the amplitudes of auditory evoked sustained responses and the repetitive rates of auditory inputs remains elusive. As the temporal and spectral features of sounds enhance different components of sustained responses, previous studies with click trains and vowel stimuli presented diverging results. In order to investigate the effect of repetition rate on cortical responses, we analyzed the auditory sustained fields evoked by periodic and aperiodic noises using magnetoencephalography. Results Sustained fields were elicited by white noise and repeating frozen noise stimuli with repetition rates of 5-, 10-, 50-, 200- and 500 Hz. The sustained field amplitudes were significantly larger for all the periodic stimuli than for white noise. Although the sustained field amplitudes showed a rising and falling pattern within the repetition rate range, the response amplitudes to 5 Hz repetition rate were significantly larger than to 500 Hz. Conclusions The enhanced sustained field responses to periodic noises show that cortical sensitivity to periodic sounds is maintained for a wide range of repetition rates. Persistence of periodicity sensitivity below the pitch range suggests that in addition to processing the fundamental frequency of voice, sustained field generators can also resolve low frequency temporal modulations in speech envelope.
Collapse
|
4
|
Chait M, Poeppel D, Simon JZ. Auditory temporal edge detection in human auditory cortex. Brain Res 2008; 1213:78-90. [PMID: 18455707 DOI: 10.1016/j.brainres.2008.03.050] [Citation(s) in RCA: 34] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2007] [Revised: 02/24/2008] [Accepted: 03/15/2008] [Indexed: 11/29/2022]
Abstract
Auditory objects are detected if they differ acoustically from the ongoing background. In simple cases, the appearance or disappearance of an object involves a transition in power, or frequency content, of the ongoing sound. However, it is more realistic that the background and object possess substantial non-stationary statistics, and the task is then to detect a transition in the pattern of ongoing statistics. How does the system detect and process such transitions? We use magnetoencephalography (MEG) to measure early auditory cortical responses to transitions between constant tones, regularly alternating, and randomly alternating tone-pip sequences. Such transitions embody key characteristics of natural auditory temporal edges. Our data demonstrate that the temporal dynamics and response polarity of the neural temporal-edge-detection processes depend in specific ways on the generalized nature of the edge (the context preceding and following the transition) and suggest that distinct neural substrates in core and non-core auditory cortex are recruited depending on the kind of computation (discovery of a violation of regularity, vs. the detection of a new regularity) required to extract the edge from the ongoing fluctuating input entering a listener's ears.
Collapse
Affiliation(s)
- Maria Chait
- Equipe Audition, Laboratoire de Psychologie de la Perception, CNRS (UMR 8158) Université Paris Descartes and Ecole Normale Supérieure, France.
| | | | | |
Collapse
|
5
|
The mismatch negativity (MMN) in basic research of central auditory processing: a review. Clin Neurophysiol 2007; 118:2544-90. [PMID: 17931964 DOI: 10.1016/j.clinph.2007.04.026] [Citation(s) in RCA: 1683] [Impact Index Per Article: 99.0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2006] [Revised: 04/18/2007] [Accepted: 04/28/2007] [Indexed: 11/22/2022]
Abstract
In the present article, the basic research using the mismatch negativity (MMN) and analogous results obtained by using the magnetoencephalography (MEG) and other brain-imaging technologies is reviewed. This response is elicited by any discriminable change in auditory stimulation but recent studies extended the notion of the MMN even to higher-order cognitive processes such as those involving grammar and semantic meaning. Moreover, MMN data also show the presence of automatic intelligent processes such as stimulus anticipation at the level of auditory cortex. In addition, the MMN enables one to establish the brain processes underlying the initiation of attention switch to, conscious perception of, sound change in an unattended stimulus stream.
Collapse
|
6
|
Chait M, Poeppel D, de Cheveigné A, Simon JZ. Processing asymmetry of transitions between order and disorder in human auditory cortex. J Neurosci 2007; 27:5207-14. [PMID: 17494707 PMCID: PMC6672364 DOI: 10.1523/jneurosci.0318-07.2007] [Citation(s) in RCA: 61] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Auditory environments vary as a result of the appearance and disappearance of acoustic sources, as well as fluctuations characteristic of the sources themselves. The appearance of an object is often manifest as a transition in the pattern of ongoing fluctuation, rather than an onset or offset of acoustic power. How does the system detect and process such transitions? Based on magnetoencephalography data, we show that the temporal dynamics and response morphology of the neural temporal-edge detection processes depend in precise ways on the nature of the change. We measure auditory cortical responses to transitions between "disorder," modeled as a sequence of random frequency tone pips, and "order," modeled as a constant tone. Such transitions embody key characteristics of natural auditory edges. Early cortical responses (from approximately 50 ms post-transition) reveal that order-disorder transitions, and vice versa, are processed by different neural mechanisms. Their dynamics suggest that the auditory cortex optimally adjusts to stimulus statistics, even when this is not required for overt behavior. Furthermore, this response profile bears a striking similarity to that measured from another order-disorder transition, between interaurally correlated and uncorrelated noise, a radically different stimulus. This parallelism suggests the existence of a general mechanism that operates early in the processing stream on the abstract statistics of the auditory input, and is putatively related to the processes of constructing a new representation or detecting a deviation from a previously acquired model of the auditory scene. Together, the data reveal information about the mechanisms with which the brain samples, represents, and detects changes in the environment.
Collapse
Affiliation(s)
- Maria Chait
- Neuroscience and Cognitive Science Program, University of Maryland, College Park, Maryland 20742, USA.
| | | | | | | |
Collapse
|
7
|
Abstract
Abstract. The memory of auditory random waveforms (i.e., noise) is a special case of auditory memory for sensory information. Five experiments are reported that evaluate the dynamics of this storage system as well as interactions with new input. Periodic waveforms can be discriminated from uncorrelated noise by naive listeners up to a cycle length of 20 s, with the major decline in performance between 5 and 10 s. Even single repetitions of a piece of the waveform can be detected up to a stimulus onset asynchrony (SOA) of 6 s. The capacity of this storage system is limited to a few items of, in total, a few hundred milliseconds length. Within this capacity, however, items do not interfere strongly. These results are compatible with the view that auditory sensory memory is a modality-specific module of short-term memory.
Collapse
|
8
|
Abstract
We assessed the ability of cats to detect repeated noise (RN), a stimulus generated by seamlessly presenting short segments of white noise in a continuous loop, in a modified go-nogo task. A recent study of the gerbil suggested that animals might have an extremely limited ability to detect RN compared to human subjects. We find that cats can discriminate RN from continuous noise with reasonable accuracy until the period length of the RN sequence reaches 450-500 ms. This is slightly longer than the maximum detectable RN period length found in gerbils, but falls far short of human performance.
Collapse
Affiliation(s)
- Hans Peter Frey
- Institute of Neuroinformatics, University/ETH Zürich, Winterthurerstrasse 190, CH-8057 Zürich, Switzerland
| | | | | |
Collapse
|
9
|
Abstract
Mongolian gerbils (N = 21) were trained to discriminate between continuous and repeated auditory white noise. While for periods up to 40 ms of the repeated noise spectral effects make this a perceptual task, longer periods require auditory sensory memory to solve the task. Short periods (20 ms) could easily be discriminated by naive gerbils (discrimination performance, i.e. hit rate minus false alarm rate >80% after 8 days of training). Discrimination was more difficult for longer periods (100 ms: discrimination performance approximately 50% after 18 days of training). By long-term training (156 days) using an optimized training paradigm two further gerbils learned to discriminate up to a period length of 360 ms but could not proceed at 400 ms. While this falls short of human performance, it demonstrates for the first time sensory memory for random waveforms in animals.
Collapse
Affiliation(s)
- Christian Kaernbach
- Institut für Allgemeine Psychologie, Universität Leipzig, Seeburgstrasse 14-20, 04 103 Leipzig, Germany.
| | | |
Collapse
|
10
|
Alain C, Arnott SR, Picton TW. Bottom-up and top-down influences on auditory scene analysis: evidence from event-related brain potentials. J Exp Psychol Hum Percept Perform 2001; 27:1072-89. [PMID: 11642696 DOI: 10.1037/0096-1523.27.5.1072] [Citation(s) in RCA: 106] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The physiological processes underlying the segregation of concurrent sounds were investigated through the use of event-related brain potentials. The stimuli were complex sounds containing multiple harmonics, one of which could be mistuned so that it was no longer an integer multiple of the fundamental. Perception of concurrent auditory objects increased with degree of mistuning and was accompanied by negative and positive waves that peaked at 180 and 400 ms poststimulus, respectively. The negative wave, referred to as object-related negativity, was present during passive listening, but the positive wave was not. These findings indicate bottom-up and top-down influences during auditory scene analysis. Brain electrical source analyses showed that distinguishing simultaneous auditory objects involved a widely distributed neural network that included auditory cortices, the medial temporal lobe, and posterior association cortices.
Collapse
Affiliation(s)
- C Alain
- Rotman Research Institute, Baycrest Centre for Geriatric Care, Toronto, Ontario, Canada.
| | | | | |
Collapse
|
11
|
Berti S, Schröger E, Mecklinger A. Attentive and pre-attentive periodicity analysis in auditory memory: an event-related brain potential study. Neuroreport 2000; 11:1883-7. [PMID: 10884037 DOI: 10.1097/00001756-200006260-00016] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
In an event-related potential (ERP) study we presented human subjects with streams of repetitive white noise (semi-periodic noise) under attend and ignore conditions to investigate whether the perception of the periodicity with short cycle-lengths is due to lower level, pre-attentive sensory memory processing or higher level, attentive working memory processing. The ERPs of both conditions reveal N1-like deflections that are time locked on the semi-periodic noise suggesting that the processing of the periodicity is due to a pre-attentive rather than an attentive process. The topography of the deflections suggests that its generators are located in the supratemporal plane. Additionally, the ERPs elicited by infrequent disruptions in the periodicity show differences between the conditions suggesting that the detection of disruptions in periodicity is facilitated by attention.
Collapse
Affiliation(s)
- S Berti
- Institut für Allgemeine Psychologie, University of Leipzig, Germany
| | | | | |
Collapse
|