Music Rhythmic Cueing for the Production of Non-native Speech Rhythm: Evidence from Chinese Learners of French

The present study examined the cross-modal cueing effect of musical rhythmic beats on non-native speech rhythm production. Two groups of Chinese learners of French were cued respectively with rhythmic beats that either matched (matching group) or mismatched (mismatching group) the rhythm patterns of the target French sentences. The participants were asked to produce the target sentences after cueing and their speech production was compared with their baseline condition in which no cueing was used. The results showed that the matching group produced the target French rhythm significantly better after cueing with musical rhythmic beats that matched the French rhythm, in contrast to the mismatching group where no significant improvement was found. Individual differences in auditory short-term memory and rhythmic skills were not related to improvement in producing French rhythm after cueing. The results suggest that musical rhythmic cueing can be used to improve non-native speech rhythm production, further indicating a close link between speech and music in the temporal domain.

Processing of Grammatical Agreement in the Face of Variation in Lexical Stress: A Mismatch Negativity Study

Previous electroencephalography studies have yielded evidence for automatic processing of syntax and lexical stress. However, these studies looked at both effects in isolation, limiting their generalizability to everyday language comprehension. In the current study, we investigated automatic processing of grammatical agreement in the face of variation in lexical stress. Using an oddball paradigm, we measured the Mismatch Negativity (MMN) in Dutch-speaking participants while they listened to Dutch subject-verb sequences (linguistic context) or acoustically similar sequences in which the subject was replaced by filtered noise (nonlinguistic context). The verb forms differed in the inflectional suffix, rendering the subject-verb sequences grammatically correct or incorrect, and leading to a difference in the stress pattern of the verb forms. We found that the MMNs were modulated in both the linguistic and nonlinguistic condition, suggesting that the processing load induced by variation in lexical stress can hinder early automatic processing of grammatical agreement. However, as the morphological differences between the verb forms correlated with differences in number of syllables, an interpretation in terms of the prosodic structure of the sequences cannot be ruled out. Future research is needed to determine which of these factors (i.e., lexical stress, syllabic structure) most strongly modulate early syntactic processing.

What a difference a syllable makes-Rhythmic reading of poetry

In reading conventional poems aloud, the rhythmic experience is coupled with the projection of meter, enabling the prediction of subsequent input. However, it is unclear how top-down and bottom-up processes interact. If the rhythmicity in reading loud is governed by the top-down prediction of metric patterns of weak and strong stress, these should be projected also onto a randomly included, lexically meaningless syllable. If bottom-up information such as the phonetic quality of consecutive syllables plays a functional role in establishing a structured rhythm, the occurrence of the lexically meaningless syllable should affect reading and the number of these syllables in a metrical line should modulate this effect. To investigate this, we manipulated poems by replacing regular syllables at random positions with the syllable "tack". Participants were instructed to read the poems aloud and their voice was recorded during the reading. At the syllable level, we calculated the syllable onset interval (SOI) as a measure of articulation duration, as well as the mean syllable intensity. Both measures were supposed to operationalize how strongly a syllable was stressed. Results show that the average articulation duration of metrically strong regular syllables was longer than for weak syllables. This effect disappeared for "tacks". Syllable intensities, on the other hand, captured metrical stress of "tacks" as well, but only for musically active participants. Additionally, we calculated the normalized pairwise variability index (nPVI) for each line as an indicator for rhythmic contrast, i.e., the alternation between long and short, as well as louder and quieter syllables, to estimate the influence of "tacks" on reading rhythm. For SOI the nPVI revealed a clear negative effect: When "tacks" occurred, lines appeared to be read less altering, and this effect was proportional to the number of tacks per line. For intensity, however, the nPVI did not capture significant effects. Results suggests that top-down prediction does not always suffice to maintain a rhythmic gestalt across a series of syllables that carry little bottom-up prosodic information. Instead, the constant integration of sufficiently varying bottom-up information appears necessary to maintain a stable metrical pattern prediction.

Theta Band (4-8 Hz) Oscillations Reflect Online Processing of Rhythm in Speech Production

How speech prosody is processed in the brain during language production remains an unsolved issue. The present work used the phrase-recall paradigm to analyze brain oscillation underpinning rhythmic processing in speech production. Participants were told to recall target speeches aloud consisting of verb-noun pairings with a common (e.g., [2+2], the numbers in brackets represent the number of syllables) or uncommon (e.g., [1+3]) rhythmic pattern. Target speeches were preceded by rhythmic musical patterns, either congruent or incongruent, created by using pure tones at various temporal intervals. Electroencephalogram signals were recorded throughout the experiment. Behavioral results in 2+2 target speeches showed a rhythmic priming effect when comparing congruent and incongruent conditions. Cerebral-acoustic coherence analysis showed that neural activities synchronized with the rhythmic patterns of primes. Furthermore, target phrases that had congruent rhythmic patterns with a prime rhythm were associated with increased theta-band (4-8 Hz) activity in the time window of 400-800 ms in both the 2+2 and 1+3 target conditions. These findings suggest that rhythmic patterns can be processed online. Neural activities synchronize with the rhythmic input and speakers create an abstract rhythmic pattern before and during articulation in speech production.

Syntactic modulation of rhythm in Australian pied butcherbird song

The acoustic structure of birdsong is spectrally and temporally complex. Temporal complexity is often investigated in a syntactic framework focusing on the statistical features of symbolic song sequences. Alternatively, temporal patterns can be investigated in a rhythmic framework that focuses on the relative timing between song elements. Here, we investigate the merits of combining both frameworks by integrating syntactic and rhythmic analyses of Australian pied butcherbird (Cracticus nigrogularis) songs, which exhibit organized syntax and diverse rhythms. We show that rhythms of the pied butcherbird song bouts in our sample are categorically organized and predictable by the song's first-order sequential syntax. These song rhythms remain categorically distributed and strongly associated with the first-order sequential syntax even after controlling for variance in note length, suggesting that the silent intervals between notes induce a rhythmic structure on note sequences. We discuss the implication of syntactic-rhythmic relations as a relevant feature of song complexity with respect to signals such as human speech and music, and advocate for a broader conception of song complexity that takes into account syntax, rhythm, and their interaction with other acoustic and perceptual features.

Syntactic modulation of rhythm in Australian pied butcherbird song

The acoustic structure of birdsong is spectrally and temporally complex. Temporal complexity is often investigated in a syntactic framework focusing on the statistical features of symbolic song sequences. Alternatively, temporal patterns can be investigated in a rhythmic framework that focuses on the relative timing between song elements. Here, we investigate the merits of combining both frameworks by integrating syntactic and rhythmic analyses of Australian pied butcherbird (Cracticus nigrogularis) songs, which exhibit organized syntax and diverse rhythms. We show that rhythms of the pied butcherbird song bouts in our sample are categorically organized and predictable by the song's first-order sequential syntax. These song rhythms remain categorically distributed and strongly associated with the first-order sequential syntax even after controlling for variance in note length, suggesting that the silent intervals between notes induce a rhythmic structure on note sequences. We discuss the implication of syntactic-rhythmic relations as a relevant feature of song complexity with respect to signals such as human speech and music, and advocate for a broader conception of song complexity that takes into account syntax, rhythm, and their interaction with other acoustic and perceptual features.

Sentential position of VN combination modulates the rhythmic pattern effect during Chinese sentence reading: Evidence from eye movements

Though previous research has examined how implicit meter can facilitate the processing of stress-timed languages, syllable-timed languages, such as Chinese, remain under studied. Past research has shown that among verb-noun combinations in Chinese, the processing of [2 + 2] (two disyllabic words) combination rhythmic pattern is easier than that of [2 + 1] (a disyllabic word and a monosyllabic word) pattern, though it is unclear whether this effect is modulated by the sentential position of the verb-noun combination. The present study uses eye-tracking to examine the influence of position on rhythmic pattern during silent reading. In Experiment 1, participants read sentences with [2 + 1] versus [2 + 2] VN phrases embedded in different sentential positions. Results show that the fixation duration of [2 + 1] VN phrases is significantly longer than that of [2 + 2] and that the fixation duration of VN phrases is shorter at the sentence-middle position than it is at the sentence-final position, suggesting that the rhythmic pattern effect at the sentence-middle position exhibits a reduced magnitude compared to the sentence-final position. In Experiment 2, participants read sentences with either mono- or disyllabic words after the VN phrases to further explore whether the reduction of the rhythmic pattern effect is related to the number of succeeding syllables. Results show that while the fixation duration of the [2 + 1] VN pattern is significantly longer than that of the [2 + 2] pattern, there is no significant difference between the monosyllabic versus the disyllabic conditions, nor is there a significant interaction between rhythmic pattern and syllable length post VN phrases, thus ruling out the rhythmic effect from succeeding context. Together, these patterns suggest that the reduction of the rhythmic pattern effect is caused by position rather than number of syllables after phrases.

Predictive Processing in Poetic Language: Event-Related Potentials Data on Rhythmic Omissions in Metered Speech

Predictions during language comprehension are currently discussed from many points of view. One area where predictive processing may play a particular role concerns poetic language that is regularized by meter and rhyme, thus allowing strong predictions regarding the timing and stress of individual syllables. While there is growing evidence that these prosodic regularities influence language processing, less is known about the potential influence of prosodic preferences (binary, strong-weak patterns) on neurophysiological processes. To this end, the present electroencephalogram (EEG) study examined whether the predictability of strong and weak syllables within metered speech would differ as a function of meter (trochee vs. iamb). Strong, i.e., accented positions within a foot should be more predictable than weak, i.e., unaccented positions. Our focus was on disyllabic pseudowords that solely differed between trochaic and iambic structure, with trochees providing the preferred foot in German. Methodologically, we focused on the omission Mismatch Negativity (oMMN) that is elicited when an anticipated auditory stimulus is omitted. The resulting electrophysiological brain response is particularly interesting because its elicitation does not depend on a physical stimulus. Omissions in deviant position of a passive oddball paradigm occurred at either first- or second-syllable position of the aforementioned pseudowords, resulting in a 2-by-2 design with the factors foot type and omission position. Analyses focused on the mean oMMN amplitude and latency differences across the four conditions. The result pattern was characterized by an interaction of the effects of foot type and omission position for both amplitudes and latencies. In first position, omissions resulted in larger and earlier oMMNs for trochees than for iambs. In second position, omissions resulted in larger oMMNs for iambs than for trochees, but the oMMN latency did not differ. The results suggest that omissions, particularly in initial position, are modulated by a trochaic preference in German. The preferred strong-weak pattern may have strengthened the prosodic prediction, especially for matching, trochaic stimuli, such that the violation of this prediction led to an earlier and stronger prediction error. Altogether, predictive processing seems to play a particular role in metered speech, especially if the meter is based on the preferred foot type.

In Time with the Beat: Entrainment in Patients with Phonological Impairment, Apraxia of Speech, and Parkinson's Disease

In the present study, we investigated if individuals with neurogenic speech sound impairments of three types, Parkinson’s dysarthria, apraxia of speech, and aphasic phonological impairment, accommodate their speech to the natural speech rhythm of an auditory model, and if so, whether the effect is more significant after hearing metrically regular sentences as compared to those with an irregular pattern. This question builds on theories of rhythmic entrainment, assuming that sensorimotor predictions of upcoming events allow humans to synchronize their actions with an external rhythm. To investigate entrainment effects, we conducted a sentence completion task relating participants’ response latencies to the spoken rhythm of the prime heard immediately before. A further research question was if the perceived rhythm interacts with the rhythm of the participants’ own productions, i.e., the trochaic or iambic stress pattern of disyllabic target words. For a control group of healthy speakers, our study revealed evidence for entrainment when trochaic target words were preceded by regularly stressed prime sentences. Persons with Parkinson’s dysarthria showed a pattern similar to that of the healthy individuals. For the patient groups with apraxia of speech and with phonological impairment, considerably longer response latencies with differing patterns were observed. Trochaic target words were initiated with significantly shorter latencies, whereas the metrical regularity of prime sentences had no consistent impact on response latencies and did not interact with the stress pattern of the target words to be produced. The absence of an entrainment in these patients may be explained by the more severe difficulties in initiating speech at all. We discuss the results in terms of clinical implications for diagnostics and therapy in neurogenic speech disorders.

Rhythmic subvocalization: An eye-tracking study on silent poetry reading

The present study investigates effects of conventionally metered and rhymed poetry on eyemovements in silent reading. Readers saw MRRL poems (i.e., metrically regular, rhymed language) in two layouts. In poem layout, verse endings coincided with line breaks. In prose layout verse endings could be mid-line. We also added metrical and rhyme anomalies. We hypothesized that silently reading MRRL results in building up auditive expectations that are based on a rhythmic “audible gestalt” and propose that rhythmicity is generated through subvocalization. Our results revealed that readers were sensitive to rhythmic-gestalt-anomalies but showed differential effects in poem and prose layouts. Metrical anomalies in particular resulted in robust reading disruptions across a variety of eye-movement measures in the poem layout and caused re-reading of the local context. Rhyme anomalies elicited stronger effects in prose layout and resulted in systematic re-reading of pre-rhymes. The presence or absence of rhythmic-gestalt-anomalies, as well as the layout manipulation, also affected reading in general. Effects of syllable number indicated a high degree of subvocalization. The overall pattern of results suggests that eye-movements reflect, and are closely aligned with, the rhythmic subvocalization of MRRL.

This study introduces a two-stage approach to the analysis of long MRRL stimuli and contributes to the discussion of how the processing of rhythm in music and speech may overlap.

Hierarchical control as a shared neurocognitive mechanism for language and music

Although comparative research has made substantial progress in clarifying the relationship between language and music as neurocognitive systems from both a theoretical and empirical perspective, there is still no consensus about which mechanisms, if any, are shared and how they bring about different neurocognitive systems. In this paper, we tackle these two questions by focusing on hierarchical control as a neurocognitive mechanism underlying syntax in language and music. We put forward the Coordinated Hierarchical Control (CHC) hypothesis: linguistic and musical syntax rely on hierarchical control, but engage this shared mechanism differently depending on the current control demand. While linguistic syntax preferably engages the abstract rule-based control circuit, musical syntax rather employs the coordination of the abstract rule-based and the more concrete motor-based control circuits. We provide evidence for our hypothesis by reviewing neuroimaging as well as neuropsychological studies on linguistic and musical syntax. The CHC hypothesis makes a set of novel testable predictions to guide future work on the relationship between language and music.

Cortical Tracking of Speech: Toward Collaboration between the Fields of Signal and Sentence Processing

In recent years, a growing number of studies have used cortical tracking methods to investigate auditory language processing. Although most studies that employ cortical tracking stem from the field of auditory signal processing, this approach should also be of interest to psycholinguistics-particularly the subfield of sentence processing-given its potential to provide insight into dynamic language comprehension processes. However, there has been limited collaboration between these fields, which we suggest is partly because of differences in theoretical background and methodological constraints, some mutually exclusive. In this paper, we first review the theories and methodological constraints that have historically been prioritized in each field and provide concrete examples of how some of these constraints may be reconciled. We then elaborate on how further collaboration between the two fields could be mutually beneficial. Specifically, we argue that the use of cortical tracking methods may help resolve long-standing debates in the field of sentence processing that commonly used behavioral and neural measures (e.g., ERPs) have failed to adjudicate. Similarly, signal processing researchers who use cortical tracking may be able to reduce noise in the neural data and broaden the impact of their results by controlling for linguistic features of their stimuli and by using simple comprehension tasks. Overall, we argue that a balance between the methodological constraints of the two fields will lead to an overall improved understanding of language processing as well as greater clarity on what mechanisms cortical tracking of speech reflects. Increased collaboration will help resolve debates in both fields and will lead to new and exciting avenues for research.

ERP mismatch response to phonological and temporal regularities in speech

Predictions of our sensory environment facilitate perception across domains. During speech perception, formal and temporal predictions may be made for phonotactic probability and syllable stress patterns, respectively, contributing to the efficient processing of speech input. The current experiment employed a passive EEG oddball paradigm to probe the neurophysiological processes underlying temporal and formal predictions simultaneously. The component of interest, the mismatch negativity (MMN), is considered a marker for experience-dependent change detection, where its timing and amplitude are indicative of the perceptual system’s sensitivity to presented stimuli. We hypothesized that more predictable stimuli (i.e. high phonotactic probability and first syllable stress) would facilitate change detection, indexed by shorter peak latencies or greater peak amplitudes of the MMN. This hypothesis was confirmed for phonotactic probability: high phonotactic probability deviants elicited an earlier MMN than low phonotactic probability deviants. We do not observe a significant modulation of the MMN to variations in syllable stress. Our findings confirm that speech perception is shaped by formal and temporal predictability. This paradigm may be useful to investigate the contribution of implicit processing of statistical regularities during (a)typical language development.

Is atypical rhythm a risk factor for developmental speech and language disorders?

Although a growing literature points to substantial variation in speech/language abilities related to individual differences in musical abilities, mainstream models of communication sciences and disorders have not yet incorporated these individual differences into childhood speech/language development. This article reviews three sources of evidence in a comprehensive body of research aligning with three main themes: (a) associations between musical rhythm and speech/language processing, (b) musical rhythm in children with developmental speech/language disorders and common comorbid attentional and motor disorders, and (c) individual differences in mechanisms underlying rhythm processing in infants and their relationship with later speech/language development. In light of converging evidence on associations between musical rhythm and speech/language processing, we propose the Atypical Rhythm Risk Hypothesis, which posits that individuals with atypical rhythm are at higher risk for developmental speech/language disorders. The hypothesis is framed within the larger epidemiological literature in which recent methodological advances allow for large-scale testing of shared underlying biology across clinically distinct disorders. A series of predictions for future work testing the Atypical Rhythm Risk Hypothesis are outlined. We suggest that if a significant body of evidence is found to support this hypothesis, we can envision new risk factor models that incorporate atypical rhythm to predict the risk of developing speech/language disorders. Given the high prevalence of speech/language disorders in the population and the negative long-term social and economic consequences of gaps in identifying children at-risk, these new lines of research could potentially positively impact access to early identification and treatment. This article is categorized under: Linguistics > Language in Mind and Brain Neuroscience > Development Linguistics > Language Acquisition.

Shared neural resources of rhythm and syntax: An ALE meta-analysis

A growing body of evidence has highlighted behavioral connections between musical rhythm and linguistic syntax, suggesting that these abilities may be mediated by common neural resources. Here, we performed a quantitative meta-analysis of neuroimaging studies using activation likelihood estimate (ALE) to localize the shared neural structures engaged in a representative set of musical rhythm (rhythm, beat, and meter) and linguistic syntax (merge movement, and reanalysis) operations. Rhythm engaged a bilateral sensorimotor network throughout the brain consisting of the inferior frontal gyri, supplementary motor area, superior temporal gyri/temporoparietal junction, insula, intraparietal lobule, and putamen. By contrast, syntax mostly recruited the left sensorimotor network including the inferior frontal gyrus, posterior superior temporal gyrus, premotor cortex, and supplementary motor area. Intersections between rhythm and syntax maps yielded overlapping regions in the left inferior frontal gyrus, left supplementary motor area, and bilateral insula-neural substrates involved in temporal hierarchy processing and predictive coding. Together, this is the first neuroimaging meta-analysis providing detailed anatomical overlap of sensorimotor regions recruited for musical rhythm and linguistic syntax.

Sensitivity to Melody, Rhythm, and Beat in Supporting Speech-in-Noise Perception in Young Adults

OBJECTIVES

Musicians appear to have an enhanced ability to perceive speech-in-noise, prompting suggestions that musical training could be used to help people who struggle to communicate in noisy environments. This study assessed the role of sensitivity to beat, rhythm, and melody in supporting speech-in-noise perception.

DESIGN

This is an exploratory study based on correlation. The study included 24 normally hearing young adult participants with a wide range of musical training and experience. Formal and informal musical experience was measured with the training subscale of the Goldsmiths' Musical Sophistication Index. Speech reception thresholds (SRT) were measured using the Matrix Sentence Test and three different speech-spectrum-shaped noise maskers: unmodulated and sinusoidally amplitude-modulated (modulation frequency, fm = 8 Hz; modulation depths: 60 and 80%). Primary predictors were measures of sensitivity to beat, rhythm, and melody. Secondary predictors were pure-tone frequency discrimination and auditory working memory (digit span). Any contributions from these two predictors were to be controlled for as appropriate.

RESULTS

Participants with more musical experience and greater sensitivity to rhythm, beat, and melody had better SRTs. Sensitivity to beat was more strongly linked with SRT than sensitivity to either rhythm or melody. This relationship remained strong even after factoring out contributions from frequency discrimination and auditory working memory.

CONCLUSIONS

Sensitivity to beat predicted SRTs in unmodulated and modulated noise. We propose that this sensitivity maximizes benefit from fluctuations in signal-to-noise ratio through temporal orienting of attention to perceptually salient parts of the signal. Beat perception may be a good candidate for targeted training aimed at enhancing speech perception when listening in noise.

Event-Related Potential Evidence of Implicit Metric Structure during Silent Reading

Under the Implicit Prosody Hypothesis, readers generate prosodic structures during silent reading that can direct their real-time interpretations of the text. In the current study, we investigated the processing of implicit meter by recording event-related potentials (ERPs) while participants read a series of 160 rhyming couplets, where the rhyme target was always a stress-alternating noun–verb homograph (e.g., permit, which is pronounced PERmit as a noun and perMIT as a verb). The target had a strong–weak or weak–strong stress pattern, which was either consistent or inconsistent with the stress expectation generated by the couplet. Inconsistent strong–weak targets elicited negativities between 80–155 ms and 325–375 ms relative to consistent strong–weak targets; inconsistent weak–strong targets elicited a positivity between 365–435 ms relative to consistent weak–strong targets. These results are largely consistent with effects of metric violations during listening, demonstrating that implicit prosodic representations are similar to explicit prosodic representations.

Pushing the Envelope: Developments in Neural Entrainment to Speech and the Biological Underpinnings of Prosody Perception

Prosodic cues in speech are indispensable for comprehending a speaker’s message, recognizing emphasis and emotion, parsing segmental units, and disambiguating syntactic structures. While it is commonly accepted that prosody provides a fundamental service to higher-level features of speech, the neural underpinnings of prosody processing are not clearly defined in the cognitive neuroscience literature. Many recent electrophysiological studies have examined speech comprehension by measuring neural entrainment to the speech amplitude envelope, using a variety of methods including phase-locking algorithms and stimulus reconstruction. Here we review recent evidence for neural tracking of the speech envelope and demonstrate the importance of prosodic contributions to the neural tracking of speech. Prosodic cues may offer a foundation for supporting neural synchronization to the speech envelope, which scaffolds linguistic processing. We argue that prosody has an inherent role in speech perception, and future research should fill the gap in our knowledge of how prosody contributes to speech envelope entrainment.

New evidence of a rhythmic priming effect that enhances grammaticality judgments in children

Musical rhythm and the grammatical structure of language share a surprising number of characteristics that may be intrinsically related in child development. The current study aimed to understand the potential influence of musical rhythmic priming on subsequent spoken grammar task performance in children with typical development who were native speakers of English. Participants (ages 5-8 years) listened to rhythmically regular and irregular musical sequences (within-participants design) followed by blocks of grammatically correct and incorrect sentences upon which they were asked to perform a grammaticality judgment task. Rhythmically regular musical sequences improved performance in grammaticality judgment compared with rhythmically irregular musical sequences. No such effect of rhythmic priming was found in two nonlinguistic control tasks, suggesting a neural overlap between rhythm processing and mechanisms recruited during grammar processing. These findings build on previous research investigating the effect of rhythmic priming by extending the paradigm to a different language, testing a younger population, and employing nonlanguage control tasks. These findings of an immediate influence of rhythm on grammar states (temporarily augmented grammaticality judgment performance) also converge with previous findings of associations between rhythm and grammar traits (stable generalized grammar abilities) in children. Taken together, the results of this study provide additional evidence for shared neural processing for language and music and warrant future investigations of potentially beneficial effects of innovative musical material on language processing.

The Temporal Prediction of Stress in Speech and Its Relation to Musical Beat Perception

While rhythmic expectancies are thought to be at the base of beat perception in music, the extent to which stress patterns in speech are similarly represented and predicted during on-line language comprehension is debated. The temporal prediction of stress may be advantageous to speech processing, as stress patterns aid segmentation and mark new information in utterances. However, while linguistic stress patterns may be organized into hierarchical metrical structures similarly to musical meter, they do not typically present the same degree of periodicity. We review the theoretical background for the idea that stress patterns are predicted and address the following questions: First, what is the evidence that listeners can predict the temporal location of stress based on preceding rhythm? If they can, is it thanks to neural entrainment mechanisms similar to those utilized for musical beat perception? And lastly, what linguistic factors other than rhythm may account for the prediction of stress in natural speech? We conclude that while expectancies based on the periodic presentation of stresses are at play in some of the current literature, other processes are likely to affect the prediction of stress in more naturalistic, less isochronous speech. Specifically, aspects of prosody other than amplitude changes (e.g., intonation) as well as lexical, syntactic and information structural constraints on the realization of stress may all contribute to the probabilistic expectation of stress in speech.

Effects of metric hierarchy and rhyme predictability on word duration in The Cat in the Hat

Word durations convey many types of linguistic information, including intrinsic lexical features like length and frequency and contextual features like syntactic and semantic structure. The current study was designed to investigate whether hierarchical metric structure and rhyme predictability account for durational variation over and above other features in productions of a rhyming, metrically-regular children's book: The Cat in the Hat (Dr. Seuss, 1957). One-syllable word durations and inter-onset intervals were modeled as functions of segment number, lexical frequency, word class, syntactic structure, repetition, and font emphasis. Consistent with prior work, factors predicting longer word durations and inter-onset intervals included more phonemes, lower frequency, first mention, alignment with a syntactic boundary, and capitalization. A model parameter corresponding to metric grid height improved model fit of word durations and inter-onset intervals. Specifically, speakers realized five levels of metric hierarchy with inter-onset intervals such that interval duration increased linearly with increased height in the metric hierarchy. Conversely, speakers realized only three levels of metric hierarchy with word duration, demonstrating that they shortened the highly predictable rhyme resolutions. These results further understanding of the factors that affect spoken word duration, and demonstrate the myriad cues that children receive about linguistic structure from nursery rhymes.

Musical training modulates the early but not the late stage of rhythmic syntactic processing

Syntactic processing is essential for musical understanding. Although the processing of harmonic syntax has been well studied, very little is known about the neural mechanisms underlying rhythmic syntactic processing. The present study investigated the neural processing of rhythmic syntax and whether and to what extent long-term musical training impacts such processing. Fourteen musicians and 14 nonmusicians listened to syntactic-regular or syntactic-irregular rhythmic sequences and judged the completeness of these sequences. Nonmusicians, as well as musicians, showed a P600 effect to syntactic-irregular endings, indicating that musical exposure and perceptual learning of music are sufficient to enable nonmusicians to process rhythmic syntax at the late stage. However, musicians, but not nonmusicians, also exhibited an early right anterior negativity (ERAN) response to syntactic-irregular endings, which suggests that musical training only modulates the early but not the late stage of rhythmic syntactic processing. These findings revealed for the first time the neural mechanisms underlying the processing of rhythmic syntax in music, which has important implications for theories of hierarchically organized music cognition and comparative studies of syntactic processing in music and language.

Subliminal Emotional Words Impact Syntactic Processing: Evidence from Performance and Event-Related Brain Potentials

Recent studies demonstrate that syntactic processing can be affected by emotional information and that subliminal emotional information can also affect cognitive processes. In this study, we explore whether unconscious emotional information may also impact syntactic processing. In an Event-Related brain Potential (ERP) study, positive, neutral and negative subliminal adjectives were inserted within neutral sentences, just before the presentation of the supraliminal adjective. They could either be correct (50%) or contain a morphosyntactic violation (number or gender disagreements). Larger error rates were observed for incorrect sentences than for correct ones, in contrast to most studies using supraliminal information. Strikingly, emotional adjectives affected the conscious syntactic processing of sentences containing morphosyntactic anomalies. The neutral condition elicited left anterior negativity (LAN) followed by a P600 component. However, a lack of anterior negativity and an early P600 onset for the negative condition were found, probably as a result of the negative subliminal correct adjective capturing early syntactic resources. Positive masked adjectives in turn prompted an N400 component in response to morphosyntactic violations, probably reflecting the induction of a heuristic processing mode involving access to lexico-semantic information to solve agreement anomalies. Our results add to recent evidence on the impact of emotional information on syntactic processing, while showing that this can occur even when the reader is unaware of the emotional stimuli.

Where Is the Beat? The Neural Correlates of Lexical Stress and Rhythmical Well-formedness in Auditory Story Comprehension

While listening to continuous speech, humans process beat information to correctly identify word boundaries. The beats of language are stress patterns that are created by combining lexical (word-specific) stress patterns and the rhythm of a specific language. Sometimes, the lexical stress pattern needs to be altered to obey the rhythm of the language. This study investigated the interplay of lexical stress patterns and rhythmical well-formedness in natural speech with fMRI. Previous electrophysiological studies on cases in which a regular lexical stress pattern may be altered to obtain rhythmical well-formedness showed that even subtle rhythmic deviations are detected by the brain if attention is directed toward prosody. Here, we present a new approach to this phenomenon by having participants listen to contextually rich stories in the absence of a task targeting the manipulation. For the interaction of lexical stress and rhythmical well-formedness, we found one suprathreshold cluster localized between the cerebellum and the brain stem. For the main effect of lexical stress, we found higher BOLD responses to the retained lexical stress pattern in the bilateral SMA, bilateral postcentral gyrus, bilateral middle fontal gyrus, bilateral inferior and right superior parietal lobule, and right precuneus. These results support the view that lexical stress is processed as part of a sensorimotor network of speech comprehension. Moreover, our results connect beat processing in language to domain-independent timing perception.

Aesthetic appreciation of poetry correlates with ease of processing in event-related potentials

Rhetorical theory suggests that rhythmic and metrical features of language substantially contribute to persuading, moving, and pleasing an audience. A potential explanation of these effects is offered by "cognitive fluency theory," which stipulates that recurring patterns (e.g., meter) enhance perceptual fluency and can lead to greater aesthetic appreciation. In this article, we explore these two assertions by investigating the effects of meter and rhyme in the reception of poetry by means of event-related brain potentials (ERPs). Participants listened to four versions of lyrical stanzas that varied in terms of meter and rhyme, and rated the stanzas for rhythmicity and aesthetic liking. The behavioral and ERP results were in accord with enhanced liking and rhythmicity ratings for metered and rhyming stanzas. The metered and rhyming stanzas elicited smaller N400/P600 ERP responses than their nonmetered, nonrhyming, or nonmetered and nonrhyming counterparts. In addition, the N400 and P600 effects for the lyrical stanzas correlated with aesthetic liking effects (metered-nonmetered), implying that modulation of the N400 and P600 has a direct bearing on the aesthetic appreciation of lyrical stanzas. We suggest that these effects are indicative of perceptual-fluency-enhanced aesthetic liking, as postulated by cognitive fluency theory.

The strong, the weak, and the first: The impact of phonological stress on processing of orthographic errors in silent reading

In auditory speech processing, phonological stress functions as an attention holding cue, which facilitates detection of mispronunciations and phonetic deviants in strong syllables as compared to weak ones. Whereas silent reading involves activation of phonological information including word stress, it is not clear whether it has any functional relevance for visual language processing. We investigated whether phonological stress impacts orthographic processing such as detection of misspellings in silent reading. In an ERP experiment, participants silently read intact and misspelled German words. We manipulated the strength of the misspelled syllable (strong vs. weak) as well as its position (word-initial vs. word-middle). No effect of stress was observed for misspellings occurring in a word-initial position suggesting that misspellings in word-initial position disrupt visual word processing regardless of the phonological strength of the first syllable. In contrast, phonological strength modulated the ERPs when misspellings occurred in the middle of the word: misspellings embedded in strong syllables enhanced the P600 and the N400-like component compared to misspellings in weak syllables. In this case, i.e., when misspellings occur in the middle of a letter string, lexical access may be hindered more when errors occur in strong syllables, as reflected in the enhanced N400 in strong compared to weak syllables. This in turn may facilitate active reanalysis as mirrored in the increased P600 in the strong condition. The findings are discussed in the context of the relatively late activation of phonological form in visual word recognition and its interaction with other perceptual visual information. Overall, the results demonstrate the functional significance of phonological stress in visual word processing.

Speech rhythm sensitivity and musical aptitude: ERPs and individual differences

This study investigated the electrophysiological markers of rhythmic expectancy during speech perception. In addition, given the large literature showing overlaps between cognitive and neural resources recruited for language and music, we considered a relation between musical aptitude and individual differences in speech rhythm sensitivity. Twenty adults were administered a standardized assessment of musical aptitude, and EEG was recorded as participants listened to sequences of four bisyllabic words for which the stress pattern of the final word either matched or mismatched the stress pattern of the preceding words. Words with unexpected stress patterns elicited an increased fronto-central mid-latency negativity. In addition, rhythm aptitude significantly correlated with the size of the negative effect elicited by unexpected iambic words, the least common type of stress pattern in English. The present results suggest shared neurocognitive resources for speech rhythm and musical rhythm.

Processing Rhythmic Pattern during Chinese Sentence Reading: An Eye Movement Study

Prosodic constraints play a fundamental role during both spoken sentence comprehension and silent reading. In Chinese, the rhythmic pattern of the verb-object (V-O) combination has been found to rapidly affect the semantic access/integration process during sentence reading (Luo and Zhou, 2010). Rhythmic pattern refers to the combination of words with different syllabic lengths, with certain combinations disallowed (e.g., [2 + 1]; numbers standing for the number of syllables of the verb and the noun respectively) and certain combinations preferred (e.g., [1 + 1] or [2 + 2]). This constraint extends to the situation in which the combination is used to modify other words. A V-O phrase could modify a noun by simply preceding it, forming a V-O-N compound; when the verb is disyllabic, however, the word order has to be O-V-N and the object is preferred to be disyllabic. In this study, we investigated how the reader processes the rhythmic pattern and word order information by recording the reader's eye-movements. We created four types of sentences by crossing rhythmic pattern and word order in compounding. The compound, embedding a disyllabic verb, could be in the correct O-V-N or the incorrect V-O-N order; the object could be disyllabic or monosyllabic. We found that the reader spent more time and made more regressions on and after the compounds when either type of anomaly was detected during the first pass reading. However, during re-reading (after all the words in the sentence have been viewed), less regressive eye movements were found for the anomalous rhythmic pattern, relative to the correct pattern; moreover, only the abnormal rhythmic pattern, not the violated word order, influenced the regressive eye movements. These results suggest that while the processing of rhythmic pattern and word order information occurs rapidly during the initial reading of the sentence, the process of recovering from the rhythmic pattern anomaly may ease the reanalysis processing at the later stage of sentence integration. Thus, rhythmic pattern in Chinese can dynamically affect both local phrase analysis and global sentence integration during silent reading.

Rhythmic Effects of Syntax Processing in Music and Language

Music and language are human cognitive and neural functions that share many structural similarities. Past theories posit a sharing of neural resources between syntax processing in music and language (Patel, 2003), and a dynamic attention network that governs general temporal processing (Large and Jones, 1999). Both make predictions about music and language processing over time. Experiment 1 of this study investigates the relationship between rhythmic expectancy and musical and linguistic syntax in a reading time paradigm. Stimuli (adapted from Slevc et al., 2009) were sentences broken down into segments; each sentence segment was paired with a musical chord and presented at a fixed inter-onset interval. Linguistic syntax violations appeared in a garden-path design. During the critical region of the garden-path sentence, i.e., the particular segment in which the syntactic unexpectedness was processed, expectancy violations for language, music, and rhythm were each independently manipulated: musical expectation was manipulated by presenting out-of-key chords and rhythmic expectancy was manipulated by perturbing the fixed inter-onset interval such that the sentence segments and musical chords appeared either early or late. Reading times were recorded for each sentence segment and compared for linguistic, musical, and rhythmic expectancy. Results showed main effects of rhythmic expectancy and linguistic syntax expectancy on reading time. There was also an effect of rhythm on the interaction between musical and linguistic syntax: effects of violations in musical and linguistic syntax showed significant interaction only during rhythmically expected trials. To test the effects of our experimental design on rhythmic and linguistic expectancies, independently of musical syntax, Experiment 2 used the same experimental paradigm, but the musical factor was eliminated—linguistic stimuli were simply presented silently, and rhythmic expectancy was manipulated at the critical region. Experiment 2 replicated effects of rhythm and language, without an interaction. Together, results suggest that the interaction of music and language syntax processing depends on rhythmic expectancy, and support a merging of theories of music and language syntax processing with dynamic models of attentional entrainment.

The role of rhythm in perceiving speech in noise: a comparison of percussionists, vocalists and non-musicians

The natural rhythms of speech help a listener follow what is being said, especially in noisy conditions. There is increasing evidence for links between rhythm abilities and language skills; however, the role of rhythm-related expertise in perceiving speech in noise is unknown. The present study assesses musical competence (rhythmic and melodic discrimination), speech-in-noise perception and auditory working memory in young adult percussionists, vocalists and non-musicians. Outcomes reveal that better ability to discriminate rhythms is associated with better sentence-in-noise (but not words-in-noise) perception across all participants. These outcomes suggest that sensitivity to rhythm helps a listener understand unfolding speech patterns in degraded listening conditions, and that observations of a "musician advantage" for speech-in-noise perception may be mediated in part by superior rhythm skills.

Noun/verb distinction in English stress homographs: an ERP study

Sensitivity to speech rhythm, especially the pattern of stressed and unstressed syllables, is an important aspect of language acquisition and comprehension from infancy through adulthood. In English, a strong correlation exists between speech rhythm and grammatical class. This property is well illustrated by a particular group of noun/verb homographs that are spelled the same but are pronounced with a lexical stress on the first syllable when used as a noun or on the second syllable when used as a verb. The purpose of this study was to further examine the neural markers of speech rhythm and its role in word recognition. To this end, event-related brain potentials were recorded while participants listened to spoken sentences containing a stress homograph either in a noun or a verb position. The rhythmic structure of the stress homographs was manipulated so that they were pronounced with a stress pattern that either matched or mismatched their grammatical class. Results of cluster-based permutation tests on the event-related brain potentials revealed larger negativities over the centrofrontal scalp regions when the stress homographs were mispronounced, in line with previous studies on lexical ambiguity resolution. In addition, differences between rhythmically unexpected nouns and verbs could be seen as early as 200 ms, suggesting that listeners are sensitive to statistical properties of their language rhythm. Together, these results support the hypothesis that information about speech rhythm is rapidly integrated during speech perception and contributes to lexical retrieval.

fMRI reveals lateralized pattern of brain activity modulated by the metrics of stimuli during auditory rhyme processing

Our fMRI study investigates auditory rhyme processing in spoken language to further elucidate the topic of functional lateralization of language processing. During scanning, 14 subjects listened to four different types of versed word strings and subsequently performed either a rhyme or a meter detection task. Our results show lateralization to auditory-related temporal regions in the right hemisphere irrespective of task. As for the left hemisphere we report responses in the supramarginal gyrus as well as in the opercular part of the inferior frontal gyrus modulated by the presence of regular meter and rhyme. The interaction of rhyme and meter was associated with increased involvement of the superior temporal sulcus and the putamen of the right hemisphere. Overall, these findings support the notion of right-hemispheric specialization for suprasegmental analyses during processing of spoken sentences and provide neuroimaging evidence for the influence of metrics on auditory rhyme processing.

How information structure influences the processing of rhythmic irregularities: ERP evidence from German phrases

This study explores the influence of focus and givenness on the cognitive processing of rhythmic irregularities occurring in natural speech. Previous ERP studies showed that even subtle rhythmic deviations are detected by the brain if attention is directed towards the rhythmic structure. By using question-answer pairs, it was investigated whether subtle rhythmic irregularities in form of stress clashes (two adjacent stressed syllables) and stress lapses (two adjacent unstressed syllables) are still perceived when presented in post-focus position in an answer sentence and attention is directed away from them, towards the meaning of the element in narrow focus position by the preceding wh-question. Moreover, by visually presenting the lexical-semantic input of the deviating structure in the question, the influence of rhythmical and lexical properties in these two forms of rhythmic deviations are disentangled. While words in the present stress clash condition do not deviate from lexical stress, stress lapses contain deviations from metrical and lexical stress. The data reveal an early negativity effect for stress clashes but not for stress lapses, supporting the assumption that they are processed differently. The absence of a negative component for stress lapses indicates that the metrical deviation alone is not salient enough to be registered in non-focus position. Moreover, the lack of a late positive component suggests that subtle rhythmic deviations are less perceivable and hence more acceptable when presented in non-focus position. Thus, these results show that attentional shift induced by information structure influences the degree of the processing of rhythm.

Perspectives on the rhythm-grammar link and its implications for typical and atypical language development

This paper reviews the mounting evidence for shared cognitive mechanisms and neural resources for rhythm and grammar. Evidence for a role of rhythm skills in language development and language comprehension is reviewed here in three lines of research: (1) behavioral and brain data from adults and children, showing that prosody and other aspects of timing of sentences influence online morpho-syntactic processing; (2) comorbidity of impaired rhythm with grammatical deficits in children with language impairment; and (3) our recent work showing a strong positive association between rhythm perception skills and expressive grammatical skills in young school-age children with typical development. Our preliminary follow-up study presented here revealed that musical rhythm perception predicted variance in 6-year-old children's production of complex syntax, as well as online reorganization of grammatical information (transformation); these data provide an additional perspective on the hierarchical relations potentially shared by rhythm and grammar. A theoretical framework for shared cognitive resources for the role of rhythm in perceiving and learning grammatical structure is elaborated on in light of potential implications for using rhythm-emphasized musical training to improve language skills in children.

Time for prediction? The effect of presentation rate on predictive sentence comprehension during word-by-word reading

Predictive processing is a core component of normal language comprehension, but the brain may not engage in prediction to the same extent in all circumstances. This study investigates the effects of timing on anticipatory comprehension mechanisms. Event-related brain potentials (ERPs) were recorded while participants read two-sentence mini-scenarios previously shown to elicit prediction-related effects for implausible items that are categorically related to expected items ('They wanted to make the hotel look more like a tropical resort. So along the driveway they planted rows of PALMS/PINES/TULIPS.'). The first sentence of every pair was presented in its entirety and was self-paced. The second sentence was presented word-by-word with a fixed stimulus onset asynchrony (SOA) of either 500 msec or 250 msec that was manipulated in a within-subjects blocked design. Amplitudes of the N400 ERP component are taken as a neural index of demands on semantic processing. At 500 msec SOA, implausible words related to predictable words elicited reduced N400 amplitudes compared to unrelated words (PINES vs TULIPS), replicating past studies. At 250 msec SOA this prediction-related semantic facilitation was diminished. Thus, timing is a factor in determining the extent to which anticipatory mechanisms are engaged. However, we found evidence that prediction can sometimes be engaged even under speeded presentation rates. Participants who first read sentences in the 250 msec SOA block showed no effect of semantic similarity for this SOA, although these same participants showed the effect in the second block with 500 msec SOA. However, participants who first read sentences in the 500 msec SOA block continued to show the N400 semantic similarity effect in the 250 msec SOA block. These findings add to results showing that the brain flexibly allocates resources to most effectively achieve comprehension goals given the current processing environment.

Bridging music and speech rhythm: rhythmic priming and audio-motor training affect speech perception

Following findings that musical rhythmic priming enhances subsequent speech perception, we investigated whether rhythmic priming for spoken sentences can enhance phonological processing - the building blocks of speech - and whether audio-motor training enhances this effect. Participants heard a metrical prime followed by a sentence (with a matching/mismatching prosodic structure), for which they performed a phoneme detection task. Behavioural (RT) data was collected from two groups: one who received audio-motor training, and one who did not. We hypothesised that 1) phonological processing would be enhanced in matching conditions, and 2) audio-motor training with the musical rhythms would enhance this effect. Indeed, providing a matching rhythmic prime context resulted in faster phoneme detection, thus revealing a cross-domain effect of musical rhythm on phonological processing. In addition, our results indicate that rhythmic audio-motor training enhances this priming effect. These results have important implications for rhythm-based speech therapies, and suggest that metrical rhythm in music and speech may rely on shared temporal processing brain resources.

The relevance of rhythmical alternation in language processing: an ERP study on English compounds

This study investigates the influence of rhythmic expectancies on language processing. It is assumed that language rhythm involves an alternation of strong and weak beats within a linguistic domain. Hence, in some contexts rhythmically induced stress shifts occur in order to comply with the Rhythm Rule. In English, this rule operates to prevent clashes of stressed adjacent syllables or lapses of adjacent unstressed syllables. While previous studies investigated effects on speech production and perception, this study focuses on brain responses to structures either obeying or deviating from this rule. Event-related potentials show that rhythmic regularity is relevant for language processing: rhythmic deviations evoked different ERP components reflecting the deviance from rhythmic expectancies. An N400 effect found for shifted items reflects higher costs in lexical processing due to stress deviation. The overall results disentangle lexical and rhythmical influences on language processing and complement the findings of previous studies on rhythmical processing.

Good, bad and ugly word stress--fMRI evidence for foot structure driven processing of prosodic violations

Using a stress violation paradigm, we investigated whether metrical feet constrain the way prosodic patterns are processed and evaluated. Processing of correctly versus incorrectly stressed words was associated with activation in left posterior angular and retrosplenial cortex, indicating the recognition of an expected and familiar pattern, whereas the inverse contrast yielded enhanced bilateral activation in the superior temporal gyrus, reflecting higher costs in auditory (re-)analysis. More fine-grained analyses of severe versus mild stress violations revealed activations of the left superior temporal and left anterior angular gyrus whereas the opposite contrast led to frontal activations including Broca's area and its right-hemisphere homologue, suggesting that detection of mild violations lead to increased effort in working memory and deeper phonological processing. Our results provide first evidence that different incorrect stress patterns are processed in a qualitatively different way and that the underlying foot structure seems to determine potential stress positions in German words.

Specific aspects of cognitive and language proficiency account for variability in neural indices of semantic and syntactic processing in children

The neural activity mediating language processing in young children is characterized by large individual variability that is likely related in part to individual strengths and weakness across various cognitive abilities. The current study addresses the following question: How does proficiency in specific cognitive and language functions impact neural indices mediating language processing in children? Thirty typically developing seven- and eight-year-olds were divided into high-normal and low-normal proficiency groups based on performance on nonverbal IQ, auditory word recall, and grammatical morphology tests. Event-related brain potentials (ERPs) were elicited by semantic anomalies and phrase structure violations in naturally spoken sentences. The proficiency for each of the specific cognitive and language tasks uniquely contributed to specific aspects (e.g., timing and/or resource allocation) of neural indices underlying semantic (N400) and syntactic (P600) processing. These results suggest that distinct aptitudes within broader domains of cognition and language, even within the normal range, influence the neural signatures of semantic and syntactic processing. Furthermore, the current findings have important implications for the design and interpretation of developmental studies of ERPs indexing language processing, and they highlight the need to take into account cognitive abilities both within and outside the classic language domain.

Perception and bias in the processing of compound versus phrasal stress: evidence from event-related brain potentials

Previous research using picture/word matching tasks has demonstrated a tendency to incorrectly interpret phrasally stressed strings as compounds. Using event-related potentials, we sought to determine whether this pattern stems from poor perceptual sensitivity to the compound/phrasal stress distinction, or from a post-perceptual bias in behavioral response selection. A secondary aim was to gain insight into the role played by contrastive stress patterns in online sentence comprehension. The behavioral results replicated previous findings of a preference for compounds, but the electrophysiological data suggested a robust sensitivity to both stress patterns. When incongruent with the context, both compound and phrasal stress elicited a sustained left-lateralized negativity. Moreover, incongruent compound stress elicited a centro-parietal negativity (N400), while incongruent phrasal stress elicited a late posterior positivity (P600). We conclude that the previous findings of a preference for compounds are due to response selection bias, and not a lack of perceptual sensitivity. The present results complement previous evidence for the immediate use of meter in semantic processing, as well as evidence for late interactions between prosodic and syntactic information.

Speech rhythm facilitates syntactic ambiguity resolution: ERP evidence

In the current event-related potential (ERP) study, we investigated how speech rhythm impacts speech segmentation and facilitates the resolution of syntactic ambiguities in auditory sentence processing. Participants listened to syntactically ambiguous German subject- and object-first sentences that were spoken with either regular or irregular speech rhythm. Rhythmicity was established by a constant metric pattern of three unstressed syllables between two stressed ones that created rhythmic groups of constant size. Accuracy rates in a comprehension task revealed that participants understood rhythmically regular sentences better than rhythmically irregular ones. Furthermore, the mean amplitude of the P600 component was reduced in response to object-first sentences only when embedded in rhythmically regular but not rhythmically irregular context. This P600 reduction indicates facilitated processing of sentence structure possibly due to a decrease in processing costs for the less-preferred structure (object-first). Our data suggest an early and continuous use of rhythm by the syntactic parser and support language processing models assuming an interactive and incremental use of linguistic information during language processing.