The phonotactic influence on the perception of a consonant cluster /pt/ by native English and native Polish listeners: a behavioral and event related potential (ERP) study

Violations of Lab-Learned Phonological Patterns Elicit a Late Positive Component

The experimental study of artificial language learning has become a widely used means of investigating the predictions of theories of language learning and representation. Although much is now known about the generalizations that learners make from various kinds of data, relatively little is known about how those representations affect speech processing. This paper presents an event-related potential (ERP) study of brain responses to violations of lab-learned phonotactics. Novel words that violated a learned phonotactic constraint elicited a larger Late Positive Component (LPC) than novel words that satisfied it. Similar LPCs have been found for violations of natively acquired linguistic structure, as well as for violations of other types of abstract generalizations, such as musical structure. We argue that lab-learned phonotactic generalizations are represented abstractly and affect the evaluation of speech in a manner that is similar to natively acquired syntactic and phonological rules.

Sensory processing of native and non-native phonotactic patterns in the alpha and beta frequency bands

The phonotactic patterns of one's native language are established within cortical network processing during development. Sensory processing of native language phonotactic patterns established in memory may be modulated by top-down signals within the alpha and beta frequency bands. To explore sensory processing of phonotactic patterns in the alpha and beta frequency bands, electroencephalograms (EEGs) were recorded from native Polish and native English-speaking adults as they listened to spoken nonwords within same and different nonword pairs. The nonwords contained three phonological sequence onsets that occur in the Polish and English languages (/pət/, /st/, /sət/) and one onset sequence /pt/, which occurs in Polish but not in English onsets. Source localization modeling was used to transform 64-channel EEGs into brain source-level channels. Spectral power values in the low frequencies (2-29 Hz) were analyzed in response to the first nonword in nonword pairs within the context of counterbalanced listening-task conditions, which were presented on separate testing days. For the with-task listening condition, participants performed a behavioral task to the second nonword in the pairs. For the without-task condition participants were only instructed to listen to the stimuli. Thus, in the with-task condition, the first nonword served as a cue for the second nonword, the target stimulus. The results revealed decreased spectral power in the beta frequency band for the with-task condition compared to the without-task condition in response to native language phonotactic patterns. In contrast, the task-related suppression effects in response to the non-native phonotactic pattern /pt/ for the English listeners extended into the alpha frequency band. These effects were localized to source channels in left auditory cortex, the left anterior temporal cortex and the occipital pole. This exploratory study revealed a pattern of results that, if replicated, suggests that native language speech perception is supported by modulations in the alpha and beta frequency bands.

Difficulties in decoupling articulatory gestures in L2 phonemic sequences: the case of Mandarin listeners' perceptual deletion of English post-vocalic laterals

Nonnative or second language (L2) perception of segmental sequences is often characterised by perceptual modification processes, which may "repair" a nonnative sequence that is phonotactically illegal in the listeners' native language (L1) by transforming the sequence into a sequence that is phonotactically legal in the L1. Often repairs involve the insertion of phonetic materials (epenthesis), but we focus, here, on the less-studied phenomenon of perceptual deletion of nonnative phonemes by testing L1 Mandarin listeners' perception of post-vocalic laterals in L2 English using the triangulating methods of a cross-language goodness rating task, an AXB task, and an AX task. The data were analysed in the framework of the Perceptual Assimilation Model (PAM/PAM-L2), and we further investigated the role of L2 vocabulary size on task performance. The experiments indicate that perceptual deletion occurs when the post-vocalic lateral overlaps with the nucleus vowel in terms of tongue backness specification. In addition, Mandarin listeners' discrimination performance in some contexts was significantly correlated with their English vocabulary size, indicating that continuous growth of vocabulary knowledge can drive perceptual learning of novel L2 segmental sequences and phonotactic structures.

Neural evidence suggests phonological acceptability judgments reflect similarity, not constraint evaluation

Acceptability judgments are a primary source of evidence in formal linguistic research. Within the generative linguistic tradition, these judgments are attributed to evaluation of novel forms based on implicit knowledge of rules or constraints governing well-formedness. In the domain of phonological acceptability judgments, other factors including ease of articulation and similarity to known forms have been hypothesized to influence evaluation. We used data-driven neural techniques to identify the relative contributions of these factors. Granger causality analysis of magnetic resonance imaging (MRI)-constrained magnetoencephalography (MEG) and electroencephalography (EEG) data revealed patterns of interaction between brain regions that support explicit judgments of the phonological acceptability of spoken nonwords. Comparisons of data obtained with nonwords that varied in terms of onset consonant cluster attestation and acceptability revealed different cortical regions and effective connectivity patterns associated with phonological acceptability judgments. Attested forms produced stronger influences of brain regions implicated in lexical representation and sensorimotor simulation on acoustic-phonetic regions, whereas unattested forms produced stronger influence of phonological control mechanisms on acoustic-phonetic processing. Unacceptable forms produced widespread patterns of interaction consistent with attempted search or repair. Together, these results suggest that speakers' phonological acceptability judgments reflect lexical and sensorimotor factors.

Acoustic-level and language-specific processing of native and non-native phonological sequence onsets in the low gamma and theta-frequency bands

Acoustic structures associated with native-language phonological sequences are enhanced within auditory pathways for perception, although the underlying mechanisms are not well understood. To elucidate processes that facilitate perception, time-frequency (T-F) analyses of EEGs obtained from native speakers of English and Polish were conducted. Participants listened to same and different nonword pairs within counterbalanced attend and passive conditions. Nonwords contained the onsets /pt/, /pət/, /st/, and /sət/ that occur in both the Polish and English languages with the exception of /pt/, which never occurs in the English language in word onset. Measures of spectral power and inter-trial phase locking (ITPL) in the low gamma (LG) and theta-frequency bands were analyzed from two bilateral, auditory source-level channels, created through source localization modeling. Results revealed significantly larger spectral power in LG for the English listeners to the unfamiliar /pt/ onsets from the right hemisphere at early cortical stages, during the passive condition. Further, ITPL values revealed distinctive responses in high and low-theta to acoustic characteristics of the onsets, which were modulated by language exposure. These findings, language-specific processing in LG and acoustic-level and language-specific processing in theta, support the view that multi scale temporal processing in the LG and theta-frequency bands facilitates speech perception.

Phonetic Encoding Contributes to the Processing of Linguistic Prosody at the Word Level: Cross-Linguistic Evidence From Event-Related Potentials

PURPOSE

This study aimed to examine whether abstract knowledge of word-level linguistic prosody is independent of or integrated with phonetic knowledge.

METHOD

Event-related potential (ERP) responses were measured from 18 adult listeners while they listened to native and nonnative word-level prosody in speech and in nonspeech. The prosodic phonology (speech) conditions included disyllabic pseudowords spoken in Chinese and in English matched for syllabic structure, duration, and intensity. The prosodic acoustic (nonspeech) conditions were hummed versions of the speech stimuli, which eliminated the phonetic content while preserving the acoustic prosodic features.

RESULTS

We observed language-specific effects on the ERP that native stimuli elicited larger late negative response (LNR) amplitude than nonnative stimuli in the prosodic phonology conditions. However, no such effect was observed in the phoneme-free prosodic acoustic control conditions.

CONCLUSIONS

The results support the integration view that word-level linguistic prosody likely relies on the phonetic content where the acoustic cues embedded in. It remains to be examined whether the LNR may serve as a neural signature for language-specific processing of prosodic phonology beyond auditory processing of the critical acoustic cues at the suprasyllabic level.

Low-frequency cortical responses to natural speech reflect probabilistic phonotactics

Humans comprehend speech despite the various challenges such as mispronunciation and noisy environments. Our auditory system is robust to these thanks to the integration of the sensory input with prior knowledge and expectations built on language-specific regularities. One such regularity regards the permissible phoneme sequences, which determine the likelihood that a word belongs to a given language (phonotactic probability; "blick" is more likely to be an English word than "bnick"). Previous research demonstrated that violations of these rules modulate brain-evoked responses. However, several fundamental questions remain unresolved, especially regarding the neural encoding and integration strategy of phonotactics in naturalistic conditions, when there are no (or few) violations. Here, we used linear modelling to assess the influence of phonotactic probabilities on the brain responses to narrative speech measured with non-invasive EEG. We found that the relationship between continuous speech and EEG responses is best described when the stimulus descriptor includes phonotactic probabilities. This indicates that low-frequency cortical signals (<9 Hz) reflect the integration of phonotactic information during natural speech perception, providing us with a measure of phonotactic processing at the individual subject-level. Furthermore, phonotactics-related signals showed the strongest speech-EEG interactions at latencies of 100-500 ms, supporting a pre-lexical role of phonotactic information.

Language Experience with a Native-Language Phoneme Sequence Modulates the Effects of Attention on Cortical Sensory Processing

Auditory evoked potentials (AEP) reflect spectro-temporal feature changes within the spoken word and are sufficiently reliable to probe deficits in auditory processing. The current research assessed whether attentional modulation would alter the morphology of these AEPs and whether native-language experience with phoneme sequences would influence the effects of attention. Native-English and native-Polish adults listened to nonsense word pairs that contained the phoneme sequence onsets /st/, /sət/, /pət/ that occur in both the Polish and English languages and the phoneme sequence onset /pt/ that occurs in the Polish language, but not the English language. Participants listened to word pairs within two experimental conditions designed to modulate attention. In one condition, participants listened to word pairs and performed a behavioral task to the second word in the pairs (“with task”) and in the alternate condition participants listened to word pairs without performing a task (“without task”). Conditions were counterbalanced so that half the English and Polish subjects performed the “without task” condition as the first testing session and the “with task” condition as the second testing session. The remaining English and Polish subjects performed the tasks in the reverse order. Two or more months separated the testing sessions. Task conditions did not modulate the morphology of the AEP. Attention, however, modulated the AEP by producing a negative shift in the overall waveform. This effect of attention was modulated by experience with a native-language phoneme sequence. Thus, only Polish listeners showed an effect of attention to the native language /pt/ onset when the behavioral task occurred as the second testing session for which attention demands were reduced. This effect began at 400 ms and suggests a mechanism at intermediate stages within auditory cortex that facilitates recognition of the native language for comprehension.

Stability of the Cortical Sensory Waveforms, the P1-N1-P2 Complex and T-Complex, of Auditory Evoked Potentials

Purpose

Atypical cortical sensory waveforms reflecting impaired encoding of auditory stimuli may result from inconsistency in cortical response to the acoustic feature changes within spoken words. Thus, the present study assessed intrasubject stability of the P1-N1-P2 complex and T-complex to multiple productions of spoken nonwords in 48 adults to provide benchmarks for future studies probing auditory processing deficits.

Method

Response trials were split (split epoch averages) for each of 4 word types for each subject and compared for similarity in waveform morphology. Waveform morphology association was assessed between 50 and 600 ms, the time frame reflecting spectro-temporal feature processing for the stimuli used in the study.

Results

Using approximately 70 trials in each split epoch, the P1-N1-P2 complex was found to be highly stable, with high positive associations found for all subjects for at least 3 word types. The T-complex was more variable, with high positive associations found for all subjects to at least 1 word type.

Conclusions

The P1-N1-P2 split epochs at group and individual levels and the T-complex at group level can be used to assess consistency of neural response in individuals with auditory processing deficits. The T-complex relative to the P1-N1-P2 complex in individuals can provide information pertaining to phonological processing.

Impact of associative word learning on phonotactic processing in 6-month-old infants: A combined EEG and fNIRS study

During early language development native phonotactics are acquired in a 'bottom-up' fashion, relying on exquisite auditory differentiation skills operational from birth. Since basic lexico-semantic abilities have been demonstrated from 6 months onwards, 'top-down' influences on phonotactic learning may complement the extraction of transitional probabilities in phonotactic learning. Such a bidirectional acquisition strategy predicts, that familiarization with (proto)words should affect processing of untrained word-forms of similar phonological structure. We investigated 6-month-old infants undergoing an associative training to establish a pseudoword-pseudoobject link. Comparison between pre- and post-training responses to trained and untrained items allowed investigating training effects. Additionally phonotactic status (50% legal, 50% illegal with regard to German) allowed investigating influences of previous language experience. EEG and functional near-infrared spectroscopy (fNIRS) provided measures of electrophysiological and hemodynamic responses. We find evidence for a robust effect of associative training on pseudoword processing when presented in isolation. This transferred to untrained items. Previous linguistic experience showed a much weaker effect. Taken together the results suggest that sensitivity to phonotactic contrasts is present at 6 months, but that acceptance as lexical candidates is rapidly modulated when word forms following non-native phonotactics become potentially meaningful due to repeated exposure in a semantic context.

Electrophysiological indices of brain activity to content and function words in discourse

BACKGROUND

An increase in positivity of event-related potentials (ERPs) at the lateral anterior sites has been hypothesized to be an index of semantic and discourse processing, with the right lateral anterior positivity (LAP) showing particular sensitivity to discourse factors. However, the research investigating the LAP is limited; it is unclear whether the effect is driven by word class (function word versus content word) or by a more general process of structure building triggered by elements of a determiner phrase (DP).

AIMS

To examine the neurophysiological indices of semantic/discourse integration using two different word categories (function versus content word) in the discourse contexts and to contrast processing of these word categories in meaningful versus nonsense contexts.

METHODS & PROCEDURES

Planned comparisons of ERPs time locked to a function word stimulus 'the' and a content word stimulus 'cats' in sentence-initial position were conducted in both discourse and nonsense contexts to examine the time course of processing following these word forms.

OUTCOMES & RESULTS

A repeated-measures analysis of variance (ANOVA) for the Discourse context revealed a significant interaction of condition and site due to greater positivity for 'the' relative to 'cats' at anterior and superior sites. In the Nonsense context, there was a significant interaction of condition, time and site due to greater positivity for 'the' relative to 'cats' at anterior sites from 150 to 350 ms post-stimulus offset and at superior sites from 150 to 200 ms post-stimulus offset. Overall, greater positivity for both 'the' and 'cats' was observed in the discourse relative to the nonsense context beginning approximately 150 ms post-stimulus offset. Additionally, topographical analyses were highly correlated for the two word categories when processing meaningful discourse. This topographical pattern could be characterized as a prominent right LAP. The LAP was attenuated when the target stimulus word initiated a nonsense context.

CONCLUSIONS & IMPLICATIONS

The results of this study support the view that the right LAP is an index of general discourse processing rather than an index of word class. These findings demonstrate that the LAP can be used to study discourse processing in populations with compromised metalinguistic skills, such as adults with aphasia or traumatic brain injury.

Repair or Violation Detection? Pre-Attentive Processing Strategies of Phonotactic Illegality Demonstrated on the Constraint of g-Deletion in German

PURPOSE

Effects of categorical phonotactic knowledge on pre-attentive speech processing were investigated by presenting illegal speech input that violated a phonotactic constraint in German called "g-deletion." The present study aimed to extend previous findings of automatic processing of phonotactic violations and to investigate the role of stimulus context in triggering either an automatic phonotactic repair or a detection of the violation.

METHOD

The mismatch negativity event-related potential component was obtained in 2 identical cross-sectional experiments with speaker variation and 16 healthy adult participants each. Four pseudowords were used as stimuli, 3 of them phonotactically legal and 1 illegal. Stimuli were contrasted pairwise in passive oddball conditions and presented binaurally via headphones. Results were analyzed by means of mixed design analyses of variance.

RESULTS

Phonotactically illegal stimuli were found to be processed differently compared to legal ones. Results indicate evidence for both automatic repair and detection of the phonotactic violation depending on the linguistic context the illegal stimulus was embedded in.

CONCLUSIONS

These findings corroborate notions that categorical phonotactic knowledge is activated and applied even in the absence of attention. Thus, our findings contribute to the general understanding of sublexical phonological processing and may be of use for further developing speech recognition models.

Representation of spectro-temporal features of spoken words within the P1-N1-P2 and T-complex of the auditory evoked potentials (AEP)

The purpose of the study was to determine whether P1-N1-P2 and T-complex morphology reflect spectro-temporal features within spoken words that approximate the natural variation of a speaker and whether waveform morphology is reliable at group and individual levels, necessary for probing auditory deficits. The P1-N1-P2 and T-complex to the syllables /pət/ and /sət/ within 70 natural word productions each were examined. EEG was recorded while participants heard nonsense word pairs and performed a syllable identification task to the second word in the pairs. Single trial auditory evoked potentials (AEP) to the first words were analyzed. Results found P1-N1-P2 and T-complex to reflect spectral and temporal feature processing. Also, results identified preliminary benchmarks for single trial response variability for individual subjects for sensory processing between 50 and 600ms. P1-N1-P2 and T-complex, at least at group level, may serve as phenotypic signatures to identify deficits in spectro-temporal feature recognition and to determine area of deficit, the superior temporal plane or lateral superior temporal gyrus.

Rules from words: a dynamic neural basis for a lawful linguistic process

Listeners show a reliable bias towards interpreting speech sounds in a way that conforms to linguistic restrictions (phonotactic constraints) on the permissible patterning of speech sounds in a language. This perceptual bias may enforce and strengthen the systematicity that is the hallmark of phonological representation. Using Granger causality analysis of magnetic resonance imaging (MRI)-constrained magnetoencephalography (MEG) and electroencephalography (EEG) data, we tested the differential predictions of rule-based, frequency-based, and top-down lexical influence-driven explanations of processes that produce phonotactic biases in phoneme categorization. Consistent with the top-down lexical influence account, brain regions associated with the representation of words had a stronger influence on acoustic-phonetic regions in trials that led to the identification of phonotactically legal (versus illegal) word-initial consonant clusters. Regions associated with the application of linguistic rules had no such effect. Similarly, high frequency phoneme clusters failed to produce stronger feedforward influences by acoustic-phonetic regions on areas associated with higher linguistic representation. These results suggest that top-down lexical influences contribute to the systematicity of phonological representation.

The effect of native-language experience on the sensory-obligatory components, the P1-N1-P2 and the T-complex

The influence of native-language experience on sensory-obligatory auditory-evoked potentials (AEPs) was investigated in native-English and native-Polish listeners. AEPs were recorded to the first word in nonsense word pairs, while participants performed a syllable identification task to the second word in the pairs. Nonsense words contained phoneme sequence onsets (i.e., /pt/, /pət/, /st/ and /sət/) that occur in the Polish and English languages, with the exception that /pt/ at syllable onset is an illegal phonotactic form in English. P1-N1-P2 waveforms from fronto-central electrode sites were comparable in English and Polish listeners, even though, these same English participants were unable to distinguish the nonsense words having /pt/ and /pət/ onsets. The P1-N1-P2 complex indexed the temporal characteristics of the word stimuli in the same manner for both language groups. Taken together, these findings suggest that the fronto-central P1-N1-P2 complex reflects acoustic feature processing of speech and is not significantly influenced by exposure to the phoneme sequences of the native-language. In contrast, the T-complex from bilateral posterior temporal sites was found to index phonological as well as acoustic feature processing to the nonsense word stimuli. An enhanced negativity for the /pt/ cluster relative to its contrast sequence (i.e., /pət/) occurred only for the Polish listeners, suggesting that neural networks within non-primary auditory cortex may be involved in early cortical phonological processing.