Determinants of dominance: Is language laterality explained by physical or linguistic features of speech?

The Role of Letter-Speech Sound Integration in Native and Second Language Reading: A Study in Native Japanese Readers Learning English

The automatic activation of letter-speech sound (L-SS) associations is a vital step in typical reading acquisition. However, the contribution of L-SS integration during nonalphabetic native and alphabetic second language (L2) reading remains unclear. This study explored whether L-SS integration plays a similar role in a nonalphabetic language as in alphabetic languages and its contribution to L2 reading among native Japanese-speaking adults with varying English proficiency. A priming paradigm in Japanese and English was performed by presenting visual letters or symbols, followed by auditory sounds. We compared behavioral and event-related responses elicited by congruent letter-sound pairs, incongruent pairs, and baseline condition (symbol-sound pairs). The behavioral experiment revealed shorter RTs in the congruent condition for Japanese and English tasks, suggesting a facilitation effect of congruency. The ERP experiment results showed an increased early N1 response to Japanese congruent pairs compared to corresponding incongruent stimuli at the left frontotemporal electrodes. Interestingly, advanced English learners exhibited greater activities in bilateral but predominantly right-lateralized frontotemporal regions for the congruent condition within the N1 time window. Moreover, the enhancement of P2 response to congruent pairs was observed in intermediate English learners. These findings indicate that, despite deviations from native language processing, advanced speakers may successfully integrate letters and sounds during English reading, whereas intermediate learners may encounter difficulty in achieving L-SS integration when reading L2. Furthermore, our results suggest that L2 proficiency may affect the level of automaticity in L-SS integration, with the right P2 congruency effect playing a compensatory role for intermediate learners.

Regionally specific cortical lateralization of abstract and concrete verb processing: Magnetic mismatch negativity study

The neural underpinnings of processing concrete and abstract semantics remain poorly understood. Previous fMRI studies have shown that multimodal and amodal neural networks respond differentially to different semantic types; importantly, abstract semantics activates more left-lateralized networks, as opposed to more bilateral activity for concrete words. Due to the lack of temporal resolution, these fMRI results do not allow to easily separate language- and task-specific brain responses and to disentangle early processing stages from later post-comprehension phenomena. To tackle this, we used magnetoencephalography (MEG), a time-resolved neuroimaging technique, in combination with a task-free oddball mismatch negativity (MMN) paradigm, an established approach to tracking early automatic activation of word-specific memory traces in the brain. We recorded the magnetic MMN responses in 30 healthy adults to auditorily presented abstract and concrete action verbs to assess lateralization of word-specific lexico-semantic processing in a set of neocortical areas. We found that MMN responses to these stimuli showed different lateralization patterns of activity in the upper limb motor area (BA4) and parts of Broca's area (BA45/BA47) within ∼100-350 ms after the word disambiguation point. Importantly, the greater leftward response lateralization for abstract semantics was due to the lesser involvement of the right-hemispheric homologues, not increased left-hemispheric activity. These findings suggest differential region-specific involvement of bilateral sensorimotor systems already in the early automatic stages of processing abstract and concrete action semantics.

Different hemispheric lateralization for periodicity and formant structure of vowels in the auditory cortex and its changes between childhood and adulthood

The spectral formant structure and periodicity pitch are the major features that determine the identity of vowels and the characteristics of the speaker. However, very little is known about how the processing of these features in the auditory cortex changes during development. To address this question, we independently manipulated the periodicity and formant structure of vowels while measuring auditory cortex responses using magnetoencephalography (MEG) in children aged 7-12 years and adults. We analyzed the sustained negative shift of source current associated with these vowel properties, which was present in the auditory cortex in both age groups despite differences in the transient components of the auditory response. In adults, the sustained activation associated with formant structure was lateralized to the left hemisphere early in the auditory processing stream requiring neither attention nor semantic mapping. This lateralization was not yet established in children, in whom the right hemisphere contribution to formant processing was strong and decreased during or after puberty. In contrast to the formant structure, periodicity was associated with a greater response in the right hemisphere in both children and adults. These findings suggest that left-lateralization for the automatic processing of vowel formant structure emerges relatively late in ontogenesis and pose a serious challenge to current theories of hemispheric specialization for speech processing.

Handedness Development: A Model for Investigating the Development of Hemispheric Specialization and Interhemispheric Coordination

The author presents his perspective on the character of science, development, and handedness and relates these to his investigations of the early development of handedness. After presenting some ideas on what hemispheric specialization of function might mean for neural processing and how handedness should be assessed, the neuroscience of control of the arms/hands and interhemispheric communication and coordination are examined for how developmental processes can affect these mechanisms. The author’s work on the development of early handedness is reviewed and placed within a context of cascading events in which different forms of handedness emerge from earlier forms but not in a deterministic manner. This approach supports a continuous rather than categorical distribution of handedness and accounts for the predominance of right-handedness while maintaining a minority of left-handedness. Finally, the relation of the development of handedness to the development of several language and cognitive skills is examined.

Perceptual Asymmetries and Auditory Processing of Estonian Quantities

Similar to visual perception, auditory perception also has a clearly described “pop-out” effect, where an element with some extra feature is easier to detect among elements without an extra feature. This phenomenon is better known as auditory perceptual asymmetry. We investigated such asymmetry between shorter or longer duration, and level or falling of pitch of linguistic stimuli that carry a meaning in one language (Estonian), but not in another (Russian). For the mismatch negativity (MMN) experiment, we created four different types of stimuli by modifying the duration of the first vowel [ɑ] (170, 290 ms) and pitch contour (level vs. falling pitch) of the stimuli words (‘SATA,’ ‘SAKI’). The stimuli were synthesized from Estonian words (‘SATA,’ ‘SAKI’) and follow the Estonian language three-way quantity system, which incorporates tonal features (falling pitch contour) together with temporal patterns. This made the meaning of the word dependent on the combination of both features and allows us to compare the relative contribution of duration and pitch contour in discrimination of language stimuli in the brain via MMN generation. The participants of the experiment were 12 Russian native speakers with little or no experience in Estonian and living in Estonia short-term, and 12 Estonian native speakers (age 18–27 years). We found that participants’ perception of the linguistic stimuli differed not only according to the physical features but also according to their native language, confirming that the meaning of the word interferes with the early automatic processing of phonological features. The GAMM and ANOVA analysis of the reversed design results showed that the deviant with longer duration among shorter standards elicited a MMN response with greater amplitude than the short deviant among long standards, while changes in pitch contour (falling vs. level pitch) produced neither strong MMN nor asymmetry. Thus, we demonstrate the effect of language background on asymmetric perception of linguistic stimuli that aligns with those of previous studies (Jaramillo et al., 2000), and contributes to the growing body of knowledge supporting auditory perceptual asymmetry.

Acoustics versus linguistics? Context is Part and Parcel to lateralized processing of the parts and parcels of speech

The purpose of this review is to provide an accessible exploration of key considerations of lateralization in speech and non-speech perception using clear and defined language. From these considerations, the primary arguments for each side of the linguistics versus acoustics debate are outlined and explored in context of emerging integrative theories. This theoretical approach entails a perspective that linguistic and acoustic features differentially contribute to leftward bias, depending on the given context. Such contextual factors include stimulus parameters and variables of stimulus presentation (e.g., noise/silence and monaural/binaural) and variances in individuals (sex, handedness, age, and behavioural ability). Discussion of these factors and their interaction is also aimed towards providing an outline of variables that require consideration when developing and reviewing methodology of acoustic and linguistic processing laterality studies. Thus, there are three primary aims in the present paper: (1) to provide the reader with key theoretical perspectives from the acoustics/linguistics debate and a synthesis of the two viewpoints, (2) to highlight key caveats for generalizing findings regarding predominant models of speech laterality, and (3) to provide a practical guide for methodological control using predominant behavioural measures (i.e., gap detection and dichotic listening tasks) and/or neurophysiological measures (i.e., mismatch negativity) of speech laterality.

Multilevel fMRI adaptation for spoken word processing in the awake dog brain

Human brains process lexical meaning separately from emotional prosody of speech at higher levels of the processing hierarchy. Recently we demonstrated that dog brains can also dissociate lexical and emotional prosodic information in human spoken words. To better understand the neural dynamics of lexical processing in the dog brain, here we used an event-related design, optimized for fMRI adaptation analyses on multiple time scales. We investigated repetition effects in dogs’ neural (BOLD) responses to lexically marked (praise) words and to lexically unmarked (neutral) words, in praising and neutral prosody. We identified temporally and anatomically distinct adaptation patterns. In a subcortical auditory region, we found both short- and long-term fMRI adaptation for emotional prosody, but not for lexical markedness. In multiple cortical auditory regions, we found long-term fMRI adaptation for lexically marked compared to unmarked words. This lexical adaptation showed right-hemisphere bias and was age-modulated in a near-primary auditory region and was independent of prosody in a secondary auditory region. Word representations in dogs’ auditory cortex thus contain more than just the emotional prosody they are typically associated with. These findings demonstrate multilevel fMRI adaptation effects in the dog brain and are consistent with a hierarchical account of spoken word processing.

The oscillatory mechanisms associated with syntactic binding in healthy ageing

Older adults frequently display differential patterns of brain activity compared to young adults in the same task, alongside widespread neuroanatomical changes. Differing functional activity patterns in older adults are commonly interpreted as being compensatory (e.g., Cabeza et al., 2002). We examined the oscillatory activity in the EEG during syntactic binding in young and older adults, as well as the relationship between oscillatory activity and behavioural performance on a syntactic judgement task within the older adults. 19 young and 41 older adults listened to two-word sentences that differentially load onto morpho-syntactic binding: correct syntactic binding (morpho-syntactically correct, e.g., "I dotch"); incorrect syntactic binding (morpho-syntactic agreement violation, e.g., "they dotches") and no syntactic binding (minimizing morpho-syntactic binding, e.g., "dotches spuff"). Behavioural performance, assessed in a syntactic judgement task, was characterized by inter-individual variability especially in older adults, with accuracy ranging from 76 to 100% in young adults and 58-100% in older adults. Compared to young adults, older adults were slower, but not less accurate. Functional neural signatures for syntactic binding were assessed as the difference in oscillatory power between the correct and no syntactic binding condition. In older adults, syntactic binding was associated with a smaller increase in theta (4-7 Hz), alpha (8-12 Hz) and beta (15-20 Hz) power in a time window surrounding the second word. There was a significant difference between the older and young adults: in the alpha range, the condition difference seemed to be in the opposite direction for older versus young adults. Our findings thus suggest that the neural signature associated with syntactic binding in older adults is different from young adults. However, we found no evidence of a significant association between behavioural performance and the neural signatures of syntactic binding for older adults, which does not readily support the predictions of compensatory models of language and ageing.

Tracking the Effects of Top-Down Attention on Word Discrimination Using Frequency-tagged Neuromagnetic Responses

Discrimination of words from nonspeech sounds is essential in communication. Still, how selective attention can influence this early step of speech processing remains elusive. To answer that question, brain activity was recorded with magnetoencephalography in 12 healthy adults while they listened to two sequences of auditory stimuli presented at 2.17 Hz, consisting of successions of one randomized word (tagging frequency = 0.54 Hz) and three acoustically matched nonverbal stimuli. Participants were instructed to focus their attention on the occurrence of a predefined word in the verbal attention condition and on a nonverbal stimulus in the nonverbal attention condition. Steady-state neuromagnetic responses were identified with spectral analysis at sensor and source levels. Significant sensor responses peaked at 0.54 and 2.17 Hz in both conditions. Sources at 0.54 Hz were reconstructed in supratemporal auditory cortex, left superior temporal gyrus (STG), left middle temporal gyrus, and left inferior frontal gyrus. Sources at 2.17 Hz were reconstructed in supratemporal auditory cortex and STG. Crucially, source strength in the left STG at 0.54 Hz was significantly higher in verbal attention than in nonverbal attention condition. This study demonstrates speech-sensitive responses at primary auditory and speech-related neocortical areas. Critically, it highlights that, during word discrimination, top-down attention modulates activity within the left STG. This area therefore appears to play a crucial role in selective verbal attentional processes for this early step of speech processing.

Neurophysiological Correlates of Fast Mapping of Novel Words in the Adult Brain

Word acquisition could be mediated by the neurocognitive mechanism known as fast mapping (FM). It refers to a process of incidental exclusion-based learning and is believed to be a critical mechanism for the rapid build-up of lexicon, although its neural mechanisms are still poorly understood. To investigate the neural bases of this key learning skill, we used event-related potentials (ERPs) and employed an audio-visual paradigm that included a counterbalanced set of familiar and novel spoken word forms presented, in a single exposure, in conjunction with novel and familiar images. To define learning-related brain dynamics, passive auditory ERPs, known to index long-term memory trace activation, were recorded before and after the FM task. Following the single FM learning exposure, we found a significant enhancement in neural activation elicited by the newly trained word form, which was expressed at ~200-400 ms after the word onset. No similar amplitude increase was found either for the native familiar word used as a control stimulus in the same learning paradigm or for similar control stimuli which were not subject to training. Topographic analysis suggested a left-lateral shift of the ERP scalp distribution for the novel FM word form, underpinned by fronto-temporal cortical sources, which may indicate the involvement of pre-existing neurolinguistic networks for mastering new word forms with native phonology. Overall, the near-instant changes in neural activity after a single-shot novel word training indicate that FM could promote rapid integration of newly learned items into the brain's neural lexicon, even in adulthood.

Domain-general and domain-specific computations in single word processing

Language comprehension relies on a multitude of domain-general and domain-specific cognitive operations. This study asks whether the domain-specific grammatical computations are obligatorily invoked whenever we process linguistic inputs. Using fMRI and three complementary measures of neural activity, we tested how domain-general and domain-specific demands of single word comprehension engage cortical language networks, and whether the left frontotemporal network (commonly taken to support domain-specific grammatical computations) automatically processes grammatical information present in inflectionally complex words. In a natural listening task, participants were presented with words that manipulated domain-general and domain-specific processing demands in a 2 × 2 manner. The results showed that only domain-general demands of mapping words onto their representations consistently engaged the language processing system during single word comprehension, triggering increased activity and connectivity in bilateral frontotemporal regions, as well as bilateral encoding across multivoxel activity patterns. In contrast, inflectional complexity failed to activate left frontotemporal regions in this task, implying that domain-specific grammatical processing in the left hemisphere is not automatically triggered when the processing context does not specifically require such analysis. This suggests that cortical computations invoked by language processing critically depend on the current communicative goals and demands, underlining the importance of domain-general processes in language comprehension, and arguing against the strong domain-specific view of the LH network function.

MVPA Analysis of Intertrial Phase Coherence of Neuromagnetic Responses to Words Reliably Classifies Multiple Levels of Language Processing in the Brain

Neural processing of language is still among the most poorly understood functions of the human brain, whereas a need to objectively assess the neurocognitive status of the language function in a participant-friendly and noninvasive fashion arises in various situations. Here, we propose a solution for this based on a short task-free recording of MEG responses to a set of spoken linguistic contrasts. We used spoken stimuli that diverged lexically (words/pseudowords), semantically (action-related/abstract), or morphosyntactically (grammatically correct/ungrammatical). Based on beamformer source reconstruction we investigated intertrial phase coherence (ITPC) in five canonical bands (α, β, and low, medium, and high γ) using multivariate pattern analysis (MVPA). Using this approach, we could successfully classify brain responses to meaningful words from meaningless pseudowords, correct from incorrect syntax, as well as semantic differences. The best classification results indicated distributed patterns of activity dominated by core temporofrontal language circuits and complemented by other areas. They varied between the different neurolinguistic properties across frequency bands, with lexical processes classified predominantly by broad γ, semantic distinctions by α and β, and syntax by low γ feature patterns. Crucially, all types of processing commenced in a near-parallel fashion from ∼100 ms after the auditory information allowed for disambiguating the spoken input. This shows that individual neurolinguistic processes take place simultaneously and involve overlapping yet distinct neuronal networks that operate at different frequency bands. This brings further hope that brain imaging can be used to assess neurolinguistic processes objectively and noninvasively in a range of populations.

Congruency of Separable Affix Verb Combinations Is Linearly Indexed by the N400

Separable affix verbs consist of a stem and a derivational affix, which, in some languages can appear together or in discontinuous, distributed form, e.g., German “aufgreifen” and “greifen … auf” [“up-pick(ing)” and “pick … up”]. Certain stems can combine with only certain affixes. However, many such combinations are evaluated not as clearly correct or incorrect, but frequently take an intermediate status with participants rating them ambiguously. Here, we mapped brain responses to combinations of verb stems and affixes realized in short sentences, including more and less common particle verbs, borderline acceptable combinations and clear violations. Event-related potential responses to discontinuous particle verbs were obtained for five affixes re-combined with 10 verb stems, situated within short, German sentences, i.e., “sie <stem>en es <affix>,” English: “they <stem> it <affix>.” The congruity of combinations was assessed both with behavioral ratings of the stimuli and corpus-derived probability measures. The size of a frontal N400 correlated with the degree of incongruency between stem and affix, as assessed by both measures. Behavioral ratings performed better than corpus-derived measures in predicting N400 magnitudes, and a combined model performed best of all. No evidence for a discrete, right/wrong effect was found. We discuss methodological implications and integrate the results into past research on the N400 and neurophysiological studies on separable-affix verbs, generally.

Spread the word: MMN brain response reveals whole-form access of discontinuous particle verbs

The status of particle verbs such as rise (…) up as either lexically stored or combinatorially assembled is an issue which so far has not been settled decisively. In this study, we use the mismatch negativity (MMN) brain response to observe neurophysiological responses to discontinuous particle verbs. The MMN can be used to distinguish between whole-form storage and combinatorial processes, as it is enhanced to stored words compared to unknown pseudowords, whereas combinatorially legal strings elicit a reduced MMN relative to ungrammatical ones. Earlier work had found larger MMNs to congruent than to incongruent verb-particle combinations when particle and verb appeared as adjacent elements, thus suggesting whole-form storage at least in this case. However, it is still possible that particle verbs discontinuously spread out across a sentence would elicit the combinatorial, grammar-violation response pattern instead. Here, we tested the brain signatures of discontinuous verb-particle combinations, orthogonally varying congruence and semantic transparency. The results show for the first time brain indices of whole-form storage for discontinuous constituents, thus arguing in favour of access to whole-form-stored lexical elements in the processing of particle verbs, irrespective of their semantic opacity. Results are discussed in the context of linguistic debates about the status of particle verbs as words, lexical elements or syntactically generated combinations. The explanation of the pattern of results within a neurobiological language model is highlighted.

Common variation in the autism risk gene CNTNAP2, brain structural connectivity and multisensory speech integration

Three lines of evidence motivated this study. 1) CNTNAP2 variation is associated with autism risk and speech-language development. 2) CNTNAP2 variations are associated with differences in white matter (WM) tracts comprising the speech-language circuitry. 3) Children with autism show impairment in multisensory speech perception. Here, we asked whether an autism risk-associated CNTNAP2 single nucleotide polymorphism in neurotypical adults was associated with multisensory speech perception performance, and whether such a genotype-phenotype association was mediated through white matter tract integrity in speech-language circuitry. Risk genotype at rs7794745 was associated with decreased benefit from visual speech and lower fractional anisotropy (FA) in several WM tracts (right precentral gyrus, left anterior corona radiata, right retrolenticular internal capsule). These structural connectivity differences were found to mediate the effect of genotype on audiovisual speech perception, shedding light on possible pathogenic pathways in autism and biological sources of inter-individual variation in audiovisual speech processing in neurotypicals.

Therapy-Induced Neuroplasticity of Language in Chronic Post Stroke Aphasia: A Mismatch Negativity Study of (A)Grammatical and Meaningful/less Mini-Constructions

Clinical language performance and neurophysiological correlates of language processing were measured before and after intensive language therapy in patients with chronic (time post stroke >1 year) post stroke aphasia (PSA). As event-related potential (ERP) measure, the mismatch negativity (MMN) was recorded in a distracted oddball paradigm to short spoken sentences. Critical 'deviant' sentence stimuli where either well-formed and meaningful, or syntactically, or lexico-semantically incorrect. After 4 weeks of speech-language therapy (SLT) delivered with high intensity (10.5 h per week), clinical language assessment with the Aachen Aphasia Test battery demonstrated significant linguistic improvements, which were accompanied by enhanced MMN responses. More specifically, MMN amplitudes to grammatically correct and meaningful mini-constructions and to 'jabberwocky' sentences containing a pseudoword significantly increased after therapy. However, no therapy-related changes in MMN responses to syntactically incorrect strings including agreement violations were observed. While MMN increases to well-formed meaningful strings can be explained both at the word and construction levels, the neuroplastic change seen for 'jabberwocky' sentences suggests an explanation in terms of constructions. The results confirm previous reports that intensive SLT leads to improvements of linguistic skills in chronic aphasia patients and now demonstrate that this clinical improvement is associated with enhanced automatic brain indexes of construction processing, although no comparable change is present for ungrammatical strings. Furthermore, the data confirm that the language-induced MMN is a useful tool to map functional language recovery in PSA.

Vowels and Consonants in the Brain: Evidence from Magnetoencephalographic Studies on the N1m in Normal-Hearing Listeners

Speech sound perception is one of the most fascinating tasks performed by the human brain. It involves a mapping from continuous acoustic waveforms onto the discrete phonological units computed to store words in the mental lexicon. In this article, we review the magnetoencephalographic studies that have explored the timing and morphology of the N1m component to investigate how vowels and consonants are computed and represented within the auditory cortex. The neurons that are involved in the N1m act to construct a sensory memory of the stimulus due to spatially and temporally distributed activation patterns within the auditory cortex. Indeed, localization of auditory fields maps in animals and humans suggested two levels of sound coding, a tonotopy dimension for spectral properties and a tonochrony dimension for temporal properties of sounds. When the stimulus is a complex speech sound, tonotopy and tonochrony data may give important information to assess whether the speech sound parsing and decoding are generated by pure bottom-up reflection of acoustic differences or whether they are additionally affected by top-down processes related to phonological categories. Hints supporting pure bottom-up processing coexist with hints supporting top-down abstract phoneme representation. Actually, N1m data (amplitude, latency, source generators, and hemispheric distribution) are limited and do not help to disentangle the issue. The nature of these limitations is discussed. Moreover, neurophysiological studies on animals and neuroimaging studies on humans have been taken into consideration. We compare also the N1m findings with the investigation of the magnetic mismatch negativity (MMNm) component and with the analogous electrical components, the N1 and the MMN. We conclude that N1 seems more sensitive to capture lateralization and hierarchical processes than N1m, although the data are very preliminary. Finally, we suggest that MEG data should be integrated with EEG data in the light of the neural oscillations framework and we propose some concerns that should be addressed by future investigations if we want to closely line up language research with issues at the core of the functional brain mechanisms.

Is the Sensorimotor Cortex Relevant for Speech Perception and Understanding? An Integrative Review

In the neuroscience of language, phonemes are frequently described as multimodal units whose neuronal representations are distributed across perisylvian cortical regions, including auditory and sensorimotor areas. A different position views phonemes primarily as acoustic entities with posterior temporal localization, which are functionally independent from frontoparietal articulatory programs. To address this current controversy, we here discuss experimental results from functional magnetic resonance imaging (fMRI) as well as transcranial magnetic stimulation (TMS) studies. On first glance, a mixed picture emerges, with earlier research documenting neurofunctional distinctions between phonemes in both temporal and frontoparietal sensorimotor systems, but some recent work seemingly failing to replicate the latter. Detailed analysis of methodological differences between studies reveals that the way experiments are set up explains whether sensorimotor cortex maps phonological information during speech perception or not. In particular, acoustic noise during the experiment and ‘motor noise’ caused by button press tasks work against the frontoparietal manifestation of phonemes. We highlight recent studies using sparse imaging and passive speech perception tasks along with multivariate pattern analysis (MVPA) and especially representational similarity analysis (RSA), which succeeded in separating acoustic-phonological from general-acoustic processes and in mapping specific phonological information on temporal and frontoparietal regions. The question about a causal role of sensorimotor cortex on speech perception and understanding is addressed by reviewing recent TMS studies. We conclude that frontoparietal cortices, including ventral motor and somatosensory areas, reflect phonological information during speech perception and exert a causal influence on language understanding.

Neural mechanisms for lexical processing in dogs

During speech processing, human listeners can separately analyze lexical and intonational cues to arrive at a unified representation of communicative content. The evolution of this capacity can be best investigated by comparative studies. Using functional magnetic resonance imaging, we explored whether and how dog brains segregate and integrate lexical and intonational information. We found a left-hemisphere bias for processing meaningful words, independently of intonation; a right auditory brain region for distinguishing intonationally marked and unmarked words; and increased activity in primary reward regions only when both lexical and intonational information were consistent with praise. Neural mechanisms to separately analyze and integrate word meaning and intonation in dogs suggest that this capacity can evolve in the absence of language.

Rapid and automatic speech-specific learning mechanism in human neocortex

A unique feature of human communication system is our ability to rapidly acquire new words and build large vocabularies. However, its neurobiological foundations remain largely unknown. In an electrophysiological study optimally designed to probe this rapid formation of new word memory circuits, we employed acoustically controlled novel word-forms incorporating native and non-native speech sounds, while manipulating the subjects' attention on the input. We found a robust index of neurolexical memory-trace formation: a rapid enhancement of the brain's activation elicited by novel words during a short (~30min) perceptual exposure, underpinned by fronto-temporal cortical networks, and, importantly, correlated with behavioural learning outcomes. Crucially, this neural memory trace build-up took place regardless of focused attention on the input or any pre-existing or learnt semantics. Furthermore, it was found only for stimuli with native-language phonology, but not for acoustically closely matching non-native words. These findings demonstrate a specialised cortical mechanism for rapid, automatic and phonology-dependent formation of neural word memory circuits.

Grammatical analysis as a distributed neurobiological function

Language processing engages large-scale functional networks in both hemispheres. Although it is widely accepted that left perisylvian regions have a key role in supporting complex grammatical computations, patient data suggest that some aspects of grammatical processing could be supported bilaterally. We investigated the distribution and the nature of grammatical computations across language processing networks by comparing two types of combinatorial grammatical sequences--inflectionally complex words and minimal phrases--and contrasting them with grammatically simple words. Novel multivariate analyses revealed that they engage a coalition of separable subsystems: inflected forms triggered left-lateralized activation, dissociable into dorsal processes supporting morphophonological parsing and ventral, lexically driven morphosyntactic processes. In contrast, simple phrases activated a consistently bilateral pattern of temporal regions, overlapping with inflectional activations in L middle temporal gyrus. These data confirm the role of the left-lateralized frontotemporal network in supporting complex grammatical computations. Critically, they also point to the capacity of bilateral temporal regions to support simple, linear grammatical computations. This is consistent with a dual neurobiological framework where phylogenetically older bihemispheric systems form part of the network that supports language function in the modern human, and where significant capacities for language comprehension remain intact even following severe left hemisphere damage.

Subcortical functional reorganization due to early blindness

Lack of visual input early in life results in occipital cortical responses to auditory and tactile stimuli. However, it remains unclear whether cross-modal plasticity also occurs in subcortical pathways. With the use of functional magnetic resonance imaging, auditory responses were compared across individuals with congenital anophthalmia (absence of eyes), those with early onset (in the first few years of life) blindness, and normally sighted individuals. We find that the superior colliculus, a "visual" subcortical structure, is recruited by the auditory system in congenital and early onset blindness. Additionally, auditory subcortical responses to monaural stimuli were altered as a result of blindness. Specifically, responses in the auditory thalamus were equally strong to contralateral and ipsilateral stimulation in both groups of blind subjects, whereas sighted controls showed stronger responses to contralateral stimulation. These findings suggest that early blindness results in substantial reorganization of subcortical auditory responses.

Audiovisual integration for speech during mid-childhood: electrophysiological evidence

Previous studies have demonstrated that the presence of visual speech cues reduces the amplitude and latency of the N1 and P2 event-related potential (ERP) components elicited by speech stimuli. However, the developmental trajectory of this effect is not yet fully mapped. We examined ERP responses to auditory, visual, and audiovisual speech in two groups of school-age children (7-8-year-olds and 10-11-year-olds) and in adults. Audiovisual speech led to the attenuation of the N1 and P2 components in all groups of participants, suggesting that the neural mechanisms underlying these effects are functional by early school years. Additionally, while the reduction in N1 was largest over the right scalp, the P2 attenuation was largest over the left and midline scalp. The difference in the hemispheric distribution of the N1 and P2 attenuation supports the idea that these components index at least somewhat disparate neural processes within the context of audiovisual speech perception.

Neurophysiological evidence for whole form retrieval of complex derived words: a mismatch negativity study

Complex words can be seen as combinations of elementary units, decomposable into stems and affixes according to morphological rules. Alternatively, complex forms may be stored as single lexical entries and accessed as whole forms. This study uses an event-related potential brain response capable of indexing both whole-form retrieval and combinatorial processing, the Mismatch Negativity (MMN), to investigate early brain activity elicited by morphologically complex derived words in German. We presented complex words consisting of stems “sicher” (secure), or “sauber” (clean) combined with abstract nominalizing derivational affixes -heit or -keit, to form either congruent derived words: “Sicherheit” (security) and “Sauberkeit” (cleanliness), or incongruent derived pseudowords: *“Sicherkeit”, and *“Sauberheit”. Using this orthogonal design, it was possible to record brain responses for -heit and -keit in both congruent and incongruent contexts, therefore balancing acoustic variance. Previous research has shown that incongruent combinations of symbols elicit a stronger MMN than congruent combinations, but that single words or constructions stored as whole forms elicit a stronger MMN than pseudowords or non-existent constructions. We found that congruent derived words elicited a stronger MMN than incongruent derived words, beginning about 150 ms after perception of the critical morpheme. This pattern of results is consistent with whole-form storage of morphologically complex derived words as lexical units, or mini-constructions. Using distributed source localization methods, the MMN enhancement for well-formed derivationally complex words appeared to be most prominent in the left inferior anterior-temporal, bilateral superior parietal and bilateral post-central, supra-marginal areas. In addition, neurophysiological results reflected the frequency of derived forms, thus providing further converging evidence for whole form storage and against a combinatorial mechanism.

Impaired pre-attentive auditory processing in fibromyalgia: A mismatch negativity (MMN) study

OBJECTIVE

Fibromyalgia (FM) patients often show deficits in cognitive functions such as attention and working memory. We assumed that pre-attentive information processing, a crucial element in human perception and cognition, would be altered in FM patients. Thus, the objective of this study was to determine whether FM patients exhibit alterations in pre-attentive processing as assessed by auditory mismatch negativity (MMN).

METHODS

Auditory evoked magnetic fields were recorded in FM patients (n=18) and healthy control subjects (n=21) during a duration-deviant auditory oddball paradigm. The magnetic mismatch negativity (MMNm) was obtained by subtracting responses to standard tones from responses to deviant tones. Pressure pain thresholds over the thenar and trapezius muscles were determined using an algometer.

RESULTS

MMNm peak amplitudes in right hemispheres were attenuated, and the directional asymmetry coefficient of the MMNm amplitude was lower in FM patients, indicating a more leftward asymmetry than in healthy control subjects. Smaller right MMNm amplitude was associated with lower pressure pain thresholds of thenar muscles in FM patients.

CONCLUSIONS

Our results suggested that pre-attentive processing of auditory information is impaired in FM patients.

SIGNIFICANCE

This study provided neurophysiological evidence of impaired pre-attentive sensory change detection in FM.

Assimilation of L2 vowels to L1 phonemes governs L2 learning in adulthood: a behavioral and ERP study

According to the Perceptual Assimilation Model (PAM), articulatory similarity/dissimilarity between sounds of the second language (L2) and the native language (L1) governs L2 learnability in adulthood and predicts L2 sound perception by naïve listeners. We performed behavioral and neurophysiological experiments on two groups of university students at the first and fifth years of the English language curriculum and on a group of naïve listeners. Categorization and discrimination tests, as well as the mismatch negativity (MMN) brain response to L2 sound changes, showed that the discriminatory capabilities of the students did not significantly differ from those of the naïve subjects. In line with the PAM model, we extend the findings of previous behavioral studies showing that, at the neural level, classroom instruction in adulthood relies on assimilation of L2 vowels to L1 phoneme categories and does not trigger improvement in L2 phonetic discrimination. Implications for L2 classroom teaching practices are discussed.

Learning to read an alphabet of human faces produces left-lateralized training effects in the fusiform gyrus

Numerous functional neuroimaging studies have shown that most orthographic stimuli, such as printed English words, produce a left-lateralized response within the fusiform gyrus (FG) at a characteristic location termed the visual word form area (VWFA). We developed an experimental alphabet (FaceFont) comprising 35 face-phoneme pairs to disentangle phonological and perceptual influences on the lateralization of orthographic processing within the FG. Using functional imaging, we found that a region in the vicinity of the VWFA responded to FaceFont words more strongly in trained versus untrained participants, whereas no differences were observed in the right FG. The trained response magnitudes in the left FG region correlated with behavioral reading performance, providing strong evidence that the neural tissue recruited by training supported the newly acquired reading skill. These results indicate that the left lateralization of the orthographic processing is not restricted to stimuli with particular visual-perceptual features. Instead, lateralization may occur because the anatomical projections in the vicinity of the VWFA provide a unique interconnection between the visual system and left-lateralized language areas involved in the representation of speech.

The neural basis of sublexical speech and corresponding nonspeech processing: a combined EEG-MEG study

We addressed the neural organization of speech versus nonspeech sound processing by investigating preattentive cortical auditory processing of changes in five features of a consonant-vowel syllable (consonant, vowel, sound duration, frequency, and intensity) and their acoustically matched nonspeech counterparts in a simultaneous EEG-MEG recording of mismatch negativity (MMN/MMNm). Overall, speech-sound processing was enhanced compared to nonspeech sound processing. This effect was strongest for changes which affect word meaning (consonant, vowel, and vowel duration) in the left and for the vowel identity change in the right hemisphere also. Furthermore, in the right hemisphere, speech-sound frequency and intensity changes were processed faster than their nonspeech counterparts, and there was a trend for speech-enhancement in frequency processing. In summary, the results support the proposed existence of long-term memory traces for speech sounds in the auditory cortices, and indicate at least partly distinct neural substrates for speech and nonspeech sound processing.

Implicit target substitution and sequencing for lexical tone production in Chinese: an FMRI study

In this study, we examine the neural substrates underlying Tone 3 sandhi and tone sequencing in Mandarin Chinese using fMRI. Tone 3 sandhi is traditionally described as the substitution of Tone 3 with Tone 2 when followed by another Tone 3 (i.e., 33→23). According to current speech production models, target substitution is expected to engage the posterior inferior frontal gyrus. Since Tone 3 sandhi is, to some extent, independent of segments, which makes it more similar to singing, right-lateralized activation in this region was predicted. As for tone sequencing, based on studies in sequencing, we expected the involvement of the supplementary motor area. In the experiments, participants were asked to produce twelve four-syllable sequences with the same tone assignment (the repeated sequences) or a different tone assignment (the mixed sequences). We found right-lateralized posterior inferior frontal gyrus activation for the sequence 3333 (Tone 3 sandhi) and left-lateralized activation in the supplementary motor area for the mixed sequences (tone sequencing). We proposed that tones and segments could be processed in parallel in the left and right hemispheres, but their integration, or the product of their integration, is hosted in the left hemisphere.

Neural dynamics of inflectional and derivational processing in spoken word comprehension: laterality and automaticity

Rapid and automatic processing of grammatical complexity is argued to take place during speech comprehension, engaging a left-lateralized fronto-temporal language network. Here we address how neural activity in these regions is modulated by the grammatical properties of spoken words. We used combined magneto- and electroencephalography to delineate the spatiotemporal patterns of activity that support the recognition of morphologically complex words in English with inflectional (-s) and derivational (-er) affixes (e.g., bakes, baker). The mismatch negativity, an index of linguistic memory traces elicited in a passive listening paradigm, was used to examine the neural dynamics elicited by morphologically complex words. Results revealed an initial peak 130–180 ms after the deviation point with a major source in left superior temporal cortex. The localization of this early activation showed a sensitivity to two grammatical properties of the stimuli: (1) the presence of morphological complexity, with affixed words showing increased left-laterality compared to non-affixed words; and (2) the grammatical category, with affixed verbs showing greater left-lateralization in inferior frontal gyrus compared to affixed nouns (bakes vs. beaks). This automatic brain response was additionally sensitive to semantic coherence (the meaning of the stem vs. the meaning of the whole form) in left middle temporal cortex. These results demonstrate that the spatiotemporal pattern of neural activity in spoken word processing is modulated by the presence of morphological structure, predominantly engaging the left-hemisphere’s fronto-temporal language network, and does not require focused attention on the linguistic input.

Neurobiological Systems for Lexical Representation and Analysis in English

Current research suggests that language comprehension engages two joint but functionally distinguishable neurobiological processes: a distributed bilateral system, which supports general perceptual and interpretative processes underpinning speech comprehension, and a left hemisphere (LH) frontotemporal system, selectively tuned to the processing of combinatorial grammatical sequences, such as regularly inflected verbs in English [Marslen-Wilson, W. D., & Tyler, L. K. Morphology, language and the brain: The decompositional substrate for language comprehension. Philosophical Transactions of the Royal Society: Biological Sciences, 362, 823–836, 2007]. Here we investigated how English derivationally complex words engage these systems, asking whether they selectively activate the LH system in the same way as inflections or whether they primarily engage the bilateral system that support nondecompositional access. In an fMRI study, we saw no evidence for selective activation of the LH frontotemporal system, even for highly transparent forms like bravely. Instead, a combination of univariate and multivariate analyses revealed the engagement of a distributed bilateral system, modulated by factors of perceptual complexity and semantic transparency. We discuss the implications for theories of the processing and representation of English derivational morphology and highlight the importance of neurobiological constraints in understanding these processes.

Automatic processing of unattended lexical information in visual oddball presentation: neurophysiological evidence

Previous electrophysiological studies of automatic language processing revealed early (100–200 ms) reflections of access to lexical characteristics of speech signal using the so-called mismatch negativity (MMN), a negative ERP deflection elicited by infrequent irregularities in unattended repetitive auditory stimulation. In those studies, lexical processing of spoken stimuli became manifest as an enhanced ERP in response to unattended real words, as opposed to phonologically matched but meaningless pseudoword stimuli. This lexical ERP enhancement was explained by automatic activation of word memory traces realized as distributed strongly intra-connected neuronal circuits, whose robustness guarantees memory trace activation even in the absence of attention on spoken input. Such an account would predict the automatic activation of these memory traces upon any presentation of linguistic information, irrespective of the presentation modality. As previous lexical MMN studies exclusively used auditory stimulation, we here adapted the lexical MMN paradigm to investigate early automatic lexical effects in the visual modality. In a visual oddball sequence, matched short word and pseudoword stimuli were presented tachistoscopically in perifoveal area outside the visual focus of attention, as the subjects' attention was concentrated on a concurrent non-linguistic visual dual task in the center of the screen. Using EEG, we found a visual analogue of the lexical ERP enhancement effect, with unattended written words producing larger brain response amplitudes than matched pseudowords, starting at ~100 ms. Furthermore, we also found significant visual MMN, reported here for the first time for unattended perifoveal lexical stimuli. The data suggest early automatic lexical processing of visually presented language which commences rapidly and can take place outside the focus of attention.

Multiple routes for compound word processing in the brain: evidence from EEG

Are compound words represented as unitary lexical units, or as individual constituents that are processed combinatorially? We investigated the neuro-cognitive processing of compounds using EEG and a passive-listening oddball design in which lexical access and combinatorial processing elicit dissociating Mismatch Negativity (MMN) brain-response patterns. MMN amplitude varied with compound frequency and semantic transparency (the clarity of the relationship between compound and constituent meanings). Opaque compounds elicited an enhanced 'lexical' MMN, reflecting stronger lexical representations, to high- vs. low-frequency compounds. Transparent compounds showed no frequency effect, nor differed to pseudo-compounds, reflecting the combination of a reduced 'syntactic' MMN indexing combinatorial links, and an enhanced 'lexical' MMN for real-word compounds compared to pseudo-compounds. We argue that transparent compounds are processed combinatorially alongside parallel lexical access of the whole-form representation, but whole-form access is the dominant mechanism for opaque compounds, particularly those of high-frequency. Results support a flexible dual-route account of compound processing.

Functional localization of the auditory thalamus in individual human subjects

Here we describe an easily implemented protocol based on sparse MR acquisition and a scrambled 'music' auditory stimulus that allows for reliable measurement of functional activity within the medial geniculate body (MGB, the primary auditory thalamic nucleus) in individual subjects. We find that our method is equally accurate and reliable as previously developed structural methods, and offers significantly more accuracy in identifying the MGB than group based methods. We also find that lateralization and binaural summation within the MGB resemble those found in the auditory cortex.

The role of attention in processing morphologically complex spoken words: an EEG/MEG study

This study determined to what extent morphological processing of spoken inflected and derived words is attention-independent. To answer these questions EEG and MEG responses were recorded from healthy participants while they were presented with spoken Finnish inflected, derived, and monomorphemic words. In the non-attended task, the participants were instructed to ignore the incoming auditory stimuli and concentrate on the silent cartoon. In the attended task, previously reported by Leminen et al. (2011), the participants were to judge the acceptability of each stimulus. Importantly, EEG and MEG responses were time-locked to the onset of critical information [suffix onset for the complex words and uniqueness point (UP) for the monomorphemic words]. Early after the critical point, word type did not interact with task: in both attended and non-attended tasks, the event-related potentials (ERPs) showed larger negativity to derived than inflected or monomorphemic words ~100 ms after the critical point. MEG source waveforms showed a similar pattern. Later than 100 ms after the critical point, there were no differences between word types in the non-attended task either in the ERP or source modeling data. However, in the attended task inflected words elicited larger responses than other words ~200 ms after the critical point. The results suggest different brain representations for derived and inflected words. The early activation after the critical point was elicited both in the non-attended and attended tasks. As this stage of word recognition was not modulated by attention, it can be concluded to reflect an automatic mapping of incoming acoustic information onto stored representations. In contrast, the later differences between word types in the attended task were not observed in the non-attended task. This indicates that later compositional processes at the (morpho)syntactic-semantic level require focused attention.

Past tense in the brain's time: neurophysiological evidence for dual-route processing of past-tense verbs

A controversial issue in neuro- and psycholinguistics is whether regular past-tense forms of verbs are stored lexically or generated productively by the application of abstract combinatorial schemas, for example affixation rules. The success or failure of models in accounting for this particular issue can be used to draw more general conclusions about cognition and the degree to which abstract, symbolic representations and rules are psychologically and neurobiologically real. This debate can potentially be resolved using a neurophysiological paradigm, in which alternative predictions of the brain response patterns for lexical and syntactic processing are put to the test. We used magnetoencephalography (MEG) to record neural responses to spoken monomorphemic words ('hide'), pseudowords ('smide'), regular past-tense forms ('cried') and ungrammatical (overregularised) past-tense forms ('flied') in a passive listening oddball paradigm, in which lexically and syntactically modulated stimuli are known to elicit distinct patterns of the mismatch negativity (MMN) brain response. We observed an enhanced ('lexical') MMN to monomorphemic words relative to pseudowords, but a reversed ('syntactic') MMN to ungrammatically inflected past tenses relative to grammatical forms. This dissociation between responses to monomorphemic and bimorphemic stimuli indicates that regular past tenses are processed more similarly to syntactic sequences than to lexically stored monomorphemic words, suggesting that regular past tenses are generated productively by the application of a combinatorial scheme to their separately represented stems and affixes. We suggest discrete combinatorial neuronal assemblies, which bind classes of sequentially occurring lexical elements into morphologically complex units, as the neurobiological basis of regular past tense inflection.

They played with the trade: MEG investigation of the processing of past tense verbs and their phonological twins

How regular and irregular verbs are processed remains a matter of debate. Some English-speaking patients with nonfluent aphasia are especially impaired on regular past-tense forms like played, whether the task requires production, comprehension or even the judgement that “play” and “played” sound different. Within a dual-mechanism account of inflectional morphology, these deficits reflect disruption to the rule-based process that adds (or strips) the suffix -ed to regular verb stems; but the fact that the patients are also impaired at detecting the difference between word pairs like “tray” and “trade” (the latter being a phonological but not a morphological twin to “played”) suggests an important role for phonological characteristics of the regular past tense. The present study examined MEG brain responses in healthy participants evoked by spoken regular past-tense forms and phonological twin words (plus twin pseudowords and a non-speech control) presented in a passive oddball paradigm. Deviant forms (played, trade, kwade/kwayed) relative to their standards (play, tray, kway) elicited a pronounced neuromagnetic response at approximately 130 ms after the onset of the affix; this response was maximal at sensors over temporal areas of both hemispheres but stronger on the left, especially for played and kwayed. Relative to the same standards, a different set of deviants ending in /t/―—plate, trait and kwate—―produced stronger difference responses especially over the right hemisphere. Results are discussed with regard to dual- and single-mechanism theories of past tense processing and the need to consider neurobiological evidence in attempts to understand inflectional morphology.

Neural Oscillations Carry Speech Rhythm through to Comprehension

A key feature of speech is the quasi-regular rhythmic information contained in its slow amplitude modulations. In this article we review the information conveyed by speech rhythm, and the role of ongoing brain oscillations in listeners' processing of this content. Our starting point is the fact that speech is inherently temporal, and that rhythmic information conveyed by the amplitude envelope contains important markers for place and manner of articulation, segmental information, and speech rate. Behavioral studies demonstrate that amplitude envelope information is relied upon by listeners and plays a key role in speech intelligibility. Extending behavioral findings, data from neuroimaging - particularly electroencephalography (EEG) and magnetoencephalography (MEG) - point to phase locking by ongoing cortical oscillations to low-frequency information (~4-8 Hz) in the speech envelope. This phase modulation effectively encodes a prediction of when important events (such as stressed syllables) are likely to occur, and acts to increase sensitivity to these relevant acoustic cues. We suggest a framework through which such neural entrainment to speech rhythm can explain effects of speech rate on word and segment perception (i.e., that the perception of phonemes and words in connected speech is influenced by preceding speech rate). Neuroanatomically, acoustic amplitude modulations are processed largely bilaterally in auditory cortex, with intelligible speech resulting in differential recruitment of left-hemisphere regions. Notable among these is lateral anterior temporal cortex, which we propose functions in a domain-general fashion to support ongoing memory and integration of meaningful input. Together, the reviewed evidence suggests that low-frequency oscillations in the acoustic speech signal form the foundation of a rhythmic hierarchy supporting spoken language, mirrored by phase-locked oscillations in the human brain.

Attention to language: novel MEG paradigm for registering involuntary language processing in the brain

Previous research indicates that, under explicit instructions to listen to spoken stimuli or in speech-oriented behavioural tasks, the brain's responses to senseless pseudowords are larger than those to meaningful words; the reverse is true in non-attended conditions. These differential responses could be used as a tool to trace linguistic processes in the brain and their interaction with attention. However, as previous studies relied on explicit instructions to attend or ignore the stimuli, a technique for automatic attention modulation (i.e., not dependent on explicit instruction) would be more advantageous, especially when cooperation with instructions may not be guaranteed (e.g., neurological patients, children etc). Here we present a novel paradigm in which the stimulus context automatically draws attention to speech. In a non-attend passive auditory oddball sequence, rare words and pseudowords were presented among frequent non-speech tones of variable frequency and length. The low percentage of spoken stimuli guarantees an involuntary attention switch to them. The speech stimuli, in turn, could be disambiguated as words or pseudowords only in their end, at the last phoneme, after the attention switch would have already occurred. Our results confirmed that this paradigm can indeed be used to induce automatic shifts of attention to spoken input. At ~250ms after the stimulus onset, a P3a-like neuromagnetic deflection was registered to spoken (but not tone) stimuli indicating an involuntary attention shift. Later, after the word-pseudoword divergence point, we found a larger oddball response to pseudowords than words, best explained by neural processes of lexical search facilitated through increased attention. Furthermore, we demonstrate a breakdown of this orderly pattern of neurocognitive processes as a result of sleep deprivation. The new paradigm may thus be an efficient way to assess language comprehension processes and their dynamic interaction with those of attention allocation. It does it in an automatic and task-free fashion, indicating its potential benefit for assessing uncooperative clinical populations.

A sparse neural code for some speech sounds but not for others

The precise neural mechanisms underlying speech sound representations are still a matter of debate. Proponents of 'sparse representations' assume that on the level of speech sounds, only contrastive or otherwise not predictable information is stored in long-term memory. Here, in a passive oddball paradigm, we challenge the neural foundations of such a 'sparse' representation; we use words that differ only in their penultimate consonant ("coronal" [t] vs. "dorsal" [k] place of articulation) and for example distinguish between the German nouns Latz ([lats]; bib) and Lachs ([laks]; salmon). Changes from standard [t] to deviant [k] and vice versa elicited a discernible Mismatch Negativity (MMN) response. Crucially, however, the MMN for the deviant [lats] was stronger than the MMN for the deviant [laks]. Source localization showed this difference to be due to enhanced brain activity in right superior temporal cortex. These findings reflect a difference in phonological 'sparsity': Coronal [t] segments, but not dorsal [k] segments, are based on more sparse representations and elicit less specific neural predictions; sensory deviations from this prediction are more readily 'tolerated' and accordingly trigger weaker MMNs. The results foster the neurocomputational reality of 'representationally sparse' models of speech perception that are compatible with more general predictive mechanisms in auditory perception.

Integration of consonant and pitch processing as revealed by the absence of additivity in mismatch negativity

Consonants, unlike vowels, are thought to be speech specific and therefore no interactions would be expected between consonants and pitch, a basic element for musical tones. The present study used an electrophysiological approach to investigate whether, contrary to this view, there is integrative processing of consonants and pitch by measuring additivity of changes in the mismatch negativity (MMN) of evoked potentials. The MMN is elicited by discriminable variations occurring in a sequence of repetitive, homogeneous sounds. In the experiment, event-related potentials (ERPs) were recorded while participants heard frequently sung consonant-vowel syllables and rare stimuli deviating in either consonant identity only, pitch only, or in both dimensions. Every type of deviation elicited a reliable MMN. As expected, the two single-deviant MMNs had similar amplitudes, but that of the double-deviant MMN was also not significantly different from them. This absence of additivity in the double-deviant MMN suggests that consonant and pitch variations are processed, at least at a pre-attentive level, in an integrated rather than independent way. Domain-specificity of consonants may depend on higher-level processes in the hierarchy of speech perception.

Emotional expressions in voice and music: same code, same effect?

Scholars have documented similarities in the way voice and music convey emotions. By using functional magnetic resonance imaging (fMRI) we explored whether these similarities imply overlapping processing substrates. We asked participants to trace changes in either the emotion or pitch of vocalizations and music using a joystick. Compared to music, vocalizations more strongly activated superior and middle temporal cortex, cuneus, and precuneus. However, despite these differences, overlapping rather than differing regions emerged when comparing emotion with pitch tracing for music and vocalizations, respectively. Relative to pitch tracing, emotion tracing activated medial superior frontal and anterior cingulate cortex regardless of stimulus type. Additionally, we observed emotion specific effects in primary and secondary auditory cortex as well as in medial frontal cortex that were comparable for voice and music. Together these results indicate that similar mechanisms support emotional inferences from vocalizations and music and that these mechanisms tap on a general system involved in social cognition.

Neural correlates of the perception of contrastive prosodic focus in French: a functional magnetic resonance imaging study

This functional magnetic resonance imaging (fMRI) study aimed at examining the cerebral regions involved in the auditory perception of prosodic focus using a natural focus detection task. Two conditions testing the processing of simple utterances in French were explored, narrow-focused versus broad-focused. Participants performed a correction detection task. The utterances in both conditions had exactly the same segmental, lexical, and syntactic contents, and only differed in their prosodic realization. The comparison between the two conditions therefore allowed us to examine processes strictly associated with prosodic focus processing. To assess the specific effect of pitch on hemispheric specialization, a parametric analysis was conducted using a parameter reflecting pitch variations specifically related to focus. The comparison between the two conditions reveals that brain regions recruited during the detection of contrastive prosodic focus can be described as a right-hemisphere dominant dual network consisting of (a) ventral regions which include the right posterosuperior temporal and bilateral middle temporal gyri and (b) dorsal regions including the bilateral inferior frontal, inferior parietal and left superior parietal gyri. Our results argue for a dual stream model of focus perception compatible with the asymmetric sampling in time hypothesis. They suggest that the detection of prosodic focus involves an interplay between the right and left hemispheres, in which the computation of slowly changing prosodic cues in the right hemisphere dynamically feeds an internal model concurrently used by the left hemisphere, which carries out computations over shorter temporal windows.