Spatiotemporal dynamics of modality-specific and supramodal word processing

Priming words with pictures: neural correlates of semantic associations in a cross-modal priming task using fMRI

In our everyday life we process information from different modalities simultaneously with great ease. With the current study we had the following goals: to detect the neural correlates of (1) automatic semantic processing of associates and (2) to investigate the influence of different visual modalities on semantic processing. Stimuli were presented with a short SOA (350 ms) as subjects performed a lexical decision task. To minimize the variance and increase homogeneity within our sample, only male subjects were measured. Three experimental conditions were compared while brain activation was measured with a 3 T fMRI scanner: related word-pairs (e.g., frame-picture), unrelated word-pairs (e.g., frame-car) as well as word-nonword pairs (e.g., frame-fubber). They were presented uni- (word-word) and cross-modally (picture-word). Behavioral data revealed a priming effect for cross-modal and unimodal word-pairs. On a neural level, the unimodal condition revealed response suppression in bilateral fronto-parietal regions. Cross-modal priming led to response suppression within the right inferior frontal gyrus. Common areas of deactivation for both modalities were found in bilateral fronto-tempo-parietal regions. These results suggest that the processing of semantic associations presented in different modalities lead to modality-specific activation caused by early access routes. However, common activation for both modalities refers to a common neural network for semantic processing suggesting amodal processing.

Spatiotemporal dynamics of bilingual word processing

Studies with monolingual adults have identified successive stages occurring in different brain regions for processing single written words. We combined magnetoencephalography and magnetic resonance imaging to compare these stages between the first (L1) and second (L2) languages in bilingual adults. L1 words in a size judgment task evoked a typical left-lateralized sequence of activity first in ventral occipitotemporal cortex (VOT: previously associated with visual word-form encoding) and then ventral frontotemporal regions (associated with lexico-semantic processing). Compared to L1, words in L2 activated right VOT more strongly from approximately 135 ms; this activation was attenuated when words became highly familiar with repetition. At approximately 400 ms, L2 responses were generally later than L1, more bilateral, and included the same lateral occipitotemporal areas as were activated by pictures. We propose that acquiring a language involves the recruitment of right hemisphere and posterior visual areas that are not necessary once fluency is achieved.

Sequential processing of lexical, grammatical, and phonological information within Broca's area

Words, grammar, and phonology are linguistically distinct, yet their neural substrates are difficult to distinguish in macroscopic brain regions. We investigated whether they can be separated in time and space at the circuit level using intracranial electrophysiology (ICE), namely by recording local field potentials from populations of neurons using electrodes implanted in language-related brain regions while people read words verbatim or grammatically inflected them (present/past or singular/plural). Neighboring probes within Broca's area revealed distinct neuronal activity for lexical (approximately 200 milliseconds), grammatical (approximately 320 milliseconds), and phonological (approximately 450 milliseconds) processing, identically for nouns and verbs, in a region activated in the same patients and task in functional magnetic resonance imaging. This suggests that a linguistic processing sequence predicted on computational grounds is implemented in the brain in fine-grained spatiotemporally patterned activity.

Tuning of the visual word processing system: distinct developmental ERP and fMRI effects

Visual tuning for words vs. symbol strings yields complementary increases of fast occipito-temporal activity (N1 or N170) in the event-related potential (ERP), and posterior-anterior gradients of increasing word-specific activity with functional magnetic resonance imaging (fMRI) in the visual word form system (VWFS). However, correlation of these coarse ERP and fMRI tuning responses seems limited to the most anterior part of the VWFS in adult and adolescent readers (Brem et al. [ 2006]: Neuroimage 29:822-837). We thus focused on fMRI tuning gradients of young readers with their more pronounced ERP print tuning, and compared developmental aspects of ERP and fMRI response tuning in the VWFS. Children (10.3 y, n = 19), adolescents (16.2 y, n = 13) and adults (25.2 y, n = 18) were tested with the same implicit reading paradigm using counterbalanced ERP and fMRI imaging. The word-specific occipito-temporal N1 specialization, its corresponding source activity, as well as the integrated source activity (0-700 ms) were most prominent in children and showed a marked decrease with age. The posterior-anterior fMRI gradient of word-specific activity instead which was fully established in children did not develop further, but exhibited a dependence on reading skills independent of age. To conclude, prominent developmental dissociation of the ERP and fMRI tuning patterns emerged despite convergent VWFS localization. The ERP response may selectively reflect fast visual aspects of print specialization, which become less important with age, while the fMRI response seems dominated by integrated task- and reading-related activations in the same regions.

Sequences of cortical activation for tactile pattern discrimination using magnetoencephalography

To observe sequential stages in tactile pattern discrimination and their modification with and without attention, we used whole-head anatomically constrained magnetoencephalography to spatiotemporally map brain responses. Eight, normal, right-handed participants discriminated between two patterns presented on the palm. Latencies of neural activity were determined from stimulus contact with the palm. Early cortical activation moved from sensorimotor cortex (SM1) to secondary somatosensory cortex (SII), Broca's area (BA), and superior parietal cortex by 65 ms. It continued bilaterally to temporal and frontal poles by 290 ms. Subtraction of nonattended from attended conditions removed primarily the early contralateral sensory components. There was some indication of a preferred order of sensory processing that may express and optimize hemispheric computational specializations. Results indicate similar functional organizations for tactile and visual pattern recognition.

Spatiotemporal convergence of semantic processing in reading and speech perception

Retrieval of word meaning from the semantic system and its integration with context are often assumed to be shared by spoken and written words. How is modality-independent semantic processing manifested in the brain, spatially and temporally? Time-sensitive neuroimaging allows tracking of neural activation sequences. Use of semantically related versus unrelated word pairs or sentences ending with a semantically highly or less plausible word, in separate studies of the auditory and visual modality, has associated lexical-semantic analysis with sustained activation at approximately 200-800 ms. Magnetoencephalography (MEG) studies have further identified the superior temporal cortex as a main locus of the semantic effect. Nevertheless, a direct comparison of the spatiotemporal neural correlates of visual and auditory word comprehension in the same brain is lacking. We used MEG to compare lexical-semantic analysis in the visual and auditory domain in the same individuals, and contrasted it with phonological analysis that, according to models of language perception, should occur at a different time with respect to semantic analysis in reading and speech perception. The stimuli were lists of four words that were either semantically or phonologically related, or with the final word unrelated to the preceding context. Superior temporal activation reflecting semantic processing occurred similarly in the two modalities, left-lateralized at 300-450 ms and thereafter bilaterally, generated in close-by areas. Effect of phonology preceded the semantic effect in speech perception but not in reading. The present data indicate involvement of the middle superior temporal cortex in semantic processing from approximately 300 ms onwards, regardless of input modality.

Time course and functional neuroanatomy of speech segmentation in adults

The present investigation was devoted to unraveling the time-course and brain regions involved in speech segmentation, which is one of the first processes necessary for learning a new language in adults and infants. A specific brain electrical pattern resembling the N400 language component was identified as an indicator of speech segmentation of candidate words. This N400 trace was clearly elicited after a short exposure to the words of the new language and showed a decrease in amplitude with longer exposure. Two brain regions were observed to be active during this process: the posterior superior temporal gyrus and the superior part of the ventral premotor cortex. We interpret these findings as evidence for the existence of an auditory-motor interface that is responsible for isolating possible candidate words when learning a new language in adults.

Parallel versus serial processing dependencies in the perisylvian speech network: a Granger analysis of intracranial EEG data

In this work, we apply Granger causality analysis to high spatiotemporal resolution intracranial EEG (iEEG) data to examine how different components of the left perisylvian language network interact during spoken language perception. The specific focus is on the characterization of serial versus parallel processing dependencies in the dominant hemisphere dorsal and ventral speech processing streams. Analysis of iEEG data from a large, 64-electrode grid implanted over the left perisylvian region in a single right-handed patient showed a consistent pattern of direct posterior superior temporal gyrus influence over sites distributed over the entire ventral pathway for words, non-words, and phonetically ambiguous items that could be interpreted either as words or non-words. For the phonetically ambiguous items, this pattern was overlayed by additional dependencies involving the inferior frontal gyrus, which influenced activation measured at electrodes located in both ventral and dorsal stream speech structures. Implications of these results for understanding the functional architecture of spoken language processing and interpreting the role of the posterior superior temporal gyrus in speech perception are discussed.

Distributed source modeling of language with magnetoencephalography: application to patients with intractable epilepsy

PURPOSE

To examine distributed patterns of language processing in healthy controls and patients with epilepsy using magnetoencephalography (MEG), and to evaluate the concordance between laterality of distributed MEG sources and language laterality as determined by the intracarotid amobarbital procedure (IAP).

METHODS

MEG was performed in 10 healthy controls using an anatomically constrained, noise-normalized distributed source solution (dynamic statistical parametric map, dSPM). Distributed source modeling of language was then applied to eight patients with intractable epilepsy. Average source strengths within temporoparietal and frontal lobe regions of interest (ROIs) were calculated, and the laterality of activity within ROIs during discrete time windows was compared to results from the IAP.

RESULTS

In healthy controls, dSPM revealed activity in visual cortex bilaterally from approximately 80 to 120 ms in response to novel words and sensory control stimuli (i.e., false fonts). Activity then spread to fusiform cortex approximately 160-200 ms, and was dominated by left hemisphere activity in response to novel words. From approximately 240 to 450 ms, novel words produced activity that was left-lateralized in frontal and temporal lobe regions, including anterior and inferior temporal, temporal pole, and pars opercularis, as well as bilaterally in posterior superior temporal cortex. Analysis of patient data with dSPM demonstrated that from 350 to 450 ms, laterality of temporoparietal sources agreed with the IAP 75% of the time, whereas laterality of frontal MEG sources agreed with the IAP in all eight patients.

DISCUSSION

Our results reveal that dSPM can unveil the timing and spatial extent of language processes in patients with epilepsy and may enhance knowledge of language lateralization and localization for use in preoperative planning.

Activation of the left inferior frontal gyrus in the first 200 ms of reading: evidence from magnetoencephalography (MEG)

BACKGROUND

It is well established that the left inferior frontal gyrus plays a key role in the cerebral cortical network that supports reading and visual word recognition. Less clear is when in time this contribution begins. We used magnetoencephalography (MEG), which has both good spatial and excellent temporal resolution, to address this question.

METHODOLOGY/PRINCIPAL FINDINGS

MEG data were recorded during a passive viewing paradigm, chosen to emphasize the stimulus-driven component of the cortical response, in which right-handed participants were presented words, consonant strings, and unfamiliar faces to central vision. Time-frequency analyses showed a left-lateralized inferior frontal gyrus (pars opercularis) response to words between 100-250 ms in the beta frequency band that was significantly stronger than the response to consonant strings or faces. The left inferior frontal gyrus response to words peaked at approximately 130 ms. This response was significantly later in time than the left middle occipital gyrus, which peaked at approximately 115 ms, but not significantly different from the peak response in the left mid fusiform gyrus, which peaked at approximately 140 ms, at a location coincident with the fMRI-defined visual word form area (VWFA). Significant responses were also detected to words in other parts of the reading network, including the anterior middle temporal gyrus, the left posterior middle temporal gyrus, the angular and supramarginal gyri, and the left superior temporal gyrus.

CONCLUSIONS/SIGNIFICANCE

These findings suggest very early interactions between the vision and language domains during visual word recognition, with speech motor areas being activated at the same time as the orthographic word-form is being resolved within the fusiform gyrus. This challenges the conventional view of a temporally serial processing sequence for visual word recognition in which letter forms are initially decoded, interact with their phonological and semantic representations, and only then gain access to a speech code.

Covert word reading induces a late response in the hand motor system of the language dominant hemisphere

Recent work has demonstrated that overt reading influences the excitability of the language-dominant hand motor cortex. However, this effect was related to speech output, whereas results on silent reading have been inconsistent, and have not allowed for systematic investigation of the different stages of word recognition. To investigate a possible modulation of the cortical excitability mediating hand movements through different stages of covert reading, motor evoked potentials (MEP) from hand muscles in right-handed subjects were recorded. We showed a significant increase of the excitability of the hand motor cortex of the dominant hemisphere during late stages of covert word reading, whereas processing of abstract shapes had no effect and covert articulation induced a decrease in hand motor cortex excitability. There was no significant change of MEP amplitudes during earlier stages of covert reading in the dominant hemisphere or in the non-dominant hemisphere. Our results demonstrate a functional connection between cortical networks mediating linguistic processing and hand movements without concurrent activation of the motor cortex through overt articulation at late stages of word reading, which have been shown to involve converging activation of classic left frontal language regions. We speculate that the effect reported here is related to a cortical network mediating gestures which are a part of verbal communication. This supports recent theories on language evolution which postulate that language emerged through manual gestures.

Effects of TMS on different stages of motor and non-motor verb processing in the primary motor cortex

The embodied cognition hypothesis suggests that motor and premotor areas are automatically and necessarily involved in understanding action language, as word conceptual representations are embodied. This transcranial magnetic stimulation (TMS) study explores the role of the left primary motor cortex in action-verb processing. TMS-induced motor-evoked potentials from right-hand muscles were recorded as a measure of M1 activity, while participants were asked either to judge explicitly whether a verb was action-related (semantic task) or to decide on the number of syllables in a verb (syllabic task). TMS was applied in three different experiments at 170, 350 and 500 ms post-stimulus during both tasks to identify when the enhancement of M1 activity occurred during word processing. The delays between stimulus onset and magnetic stimulation were consistent with electrophysiological studies, suggesting that word recognition can be differentiated into early (within 200 ms) and late (within 400 ms) lexical-semantic stages, and post-conceptual stages. Reaction times and accuracy were recorded to measure the extent to which the participants' linguistic performance was affected by the interference of TMS with M1 activity. No enhancement of M1 activity specific for action verbs was found at 170 and 350 ms post-stimulus, when lexical-semantic processes are presumed to occur (Experiments 1-2). When TMS was applied at 500 ms post-stimulus (Experiment 3), processing action verbs, compared with non-action verbs, increased the M1-activity in the semantic task and decreased it in the syllabic task. This effect was specific for hand-action verbs and was not observed for action-verbs related to other body parts. Neither accuracy nor RTs were affected by TMS. These findings suggest that the lexical-semantic processing of action verbs does not automatically activate the M1. This area seems to be rather involved in post-conceptual processing that follows the retrieval of motor representations, its activity being modulated (facilitated or inhibited), in a top-down manner, by the specific demand of the task.

The cortical dynamics of intelligible speech

An important and unresolved question is how the human brain processes speech for meaning after initial analyses in early auditory cortical regions. A variety of left-hemispheric areas have been identified that clearly support semantic processing, although a systematic analysis of directed interactions among these areas is lacking. We applied dynamic causal modeling of functional magnetic resonance imaging responses and Bayesian model selection to investigate, for the first time, experimentally induced changes in coupling among three key multimodal regions that were activated by intelligible speech: the posterior and anterior superior temporal sulcus (pSTS and aSTS, respectively) and pars orbitalis (POrb) of the inferior frontal gyrus. We tested 216 different dynamic causal models and found that the best model was a "forward" system that was driven by auditory inputs into the pSTS, with forward connections from the pSTS to both the aSTS and the POrb that increased considerably in strength (by 76 and 150%, respectively) when subjects listened to intelligible speech. Task-related, directional effects can now be incorporated into models of speech comprehension.

Cortical dynamics of word recognition

While functional neuroimaging studies have helped elucidate major regions implicated in word recognition, much less is known about the dynamics of the associated activations or the actual neural processes of their functional network. We used intracerebral electroencephalography recordings in 10 patients with epilepsy to directly measure neural activity in the temporal and frontal lobes during written words' recognition, predominantly in the left hemisphere. The patients were presented visually with consonant strings, pseudo-words, and words and performed a hierarchical paradigm contrasting semantic processes (living vs. nonliving word categorization task), phonological processes (rhyme decision task on pseudo-words), and visual processes (visual analysis of consonant strings). Stimuli triggered a cascade of modulations in the gamma-band (>40 Hz) with reproducible timing and task-sensitivity throughout the functional reading network: the earliest gamma-band activations were observed for all stimuli in the mesial basal temporal lobe at 150 ms, reaching the word form area in the mid fusiform gyrus at 200 ms, evidencing a superiority effect for word-like stimuli. Peaks of gamma-band activations were then observed for word-like stimuli after 400 ms in the anterior and middle portion of the superior temporal gyrus (BA 38 and BA 22 respectively), in the pars triangularis of Broca's area for the semantic task (BAs 45 and 47), and in the pars opercularis for the phonological task (BA 44). Concurrently, we observed a two-pronged effect in the prefrontal cortex (BAs 9 and 46), with nonspecific sustained dorsal activation related to sustained attention and, more ventrally, a strong reflex deactivation around 500 ms, possibly due to semantic working memory reset.

Task and semantic relationship influence both the polarity and localization of hemodynamic modulation during lexico-semantic processing

This study examined how task (implicit vs. explicit) and semantic relationship (direct vs. indirect) modulated hemodynamic activity during lexico-semantic processing. Participants viewed directly related, indirectly related, and unrelated prime-target word-pairs as they performed (a) an implicit lexical decision (LD) task in which they decided whether each target was a real word or a nonword, and (b) an explicit relatedness judgment (RJ) task in which they determined whether each word-pair was related or unrelated in meaning. Task influenced both the polarity and neuroanatomical localization of hemodynamic modulation. Semantic relationship influenced the neuroanatomical localization of hemodynamic modulation. The implicit LD task was primarily associated with inferior prefrontal and ventral inferior temporal/fusiform hemodynamic response suppression to directly related (relative to unrelated) word-pairs, and with more widespread temporal-occipital response suppression to indirectly related (relative to unrelated) word-pairs. In contrast, the explicit RJ task was primarily associated with left inferior parietal hemodynamic response enhancement to both directly and indirectly related (relative to unrelated) word-pairs, as well as with additional left inferior prefrontal hemodynamic response enhancement to indirectly related (relative to unrelated) word-pairs. These findings are discussed in relation to the specific neurocognitive processes thought to underlie implicit and explicit semantic processes. Hum Brain Mapp, 2008. (c) 2007 Wiley-Liss, Inc.

Seeing sounds and hearing sights: the influence of prior learning on current perception

It is well known that previous perceptual experiences alter subsequent perception, but the details of the neural underpinnings of this general phenomenon are still sketchy. Here, we ask whether previous experiences with an item (such as seeing a person's face) leads to the alteration of the neural correlates related to processing of the item as such, or whether it creates additional associative connections between such substrates and those activated during prior experience. To address this question, we used magnetoencephalography (MEG) to identify neural changes accompanying subjects' viewing of unfamiliar versus famous faces and hearing the names of unfamiliar versus famous names. We were interested in the nature of the involvement of auditory brain regions in the viewing of faces, and in the involvement of visual regions in the hearing of names. Evoked responses from MEG recordings for the names and faces conditions were localized to auditory and visual cortices, respectively. Unsurprisingly, peak activation strength of evoked responses was larger for famous versus nonfamous names within the superior temporal gyrus (STG), and was similar for famous and nonfamous faces in the occipital cortex. More relevant to the issue of experience on perception, peak activation strength in the STG was larger for viewed famous versus nonfamous faces, and peak activation within the occipital cortex was larger for heard famous versus nonfamous names. Critically, these experience-related responses were present within 150-250 msec of stimulus onset. These findings support the hypothesis that prior experiences may influence processing of faces and names such that perception encompasses more than what is imparted on the senses.

The effects of priming on frontal-temporal communication

Repeated exposure to a stimulus facilitates its processing. This is reflected in faster and more accurate identification, reduced perceptual identification thresholds, and more efficient classifications for repeated compared with novel items. Here, we test a hypothesis that this experience-based behavioral facilitation is a result of enhanced communication between distinct cortical regions, which reduces local processing demands. A magnetoencephalographic investigation revealed that repeated object classification led to decreased neural responses in the prefrontal cortex and temporal cortex. Critically, this decrease in absolute activity was accompanied by greater neural synchrony (a measure of functional connectivity) between these regions with repetition. Additionally, the onset of the enhanced interregional synchrony predicted the degree of behavioral facilitation. These findings suggest that object repetition results in enhanced interactions between brain regions, which facilitates performance and reduces processing demands on the regions involved.

Enumeration Produces Poor Primacy for Tactile Presentation Relative to Visual and Auditory Presentation as the Only Modality Effect

Methodological biases may help explain the modality effect, which is superior recall of auditory recency (end of list) items relative to visual recency items. In 1985 Nairne and McNabb used a counting procedure to reduce methodological biases, and they produced modality-like effects, such that recall of tactile recency items was superior to recall of visual recency items. The present study extended Nairne and McNabb's counting procedure and controlled several variables which may have enhanced recall of tactile end items or disrupted recall of visual end items in their study. Although the results of the present study indicated general serial position effects across tactile, visual, and auditory presentation modalities, the tactile condition showed lower recall for the initial items in the presentation list than the other two conditions. Moreover, recall of the final list item did not differ across the three presentation modalities; modality effects were not found. These results did not replicate the findings of Nairne and McNabb, or much of the past research showing superior recall of auditory recency items. Implications of these findings are discussed.

ERP measures of partial semantic knowledge: left temporal indices of skill differences and lexical quality

This study examines the sensitivity of early event-related potentials (ERPs) to degrees of word semantic knowledge. Participants with strong, average, or weak vocabulary skills made speeded lexical decisions to letter strings. To represent the full spectrum of word knowledge among adult native-English speakers, we used rare words that were orthographically matched with more familiar words and with pseudowords. Since the lexical decision could not reliably be made on the basis of word form, subjects were obliged to use semantic knowledge to perform the task. A d' analysis suggested that high-skilled subjects adopted a more conservative strategy in response to rare versus more familiar words. Moreover, the high-skilled participants showed a trend towards an enhanced "N2c" to rare words, and a similar posterior temporal effect reached significance approximately 650 ms. Generators for these effects were localized to left temporal cortex. We discuss implications of these results for word learning and for theories of lexical semantic access.

Spatiotemporal signatures of large-scale synfire chains for speech processing as revealed by MEG

We report a new brain signature of memory trace activation in the human brain revealed by magnetoencephalography and distributed source localization. Spatiotemporal patterns of cortical activation can be picked up in the time course of source images underlying magnetic brain responses to speech and noise stimuli, especially the generators of the magnetic mismatch negativity. We found that acoustic signals perceived as speech elicited a well-defined spatiotemporal pattern of sequential activation of superior-temporal and inferior-frontal cortex, whereas the same identical stimuli, when perceived as noise, did not elicit temporally structured activation. Strength of local sources constituting large-scale spatiotemporal patterns reflected additional lexical and syntactic features of speech. Morphological processing of the critical sound as verb inflection led to particularly pronounced early left inferior-frontal activation, whereas the same sound functioning as inflectional affix of a noun activated superior-temporal cortex more strongly. We conclude that precisely timed spatiotemporal patterns involving specific cortical areas may represent a brain code of memory circuit activation. These spatiotemporal patterns are best explained in terms of synfire mechanisms linking neuronal populations in different cortical areas. The large-scale synfire chains appear to reflect the processing of stimuli together with the context-dependent perceptual and cognitive information bound to them.

The use of neuroimaging to study behavior in patients with epilepsy

Structural and functional neuroimaging continues to play an increasing role in the presurgical evaluation of patients with epilepsy. In addition to its value in localizing the epileptogenic zone and eloquent cortex, neuroimaging is contributing to our understanding of mood comorbidity in epilepsy. Although the vast majority of research has focused on patients with temporal lobe epilepsy (TLE), neuroimaging studies of patients with extratemporal epilepsy and primary generalized epilepsy are increasing in number. In this review, structural and functional imaging modalities that have received considerable research attention in recent years are reviewed, and their strengths and limitations for understanding behavior in epilepsy are assessed. In addition, advances in multimodal imaging are discussed along with their potential application to the presurgical evaluation of patients with seizure disorders.

Fronto-temporal brain systems supporting spoken language comprehension

The research described here combines psycholinguistically well-motivated questions about different aspects of human language comprehension with behavioural and neuroimaging studies of normal performance, incorporating both subtractive analysis techniques and functional connectivity methods, and applying these tasks and techniques to the analysis of the functional and neural properties of brain-damaged patients with selective linguistic deficits in the relevant domains. The results of these investigations point to a set of partially dissociable sub-systems supporting three major aspects of spoken language comprehension, involving regular inflectional morphology, sentence-level syntactic analysis and sentence-level semantic interpretation. Differential patterns of fronto-temporal connectivity for these three domains confirm that the core aspects of language processing are carried out in a fronto-temporo-parietal language system which is modulated in different ways as a function of different linguistic processing requirements. No one region or sub-region holds the key to a specific language function; each requires the coordination of activity within a number of different regions. Functional connectivity analysis plays the critical role of indicating the regions which directly participate in a given sub-process, by virtue of their joint time-dependent activity. By revealing these codependencies, connectivity analysis sharpens the pattern of structure–function relations underlying specific aspects of language performance.

Early MEG activation dynamics in the left temporal and inferior frontal cortex reflect semantic context integration

Traditional views link semantic context integration to neurophysiological activity at 300-500 msec. To study possible early dynamics related to semantic context integration, we recorded, in passive oddball paradigm, magnetic evoked responses to spoken word pairs, the second word being either congruent or incongruent with the first one. The same experimental words were placed in orthogonally varied context, thus providing a strict control for any effects of acoustic, phonological, and psycholinguistic stimulus features. Responses to the same critical words were obtained also outside of semantic context. We found that regardless of their acoustic features, semantically incongruent stimuli elicited a brain response already at approximately 115 msec after the critical word onset. The same words did not produce such deflection in semantically legal context. The responses were maximal at left temporal and inferior frontal cortical sites, which was also confirmed by distributed current source analysis. The left temporal activation preceded the frontal one by approximately 16 msec. No late response dynamics (>350 msec) were found that would reflect the semantic modulation in this nonattend passive design, indicating the possible role of attention in generating the later responses. Our results suggest that the earliest brain processes of semantic context integration can occur at approximately 100 msec after the onset of spoken words in the left inferior frontal and superior temporal cortex.

Spatiotemporal patterns of oscillatory brain activity during auditory word recognition in children: a synthetic aperture magnetometry study

OBJECTIVE

We studied the task-induced spatiotemporal evolution and characteristics of cortical neural oscillations in children during an auditory word recognition task.

METHODS

We presented abstract nouns binaurally and recorded the MEG response in eight healthy right-handed children (6-12 years). We calculated the event-related changes in cortical oscillations using a beamformer spatial filter analysis technique (SAM), then transformed each subject's statistical maps into standard space and used these to make group statistical inferences.

RESULTS

Across subjects, the cortical response to words could be divided into at least two phases: an initial event-related synchronization in both the right temporal (100-300 ms, 15-25 Hz; 200-400 ms, 5-15 Hz) and left frontal regions (200-400 ms; 15-25 Hz); followed by a strong left-lateralized event-related desynchronization in the left temporal region (500-700 ms; 5-15 Hz).

CONCLUSIONS

We found bilateral event-related synchronization followed by later left lateralized event-related desynchronization in language-related cortical areas. These data demonstrate the spatiotemporal time course of neural activation during an auditory word recognition task in a group of children. As well, this demonstrates the utility of SAM analyses to detect subtle sequential task-related neural activations.

Minding the PS, queues, and PXQs: uniformity of semantic processing across multiple stimulus types

An assumption in the reading literature is that access to semantics is gated by stimulus properties such as orthographic regularity or familiarity. In the electrophysiological domain, this assumption has led to a debate about the features necessary to initiate semantic processing as indexed by the N400 event-related potential (ERP) component. To examine this, we recorded ERPs to sentences with endings that were familiar and legal (words), familiar and illegal (acronyms), or unfamiliar and illegal (consonant or vowel strings). N400 congruency effects (reduced negativity to expected relative to unexpected endings) were observed for words and acronyms; these were identical in size, timing, and scalp distribution. Notably, clear N400 potentials were also elicited by unfamiliar, illegal strings, suggesting that, at least in a verbal context, semantic access may be attempted for any letter string, regardless of familiarity or regularity.

Where do you know what you know? The representation of semantic knowledge in the human brain

Mr M, a patient with semantic dementia--a neurodegenerative disease that is characterized by the gradual deterioration of semantic memory--was being driven through the countryside to visit a friend and was able to remind his wife where to turn along the not-recently-travelled route. Then, pointing at the sheep in the field, he asked her "What are those things?" Prior to the onset of symptoms in his late 40s, this man had normal semantic memory. What has gone wrong in his brain to produce this dramatic and selective erosion of conceptual knowledge?

Evidence of fronto-temporal interactions for strategic inference processes during language comprehension

We investigated how readers strategically infer context-appropriate information on the basis of the presented text and their world knowledge during passage reading. In the main experimental condition, participants were instructed to read short passages and to predict the development of the situation described in each passage during reading. To accomplish this task, we assumed that participants need to draw strategic inferences relevant to the contexts. Comparing this condition with a passage-reading condition without prediction, we found out that the left anterior prefrontal cortex (aPFC) in Brodmann area 9/10 and the left anterior ventral inferior frontal gyrus (vIFG) in Brodmann area 47 elicited increased hemodynamic responses. These two regions are probably critical in coherence evaluation and in drawing strategic inferences. Additionally, we used dynamic causal modelling (DCM) to investigate the fronto-temporal interactions induced by the experimental conditions. Ten models with different plausible ways to modulate the connections between frontal and temporal regions were compared. The DCM results showed a consistent conclusion: The connectivity between the left posterior superior temporal sulcus (pSTS) and the left dorsal lateral inferior frontal gyrus (dIFG) were enhanced when participants made inferential predictions during reading. The results support the role of top-down influences mediated by the neural pathways between dIFG and pSTS in retrieving strategic inferences. With these findings we discuss functional roles of aPFC, vIFG and dIFG-pSTS connections in drawing strategic inferences.

Task-specific change of unconscious neural priming in the cerebral language network

We explored the impact of task context on subliminal neural priming using functional magnetic resonance imaging. The repetition of words during semantic categorization produced activation reduction in the left middle temporal gyrus previously associated with semantic-level representation and dorsal premotor cortex. By contrast, reading aloud produced repetition enhancement in the left inferior parietal lobe associated with print-to-sound conversion and ventral premotor cortex. Analyses of effective connectivity revealed that the task set for reading generated reciprocal excitatory connections between the left inferior parietal and superior temporal regions, reflecting the audiovisual integration required for vocalization, whereas categorization did not produce such backward projection to posterior regions. Thus, masked repetition priming involves two distinct components in the task-specific neural streams, one in the parietotemporal cortex for task-specific word processing and the other in the premotor cortex for behavioral response preparation. The top-down influence of task sets further changes the directions of the unconscious priming in the entire cerebral circuitry for reading.

A common system for the comprehension and production of narrative speech

Humans devote much time to the exchange of memories within the context of shared general and personal semantic knowledge. Our hypothesis was that functional imaging in normal subjects would demonstrate the convergence of speech comprehension and production on high-order heteromodal and amodal cortical areas implicated in declarative memory functions. Activity independent of speech phase (that is, comprehension and production) was most evident in the left and right lateral anterior temporal cortex. Significant activity was also observed in the posterior cortex, ventral to the angular gyri. The left and right hippocampus and adjacent inferior temporal cortex were active during speech comprehension, compatible with mnemonic encoding of narrative information, but activity was significantly less during the overt memory retrieval associated with speech production. Therefore, although clinical studies suggest that hippocampal function is necessary for the retrieval as well as the encoding of memories, the former appears to depend on much less net synaptic activity. In contrast, the retrosplenial/posterior cingulate cortex and the parahippocampal area, which are closely associated anatomically with the hippocampus, were equally active during both speech comprehension and production. The results demonstrate why a severe and persistent inability both to understand and produce meaningful speech in the absence of an impairment to process linguistic forms is usually only observed after bilateral, and particularly anterior, destruction of the temporal lobes, and emphasize the importance of retrosplenial/posterior cingulate cortex, an area known to be affected early in the course of Alzheimer's disease, in the processing of memories during communication.

An MEG Study of Silent Meaning

Although research on the neural bases of language has made significant progress on how the brain accesses the meanings of words, our understanding of sentence-level semantic composition remains limited. We studied the magnetoencephalography (MEG) responses elicited by expressions whose meanings involved an element not expressed in the syntax, which enabled us to investigate the brain correlates of semantic composition without confounds from syntactic composition. Sentences such as the author began the book, which asserts that an activity was begun although no activity is mentioned in the syntax, were contrasted with control sentences such as the author wrote the book, which involved no implicit meaning. These conditions were further compared with a semantically anomalous condition (the author disgusted the book). MEG responses to the object noun showed that silent meaning and anomaly are associated with distinct effects, silent meaning, but not anomaly, eliciting increased amplitudes in the anterior midline field (AMF) at 350–450 msec. The AMF was generated in ventromedial prefrontal areas, usually implicated for social cognition and theory of mind. Our results raise the possibility that silent meaning interpretation may share mechanisms with these neighboring domains of cognition.

Lexical access and selection of contextually appropriate meaning for ambiguous words

To clarify the neural mechanisms of lexical access and selection of contextually appropriate meanings for ambiguous words, we investigated the spatio-temporal characteristics of neural activities during silent reading and semantic judgment of lexically ambiguous or unambiguous target words that were preceded by semantically related or unrelated words by using magnetoencephalography. The left posterior superior temporal/inferior parietal area and the left anterior middle/inferior temporal area consistently showed a clear context effect, regardless of the ambiguity: the activities for related words were weaker than those for unrelated words. The activities in the left inferior frontal cortex, in contrast, were influenced by ambiguities. From approximately 200 to 300 ms, the activities in the left anterior inferior frontal cortex (aIFC) were stronger for ambiguous words than for unambiguous words, regardless of context. The stronger activities in the left aIFC, reflecting an increase in controlled semantic retrieval, indicate that multiple meanings for lexically ambiguous words are accessed irrespective of context. At approximately 400 ms, the left posterior inferior frontal cortex (pIFC) showed a clear context effect for unambiguous words but not for ambiguous ones. In addition, the activation in the left pIFC was stronger for related ambiguous words than for related unambiguous ones. These results suggest that in ambiguous words, not only contextually appropriate meanings but also two or more inappropriate meanings would be semantically integrated with a context. We conclude that the left IFC plays an important role in selecting an appropriate meaning from multiple alternatives after the integration of contextual information.

Spatiotemporal dynamics of word processing in the human brain

We examined the spatiotemporal dynamics of word processing by recording the electrocorticogram (ECoG) from the lateral frontotemporal cortex of neurosurgical patients chronically implanted with subdural electrode grids. Subjects engaged in a target detection task where proper names served as infrequent targets embedded in a stream of task-irrelevant verbs and nonwords. Verbs described actions related to the hand (e.g, throw) or mouth (e.g., blow), while unintelligible nonwords were sounds which matched the verbs in duration, intensity, temporal modulation, and power spectrum. Complex oscillatory dynamics were observed in the delta, theta, alpha, beta, low, and high gamma (HG) bands in response to presentation of all stimulus types. HG activity (80-200 Hz) in the ECoG tracked the spatiotemporal dynamics of word processing and identified a network of cortical structures involved in early word processing. HG was used to determine the relative onset, peak, and offset times of local cortical activation during word processing. Listening to verbs compared to nonwords sequentially activates first the posterior superior temporal gyrus (post-STG), then the middle superior temporal gyrus (mid-STG), followed by the superior temporal sulcus (STS). We also observed strong phase-locking between pairs of electrodes in the theta band, with weaker phase-locking occurring in the delta, alpha, and beta frequency ranges. These results provide details on the first few hundred milliseconds of the spatiotemporal evolution of cortical activity during word processing and provide evidence consistent with the hypothesis that an oscillatory hierarchy coordinates the flow of information between distinct cortical regions during goal-directed behavior.

Localization of Syntactic and Semantic Brain Responses using Magnetoencephalography

Electrophysiological methods have been used to study the temporal sequence of syntactic and semantic processing during sentence comprehension. Two responses associated with syntactic violations are the left anterior negativity (LAN) and the P600. A response to semantic violation is the N400. Although the sources of the N400 response have been identified in the left (and right) temporal lobe, the neural signatures of the LAN and P600 have not been revealed. The present study used magnetoencephalography to localize sources of syntactic and semantic activation in Finnish sentence reading. Participants were presented with sentences that ended in normally inf lected nouns, nouns in an unacceptable case, verbs instead of nouns, or nouns that were correctly inflected but made no sense in the context. Around 400 msec, semantically anomalous last words evoked strong activation in the left superior temporal lobe with significant activation also for word class errors (N400). Weaker activation was seen for the semantic errors in the right hemisphere. Later, 600-800 msec after word onset, the strongest activation was seen to word class and morphosyntactic errors (P600). Activation was significantly weaker to semantically anomalous and correct words. The P600 syntactic activation was localized to bilateral sources in the temporal lobe, posterior to the N400 sources. The results suggest that the same general region of the superior temporal cortex gives rise to both LAN and N400 with bilateral reactivity to semantic manipulation and a left hemisphere effect to syntactic manipulation. The bilateral P600 response was sensitive to syntactic but not semantic factors.

Spatiotemporal Interaction between Sound Form and Meaning during Spoken Word Perception

Cortical dynamics of spoken word perception is not well understood. The possible interplay between analysis of sound form and meaning, in particular, remains elusive. We used magnetoencephalography to study cortical manifestation of phonological and semantic priming. Ten subjects listened to lists of 4 words. The first 3 words set a semantic or phonological context, and the list-final word was congruent or incongruent with this context. Attenuation of activation by priming during the first 3 words and increase of activation to semantic or phonological mismatch in the list-final word provided converging evidence: The superior temporal cortex bilaterally was involved in both analysis of sound form and meaning but the role of each hemisphere varied over time. Sensitivity to sound form was observed at approximately 100 ms after word onset, followed by sensitivity to semantic aspects from approximately 250 ms onwards, in the left hemisphere. From approximately 450 ms onwards, the picture was changed, with semantic effects now present bilaterally, accompanied by a subtle late effect of sound form in the right hemisphere. Present MEG data provide a detailed spatiotemporal account of neural mechanisms during speech perception that may underlie characterizations obtained with other neuroimaging methods less sensitive in temporal or spatial domain.

The influence of semantic processing on phonological decisions in children and adults: a magnetoencephalography (MEG) study

PURPOSE

To examine the behavioral effects and neural activation patterns associated with implicit semantic processing influences on phonological judgments during reading in children and adults.

METHOD

Whole-head magnetoencephalography (MEG) recordings were obtained from 2 groups, children (9-13 years) and adults, performing a homophone judgment task. The stimuli consisted of pairs of sequentially presented written words that were either homophones, synonym foils, or unrelated control words.

RESULTS

The difference in the time taken to respond to synonym pairs relative to control pairs of stimuli, called the semantic interference effect (SIE), was, on average, 24 ms for adults and 86 ms for children. Source analysis of the MEG data using minimum-norm estimation (MNE) yielded less activation in the adults for the synonym condition compared with the control condition in right anterior temporal and inferior frontal cortex 300-500 ms after the onset of the 2nd word in a pair, suggestive of semantic priming as well as inhibition of the SIE. A similar priming effect was observed for the children in left-anterior temporal cortex.

CONCLUSION

The observed group differences in the magnitude of the SIE and brain activation patterns may reflect developmental differences in the effects of semantic information on phonological decisions during word processing.

Spatiotemporal cortical dynamics underlying abstract and concrete word reading

The current study used whole-head anatomically constrained magnetoencephalography (aMEG) to spatiotemporally map brain responses while subjects made abstract/concrete judgments on visually presented words. Both word types evoked a similar posterior-to-anterior sequence of cortical recruitment involving occipital, temporal, parietal, and frontal areas from approximately 100 to 900 ms poststimulus. A prominent left temporofrontal N400m was smaller to abstract words, while the right temporal N400m was smaller to concrete words, suggesting that differences may exist in their semantic representation. The left temporofrontal decrease for abstract words is consistent with EEG studies, indicating a smaller N400 for abstract words based on a more extensive or accessible lexicosemantic network. Furthermore, the N400m peaked at approximately 420 ms and was followed by a large right hemisphere medial occipitoparietal as well as lateral parietal response to concrete words peaking at approximately 550 ms, perhaps embodying imagistic processing. These data suggest that words may be initially understood using a left-lateralized (frontotemporal) verbal-linguistic system that for concrete words is supplemented after a short delay by a right parietal and medial occipital imagistic network.

Multimodal access to verbal name codes

Congruent information conveyed over different sensory modalities often facilitates a variety of cognitive processes, including speech perception (Sumby & Pollack, 1954). Since auditory processing is substantially faster than visual processing, auditory-visual integration can occur over a surprisingly wide temporal window (Stein, 1998). We investigated the processing architecture mediating the integration of acoustic digit names with corresponding symbolic visual forms. The digits "1" or "2" were presented in auditory, visual, or bimodal format at several stimulus onset asynchronies (SOAs; 0, 75, 150, and 225 msec). The reaction times (RTs) for echoing unimodal auditory stimuli were approximately 100 msec faster than the RTs for naming their visual forms. Correspondingly, bimodal facilitation violated race model predictions, but only at SOA values greater than 75 msec. These results indicate that the acoustic and visual information are pooled prior to verbal response programming. However, full expression of this bimodal summation is dependent on the central coincidence of the visual and auditory inputs. These results are considered in the context of studies demonstrating multimodal activation of regions involved in speech production.