Category specific spatial dissociations of parallel processes underlying visual naming

Dissociation of reading and naming in ventral occipitotemporal cortex

Lesions in the language-dominant ventral occipitotemporal cortex (vOTC) can result in selective impairment of either reading or naming, resulting in alexia or anomia. Yet, functional imaging studies that show differential activation for naming and reading do not reveal activity exclusively tuned to one of these inputs. To resolve this dissonance in the functional architecture of the vOTC, we used focused stimulation to the vOTC in 49 adult patients during reading and naming, and generated a population-level, probabilistic map to evaluate if reading and naming are clearly dissociable within individuals. Language mapping (50 Hz, 2829 stimulations) was performed during passage reading (216 positive sites) and visual naming (304 positive sites). Within the vOTC, we isolated sites that selectively disrupted reading (24 sites in 11 patients) or naming (27 sites in 12 patients), and those that disrupted both processes (75 sites in 21 patients). The anteromedial vOTC had a higher probability of producing naming disruption, while posterolateral regions resulted in greater reading-specific disruption. Between them lay a multi-modal region where stimulation disrupted both reading and naming. This work provides a comprehensive view of vOTC organization-the existence of a heteromodal cortex critical to both reading and naming, along with a causally dissociable unimodal naming cortex, and a reading-specific visual word form area in the vOTC. Their distinct roles as associative regions may thus relate to their connectivity within the broader language network that is disrupted by stimulation, more than to highly selective tuning properties. Our work also implies that pre-surgical mapping of both reading and naming is essential for patients requiring vOTC resections, as these functions are not co-localized, and such mapping may prevent the occurrence of unexpected deficits.

The spatiotemporal dynamics of semantic integration in the human brain

Language depends critically on the integration of lexical information across multiple words to derive semantic concepts. Limitations of spatiotemporal resolution have previously rendered it difficult to isolate processes involved in semantic integration. We utilized intracranial recordings in epilepsy patients (n = 58) who read written word definitions. Descriptions were either referential or non-referential to a common object. Semantically referential sentences enabled high frequency broadband gamma activation (70-150 Hz) of the inferior frontal sulcus (IFS), medial parietal cortex, orbitofrontal cortex (OFC) and medial temporal lobe in the left, language-dominant hemisphere. IFS, OFC and posterior middle temporal gyrus activity was modulated by the semantic coherence of non-referential sentences, exposing semantic effects that were independent of task-based referential status. Components of this network, alongside posterior superior temporal sulcus, were engaged for referential sentences that did not clearly reduce the lexical search space by the final word. These results indicate the existence of complementary cortical mosaics for semantic integration in posterior temporal and inferior frontal cortex.

Spatio-temporal evolution of human neural activity during visually cued hand movements

Making hand movements in response to visual cues is common in daily life. It has been well known that this process activates multiple areas in the brain, but how these neural activations progress across space and time remains largely unknown. Taking advantage of intracranial electroencephalographic (iEEG) recordings using depth and subdural electrodes from 36 human subjects using the same task, we applied single-trial and cross-trial analyses to high-frequency iEEG activity. The results show that the neural activation was widely distributed across the human brain both within and on the surface of the brain, and focused specifically on certain areas in the parietal, frontal, and occipital lobes, where parietal lobes present significant left lateralization on the activation. We also demonstrate temporal differences across these brain regions. Finally, we evaluated the degree to which the timing of activity within these regions was related to sensory or motor function. The findings of this study promote the understanding of task-related neural processing of the human brain, and may provide important insights for translational applications.

A Spatiotemporal Map of Reading Aloud

Reading words aloud is a fundamental aspect of literacy. The rapid rate at which multiple distributed neural substrates are engaged in this process can only be probed via techniques with high spatiotemporal resolution. We probed this with direct intracranial recordings covering most of the left hemisphere in 46 humans (26 male, 20 female) as they read aloud regular, exception and pseudo-words. We used this to create a spatiotemporal map of word processing and to derive how broadband γ activity varies with multiple word attributes critical to reading speed: lexicality, word frequency, and orthographic neighborhood. We found that lexicality is encoded earliest in mid-fusiform (mFus) cortex, and precentral sulcus, and is represented reliably enough to allow single-trial lexicality decoding. Word frequency is first represented in mFus and later in the inferior frontal gyrus (IFG) and inferior parietal sulcus (IPS), while orthographic neighborhood sensitivity resides solely in IPS. We thus isolate the neural correlates of the distributed reading network involving mFus, IFG, IPS, precentral sulcus, and motor cortex and provide direct evidence for parallel processes via the lexical route from mFus to IFG, and the sublexical route from IPS and precentral sulcus to anterior IFG.SIGNIFICANCE STATEMENT Reading aloud depends on multiple complex cerebral computations: mapping from a written letter string on a page to a sequence of spoken sound representations. Here, we used direct intracranial recordings in a large cohort while they read aloud known and novel words, to track, across space and time, the progression of neural representations of behaviorally relevant factors that govern reading speed. We find, concordant with cognitive models of reading, that known and novel words are differentially processed through a lexical route, sensitive to frequency of occurrence of known words in natural language, and a sublexical route, performing letter-by-letter construction of novel words.

MULTIMAP: Multilingual picture naming test for mapping eloquent areas during awake surgeries

Picture naming tasks are currently the gold standard for identifying and preserving language-related areas during awake brain surgery. With multilingual populations increasing worldwide, patients frequently need to be tested in more than one language. There is still no reliable testing instrument, as the available batteries have been developed for specific languages. Heterogeneity in the selection criteria for stimuli leads to differences, for example, in the size, color, image quality, and even names associated with pictures, making direct cross-linguistic comparisons difficult. Here we present MULTIMAP, a new multilingual picture naming test for mapping eloquent areas during awake brain surgery. Recognizing that the distinction between nouns and verbs is necessary for detailed and precise language mapping, MULTIMAP consists of a database of 218 standardized color pictures representing both objects and actions. These images have been tested for name agreement with speakers of Spanish, Basque, Catalan, Italian, French, English, German, Mandarin Chinese, and Arabic, and have been controlled for relevant linguistic features in cross-language combinations. The MULTIMAP test for objects and verbs represents an alternative to the Oral Denomination 80 (DO 80) monolingual pictorial set currently used in language mapping, providing an open-source, standardized set of up-to-date pictures, where relevant linguistic variables across several languages have been taken into account in picture creation and selection.

NetDI: Methodology Elucidating the Role of Power and Dynamical Brain Network Features That Underpin Word Production

Canonical language models describe eloquent function as the product of a series of cognitive processes, typically characterized by the independent activation profiles of focal brain regions. In contrast, more recent work has suggested that the interactions between these regions, the cortical networks of language, are critical for understanding speech production. We investigated the cortical basis of picture naming (PN) with human intracranial electrocorticography (ECoG) recordings and direct cortical stimulation (DCS), adjudicating between two competing hypotheses: are task-specific cognitive functions discretely computed within well-localized brain regions or rather by distributed networks? The time resolution of ECoG allows direct comparison of intraregional activation measures [high gamma (h_γ) power] with graph theoretic measures of interregional dynamics. We developed an analysis framework, network dynamics using directed information (NetDI), using information and graph theoretic tools to reveal spatiotemporal dynamics at multiple scales: coarse, intermediate, and fine. Our analysis found novel relationships between the power profiles and network measures during the task. Furthermore, validation using DCS indicates that such network parameters combined with h_γ power are more predictive than h_γ power alone, for identifying critical language regions in the brain. NetDI reveals a high-dimensional space of network dynamics supporting cortical language function, and to account for disruptions to language function observed after neurosurgical resection, traumatic injury, and degenerative disease.

Picture naming yields highly consistent cortical activation patterns: Test-retest reliability of magnetoencephalography recordings

Reliable paradigms and imaging measures of individual-level brain activity are paramount when reaching from group-level research studies to clinical assessment of individual patients. Magnetoencephalography (MEG) provides a direct, non-invasive measure of cortical processing with high spatiotemporal accuracy, and is thus well suited for assessment of functional brain damage in patients with language difficulties. This MEG study aimed to identify, in a delayed picture naming paradigm, source-localized evoked activity and modulations of cortical oscillations that show high test-retest reliability across measurement days in healthy individuals, demonstrating their applicability in clinical settings. For patients with a language disorder picture naming can be a challenging task. Therefore, we also determined whether a semantic judgment task ('Is this item living?') with a spoken response ("yes"/"no") would suffice to induce comparably consistent activity within brain regions related to language production. The MEG data was collected from 19 healthy participants on two separate days. In picture naming, evoked activity was consistent across measurement days (intraclass correlation coefficient (ICC)>0.4) in the left frontal (400-800 ms after image onset), sensorimotor (200-800 ms), parietal (200-600 ms), temporal (200-800 ms), occipital (400-800 ms) and cingulate (600-800 ms) regions, as well as the right temporal (600-800 ms) region. In the semantic judgment task, consistent evoked activity was spatially more limited, occurring in the left temporal (200-800 ms), sensorimotor (400-800 ms), occipital (400-600 ms) and subparietal (600-800 ms) regions, and the right supramarginal cortex (600-800 ms). The delayed naming task showed typical beta oscillatory suppression in premotor and sensorimotor regions (800-1200 ms) but other consistent modulations of oscillatory activity were mostly observed in posterior cortical regions that have not typically been associated with language processing. The high test-retest consistency of MEG evoked activity in the picture naming task testifies to its applicability in clinical evaluations of language function, as well as in longitudinal MEG studies of language production in clinical and healthy populations.

Spatiotemporal dynamics of orthographic and lexical processing in the ventral visual pathway

Reading is a rapid, distributed process that engages multiple components of the ventral visual stream. To understand the neural constituents and their interactions that allow us to identify written words, we performed direct intra-cranial recordings in a large cohort of humans. This allowed us to isolate the spatiotemporal dynamics of visual word recognition across the entire left ventral occipitotemporal cortex. We found that mid-fusiform cortex is the first brain region sensitive to lexicality, preceding the traditional visual word form area. The magnitude and duration of its activation are driven by the statistics of natural language. Information regarding lexicality and word frequency propagates posteriorly from this region to visual word form regions and to earlier visual cortex, which, while active earlier, show sensitivity to words later. Further, direct electrical stimulation of this region results in reading arrest, further illustrating its crucial role in reading. This unique sensitivity of mid-fusiform cortex to sub-lexical and lexical characteristics points to its central role as the orthographic lexicon-the long-term memory representations of visual word forms.

Category Selectivity for Face and Scene Recognition in Human Medial Parietal Cortex

The rapid recognition and memory of faces and scenes implies the engagement of category-specific computational hubs in the ventral visual stream with the distributed cortical memory network. To better understand how recognition and identification occur in humans, we performed direct intracranial recordings, in a large cohort of patients (n = 50), from the medial parietal cortex (MPC) and the medial temporal lobe (MTL), structures known to be engaged during face and scene identification. We discovered that the MPC is topologically tuned to face and scene recognition, with clusters in MPC performing scene recognition bilaterally and face recognition in right subparietal sulcus. The MTL displayed a selectivity gradient with anterior, entorhinal cortex showing face selectivity and posterior parahippocampal regions showing scene selectivity. In both MPC and MTL, stimulus-specific identifiable exemplars led to greater activity in these cortical patches. These two regions work in concert for recognition of faces and scenes. Feature selectivity and identity-sensitive activity in the two regions was coincident, and they exhibited theta-phase locking during face and scene recognition. These findings together provide clear evidence for a specific role of subregions in the MPC for the recognition of unique entities.

iEEGview: an open-source multifunction GUI-based Matlab toolbox for localization and visualization of human intracranial electrodes

OBJECTIVE

The precise localization of intracranial electrodes is a fundamental step relevant to the analysis of intracranial electroencephalography (iEEG) recordings in various fields. With the increasing development of iEEG studies in human neuroscience, higher requirements have been posed on the localization process, resulting in urgent demand for more integrated, easy-operation and versatile tools for electrode localization and visualization. With the aim of addressing this need, we develop an easy-to-use and multifunction toolbox called iEEGview, which can be used for the localization and visualization of human intracranial electrodes.

APPROACH

iEEGview is written in Matlab scripts and implemented with a GUI. From the GUI, by taking only pre-implant MRI and post-implant CT images as input, users can directly run the full localization pipeline including brain segmentation, image co-registration, electrode reconstruction, anatomical information identification, activation map generation and electrode projection from native brain space into common brain space for group analysis. Additionally, iEEGview implements methods for brain shift correction, visual location inspection on MRI slices and computation of certainty index in anatomical label assignment.

MAIN RESULTS

All the introduced functions of iEEGview work reliably and successfully, and are tested by images from 28 human subjects implanted with depth and/or subdural electrodes.

SIGNIFICANCE

iEEGview is the first public Matlab GUI-based software for intracranial electrode localization and visualization that holds integrated capabilities together within one pipeline. iEEGview promotes convenience and efficiency for the localization process, provides rich localization information for further analysis and offers solutions for addressing raised technical challenges. Therefore, it can serve as a useful tool in facilitating iEEG studies.

Network dynamics of Broca's area during word selection

Current models of word-production in Broca's area (i.e. left ventro-lateral prefrontal cortex, VLPFC) posit that sequential and staggered semantic, lexical, phonological and articulatory processes precede articulation. Using millisecond-resolution intra-cranial recordings, we evaluated spatiotemporal dynamics and high frequency functional interconnectivity between left VLPFC regions during single-word production. Through the systematic variation of retrieval, selection, and phonological loads, we identified specific activation profiles and functional coupling patterns between these regions that fit within current psycholinguistic theories of word production. However, network interactions underpinning these processes activate in parallel (not sequentially), while the processes themselves are indexed by specific changes in network state. We found evidence that suggests that pars orbitalis is coupled with pars triangularis during lexical retrieval, while lexical selection is terminated via coupled activity with M1 at articulation onset. Taken together, this work reveals that speech production relies on very specific inter-regional couplings in rapid sequence in the language dominant hemisphere.

Temporal Dynamics of Human Frontal and Cingulate Neural Activity During Conflict and Cognitive Control

Cognitive control refers to the ability to produce flexible, goal-oriented behavior in the face of changing task demands and conflicting response tendencies. A classic cognitive control experiment is the Stroop-color naming task, which requires participants to name the color in which a word is written while inhibiting the tendency to read the word. By comparing stimuli with conflicting word-color associations to congruent ones, control processes over response tendencies can be isolated. We assessed the spatial specificity and temporal dynamics in the theta and gamma bands for regions engaged in detecting and resolving conflict in a cohort of 13 patients using a combination of high-resolution surface and depth recordings. We show that cognitive control manifests as a sustained increase in gamma band power, which correlates with response time. Conflict elicits a sustained gamma power increase but a transient theta power increase, specifically localized to the left cingulate sulcus and bilateral dorsolateral prefrontal cortex (DLPFC). Additionally, activity in DLPFC is affected by trial-by-trial modulation of cognitive control (the Gratton effect). Altogether, the sustained local neural activity in dorsolateral and medial regions is what determines the timing of the correct response.

Uncovering the functional anatomy of the human insula during speech

The contribution of insular cortex to speech production remains unclear and controversial given diverse findings from functional neuroimaging and lesional data. To create a precise spatiotemporal map of insular activity, we performed a series of experiments: single-word articulations of varying complexity, non-speech orofacial movements and speech listening, in a cohort of 27 patients implanted with penetrating intracranial electrodes. The posterior insula was robustly active bilaterally, but after the onset of articulation, during listening to speech and during production of non-speech mouth movements. Preceding articulation there was very sparse activity, localized primarily to the frontal operculum rather than the insula. Posterior insular was active coincident with superior temporal gyrus but was more active for self-generated speech than external speech, the opposite of the superior temporal gyrus. These findings support the conclusion that the insula does not serve pre-articulatory preparatory roles.

A lexical semantic hub for heteromodal naming in middle fusiform gyrus

Semantic memory underpins our understanding of objects, people, places, and ideas. Anomia, a disruption of semantic memory access, is the most common residual language disturbance and is seen in dementia and following injury to temporal cortex. While such anomia has been well characterized by lesion symptom mapping studies, its pathophysiology is not well understood. We hypothesize that inputs to the semantic memory system engage a specific heteromodal network hub that integrates lexical retrieval with the appropriate semantic content. Such a network hub has been proposed by others, but has thus far eluded precise spatiotemporal delineation. This limitation in our understanding of semantic memory has impeded progress in the treatment of anomia. We evaluated the cortical structure and dynamics of the lexical semantic network in driving speech production in a large cohort of patients with epilepsy using electrocorticography (n = 64), functional MRI (n = 36), and direct cortical stimulation (n = 30) during two generative language processes that rely on semantic knowledge: visual picture naming and auditory naming to definition. Each task also featured a non-semantic control condition: scrambled pictures and reversed speech, respectively. These large-scale data of the left, language-dominant hemisphere uniquely enable convergent, high-resolution analyses of neural mechanisms characterized by rapid, transient dynamics with strong interactions between distributed cortical substrates. We observed three stages of activity during both visual picture naming and auditory naming to definition that were serially organized: sensory processing, lexical semantic processing, and articulation. Critically, the second stage was absent in both the visual and auditory control conditions. Group activity maps from both electrocorticography and functional MRI identified heteromodal responses in middle fusiform gyrus, intraparietal sulcus, and inferior frontal gyrus; furthermore, the spectrotemporal profiles of these three regions revealed coincident activity preceding articulation. Only in the middle fusiform gyrus did direct cortical stimulation disrupt both naming tasks while still preserving the ability to repeat sentences. These convergent data strongly support a model in which a distinct neuroanatomical substrate in middle fusiform gyrus provides access to object semantic information. This under-appreciated locus of semantic processing is at risk in resections for temporal lobe epilepsy as well as in trauma and strokes that affect the inferior temporal cortex-it may explain the range of anomic states seen in these conditions. Further characterization of brain network behaviour engaging this region in both healthy and diseased states will expand our understanding of semantic memory and further development of therapies directed at anomia.

Dynamic Brain Interactions during Picture Naming

Brain computations involve multiple processes by which sensory information is encoded and transformed to drive behavior. These computations are thought to be mediated by dynamic interactions between populations of neurons. Here, we demonstrate that human brains exhibit a reliable sequence of neural interactions during speech production. We use an autoregressive Hidden Markov Model (ARHMM) to identify dynamical network states exhibited by electrocorticographic signals recorded from human neurosurgical patients. Our method resolves dynamic latent network states on a trial-by-trial basis. We characterize individual network states according to the patterns of directional information flow between cortical regions of interest. These network states occur consistently and in a specific, interpretable sequence across trials and subjects: the data support the hypothesis of a fixed-length visual processing state, followed by a variable-length language state, and then by a terminal articulation state. This empirical evidence validates classical psycholinguistic theories that have posited such intermediate states during speaking. It further reveals these state dynamics are not localized to one brain area or one sequence of areas, but are instead a network phenomenon.

Closed-loop intracranial stimulation alters movement timing in humans

BACKGROUND

A prime objective driving the recent development of human neural prosthetics is to stimulate neural circuits in a manner time-locked to ongoing brain activity. The human supplementary motor area (SMA) is a particularly useful target for this objective because it displays characteristic neural activity just prior to voluntary movement.

OBJECTIVE

Here, we tested a method that detected activity in the human SMA related to impending movement and then delivered cortical stimulation with intracranial electrodes to influence the timing of movement.

METHODS

We conducted experiments in nine patients with electrodes implanted for epilepsy localization: five patients with SMA electrodes and four control patients with electrodes outside the SMA. In the first experiment, electrocorticographic (ECoG) recordings were used to localize the electrode of interest during a task involving bimanual finger movements. In the second experiment, a real-time sense-and-stimulate (SAS) system was implemented that delivered an electrical stimulus when pre-movement gamma power exceeded a threshold.

RESULTS

Stimulation based on real-time detection of this supra-threshold activity resulted in significant slowing of motor behavior in all of the cases where stimulation was carried out in the SMA patients but in none of the patients where stimulation was performed at the control site.

CONCLUSIONS

The neurophysiological correlates of impending movement can be used to trigger a closed loop stimulation device and influence ongoing motor behavior in a manner imperceptible to the subject. This is the first report of a human closed loop system designed to alter movement using direct cortical recordings and direct stimulation.

Dissociable intrinsic functional networks support noun-object and verb-action processing

The processing mechanism of verbs-actions and nouns-objects is a central topic of language research, with robust evidence for behavioral dissociation. The neural basis for these two major word and/or conceptual classes, however, remains controversial. Two experiments were conducted to study this question from the network perspective. Experiment 1 found that nodes of the same class, obtained through task-evoked brain imaging meta-analyses, were more strongly connected with each other than nodes of different classes during resting-state, forming segregated network modules. Experiment 2 examined the behavioral relevance of these intrinsic networks using data from 88 brain-damaged patients, finding that across patients the relative strength of functional connectivity of the two networks significantly correlated with the noun-object vs. verb-action relative behavioral performances. In summary, we found that verbs-actions and nouns-objects are supported by separable intrinsic functional networks and that the integrity of such networks accounts for the relative noun-object- and verb-action-selective deficits.

Network dynamics of human face perception

Prevailing theories suggests that cortical regions responsible for face perception operate in a serial, feed-forward fashion. Here, we utilize invasive human electrophysiology to evaluate serial models of face-processing via measurements of cortical activation, functional connectivity, and cortico-cortical evoked potentials. We find that task-dependent changes in functional connectivity between face-selective regions in the inferior occipital (f-IOG) and fusiform gyrus (f-FG) are bidirectional, not feed-forward, and emerge following feed-forward input from early visual cortex (EVC) to both of these regions. Cortico-cortical evoked potentials similarly reveal independent signal propagations between EVC and both f-IOG and f-FG. These findings are incompatible with serial models, and support a parallel, distributed network underpinning face perception in humans.

Neural correlate of the construction of sentence meaning

The neural processes that underlie your ability to read and understand this sentence are unknown. Sentence comprehension occurs very rapidly, and can only be understood at a mechanistic level by discovering the precise sequence of underlying computational and neural events. However, we have no continuous and online neural measure of sentence processing with high spatial and temporal resolution. Here we report just such a measure: intracranial recordings from the surface of the human brain show that neural activity, indexed by γ-power, increases monotonically over the course of a sentence as people read it. This steady increase in activity is absent when people read and remember nonword-lists, despite the higher cognitive demand entailed, ruling out accounts in terms of generic attention, working memory, and cognitive load. Response increases are lower for sentence structure without meaning ("Jabberwocky" sentences) and word meaning without sentence structure (word-lists), showing that this effect is not explained by responses to syntax or word meaning alone. Instead, the full effect is found only for sentences, implicating compositional processes of sentence understanding, a striking and unique feature of human language not shared with animal communication systems. This work opens up new avenues for investigating the sequence of neural events that underlie the construction of linguistic meaning.

Category-Selectivity in Human Visual Cortex Follows Cortical Topology: A Grouped icEEG Study

Neuroimaging studies suggest that category-selective regions in higher-order visual cortex are topologically organized around specific anatomical landmarks: the mid-fusiform sulcus (MFS) in the ventral temporal cortex (VTC) and lateral occipital sulcus (LOS) in the lateral occipital cortex (LOC). To derive precise structure-function maps from direct neural signals, we collected intracranial EEG (icEEG) recordings in a large human cohort (n = 26) undergoing implantation of subdural electrodes. A surface-based approach to grouped icEEG analysis was used to overcome challenges from sparse electrode coverage within subjects and variable cortical anatomy across subjects. The topology of category-selectivity in bilateral VTC and LOC was assessed for five classes of visual stimuli-faces, animate non-face (animals/body-parts), places, tools, and words-using correlational and linear mixed effects analyses. In the LOC, selectivity for living (faces and animate non-face) and non-living (places and tools) classes was arranged in a ventral-to-dorsal axis along the LOS. In the VTC, selectivity for living and non-living stimuli was arranged in a latero-medial axis along the MFS. Written word-selectivity was reliably localized to the intersection of the left MFS and the occipito-temporal sulcus. These findings provide direct electrophysiological evidence for topological information structuring of functional representations within higher-order visual cortex.

Modulation of Orthographic Decoding by Frontal Cortex

Opinions are divided on whether word reading processes occur in a hierarchical, feedforward fashion or within an interactive framework. To critically evaluate these competing theories, we recorded electrocorticographic (ECoG) data from 15 human patients with intractable epilepsy during a word completion task and evaluated brain network dynamics across individuals. We used a novel technique of analyzing multihuman ECoG recordings to identify cortical regions most relevant to processing lexical information. The mid fusiform gyrus showed the strongest, earliest response after stimulus onset, whereas activity was maximal in frontal, dorsal lateral prefrontal, and sensorimotor regions toward articulation onset. To evaluate interregional functional connectivity, ECoG data from electrodes situated over specific cortical regions of interest were fit into linear multivariate autoregressive (MVAR) models. Spectral characteristics of the MVAR models were used to precisely reveal the timing and the magnitude of information flow between localized brain regions. This is the first application of MVAR for developing a comprehensive account of interregional interactions from a word reading ECoG dataset. Our comprehensive findings revealed both top-down and bottom-up influences between higher-level language areas and the mid fusiform gyrus. Our findings thus challenge strictly hierarchical, feedforward views of word reading and suggest that orthographic processes are modulated by prefrontal and sensorimotor regions via an interactive framework.

SIGNIFICANCE STATEMENT

Word reading is a critical part of everyday life. When the ability to read is disrupted, it can lead to learning disorders, as well as emotional and academic difficulties. The neural mechanisms underlying word reading are not well understood due to limitations in the spatial and temporal specificity of prior word reading studies. Our research analyzed data recorded from sensors implanted directly from surface of human brains while these individuals performed a word reading task. Our research analyzed these recordings to infer how brain regions communicate during word reading. Our original results improve upon current models of word reading and can be used to develop treatment plans for individuals with reading disabilities.

Four-dimensional maps of the human somatosensory system

A fine-grained description of the spatiotemporal dynamics of human brain activity is a major goal of neuroscientific research. Limitations in spatial and temporal resolution of available noninvasive recording and imaging techniques have hindered so far the acquisition of precise, comprehensive four-dimensional maps of human neural activity. The present study combines anatomical and functional data from intracerebral recordings of nearly 100 patients, to generate highly resolved four-dimensional maps of human cortical processing of nonpainful somatosensory stimuli. These maps indicate that the human somatosensory system devoted to the hand encompasses a widespread network covering more than 10% of the cortical surface of both hemispheres. This network includes phasic components, centered on primary somatosensory cortex and neighboring motor, premotor, and inferior parietal regions, and tonic components, centered on opercular and insular areas, and involving human parietal rostroventral area and ventral medial-superior-temporal area. The technique described opens new avenues for investigating the neural basis of all levels of cortical processing in humans.

Development of grouped icEEG for the study of cognitive processing

Invasive intracranial EEG (icEEG) offers a unique opportunity to study human cognitive networks at an unmatched spatiotemporal resolution. To date, the contributions of icEEG have been limited to the individual-level analyses or cohorts whose data are not integrated in any way. Here we discuss how grouped approaches to icEEG overcome challenges related to sparse-sampling, correct for individual variations in response and provide statistically valid models of brain activity in a population. By the generation of whole-brain activity maps, grouped icEEG enables the study of intra and interregional dynamics between distributed cortical substrates exhibiting task-dependent activity. In this fashion, grouped icEEG analyses can provide significant advances in understanding the mechanisms by which cortical networks give rise to cognitive functions.

Dissociated roles of the inferior frontal gyrus and superior temporal sulcus in audiovisual processing: top-down and bottom-up mismatch detection

Visual inputs can distort auditory perception, and accurate auditory processing requires the ability to detect and ignore visual input that is simultaneous and incongruent with auditory information. However, the neural basis of this auditory selection from audiovisual information is unknown, whereas integration process of audiovisual inputs is intensively researched. Here, we tested the hypothesis that the inferior frontal gyrus (IFG) and superior temporal sulcus (STS) are involved in top-down and bottom-up processing, respectively, of target auditory information from audiovisual inputs. We recorded high gamma activity (HGA), which is associated with neuronal firing in local brain regions, using electrocorticography while patients with epilepsy judged the syllable spoken by a voice while looking at a voice-congruent or -incongruent lip movement from the speaker. The STS exhibited stronger HGA if the patient was presented with information of large audiovisual incongruence than of small incongruence, especially if the auditory information was correctly identified. On the other hand, the IFG exhibited stronger HGA in trials with small audiovisual incongruence when patients correctly perceived the auditory information than when patients incorrectly perceived the auditory information due to the mismatched visual information. These results indicate that the IFG and STS have dissociated roles in selective auditory processing, and suggest that the neural basis of selective auditory processing changes dynamically in accordance with the degree of incongruity between auditory and visual information.

Contribution of research on 'Epilepsy & behavior' to the refinement of functional brain atlas in four dimensions

Intracranial stimulation mapping by Penfield et al. largely contributed to our current knowledge of the functional organization of motor, sensory, and language systems. The functional maps were generated and printed in two dimensions, based on the summary results of direct cortical stimulation of which locations varied across patients. Intracranial measurement of electrocorticographic changes elicited by a task can localize the regions involved in or participating to the given task. Augmentation of high-gamma activity at >80 Hz is considered to reflect in situ cortical activation at each moment. In the late 2000s, the spatial-temporal profiles of event-related high-gamma activity began to be published as a video material in journals. We have referred to our animation movie as ‘in-vivo animation of event-related high-gamma activity’, that demonstrates ‘when’ and ‘where’ cortical regions are activated in a self-explanatory fashion. Summation of event-related high-gamma measures derived from a large cohort of patients, as previously performed by Penfield et al, is expected to generate unique four-dimensional functional brain atlas covering the whole cerebral cortex.