Theories of spoken word recognition deficits in aphasia: evidence from eye-tracking and computational modeling

Online Eye Tracking for Aphasia: A Feasibility Study Comparing Web and Lab Tracking and Implications for Clinical Use

BACKGROUND & AIMS

Studies using eye-tracking methodology have made important contributions to the study of language disorders such as aphasia. Nevertheless, in clinical groups especially, eye-tracking studies often include small sample sizes, limiting the generalizability of reported findings. Online, webcam-based tracking offers a potential solution to this issue, but web-based tracking has not been compared with in-lab tracking in past studies and has never been attempted in groups with language impairments.

MATERIALS & METHODS

Patients with post-stroke aphasia (n = 16) and age-matched controls (n = 16) completed identical sentence-picture matching tasks in the lab (using an EyeLink system) and on the web (using WebGazer.js), with the order of sessions counterbalanced. We examined whether web-based eye tracking is as sensitive as in-lab eye tracking in detecting group differences in sentence processing.

RESULTS

Patients were less accurate and slower to respond to all sentence types than controls. Proportions of gazes to the target and foil picture were computed in 100 ms increments, which showed that the two modes of tracking were comparably sensitive to overall group differences across different sentence types. Web tracking showed comparable fluctuations in gaze proportions to target pictures to lab tracking in most analyses, whereas a delay of approximately 500-800 ms appeared in web compared to lab data.

DISCUSSION & CONCLUSIONS

Web-based eye tracking is feasible to study impaired language processing in aphasia and is sensitive enough to detect most group differences between controls and patients. Given that validations of webcam-based tracking are in their infancy and how transformative this method could be to several disciplines, much more testing is warranted.

Rational adaptation in word production: Strong conceptual ability reduces the effect of lexical impairments on verb retrieval in aphasia

Language users rely on both linguistic and conceptual processing abilities to efficiently comprehend or produce language. According to the principle of rational adaptation, the degree to which a cognitive system relies on one process vs. another can change under different conditions or disease states with the goal of optimizing behavior. In this study, we investigated rational adaptation in reliance on linguistic versus conceptual processing in aphasia, an acquired disorder of language. In individuals living with aphasia, verb-retrieval impairments are a pervasive deficit that negatively impacts communicative function. As such, we examined evidence of adaptation in verb production, using parallel measures to index impairment in two of verb naming's critical subcomponents: conceptual and linguistic processing. These component processes were evaluated using a standardized assessment battery designed to contrast non-linguistic (picture input) and linguistic (word input) tasks of conceptual action knowledge. The results indicate that non-linguistic conceptual action processing can be impaired in people with aphasia and contributes to verb-retrieval impairments. Furthermore, relatively unimpaired conceptual action processing can ameliorate the influence of linguistic processing deficits on verb-retrieval impairments. These findings are consistent with rational adaptation accounts, indicating that conceptual processing plays a key role in language function and can be leveraged in rehabilitation to improve verb retrieval in adults with chronic aphasia.

The role of inhibitory control in spoken word recognition: Evidence from cochlear implant users

During word recognition, listeners must quickly map sounds to meaning, while suppressing similar sounding competitors. It remains an open question whether domain-general inhibitory control is recruited for resolving lexical competition. Cochlear implant (CI) users present a unique population for addressing this question because they are consistently confronted with degraded auditory input, and therefore may need to rely on domain-general mechanisms to compensate. We examined spoken word recognition in adult CI users who were prelingually deaf (were born deaf or lost their hearing in childhood, N=21), postlingually deaf (lost their hearing in adulthood, N=50), and normal hearing controls (NH; N=71). Participants recognized spoken words while their eyes were tracked and completed an inhibitory control task. CI users were slower to recognize words and did not resolve competition as fully as NH controls. Better inhibitory control predicted faster word activation in NH controls and postlingual, but not prelingual, CI users. Prolonged experience with acoustic language may thus influence how domain-general mechanisms are recruited for language processing.

Using lexical semantic cues to mitigate interference effects during real-time sentence processing in aphasia

We examined the auditory sentence processing of neurologically unimpaired listeners and individuals with aphasia on canonical sentence structures in real-time using a visual-world eye-tracking paradigm. The canonical sentence constructions contained multiple noun phrases and an unaccusative verb, the latter of which formed a long-distance dependency link between the unaccusative verb and its single argument (which was base generated in the object position and then displaced to the subject position). To explore the likelihood of similarity-based interference during the real time linking of the verb and the sentence's subject noun, we manipulated the animacy feature of the noun phrases (matched or mismatched). The study's objectives were to examine whether (a) reducing the similarity-based interference by mismatching animacy features would modulate the encoding and retrieval dynamics of noun phrases in real-time; and (b) whether individuals with aphasia would demonstrate on time sensitivity to this lexical-semantic cue. Results revealed a significant effect of this manipulation in individuals both with and without aphasia. In other words, the mismatch in the representational features of the noun phrases increased the distinctiveness of the unaccusative verb's subject target at the time of syntactic retrieval (verb offset) for individuals in both groups. Moreover, individuals with aphasia were shown to be sensitive to the lexical-semantic cue, even though they appeared to process it slower than unimpaired listeners. This study extends to the cue-based retrieval model by providing new insight on the real-time mechanisms underpinning sentence comprehension.

Analysing data from the psycholinguistic visual-world paradigm: Comparison of different analysis methods

In this paper, we discuss key characteristics and typical experimental designs of the visual-world paradigm and compare different methods of analysing eye-movement data. We discuss the nature of the eye-movement data from a visual-world study and provide data analysis tutorials on ANOVA, t-tests, linear mixed-effects model, growth curve analysis, cluster-based permutation analysis, bootstrapped differences of timeseries, generalised additive modelling, and divergence point analysis to enable psycholinguists to apply each analytical method to their own data. We discuss advantages and disadvantages of each method and offer recommendations about how to select an appropriate method depending on the research question and the experimental design.

The effect of time on lexical and syntactic processing in aphasia

Processing deficits at the lexical level, such as delayed and reduced lexical activation, have been theorized as the source of breakdowns in syntactic operations and thus contribute to sentence comprehension deficits in individuals with aphasia (IWA). In the current study, we investigate the relationship between lexical and syntactic processing in object-relative sentences using eye-tracking while listening in IWA. We explore whether manipulating the time available to process a critical lexical item (the direct-object noun) when it is initially heard in a sentence has an immediate effect on lexical access as well as a downstream effect on syntactic processing. To achieve this aim, we use novel temporal manipulations to provide additional time for lexical processing to occur. In addition to exploring these temporal effects in IWA, we also seek to understand the effect that additional time has on sentence processing in neurotypical age-matched adults (AMC). We predict that the temporal manipulations designed to provide increased processing time for critical lexical items will 1) enhance lexical processing of the target noun, 2) facilitate syntactic integration, and 3) improve sentence comprehension for both IWA and AMC. We demonstrate that strengthening lexical processing via the addition of time can affect lexical processing and facilitate syntactic retrieval of the target noun and lead to enhanced interference resolution in both unimpaired and impaired systems. In aphasia, additional time can mitigate impairments in spreading activation thereby improving lexical access and reducing interference during downstream dependency linking. However, individuals with aphasia may require longer additions of time to fully realize these benefits.

I'm not sure that curve means what you think it means: Toward a [more] realistic understanding of the role of eye-movement generation in the Visual World Paradigm

The Visual World Paradigm (VWP) is a powerful experimental paradigm for language research. Listeners respond to speech in a "visual world" containing potential referents of the speech. Fixations to these referents provides insight into the preliminary states of language processing as decisions unfold. The VWP has become the dominant paradigm in psycholinguistics and extended to every level of language, development, and disorders. Part of its impact is the impressive data visualizations which reveal the millisecond-by-millisecond time course of processing, and advances have been made in developing new analyses that precisely characterize this time course. All theoretical and statistical approaches make the tacit assumption that the time course of fixations is closely related to the underlying activation in the system. However, given the serial nature of fixations and their long refractory period, it is unclear how closely the observed dynamics of the fixation curves are actually coupled to the underlying dynamics of activation. I investigated this assumption with a series of simulations. Each simulation starts with a set of true underlying activation functions and generates simulated fixations using a simple stochastic sampling procedure that respects the sequential nature of fixations. I then analyzed the results to determine the conditions under which the observed fixations curves match the underlying functions, the reliability of the observed data, and the implications for Type I error and power. These simulations demonstrate that even under the simplest fixation-based models, observed fixation curves are systematically biased relative to the underlying activation functions, and they are substantially noisier, with important implications for reliability and power. I then present a potential generative model that may ultimately overcome many of these issues.

Nonspecific Effects of Normal Aging on Taxonomic and Thematic Semantic Processing

OBJECTIVE

This study aimed to assess the effect of normal aging on the processing of taxonomic and thematic semantic relations.

METHOD

We used the Visual-World-Paradigm coupled with eye-movement recording. We compared performance of healthy younger and older adults on a word-to-picture matching task in which participants had to identify each target among semantically related (taxonomic or thematic) and unrelated distractors.

RESULTS

Younger and older participants exhibited similar patterns of gaze fixations in the two semantic conditions. The effect of aging took the form of an overall reduction in sensitivity to semantic competitors, with no difference between the taxonomic and thematic conditions. Moreover, comparison of the proportions of fixations between the younger and older participants indicated that targets were identified equally quickly in both age groups. This was not the case when mouse-click reaction times were analyzed.

CONCLUSIONS

Findings argue in favor of nonspecific effects of normal aging on semantic processing that similarly affect taxonomic and thematic processing. There are important clinical implications, as pathological aging has been repeatedly shown to selectively affect either taxonomic or thematic relations. Measuring eye-movements in a semantic task is also an interesting approach in the elderly, as these seem to be less impacted by aging than other motor responses.

Effect of Lexical-Semantic Cues during Real-Time Sentence Processing in Aphasia

Using a visual world eye-tracking paradigm, we investigated the real-time auditory sentence processing of neurologically unimpaired listeners and individuals with aphasia. We examined whether lexical-semantic cues provided as adjectives of a target noun modulate the encoding and retrieval dynamics of a noun phrase during the processing of complex, non-canonical sentences. We hypothesized that the real-time processing pattern of sentences containing a semantically biased lexical cue (e.g., the venomous snake) would be different than sentences containing unbiased adjectives (e.g., the voracious snake). More specifically, we predicted that the presence of a biased lexical cue would facilitate (1) lexical encoding (i.e., boosted lexical access) of the target noun, snake, and (2) on-time syntactic retrieval or dependency linking (i.e., increasing the probability of on-time lexical retrieval at post-verb gap site) for both groups. For unimpaired listeners, results revealed a difference in the time course of gaze trajectories to the target noun (snake) during lexical encoding and syntactic retrieval in the biased compared to the unbiased condition. In contrast, for the aphasia group, the presence of biased adjectives did not affect the time course of processing the target noun. Yet, at the post-verb gap site, the presence of a semantically biased adjective influenced syntactic re-activation. Our results extend the cue-based parsing model by offering new and valuable insights into the processes underlying sentence comprehension of individuals with aphasia.

Predicting language treatment response in bilingual aphasia using neural network-based patient models

Predicting language therapy outcomes in bilinguals with aphasia (BWA) remains challenging due to the multiple pre- and poststroke factors that determine the deficits and recovery of their two languages. Computational models that simulate language impairment and treatment outcomes in BWA can help predict therapy response and identify the optimal language for treatment. Here we used the BiLex computational model to simulate the behavioral profile of language deficits and treatment response of a retrospective sample of 13 Spanish-English BWA who received therapy in one of their languages. Specifically, we simulated their prestroke naming ability and poststroke naming impairment in each language, and their treatment response in the treated and the untreated language. BiLex predicted treatment effects accurately and robustly in the treated language and captured different degrees of cross-language generalization in the untreated language in BWA. Our cross-validation approach further demonstrated that BiLex generalizes to predict treatment response for patients whose data were not used in model training. These findings support the potential of BiLex to predict therapy outcomes for BWA and suggest that computational modeling may be helpful to guide individually tailored rehabilitation plans for this population.

A Computational Evaluation of Two Models of Retrieval Processes in Sentence Processing in Aphasia

Can sentence comprehension impairments in aphasia be explained by difficulties arising from dependency completion processes in parsing? Two distinct models of dependency completion difficulty are investigated, the Lewis and Vasishth (2005) activation-based model and the direct-access model (DA; McElree, 2000). These models' predictive performance is compared using data from individuals with aphasia (IWAs) and control participants. The data are from a self-paced listening task involving subject and object relative clauses. The relative predictive performance of the models is evaluated using k-fold cross-validation. For both IWAs and controls, the activation-based model furnishes a somewhat better quantitative fit to the data than the DA. Model comparisons using Bayes factors show that, assuming an activation-based model, intermittent deficiencies may be the best explanation for the cause of impairments in IWAs, although slowed syntax and lexical delayed access may also play a role. This is the first computational evaluation of different models of dependency completion using data from impaired and unimpaired individuals. This evaluation develops a systematic approach that can be used to quantitatively compare the predictions of competing models of language processing.

Alexithymia explains atypical spatiotemporal dynamics of eye gaze in autism

Recognition of emotional facial expressions is considered to be atypical in autism. This difficulty is thought to be due to the way that facial expressions are visually explored. Evidence for atypical visual exploration of emotional faces in autism is, however, equivocal. We propose that, where observed, atypical visual exploration of emotional facial expressions is due to alexithymia, a distinct but frequently co-occurring condition. In this eye-tracking study we tested the alexithymia hypothesis using a number of recent methodological advances to study eye gaze during several emotion processing tasks (emotion recognition, intensity judgements, free gaze), in 25 adults with, and 45 without, autism. A multilevel polynomial modelling strategy was used to describe the spatiotemporal dynamics of eye gaze to emotional facial expressions. Converging evidence from traditional and novel analysis methods revealed that atypical gaze to the eyes is best predicted by alexithymia in both autistic and non-autistic individuals. Information theoretic analyses also revealed differential effects of task on gaze patterns as a function of alexithymia, but not autism. These findings highlight factors underlying atypical emotion processing in autistic individuals, with wide-ranging implications for emotion research.

Eye Tracking Measures for Studying Language Comprehension Deficits in Aphasia: A Systematic Search and Scoping Review

Aim The aim of this scoping review is to identify the eye tracking paradigms and eye movement measures used to investigate auditory and reading comprehension deficits in persons with aphasia (PWA). Method MEDLINE via PubMed, Cochrane, CINAHL, Embase, PsycINFO, OTseeker, Scopus, Google Scholar, Grey Literature Database, and ProQuest Search (Dissertations & Theses) were searched for relevant studies. The Covidence software was used to manage the initial and full-text screening process for the search. Results and Discussion From a total of 1,803 studies, 68 studies were included for full-text screening. In addition, 418 records from gray literature were also screened. After full-text screening, 16 studies were included for this review-12 studies for auditory comprehension in PWA and four studies for reading comprehension in PWA. The review highlights the use of common eye tracking paradigms used to study language comprehension in PWA. We also discusse eye movement measures and how they help in assessing auditory and reading comprehension. Methodological challenges of using eye tracking are discussed. Conclusion The studies summarized in this scoping review provide evidence that the eye tracking methods are beneficial for studying auditory and reading comprehension in PWA.

Verb-argument integration in primary progressive aphasia: Real-time argument access and selection

BACKGROUND

Impaired sentence comprehension is observed in the three major subtypes of PPA, with distinct performance patterns relating to impairments in comprehending complex sentences in the agrammatic (PPA-G) and logopenic (PPA-L) variants and word comprehension in the semantic subtype (PPA-S). However, little is known about basic combinatory processes during sentence comprehension in PPA, such the integration of verbs with their subject and object(s) (verb-argument integration).

METHODS

The present study used visual-world eye-tracking to examine real-time verb-argument integration in individuals with PPA (12 with PPA-G, 10 with PPA-L, and 6 with PPA-S) and neurotypical older adults (15). Two baseline experiments probed eye movement control, using a non-linguistic task, and noun comprehension, respectively. Two verb-argument integration experiments examined the effects of verb meaning on (a) lexical access of the verb's direct object (argument access) and (b) selection of a semantically-appropriate direct object (argument selection), respectively. Eye movement analyses were conducted only for trials with correct behavioral responses, allowing us to distinguish accuracy and online processing.

RESULTS

The eye movement control experiment revealed no significant impairments in PPA, whereas the noun comprehension experiment revealed reduced accuracy and eye-movement latencies in PPA-S, and to a lesser extent PPA-G. In the argument access experiment, verb meaning facilitated argument access normally in PPA-G and PPA-L; in PPA-S, verb-meaning effects emerged on an atypical time course. In the argument selection experiment, significant impairments in accuracy were observed only in PPA-G, accompanied by markedly atypical eye movement patterns.

CONCLUSION

This study revealed two distinct patterns of impaired verb-argument integration in PPA. In PPA-S, impaired verb-argument integration was observed in the argument access experiment, indicating impairments in basic semantic combinatory processes which likely relate to damage in ventral language pathways. In contrast, listeners with PPA-G showed marked impairments of argument selection, likely relating to damage to left inferior frontal regions.

Audiovisual speech segmentation in post-stroke aphasia: a pilot study

Background: Stroke may cause sentence comprehension disorders. Speech segmentation, i.e. the ability to detect word boundaries while listening to continuous speech, is an initial step allowing the successful identification of words and the accurate understanding of meaning within sentences. It has received little attention in people with post-stroke aphasia (PWA).Objectives: Our goal was to study speech segmentation in PWA and examine the potential benefit of seeing the speakers' articulatory gestures while segmenting sentences.Methods: Fourteen PWA and twelve healthy controls participated in this pilot study. Performance was measured with a word-monitoring task. In the auditory-only modality, participants were presented with auditory-only stimuli while in the audiovisual modality, visual speech cues (i.e. speaker's articulatory gestures) accompanied the auditory input. The proportion of correct responses was calculated for each participant and each modality. Visual enhancement was then calculated in order to estimate the potential benefit of seeing the speaker's articulatory gestures.Results: Both in auditory-only and audiovisual modalities, PWA performed significantly less well than controls, who had 100% correct performance in both modalities. The performance of PWA was correlated with their phonological ability. Six PWA used the visual cues. Group level analysis performed on PWA did not show any reliable difference between the auditory-only and audiovisual modalities (median of visual enhancement = 7% [Q1 - Q3: -5 - 39]).Conclusion: Our findings show that speech segmentation disorder may exist in PWA. This points to the importance of assessing and training speech segmentation after stroke. Further studies should investigate the characteristics of PWA who use visual speech cues during sentence processing.

Validity of an eyetracking method for capturing auditory-visual cross-format semantic priming

INTRODUCTION

Semantic priming paradigms are important for understanding lexical-semantic processing and the nature of linguistic deficits accompanying language performance in neurologically impaired individuals such as people with aphasia. Reaction-time-(RT)-based traditional semantic priming tasks entail potential confounds, especially problematic when applied to people with aphasia, who may have concomitant neurocognitive challenges that limit task performance. Some of these confounds include requirements of following complex instructions, making metalinguistic judgments, and using speech or limb-based motor actions to indicate overt responses. Eyetracking methods have great potential for avoiding some of these confounds. We tested the validity of an eyetracking method in capturing semantic priming in an auditory-visual cross-format priming paradigm (auditory word prime-visual image target).

METHOD

A total of 72 neurologically unimpaired adults participated in two phases: a stimulus development phase using traditional priming (n = 32) and an experimental eyetracking phase (n = 40). Each phase included two conditions, representing distinct levels of prime-target semantic relatedness: unrelated and related. Mean RT data from the traditional priming (stimuli development) phase guided image selection for the eyetracking experiment. Eyetracking indices of fixation duration and latency of fixation were recorded to capture semantic priming in the eyetracking experiment.

RESULTS

Eye fixation data indicated that images related to auditory primes were attended to earlier and attracted significantly greater visual attention than unrelated images. These results mirrored RT data from the traditional priming method, which showed faster RT latencies and more accurate naming performance for related images than for unrelated images.

CONCLUSIONS

Results support the validity of eyetracking indices of semantic priming and offer a robust testing protocol for future studies in this line of research. Current clinical relevance for people with aphasia is highlighted. Further empirical testing of the psychometric properties of the eyetracking measures in various semantic priming contexts is recommended.

Task-Related Differences in Eye Movements in Individuals With Aphasia

Background: Neurotypical young adults show task-based modulation and stability of their eye movements across tasks. This study aimed to determine whether persons with aphasia (PWA) modulate their eye movements and show stability across tasks similarly to control participants.

Methods: Forty-eight PWA and age-matched control participants completed four eye-tracking tasks: scene search, scene memorization, text-reading, and pseudo-reading.

Results: Main effects of task emerged for mean fixation duration, saccade amplitude, and standard deviations of each, demonstrating task-based modulation of eye movements. Group by task interactions indicated that PWA produced shorter fixations relative to controls. This effect was most pronounced for scene memorization and for individuals who recently suffered a stroke. PWA produced longer fixations, shorter saccades, and less variable eye movements in reading tasks compared to controls. Three-way interactions of group, aphasia subtype, and task also emerged. Text-reading and scene memorization were particularly effective at distinguishing aphasia subtype. Persons with anomic aphasia showed a reduction in reading saccade amplitudes relative to their respective control group and other PWA. Persons with conduction/Wernicke’s aphasia produced shorter scene memorization fixations relative to controls or PWA of other subtypes, suggesting a memorization specific effect. Positive correlations across most tasks emerged for fixation duration and did not significantly differ between controls and PWA.

Conclusion: PWA generally produced shorter fixations and smaller saccades relative to controls particularly in scene memorization and text-reading, respectively. The effect was most pronounced recently after a stroke. Selectively in reading tasks, PWA produced longer fixations and shorter saccades relative to controls, consistent with reading difficulty. PWA showed task-based modulation of eye movements, though the pattern of results was somewhat abnormal relative to controls. All subtypes of PWA also demonstrated task-based modulation of eye movements. However, persons with anomic aphasia showed reduced modulation of saccade amplitude and smaller reading saccades, possibly to improve reading comprehension. Controls and PWA generally produced stabile fixation durations across tasks and did not differ in their relationship across tasks. Overall, these results suggest there is potential to differentiate among PWA with varying subtypes and from controls using eye movement measures of task-based modulation, especially reading and scene memorization tasks.

Impaired Lexical Selection and Fluency in Post-Stroke Aphasia

BACKGROUND

Deficits in fluent language production are a hallmark of aphasia and may arise from impairments at different levels in the language system. It has been proposed that difficulty resolving lexical competition contributes to fluency deficits.

AIMS

The present study tested this hypothesis in a novel way: by examining whether narrative speech production fluency is associated with difficulty resolving lexical competition in spoken word recognition as measured by sensitivity to phonological neighborhood density.

METHODS & PROCEDURES

Nineteen participants with aphasia and 15 neurologically intact older adults identified spoken words that varied in phonological neighborhood density and were presented in moderate noise.

OUTCOMES & RESULTS

Neurologically intact participants exhibited the standard inhibitory effect of phonological neighborhood density on response times: slower recognition of spoken words from denser neighborhoods. Among participants with aphasia, the inhibitory effect of phonological neighborhood density (less accurate recognition of spoken words from denser neighborhoods) was smaller for participants with greater fluency. The neighborhood effect was larger for participants with greater receptive vocabulary knowledge, indicating that the fluency effect was not a result of general lexical deficits.

CONCLUSIONS

These results are consistent with the hypothesis that impaired lexical selection is a contributing factor in fluency deficits in post-stroke aphasia.

Subliminal Priming-State of the Art and Future Perspectives

The influence of subliminal priming (behavior outside of awareness) in humans is an interesting phenomenon and its understanding is crucial as it can impact behavior, choices, and actions. Given this, research about the impact of priming continues to be an area of investigative interest, and this paper provides a technical overview of research design strengths and issues in subliminal priming research. Efficient experiments and protocols, as well as associated electroencephalographic and eye movement data analyses, are discussed in detail. We highlight the strengths and weaknesses of different priming experiments that have measured affective (emotional) and cognitive responses. Finally, very recent approaches and findings are described to summarize and emphasize state-of-the-art methods and potential future directions in research marketing and other commercial applications.

Interaction in Spoken Word Recognition Models: Feedback Helps

Human perception, cognition, and action requires fast integration of bottom-up signals with top-down knowledge and context. A key theoretical perspective in cognitive science is the interactive activation hypothesis: forward and backward flow in bidirectionally connected neural networks allows humans and other biological systems to approximate optimal integration of bottom-up and top-down information under real-world constraints. An alternative view is that online feedback is neither necessary nor helpful; purely feed forward alternatives can be constructed for any feedback system, and online feedback could not improve processing and would preclude veridical perception. In the domain of spoken word recognition, the latter view was apparently supported by simulations using the interactive activation model, TRACE, with and without feedback: as many words were recognized more quickly without feedback as were recognized faster with feedback, However, these simulations used only a small set of words and did not address a primary motivation for interaction: making a model robust in noise. We conducted simulations using hundreds of words, and found that the majority were recognized more quickly with feedback than without. More importantly, as we added noise to inputs, accuracy and recognition times were better with feedback than without. We follow these simulations with a critical review of recent arguments that online feedback in interactive activation models like TRACE is distinct from other potentially helpful forms of feedback. We conclude that in addition to providing the benefits demonstrated in our simulations, online feedback provides a plausible means of implementing putatively distinct forms of feedback, supporting the interactive activation hypothesis.

Audiological Assessment of Word Recognition Skills in Persons With Aphasia

PURPOSE

The purpose of this study was to evaluate the ability of persons with aphasia, with and without hearing loss, to complete a commonly used open-set word recognition test that requires a verbal response. Furthermore, phonotactic probabilities and neighborhood densities of word recognition errors were assessed to explore potential underlying linguistic complexities that might differentially influence performance among groups.

METHOD

Four groups of adult participants were tested: participants with no brain injury with normal hearing, participants with no brain injury with hearing loss, participants with brain injury with aphasia and normal hearing, and participants with brain injury with aphasia and hearing loss. The Northwestern University Auditory Test No. 6 (NU-6; Tillman & Carhart, 1966) was administered. Those participants who were unable to respond orally (repeating words as heard) were assessed with the Picture Identification Task (Wilson & Antablin, 1980), permitting a picture-pointing response instead. Error patterns from the NU-6 were assessed to determine whether phonotactic probability influenced performance.

RESULTS

All participants with no brain injury and 72.7% of the participants with aphasia (24 out of 33) completed the NU-6. Furthermore, all participants who were unable to complete the NU-6 were able to complete the Picture Identification Task. There were significant group differences on NU-6 performance. The 2 groups with normal hearing had significantly higher scores than the 2 groups with hearing loss, but the 2 groups with normal hearing and the 2 groups with hearing loss did not differ from one another, implying that their performance was largely determined by hearing loss rather than by brain injury or aphasia. The neighborhood density, but not phonotactic probabilities, of the participants' errors differed across groups with and without aphasia.

CONCLUSIONS

Because the vast majority of the participants with aphasia examined could be tested readily using an instrument such as the NU-6, clinicians should not be reticent to use this test if patients are able to repeat single words, but routine use of alternative tests is encouraged for populations of people with brain injuries.

Encoding lexical tones in jTRACE: a simulation of monosyllabic spoken word recognition in Mandarin Chinese

Despite its prevalence as one of the most highly influential models of spoken word recognition, the TRACE model has yet to be extended to consider tonal languages such as Mandarin Chinese. A key reason for this is that the model in its current state does not encode lexical tone. In this report, we present a modified version of the jTRACE model in which we borrowed on its existing architecture to code for Mandarin phonemes and tones. Units are coded in a way that is meant to capture the similarity in timing of access to vowel and tone information that has been observed in previous studies of Mandarin spoken word recognition. We validated the model by first simulating a recent experiment that had used the visual world paradigm to investigate how native Mandarin speakers process monosyllabic Mandarin words (Malins & Joanisse, 2010). We then subsequently simulated two psycholinguistic phenomena: (1) differences in the timing of resolution of tonal contrast pairs, and (2) the interaction between syllable frequency and tonal probability. In all cases, the model gave rise to results comparable to those of published data with human subjects, suggesting that it is a viable working model of spoken word recognition in Mandarin. It is our hope that this tool will be of use to practitioners studying the psycholinguistics of Mandarin Chinese and will help inspire similar models for other tonal languages, such as Cantonese and Thai.

Development of an eye-tracking method to assess mental set switching in people with aphasia

BACKGROUND

Deficits in cognitive flexibility contribute to impaired functional communication in people with aphasia. Understanding the relationship between functional communication and cognitive flexibility in people with neurologic communication disorders is important. However, traditional methods to assess mental set switching pose significant linguistic, cognitive and motoric response confounds. Eye-tracking methods have great potential to address these challenges.

AIMS

The goal of this study was to develop and validate an eye-tracking method to index mental set switching in individuals without neurological impairment based upon performance on a nonlinguistic switching task.

METHODS

Eye movements of 20 adults without communication disorders were recorded as they completed a switching task, requiring participants to match stimuli to one or two search criteria (colour or shape) in single- and mixed-task conditions. Differences between single and mixed conditions were assessed with eye-tracking measures. Performance on the eye-tracking task was compared to standardized measures of cognitive flexibility.

RESULTS

Eye-tracking measures indexed significant differences between nonswitch and switch trials within and between single- and mixed-task condition. Some standardized assessment measures correlated significantly with the eye movement measures.

CONCLUSIONS

Results support the construct validity of the novel eye-tracking method for assessing cognitive switching in language-normal adults. Clinical and research implications are discussed.

Inferior Frontal Cortex Contributions to the Recognition of Spoken Words and Their Constituent Speech Sounds

Speech perception and comprehension are often challenged by the need to recognize speech sounds that are degraded or ambiguous. Here, we explore the cognitive and neural mechanisms involved in resolving ambiguity in the identity of speech sounds using syllables that contain ambiguous phonetic segments (e.g., intermediate sounds between /b/ and /g/ as in "blade" and "glade"). We used an audio-morphing procedure to create a large set of natural sounding minimal pairs that contain phonetically ambiguous onset or offset consonants (differing in place, manner, or voicing). These ambiguous segments occurred in different lexical contexts (i.e., in words or pseudowords, such as blade-glade or blem-glem) and in different phonological environments (i.e., with neighboring syllables that differed in lexical status, such as blouse-glouse). These stimuli allowed us to explore the impact of phonetic ambiguity on the speed and accuracy of lexical decision responses (Experiment 1), semantic categorization responses (Experiment 2), and the magnitude of BOLD fMRI responses during attentive comprehension (Experiment 3). For both behavioral and neural measures, observed effects of phonetic ambiguity were influenced by lexical context leading to slower responses and increased activity in the left inferior frontal gyrus for high-ambiguity syllables that distinguish pairs of words, but not for equivalent pseudowords. These findings suggest lexical involvement in the resolution of phonetic ambiguity. Implications for speech perception and the role of inferior frontal regions are discussed.

Tracking sentence comprehension: Test-retest reliability in people with aphasia and unimpaired adults

PURPOSE

Visual-world eyetracking is increasingly used to investigate online language processing in normal and language impaired listeners. Tracking changes in eye movements over time also may be useful for indexing language recovery in those with language impairments. Therefore, it is critical to determine the test-retest reliability of results obtained using this method.

METHODS

Unimpaired young adults and people with aphasia took part in two eyetracking sessions spaced about one week apart. In each session, participants completed a sentence-picture matching task in which they listened to active and passive sentences (e.g., The [N1+Auxwoman was] [Vvisiting/visited] [NP/PP2(by) the man]) and selected between two pictures with reversed thematic roles. We used intraclass correlations (ICCs) to examine the test-retest reliability of response measures (accuracy, reaction time (RT)) and online eye movements (i.e., the likelihood of fixating the target picture in each region of the sentence) in each participant group.

RESULTS

In the unimpaired adults, accuracy was at ceiling (thus ICCs were not computed), with moderate ICCs for RT (i.e., 0.4 - 0.58) for passive sentences and low (<0.4) for actives. In individuals with aphasia, test-retest reliability was strong (0.590.75) for RT for both sentence types. Similarly, for the unimpaired listeners, reliability of eye movements was moderate for passive sentences (NP/PP2 region) and low in all regions for active sentences. But, for the aphasic participant group, eye movement reliability was excellent for passive sentences (in the first second after sentence end) and strong for active sentences (V and NP/PP2 regions).

CONCLUSION

Results indicated moderate-to-low reliability for unimpaired listeners; however, reliable eye movement patterns were detected for processes specific to passive sentences (e.g., thematic reanalysis). In contrast, individuals with aphasia exhibited strong and stable performance across sentence types in response measures and online eye movements. These findings indicate that visual-world eyetracking provides a reliable measure of online sentence comprehension, and thus may be useful for investigating sentence processing changes over time.

The ventrolateral prefrontal cortex facilitates processing of sentential context to locate referents

Left ventrolateral prefrontal cortex (VLPFC) has been implicated in both integration and conflict resolution in sentence comprehension. Most evidence in favor of the integration account comes from processing ambiguous or anomalous sentences, which also poses a demand for conflict resolution. In two eye-tracking experiments we studied the role of VLPFC in integration when demands for conflict resolution were minimal. Two closely-matched groups of individuals with chronic post-stroke aphasia were tested: the Anterior group had damage to left VLPFC, whereas the Posterior group had left temporo-parietal damage. In Experiment 1 a semantic cue (e.g., "She will eat the apple") uniquely marked the target (apple) among three distractors that were incompatible with the verb. In Experiment 2 phonological cues (e.g., "She will see an eagle."/"She will see a bear.") uniquely marked the target among three distractors whose onsets were incompatible with the cue (e.g., all consonants when the target started with a vowel). In both experiments, control conditions had a similar format, but contained no semantic or phonological contextual information useful for target integration (e.g., the verb "see", and the determiner "the"). All individuals in the Anterior group were slower in using both types of contextual information to locate the target than were individuals in the Posterior group. These results suggest a role for VLPFC in integration beyond conflict resolution. We discuss a framework that accommodates both integration and conflict resolution.

What do pauses in narrative production reveal about the nature of word retrieval deficits in PPA?

Naming and word-retrieval deficits, which are common characteristics of primary progressive aphasia (PPA), differentially affect production across word classes (e.g., nouns, verbs) in some patients. Individuals with the agrammatic variant (PPA-G) often show greater difficulty producing verbs whereas those with the semantic variant (PPA-S) show greater noun deficits and those with logopenic PPA (PPA-L) evince no clear-cut differences in production of the two word classes. To determine the source of these production patterns, the present study examined word-finding pauses as conditioned by lexical variables (i.e., word class, frequency, length) in narrative speech samples of individuals with PPA-S (n=12), PPA-G (n=12), PPA-L (n=11), and cognitively healthy controls (n=12). We also examined the relation between pause distribution and cortical atrophy (i.e., cortical thickness) in nine left hemisphere regions of interest (ROIs) linked to word production. Results showed higher overall pause rates for PPA compared to unimpaired controls; however, greater naming severity was not associated with increased pause rate. Across all groups, more pauses were produced before lower vs. higher frequency words, with no independent effects of word length after controlling for frequency. With regard to word class, the PPA-L group showed a higher rate of pauses prior to production of nouns compared to verbs, consistent with noun-retrieval deficits arising at the lemma level of word production. Those with PPA-G and PPA-S, like controls, produced similar pause rates across word classes; however, lexical simplification (i.e., production of higher-frequency and/or shorter words) was evident in the more-impaired word class: nouns for PPA-S and verbs for PPA-G. These patterns are consistent with conceptual and/or lemma-level impairments for PPA-S, predominantly affecting objects/nouns, and a lemma-level verb-retrieval deficit for PPA-G, with a concomitant impairment in phonological encoding and articulation affecting overall pause rates. The greater tendency to pause before nouns was correlated with atrophy in the left precentral gyrus, inferior frontal gyrus and inferior parietal lobule, whereas the greater tendency to pause before less frequent and longer words was associated with atrophy in left precentral and inferior parietal regions.

Detecting time-specific differences between temporal nonlinear curves: Analyzing data from the visual world paradigm

In multiple fields of study, time series measured at high frequencies are used to estimate population curves that describe the temporal evolution of some characteristic of interest. These curves are typically nonlinear, and the deviations of each series from the corresponding curve are highly autocorrelated. In this scenario, we propose a procedure to compare the response curves for different groups at specific points in time. The method involves fitting the curves, performing potentially hundreds of serially correlated tests, and appropriately adjusting the overall alpha level of the tests. Our motivating application comes from psycholinguistics and the visual world paradigm. We describe how the proposed technique can be adapted to compare fixation curves within subjects as well as between groups. Our results lead to conclusions beyond the scope of previous analyses.

A Computational Evaluation of Sentence Processing Deficits in Aphasia

Individuals with agrammatic Broca's aphasia experience difficulty when processing reversible non-canonical sentences. Different accounts have been proposed to explain this phenomenon. The Trace Deletion account (Grodzinsky, 1995, 2000, 2006) attributes this deficit to an impairment in syntactic representations, whereas others (e.g., Caplan, Waters, Dede, Michaud, & Reddy, 2007; Haarmann, Just, & Carpenter, 1997) propose that the underlying structural representations are unimpaired, but sentence comprehension is affected by processing deficits, such as slow lexical activation, reduction in memory resources, slowed processing and/or intermittent deficiency, among others. We test the claims of two processing accounts, slowed processing and intermittent deficiency, and two versions of the Trace Deletion Hypothesis (TDH), in a computational framework for sentence processing (Lewis & Vasishth, 2005) implemented in ACT-R (Anderson, Byrne, Douglass, Lebiere, & Qin, 2004). The assumption of slowed processing is operationalized as slow procedural memory, so that each processing action is performed slower than normal, and intermittent deficiency as extra noise in the procedural memory, so that the parsing steps are more noisy than normal. We operationalize the TDH as an absence of trace information in the parse tree. To test the predictions of the models implementing these theories, we use the data from a German sentence-picture matching study reported in Hanne, Sekerina, Vasishth, Burchert, and De Bleser (2011). The data consist of offline (sentence-picture matching accuracies and response times) and online (eye fixation proportions) measures. From among the models considered, the model assuming that both slowed processing and intermittent deficiency are present emerges as the best model of sentence processing difficulty in aphasia. The modeling of individual differences suggests that, if we assume that patients have both slowed processing and intermittent deficiency, they have them in differing degrees.

How hearing impairment affects sentence comprehension: using eye fixations to investigate the duration of speech processing

The main objective of this study was to investigate the extent to which hearing impairment influences the duration of sentence processing. An eye-tracking paradigm is introduced that provides an online measure of how hearing impairment prolongs processing of linguistically complex sentences; this measure uses eye fixations recorded while the participant listens to a sentence. Eye fixations toward a target picture (which matches the aurally presented sentence) were measured in the presence of a competitor picture. Based on the recorded eye fixations, the single target detection amplitude, which reflects the tendency of the participant to fixate the target picture, was used as a metric to estimate the duration of sentence processing. The single target detection amplitude was calculated for sentence structures with different levels of linguistic complexity and for different listening conditions: in quiet and in two different noise conditions. Participants with hearing impairment spent more time processing sentences, even at high levels of speech intelligibility. In addition, the relationship between the proposed online measure and listener-specific factors, such as hearing aid use and cognitive abilities, was investigated. Longer processing durations were measured for participants with hearing impairment who were not accustomed to using a hearing aid. Moreover, significant correlations were found between sentence processing duration and individual cognitive abilities (such as working memory capacity or susceptibility to interference). These findings are discussed with respect to audiological applications.

Interaction between phonological and semantic representations: time matters

Computational modeling and eye-tracking were used to investigate how phonological and semantic information interact to influence the time course of spoken word recognition. We extended our recent models (Chen & Mirman, 2012; Mirman, Britt, & Chen, 2013) to account for new evidence that competition among phonological neighbors influences activation of semantically related concepts during spoken word recognition (Apfelbaum, Blumstein, & McMurray, 2011). The model made a novel prediction: Semantic input modulates the effect of phonological neighbors on target word processing, producing an approximately inverted-U-shaped pattern with a high phonological density advantage at an intermediate level of semantic input-in contrast to the typical disadvantage for high phonological density words in spoken word recognition. This prediction was confirmed with a new analysis of the Apfelbaum et al. data and in a visual world paradigm experiment with preview duration serving as a manipulation of strength of semantic input. These results are consistent with our previous claim that strongly active neighbors produce net inhibitory effects and weakly active neighbors produce net facilitative effects.

Effects of Vocabulary Size on Online Lexical Processing by Preschoolers

This study was designed to investigate the relationship between vocabulary size and the speed and accuracy of lexical processing in preschoolers between the ages of 30-46 months using an automatic eye tracking task based on the looking-while-listening paradigm (Fernald, Zangl, Portillo, & Marchman, 2008) and mispronunciation paradigm (White & Morgan, 2008). Children's eye gaze patterns were tracked while they looked at two pictures (one familiar object, one unfamiliar object) on a computer screen and simultaneously heard one of three kinds of auditory stimuli: correct pronunciations of the familiar object's name, one-feature mispronunciations of the familiar object's name, or a nonword. The results showed that children with larger expressive vocabularies, relative to children with smaller expressive vocabularies, were more likely to look to a familiar object upon hearing a correct pronunciation and to an unfamiliar object upon hearing a novel word. Results also showed that children with larger expressive vocabularies were more sensitive to mispronunciations; they were more likely to look toward the unfamiliar object rather than the familiar object upon hearing a one-feature mispronunciation of a familiar object-name. These results suggest that children with smaller vocabularies, relative to their larger-vocabulary age peers, are at a disadvantage for learning new words, as well as for processing familiar words.

Processing lexical ambiguity in sentential context: Eye-tracking data from brain-damaged and non-brain-damaged individuals

The purpose of the present study was to identify general and syndrome-specific deficits in the lexical processing of individuals with non-fluent and fluent aphasia compared to individuals without cognitive, neurological or language impairments. The time course of lexical access, as well as lexical selection and integration was studied using a visual-world paradigm in three groups of Russian speakers: 36 individuals in the control group, 15 individuals with non-fluent aphasia and eight individuals with fluent aphasia. Participants listened to temporarily ambiguous sentences wherein the context biased the interpretation of an ambiguous word toward one of its two meanings. In half of the experimental sentences, a reanalysis was needed upon encountering the disambiguating phrase. The effect of the length of the intervening material between the ambiguous word and the disambiguation point was additionally monitored. All groups of participants showed intact lexical access under slowed speech rate, but non-fluent participants experienced difficulties with timely activation of multiple referents. At later stages of lexical processing, they additionally demonstrated a specific impairment of reanalysis. The deficit in participants with fluent aphasia was not focalized at any specific stage of lexical processing. Rather, the breakdown of lexical processes in fluent aphasia was likely related to difficulties with the inhibition of irrelevant lexical activation, which is further supported by the finding that increased phonological distance between the ambiguous word and ambiguity resolution was influential to the offline performance in this group.

Abnormal dynamics of activation of object use information in apraxia: evidence from eyetracking

Action representations associated with object use may be incidentally activated during visual object processing, and the time course of such activations may be influenced by lexical-semantic context (e.g., Lee, Middleton, Mirman, Kalénine, & Buxbaum (2012). Journal of Experimental Psychology: Human Perception and Performance, 39(1), 257-270). In this study we used the "visual world" eye-tracking paradigm to examine whether a deficit in producing skilled object-use actions (apraxia) is associated with abnormalities in incidental activation of action information, and assessed the neuroanatomical substrates of any such deficits. Twenty left hemisphere stroke patients, ten of whom were apraxic, performed a task requiring identification of a named object in a visual display containing manipulation-related and unrelated distractor objects. Manipulation relationships among objects were not relevant to the identification task. Objects were cued with neutral ("S/he saw the…."), or action-relevant ("S/he used the….") sentences. Non-apraxic participants looked at use-related non-target objects significantly more than at unrelated non-target objects when cued both by neutral and action-relevant sentences, indicating that action information is incidentally activated. In contrast, apraxic participants showed delayed activation of manipulation-based action information during object identification when cued by neutral sentences. The magnitude of delayed activation in the neutral sentence condition was reliably predicted by lower scores on a test of gesture production to viewed objects, as well as by lesion loci in the inferior parietal and posterior temporal lobes. However, when cued by a sentence containing an action verb, apraxic participants showed fixation patterns that were statistically indistinguishable from non-apraxic controls. In support of grounded theories of cognition, these results suggest that apraxia and temporal-parietal lesions may be associated with abnormalities in incidental activation of action information from objects. Further, they suggest that the previously-observed facilitative role of action verbs in the retrieval of object-related action information extends to participants with apraxia.

Infant word recognition: Insights from TRACE simulations

The TRACE model of speech perception (McClelland & Elman, 1986) is used to simulate results from the infant word recognition literature, to provide a unified, theoretical framework for interpreting these findings. In a first set of simulations, we demonstrate how TRACE can reconcile apparently conflicting findings suggesting, on the one hand, that consonants play a pre-eminent role in lexical acquisition (Nespor, Peña & Mehler, 2003; Nazzi, 2005), and on the other, that there is a symmetry in infant sensitivity to vowel and consonant mispronunciations of familiar words (Mani & Plunkett, 2007). In a second series of simulations, we use TRACE to simulate infants' graded sensitivity to mispronunciations of familiar words as reported by White and Morgan (2008). An unexpected outcome is that TRACE fails to demonstrate graded sensitivity for White and Morgan's stimuli unless the inhibitory parameters in TRACE are substantially reduced. We explore the ramifications of this finding for theories of lexical development. Finally, TRACE mimics the impact of phonological neighbourhoods on early word learning reported by Swingley and Aslin (2007). TRACE offers an alternative explanation of these findings in terms of mispronunciations of lexical items rather than imputing word learning to infants. Together these simulations provide an evaluation of Developmental (Jusczyk, 1993) and Familiarity (Metsala, 1999) accounts of word recognition by infants and young children. The findings point to a role for both theoretical approaches whereby vocabulary structure and content constrain infant word recognition in an experience-dependent fashion, and highlight the continuity in the processes and representations involved in lexical development during the second year of life.

Effect of repetition proportion on language-driven anticipatory eye movements

Previous masked priming research in word recognition has demonstrated that repetition priming is influenced by experiment-wise information structure, such as proportion of target repetition. Research using naturalistic tasks and eye-tracking has shown that people use linguistic knowledge to anticipate upcoming words. We examined whether the proportion of target repetition within an experiment can have a similar effect on anticipatory eye movements. We used a word-to-picture matching task (i.e., the visual world paradigm) with target repetition proportion carefully controlled. Participants' eye movements were tracked starting when the pictures appeared, one second prior to the onset of the target word. Targets repeated from the previous trial were fixated more than other items during this preview period when target repetition proportion was high and less than other items when target repetition proportion was low. These results indicate that linguistic anticipation can be driven by short-term within-experiment trial structure, with implications for the generalization of priming effects, the bases of anticipatory eye movements, and experiment design.

When words fail us: insights into language processing from developmental and acquired disorders

Acquired disorders of language represent loss of previously acquired skills, usually with relatively specific impairments. In children with developmental disorders of language, we may also see selective impairment in some skills; but in this case, the acquisition of language or literacy is affected from the outset. Because systems for processing spoken and written language change as they develop, we should beware of drawing too close a parallel between developmental and acquired disorders. Nevertheless, comparisons between the two may yield new insights. A key feature of connectionist models simulating acquired disorders is the interaction of components of language processing with each other and with other cognitive domains. This kind of model might help make sense of patterns of comorbidity in developmental disorders. Meanwhile, the study of developmental disorders emphasizes learning and change in underlying representations, allowing us to study how heterogeneity in cognitive profile may relate not just to neurobiology but also to experience. Children with persistent language difficulties pose challenges both to our efforts at intervention and to theories of learning of written and spoken language. Future attention to learning in individuals with developmental and acquired disorders could be of both theoretical and applied value.

What we talk about when we talk about access deficits

Semantic impairments have been divided into storage deficits, in which the semantic representations themselves are damaged, and access deficits, in which the representations are intact but access to them is impaired. The behavioural phenomena that have been associated with access deficits include sensitivity to cueing, sensitivity to presentation rate, performance inconsistency, negative serial position effects, sensitivity to number and strength of competitors, semantic blocking effects, disordered selection between strong and weak competitors, correlation between semantic deficits and executive function deficits and reduced word frequency effects. Four general accounts have been proposed for different subsets of these phenomena: abnormal refractoriness, too much activation, impaired competitive selection and deficits of semantic control. A combination of abnormal refractoriness and impaired competitive selection can account for most of the behavioural phenomena, but there remain several open questions. In particular, it remains unclear whether access deficits represent a single syndrome, a syndrome with multiple subtypes or a variable collection of phenomena, whether the underlying deficit is domain-general or domain-specific, whether it is owing to disorders of inhibition, activation or selection, and the nature of the connection (if any) between access phenomena in aphasia and in neurologically intact controls. Computational models offer a promising approach to answering these questions.

Effects of verb meaning on lexical integration in agrammatic aphasia: Evidence from eyetracking

Relatively little is known about the time course of access to the lexical representations of verbs in agrammatic aphasia and its effects on the prediction and integration of the verb's arguments. The present study used visual-world eyetracking to test whether verb meaning can be used by agrammatic aphasic individuals to predict and facilitate the integration of a subsequent noun argument. Nine adults with agrammatic aphasia and ten age-matched controls participated in the study. In Experiment 1, participants viewed arrays of four objects (e.g., jar, plate, stick, pencil) while listening to sentences containing either a restrictive verb that was semantically compatible only with the target object or an unrestrictive verb compatible with all four objects (e.g., Susan will open/break the jar). For both participant groups, the restrictive condition elicited more fixations to the target object immediately after the verb. Experiment 2 differed from Experiment 1 in that the auditory sentences presented were incomplete (e.g., Susan will open/break the…). For controls, restrictive verbs elicited more target fixations immediately after the verb; however, the effects of verb type were noted downstream from the verb for the aphasic listeners. The results suggest that individuals with agrammatic aphasia have preserved ability to use verb information to facilitate integration of overt arguments, but prediction of upcoming arguments is impaired. Impaired lexical-semantic prediction processes may be caused by damage to the left inferior frontal gyrus, which has been argued to support higher-level lexical processes.

Pupil size varies with word listening and response selection difficulty in older adults with hearing loss

Listening to speech in noise can be exhausting, especially for older adults with impaired hearing. Pupil dilation is thought to track the difficulty associated with listening to speech at various intelligibility levels for young and middle-aged adults. This study examined changes in the pupil response with acoustic and lexical manipulations of difficulty in older adults with hearing loss. Participants identified words at two signal-to-noise ratios (SNRs) among options that could include a similar-sounding lexical competitor. Growth Curve Analyses revealed that the pupil response was affected by an SNR × Lexical competition interaction, such that it was larger and more delayed and sustained in the harder SNR condition, particularly in the presence of lexical competition. Pupillometry detected these effects for correct trials and across reaction times, suggesting it provides additional evidence of task difficulty than behavioral measures alone.

Categorization is modulated by transcranial direct current stimulation over left prefrontal cortex

Humans have an unparalleled ability to represent objects as members of multiple categories. A given object, such as a pillow may be-depending on current task demands-represented as an instance of something that is soft, as something that contains feathers, as something that is found in bedrooms, or something that is larger than a toaster. This type of processing requires the individual to dynamically highlight task-relevant properties and abstract over or suppress object properties that, although salient, are not relevant to the task at hand. Neuroimaging and neuropsychological evidence suggests that this ability may depend on cognitive control processes associated with the left inferior prefrontal gyrus. Here, we show that stimulating the left inferior frontal cortex using transcranial direct current stimulation alters performance of healthy subjects on a simple categorization task. Our task required subjects to select pictures matching a description, e.g., "click on all the round things." Cathodal stimulation led to poorer performance on classification trials requiring attention to specific dimensions such as color or shape as opposed to trials that required selecting items belonging to a more thematic category such as objects that hold water. A polarity reversal (anodal stimulation) lowered the threshold for selecting items that were more weakly associated with the target category. These results illustrate the role of frontally-mediated control processes in categorization and suggest potential interactions between categorization, cognitive control, and language.

Damage to temporo-parietal cortex decreases incidental activation of thematic relations during spoken word comprehension

Both taxonomic and thematic semantic relations have been studied extensively in behavioral studies and there is an emerging consensus that the anterior temporal lobe plays a particularly important role in the representation and processing of taxonomic relations, but the neural basis of thematic semantics is less clear. We used eye tracking to examine incidental activation of taxonomic and thematic relations during spoken word comprehension in participants with aphasia. Three groups of participants were tested: neurologically intact control participants (N=14), individuals with aphasia resulting from lesions in left hemisphere BA 39 and surrounding temporo-parietal cortex regions (N=7), and individuals with the same degree of aphasia severity and semantic impairment and anterior left hemisphere lesions (primarily inferior frontal gyrus and anterior temporal lobe) that spared BA 39 (N=6). The posterior lesion group showed reduced and delayed activation of thematic relations, but not taxonomic relations. In contrast, the anterior lesion group exhibited longer-lasting activation of taxonomic relations and did not differ from control participants in terms of activation of thematic relations. These results suggest that taxonomic and thematic semantic knowledge are functionally and neuroanatomically distinct, with the temporo-parietal cortex playing a particularly important role in thematic semantics.

A combination of thematic and similarity-based semantic processes confers resistance to deficit following left hemisphere stroke

Semantic knowledge may be organized in terms of similarity relations based on shared features and/or complementary relations based on co-occurrence in events. Thus, relationships between manipulable objects such as tools may be defined by their functional properties (what the objects are used for) or thematic properties (e.g., what the objects are used with or on). A recent study from our laboratory used eye-tracking to examine incidental activation of semantic relations in a word–picture matching task and found relatively early activation of thematic relations (e.g., broom–dustpan), later activation of general functional relations (e.g., broom–sponge), and an intermediate pattern for specific functional relations (e.g., broom–vacuum cleaner). Combined with other recent studies, these results suggest that there are distinct semantic systems for thematic and similarity-based knowledge and that the “specific function” condition drew on both systems. This predicts that left hemisphere stroke that damages either system (but not both) may spare specific function processing. The present experiment tested these hypotheses using the same experimental paradigm with participants with left hemisphere lesions (N = 17). The results revealed that, compared to neurologically intact controls (N = 12), stroke participants showed later activation of thematic and general function relations, but activation of specific function relations was spared and was significantly earlier for stroke participants than controls. Across the stroke participants, activation of thematic and general function relations was negatively correlated, further suggesting that damage tended to affect either one semantic system or the other. These results support the distinction between similarity-based and complementarity-based semantic relations and suggest that relations that draw on both systems are relatively more robust to damage.

Competition and cooperation among similar representations: toward a unified account of facilitative and inhibitory effects of lexical neighbors

One of the core principles of how the mind works is the graded, parallel activation of multiple related or similar representations. Parallel activation of multiple representations has been particularly important in the development of theories and models of language processing, where coactivated representations (neighbors) have been shown to exhibit both facilitative and inhibitory effects on word recognition and production. Researchers generally ascribe these effects to interactive activation and competition, but there is no unified explanation for why the effects are facilitative in some cases and inhibitory in others. We present a series of simulations of a simple domain-general interactive activation and competition model that is broadly consistent with more specialized domain-specific models of lexical processing. The results showed that interactive activation and competition can indeed account for the complex pattern of reversals. Critically, the simulations revealed a core computational principle that determines whether neighbor effects are facilitative or inhibitory: strongly active neighbors exert a net inhibitory effect, and weakly active neighbors exert a net facilitative effect.