Refractoriness and the healthy brain: a behavioural study on semantic access

The Role of the Dorsolateral Prefrontal Cortex in the Production and Comprehension of Phonologically and Semantically Related Words

Previous studies suggest that producing and comprehending semantically related words relies on inhibitory control over competitive lexical selection which results in the recruitment of the left inferior frontal gyrus (IFG). Few studies, however, have examined the involvement of other regions of the frontal cortex, such as the dorsolateral prefrontal cortex (DLPFC), despite its role in cognitive control related to lexical processing. The primary objective of this study was to elucidate the role of the DLPFC in the production and comprehension of semantically and phonologically related words in blocked cyclic naming and picture-word matching paradigms. Twenty-one adults participated in neuroimaging with functional near-infrared spectroscopy to measure changes in oxygenated and deoxygenated hemoglobin concentrations across the bilateral frontal cortex during blocked cyclic picture naming and blocked cyclic picture-word-matching tasks. After preprocessing, oxygenated and deoxygenated hemoglobin concentrations were obtained for each task (production, comprehension), condition (semantic, phonological) and region (DLPFC, IFG). The results of pairwise t-tests adjusted for multiple comparisons showed significant increases in oxygenated hemoglobin concentration over baseline in the bilateral DLPFC during picture naming for phonologically related words. For picture-word matching, we found significant increases in oxygenated hemoglobin concentration over baseline in the right DLPFC for semantically related words and in the right IFG for phonologically related words. We discuss the results in light of the inhibitory attentional control over competitive lexical access theory in contrast to alternative potential explanations for the findings.

BONEs not CATs attract DOGs: Semantic context effects for picture naming in the lesioned language network

The breakdown of rapid and accurate retrieval of words is a hallmark of aphasic speech and a prime target of therapeutic intervention. Complementary, psycho- and neurolinguistic research have developed a spectrum of models, how and by which neuronal network uncompromised speakers can rely on remarkable lexical retrieval capacities. Motivated by both lines of research we invited 32 participants with a chronic left hemispheric brain lesion to name pictures in the presence of distractor words. This picture-word-interference (PWI) paradigm is widely used in psycho- and neurolinguistic research. We find that also after brain lesion categorically related words (CAT → [dog]^picture) impede naming, while associatively related words (BONE → [dog]^picture) ease access, when compared to unrelated distractor words. The effects largely affecting latencies in neurotypical populations, are reproduced for error rate in our participants with lesions in the language network. Unsurprisingly, overall naming abilities varied greatly across patients. Notably, however, the two effects (categorical interference / associative facilitation) differ between participants. Correlating performance with lesion patterns we find support for the notion of a divergence of brain areas affording different aspects of the task: (i) lesions in the left middle temporal gyurs (MTG) deteriorate overall naming, confirming previous work; more notably, (ii) lesions comprising the inferior frontal hub (inferior frontal gyrus, IFG) of the language-network increase the interference effect for the categorical condition; on the contrary, (iii) lesions to the mid-to-posterior temporal hub (posterior middle and superior temporal gyri, pMTG/ pSTG) increase the facilitatory effect for the associative condition on error rates. The findings can be accommodated in a neuro-linguistic framework, which localizes lexical activation but also lexical interference in posterior parts of the language network (pMTG/pITG); conversely, selection between co-activated categorically related entries is afforded by frontal language areas (IFG). While purely experimental in nature our study highlights that lesion site differentially influences specific aspects of word retrieval. Since confrontational naming is a cornerstone of aphasia rehabilitation, this may be of note when designing and evaluating novel therapeutic regimes.

When comprehension elicits incomprehension: Deterioration of semantic categorisation in the absence of stimulus repetition

Repetition improves retrieval from memory; however, under some circumstances, it can also impair performance. Separate literatures have investigated this phenomenon, including studies showing subjective loss of meaning following ‘semantic satiation’, slowed naming and categorisation when semantically related items are repeated and semantic ‘access deficits’ in aphasia. Such effects have been variously explained in terms of habituation of repeatedly accessed representations, increased interference from strongly activated competitors and long-term weight changes reflecting the suppression of non-targets on earlier trials (i.e., retrieval-induced forgetting). While studies of semantic satiation involve massed repetition of individual items, competition and weight changes at the conceptual level should elicit declining comprehension for non-repeated items: this pattern has been demonstrated for picture naming but effects in categorisation are less clear. We developed a paced serial semantic task (PSST), in which participants identified category members among distracters. Performance in healthy young adults deteriorated with ongoing retrieval for non-repeated words belonging to functional categories (e.g., picnic), taxonomic categories (e.g., animal) and feature-based categories (e.g., colour red – ‘tomato’, ‘post box’). This decline was greatest at fast presentation speeds (when there was less time to overcome competition/inhibition) and for strongly associated targets (which may have accrued more inhibition to facilitate earlier target categorisation). Deteriorating performance was also seen across words and pictures, consistent with a conceptual locus. We observed a release from deteriorating categorisation following a switch to a new category, demonstrating that this was not a general effect of time on task. Patients with semantic aphasia, who have deficient semantic control, maintained their performance throughout the categories, unlike younger adults: this finding is hard to reconcile with accounts of declining performance that propose a build-up of competition, since the patients should have had greater difficulty resolving such competition. These results instead suggest that declining performance on our goal-driven categorisation task was linked to the use of a controlled retrieval strategy by healthy young adults. Patients may not have inhibited related non-target knowledge to facilitate initial categorisation like younger volunteers, and consequently they were less vulnerable to declining comprehension in this paradigm. Together, these results demonstrate circumstances which produce declines in continuous categorisation in healthy adults.

Sensory and semantic activations evoked by action attributes of manipulable objects: Evidence from ERPs

"Two route" theories of object-related action processing posit different temporal activation profiles of grasp-to-move actions (rapidly evoked based on object structure) versus skilled use actions (more slowly activated based on semantic knowledge). We capitalized on the exquisite temporal resolution and multidimensionality of Event-Related Potentials (ERPs) to directly test this hypothesis. Participants viewed manipulable objects (e.g., calculator) preceded by objects sharing either "grasp", "use", or no action attributes (e.g., bar of soap, keyboard, earring, respectively), as well as by action-unrelated but taxonomically-related objects (e.g., abacus); participants judged whether the two objects were related. The results showed more positive responses to "grasp-to-move" primed objects than "skilled use" primed objects or unprimed objects starting in the P1 (0-150 ms) time window and continuing onto the subsequent N1 and P2 components (150-300 ms), suggesting that only "grasp-to-move", but not "skilled use", actions may facilitate visual attention to object attributes. Furthermore, reliably reduced N400s (300-500 ms), an index of semantic processing, were observed to taxonomically primed and "skilled use" primed objects relative to unprimed objects, suggesting that "skilled use" action attributes are a component of distributed, multimodal semantic representations of objects. Together, our findings provide evidence supporting two-route theories by demonstrating that "grasp-to-move" and "skilled use" actions impact different aspects of object processing and highlight the relationship of "skilled use" information to other aspects of semantic memory.

Facilitation and interference in naming: A consequence of the same learning process?

Our success with naming depends on what we have named previously, a phenomenon thought to reflect learning processes. Repeatedly producing the same name facilitates language production (i.e., repetition priming), whereas producing semantically related names hinders subsequent performance (i.e., semantic interference). Semantic interference is found whether naming categorically related items once (continuous naming) or multiple times (blocked cyclic naming). A computational model suggests that the same learning mechanism responsible for facilitation in repetition creates semantic interference in categorical naming (Oppenheim, Dell, & Schwartz, 2010). Accordingly, we tested the predictions that variability in semantic interference is correlated across categorical naming tasks and is caused by learning, as measured by two repetition priming tasks (picture-picture repetition priming, Exp. 1; definition-picture repetition priming, Exp. 2, e.g., Wheeldon & Monsell, 1992). In Experiment 1 (77 subjects) semantic interference and repetition priming effects were robust, but the results revealed no relationship between semantic interference effects across contexts. Critically, learning (picture-picture repetition priming) did not predict semantic interference effects in either task. We replicated these results in Experiment 2 (81 subjects), finding no relationship between semantic interference effects across tasks or between semantic interference effects and learning (definition-picture repetition priming). We conclude that the changes underlying facilitatory and interfering effects inherent to lexical access are the result of distinct learning processes where multiple mechanisms contribute to semantic interference in naming.

Different Loci of Semantic Interference in Picture Naming vs. Word-Picture Matching Tasks

Naming pictures and matching words to pictures belonging to the same semantic category impairs performance relative to when stimuli come from different semantic categories (i.e., semantic interference). Despite similar semantic interference phenomena in both picture naming and word-picture matching tasks, the locus of interference has been attributed to different levels of the language system - lexical in naming and semantic in word-picture matching. Although both tasks involve access to shared semantic representations, the extent to which interference originates and/or has its locus at a shared level remains unclear, as these effects are often investigated in isolation. We manipulated semantic context in cyclical picture naming and word-picture matching tasks, and tested whether factors tapping semantic-level (generalization of interference to novel category items) and lexical-level processes (interactions with lexical frequency) affected the magnitude of interference, while also assessing whether interference occurs at a shared processing level(s) (transfer of interference across tasks). We found that semantic interference in naming was sensitive to both semantic- and lexical-level processes (i.e., larger interference for novel vs. old and low- vs. high-frequency stimuli), consistent with a semantically mediated lexical locus. Interference in word-picture matching exhibited stable interference for old and novel stimuli and did not interact with lexical frequency. Further, interference transferred from word-picture matching to naming. Together, these experiments provide evidence to suggest that semantic interference in both tasks originates at a shared processing stage (presumably at the semantic level), but that it exerts its effect at different loci when naming pictures vs. matching words to pictures.

The role of the right hemisphere in semantic control: A case-series comparison of right and left hemisphere stroke

Semantic control processes guide conceptual retrieval so that we are able to focus on non-dominant associations and features when these are required for the task or context, yet the neural basis of semantic control is not fully understood. Neuroimaging studies have emphasised the role of left inferior frontal gyrus (IFG) in controlled retrieval, while neuropsychological investigations of semantic control deficits have almost exclusively focussed on patients with left-sided damage (e.g., patients with semantic aphasia, SA). Nevertheless, activation in fMRI during demanding semantic tasks typically extends to right IFG. To investigate the role of the right hemisphere (RH) in semantic control, we compared nine RH stroke patients with 21 left-hemisphere SA patients, 11 mild SA cases and 12 healthy, aged-matched controls on semantic and executive tasks, plus experimental tasks that manipulated semantic control in paradigms particularly sensitive to RH damage. RH patients had executive deficits to parallel SA patients but they performed well on standard semantic tests. Nevertheless, multimodal semantic control deficits were found in experimental tasks involving facial emotions and the 'summation' of meaning across multiple items. On these tasks, RH patients showed effects similar to those in SA cases - multimodal deficits that were sensitive to distractor strength and cues and miscues, plus increasingly poor performance in cyclical matching tasks which repeatedly probed the same set of concepts. Thus, despite striking differences in single-item comprehension, evidence presented here suggests semantic control is bilateral, and disruption of this component of semantic cognition can be seen following damage to either hemisphere.

Varieties of semantic 'access' deficit in Wernicke's aphasia and semantic aphasia

Comprehension deficits are common in stroke aphasia, including in cases with (i) semantic aphasia, characterized by poor executive control of semantic processing across verbal and non-verbal modalities; and (ii) Wernicke's aphasia, associated with poor auditory-verbal comprehension and repetition, plus fluent speech with jargon. However, the varieties of these comprehension problems, and their underlying causes, are not well understood. Both patient groups exhibit some type of semantic 'access' deficit, as opposed to the 'storage' deficits observed in semantic dementia. Nevertheless, existing descriptions suggest that these patients might have different varieties of 'access' impairment-related to difficulty resolving competition (in semantic aphasia) versus initial activation of concepts from sensory inputs (in Wernicke's aphasia). We used a case series design to compare patients with Wernicke's aphasia and those with semantic aphasia on Warrington's paradigmatic assessment of semantic 'access' deficits. In these verbal and non-verbal matching tasks, a small set of semantically-related items are repeatedly presented over several cycles so that the target on one trial becomes a distractor on another (building up interference and eliciting semantic 'blocking' effects). Patients with Wernicke's aphasia and semantic aphasia were distinguished according to lesion location in the temporal cortex, but in each group, some individuals had additional prefrontal damage. Both of these aspects of lesion variability-one that mapped onto classical 'syndromes' and one that did not-predicted aspects of the semantic 'access' deficit. Both semantic aphasia and Wernicke's aphasia cases showed multimodal semantic impairment, although as expected, the Wernicke's aphasia group showed greater deficits on auditory-verbal than picture judgements. Distribution of damage in the temporal lobe was crucial for predicting the initially 'beneficial' effects of stimulus repetition: cases with Wernicke's aphasia showed initial improvement with repetition of words and pictures, while in semantic aphasia, semantic access was initially good but declined in the face of competition from previous targets. Prefrontal damage predicted the 'harmful' effects of repetition: the ability to reselect both word and picture targets in the face of mounting competition was linked to left prefrontal damage in both groups. Therefore, patients with semantic aphasia and Wernicke's aphasia have partially distinct impairment of semantic 'access' but, across these syndromes, prefrontal lesions produce declining comprehension with repetition in both verbal and non-verbal tasks.

Long-lasting semantic interference effects in object naming are not necessarily conceptually mediated

Long-lasting interference effects in picture naming are induced when objects are presented in categorically related contexts in both continuous and blocked cyclic paradigms. Less consistent context effects have been reported when the task is changed to semantic classification. Experiment 1 confirmed the recent finding of cumulative facilitation in the continuous paradigm with living/non-living superordinate categorization. To avoid a potential confound involving participants responding with the identical superordinate category in related contexts in the blocked cyclic paradigm, we devised a novel set of categorically related objects that also varied in terms of relative age – a core semantic type associated with the adjective word class across languages. Experiment 2 demonstrated the typical interference effect with these stimuli in basic level naming. In Experiment 3, using the identical blocked cyclic paradigm, we failed to observe semantic context effects when the same pictures were classified as younger–older. Overall, the results indicate the semantic context effects in the two paradigms do not share a common origin, with the effect in the continuous paradigm arising at the level of conceptual representations or in conceptual-to-lexical connections while the effect in the blocked cyclic paradigm most likely originates at a lexical level of representation. The implications of these findings for current accounts of long-lasting interference effects in spoken word production are discussed.

Uncovering the architecture of action semantics

Despite research suggesting that stored sensorimotor information about tool use is a component of the semantic representations of tools, little is known about the action features or organizing principles that underlie this knowledge. We used methods similar to those applied in other semantic domains to examine the "architecture" of action semantic knowledge. In Experiment 1, participants sorted photographs of tools into groups according to the similarity of their associated "use" actions and rated tools on dimensions related to action. The results suggest that the magnitude of arm movement, configuration of the hand, and manner of motion during tool use play a role in determining how tools cluster in action "semantic space." In Experiment 2, we validated the architecture uncovered in Experiment 1 using an implicit semantic task for which tool use knowledge was not ostensibly relevant (blocked cyclic word-picture matching). Using stimuli from Experiment 1, we found that participants performed more poorly during blocks of trials containing tools used with similar versus unrelated actions, and the amount of semantic interference depended on the magnitude of action similarity among tools. Thus, the degree of featural overlap between tool use actions plays a role in determining the overall semantic similarity of tools.

Abnormal dynamics of activation of object use information in apraxia: evidence from eyetracking

Action representations associated with object use may be incidentally activated during visual object processing, and the time course of such activations may be influenced by lexical-semantic context (e.g., Lee, Middleton, Mirman, Kalénine, & Buxbaum (2012). Journal of Experimental Psychology: Human Perception and Performance, 39(1), 257-270). In this study we used the "visual world" eye-tracking paradigm to examine whether a deficit in producing skilled object-use actions (apraxia) is associated with abnormalities in incidental activation of action information, and assessed the neuroanatomical substrates of any such deficits. Twenty left hemisphere stroke patients, ten of whom were apraxic, performed a task requiring identification of a named object in a visual display containing manipulation-related and unrelated distractor objects. Manipulation relationships among objects were not relevant to the identification task. Objects were cued with neutral ("S/he saw the…."), or action-relevant ("S/he used the….") sentences. Non-apraxic participants looked at use-related non-target objects significantly more than at unrelated non-target objects when cued both by neutral and action-relevant sentences, indicating that action information is incidentally activated. In contrast, apraxic participants showed delayed activation of manipulation-based action information during object identification when cued by neutral sentences. The magnitude of delayed activation in the neutral sentence condition was reliably predicted by lower scores on a test of gesture production to viewed objects, as well as by lesion loci in the inferior parietal and posterior temporal lobes. However, when cued by a sentence containing an action verb, apraxic participants showed fixation patterns that were statistically indistinguishable from non-apraxic controls. In support of grounded theories of cognition, these results suggest that apraxia and temporal-parietal lesions may be associated with abnormalities in incidental activation of action information from objects. Further, they suggest that the previously-observed facilitative role of action verbs in the retrieval of object-related action information extends to participants with apraxia.

What we talk about when we talk about access deficits

Semantic impairments have been divided into storage deficits, in which the semantic representations themselves are damaged, and access deficits, in which the representations are intact but access to them is impaired. The behavioural phenomena that have been associated with access deficits include sensitivity to cueing, sensitivity to presentation rate, performance inconsistency, negative serial position effects, sensitivity to number and strength of competitors, semantic blocking effects, disordered selection between strong and weak competitors, correlation between semantic deficits and executive function deficits and reduced word frequency effects. Four general accounts have been proposed for different subsets of these phenomena: abnormal refractoriness, too much activation, impaired competitive selection and deficits of semantic control. A combination of abnormal refractoriness and impaired competitive selection can account for most of the behavioural phenomena, but there remain several open questions. In particular, it remains unclear whether access deficits represent a single syndrome, a syndrome with multiple subtypes or a variable collection of phenomena, whether the underlying deficit is domain-general or domain-specific, whether it is owing to disorders of inhibition, activation or selection, and the nature of the connection (if any) between access phenomena in aphasia and in neurologically intact controls. Computational models offer a promising approach to answering these questions.

Effects of phonological and semantic deficits on facilitative and inhibitory consequences of item repetition in spoken word comprehension

Repeating a word can have both facilitative and inhibitory effects on subsequent processing. The present study investigated these dynamics by examining the facilitative and inhibitory consequences of different kinds of item repetition in two individuals with aphasia and a group of neurologically intact control participants. The two individuals with aphasia were matched on overall aphasia severity, but had deficits at different levels of processing: one with a phonological deficit and spared semantic processing, the other with a semantic deficit and spared phonological processing. Participants completed a spoken word-to-picture matching task in which they had to pick which of four object images matched the spoken word. The trials were grouped into pairs such that exactly two objects from the first trial in a pair were present on screen during the second trial in the pair. When the second trial's target was the same as the first trial's target, compared to control participants, both participants with aphasia exhibited equally larger repetition priming effects. When the second trial's target was one of the new items, the participant with a phonological deficit exhibited a significantly more negative effect (i.e., second trial response slower than first trial response) than the control participants and the participant with a semantic deficit. Simulations of a computational model confirmed that this pattern of results could arise from (1) normal residual activation being functionally more significant when overall lexical processing is slower and (2) residual phonological activation of the previous trial's target having a particularly strong inhibitory effect specifically when phonological processing is impaired because the task was phonologically-driven (the spoken input specified the target). These results provide new insights into perseveration errors and lexical access deficits in aphasia.

Manipulability and object recognition: is manipulability a semantic feature?

Several lines of evidence exist, coming from neuropsychology, neuroimaging and behavioural investigations on healthy subjects, suggesting that an interaction might exist between the systems devoted to object identification and those devoted to online object-directed actions and that the way an object is acted upon (manipulability) might indeed influence object recognition. In this series of experiments on speeded word-to-picture-matching tasks, it is shown how the presentation of pairs of objects sharing similar manipulation causes greater interference with respect to objects sharing only visual similarity (experiment 1). Moreover, (experiment 2) it is shown how the repeated presentation of pairs of objects sharing a similar type of manipulation leads to a 'negative' serial position effect, with the number of errors increasing across presentations, a behaviour that is typically found in patients with access deficits to semantic representations. By contrast, the repeated presentation of pairs of objects sharing only visual similarity leads to an opposite 'positive' serial position effect, with errors decreasing across presentations. It is argued that a negative serial position effect is linked to interference occurring within the semantic system, and therefore that the way an object is manipulated is indeed a semantic feature, critical in defining manipulable object properties at a semantic level. To our knowledge, this constitutes the first direct evidence of manipulability being a semantic dimension. The results are discussed in the light of current models of semantic memory organization.