Explaining semantic short-term memory deficits: evidence for the critical role of semantic control

Using lexical semantic cues to mitigate interference effects during real-time sentence processing in aphasia

We examined the auditory sentence processing of neurologically unimpaired listeners and individuals with aphasia on canonical sentence structures in real-time using a visual-world eye-tracking paradigm. The canonical sentence constructions contained multiple noun phrases and an unaccusative verb, the latter of which formed a long-distance dependency link between the unaccusative verb and its single argument (which was base generated in the object position and then displaced to the subject position). To explore the likelihood of similarity-based interference during the real time linking of the verb and the sentence's subject noun, we manipulated the animacy feature of the noun phrases (matched or mismatched). The study's objectives were to examine whether (a) reducing the similarity-based interference by mismatching animacy features would modulate the encoding and retrieval dynamics of noun phrases in real-time; and (b) whether individuals with aphasia would demonstrate on time sensitivity to this lexical-semantic cue. Results revealed a significant effect of this manipulation in individuals both with and without aphasia. In other words, the mismatch in the representational features of the noun phrases increased the distinctiveness of the unaccusative verb's subject target at the time of syntactic retrieval (verb offset) for individuals in both groups. Moreover, individuals with aphasia were shown to be sensitive to the lexical-semantic cue, even though they appeared to process it slower than unimpaired listeners. This study extends to the cue-based retrieval model by providing new insight on the real-time mechanisms underpinning sentence comprehension.

Neural evidence for a separation of semantic and phonological control processes

There remain major doubts about the nature and domain specificity of inhibitory control processes, both within and between cognitive domains. This study examined inhibitory processes within the language domain, by contrasting semantic versus phonological inhibitory control. In an fMRI experiment, elderly participants performed phonological and semantic inhibitory control tasks involving resistance to highly or weakly interfering stimuli. In the semantic domain, inhibitory control effects, contrasting high vs. low interference control levels, were observed at univariate and multivariate levels in all fronto-parieto-temporal region-of-interests. In the phonological domain, inhibitory control effects were observed only at multivariate levels, and were restricted to the pars triangularis of the bilateral inferior frontal gyrus and to the left middle temporal gyrus. Critically, no reliable multivariate cross-domain prediction of neural patterns associated with inhibitory control was observed. This study supports a functional dissociation of the neural substrates associated with inhibitory control for phonological vs. semantic domains.

Motivated semantic control: Exploring the effects of extrinsic reward and self-reference on semantic retrieval in semantic aphasia

Recent insights show that increased motivation can benefit executive control, but this effect has not been explored in relation to semantic cognition. Patients with deficits of controlled semantic retrieval in the context of semantic aphasia (SA) after stroke may benefit from this approach since ‘semantic control’ is considered an executive process. Deficits in this domain are partially distinct from the domain‐general deficits of cognitive control. We assessed the effect of both extrinsic and intrinsic motivation in healthy controls and SA patients. Experiment 1 manipulated extrinsic reward using high or low levels of points for correct responses during a semantic association task. Experiment 2 manipulated the intrinsic value of items using self‐reference, allocating pictures of items to the participant (‘self’) or researcher (‘other’) in a shopping game before participants retrieved their semantic associations. These experiments revealed that patients, but not controls, showed better performance when given an extrinsic reward, consistent with the view that increased external motivation may help ameliorate patients’ semantic control deficits. However, while self‐reference was associated with better episodic memory, there was no effect on semantic retrieval. We conclude that semantic control deficits can be reduced when extrinsic rewards are anticipated; this enhanced motivational state is expected to support proactive control, for example, through the maintenance of task representations. It may be possible to harness this modulatory impact of reward to combat the control demands of semantic tasks in SA patients.

A case-study of language-specific executive disorder

Executive control is recruited for language processing, particularly in complex linguistic tasks. Although the issue of the existence of an executive control specific to language is still an open issue, there is much evidence that executively-demanding language tasks rely on domain-general rather than language-specific executive resources. Here, we addressed this issue by assessing verbal and non-verbal executive capacities in LG, an aphasic patient after a stroke. First, we showed that LG's performance was spared in all non-verbal tasks regardless of the executive demands. Second, by contrasting conditions of high and low executive demand in verbal tasks, we showed that LG was only impaired in verbal task with high executive demand. The performance dissociation between low and high executive demand conditions in the verbal domain, not observed in the non-verbal domain, shows that verbal executive control partly dissociates from non-verbal executive control. This language-specific executive disorder suggests that some executive processes might be language-specific.

Maintaining verbal short-term memory representations in non-perceptual parietal regions

Buffer accounts of verbal short-term memory (STM) assume dedicated buffers for maintaining different types of information (e.g., phonological, visual) whereas embedded processes accounts argue against the existence of buffers and claim that STM consists of the activated portion of long-term memory (LTM). We addressed this debate by determining whether STM recruits the same neural substrate as LTM, or whether additional regions are involved in short-term storage. Using fMRI with representational similarity analysis (RSA), we examined the representational correspondence of multi-voxel neural activation patterns with the theoretical predictions for the maintenance of both phonological and semantic codes in STM. We found that during the delay period of a phonological STM task, phonological representations could be decoded in the left supramarginal gyrus (SMG) but not the superior temporal gyrus (STG), a speech processing region, for word stimuli. Whereas the pattern in the SMG was specific to phonology, a different region in the left angular gyrus showed RSA decoding evidence for the retention of either phonological or semantic codes, depending on the task context. Taken together, the results provide clear support for a dedicated buffer account of phonological STM, although evidence for a semantic buffer is equivocal.

Evaluating the distinction between semantic knowledge and semantic access: Evidence from semantic dementia and comprehension-impaired stroke aphasia

Theories of semantic memory based on neuropsychological findings have posited a distinction between stored semantic representations and the mechanisms used to access and manipulate them (e.g., Lambon Ralph, Jefferies, Patterson, & Rogers, 2017; Warrington & Cipolotti, 1996). The most recent instantiation of this view, the controlled semantic cognition theory (Lambon Ralph et al., 2017), is supported by findings suggesting that multimodal (i.e., both verbal and nonverbal) semantic deficits may result from qualitatively different impairments: on the one hand, damage to a semantic access mechanism related to executive control, which is observed in semantic aphasia (SA), and on the other, damage to semantic representations, which is observed in semantic dementia (SD) (Jefferies & Lambon Ralph, 2006). In this study we compared SA and SD patients on several phenomena previously used to support these distinctions. Contrary to the prior results, we found that (1) overall, cross-task consistency was equivalent for the two groups; (2) neither patient group showed consistency driven by item identity across different semantic tasks; (3) correlations among task performance were not obviously driven by the semantic control demands of different tasks; (4) both groups showed executive function deficits; and (5) both groups showed strong effects of distractor interference in a synonym judgment task. Furthermore, we investigated the components of executive ability that could underlie semantic control deficits by correlating performance on updating, shifting, and inhibition tasks with performance on tasks testing semantic abilities. We found that updating was related to semantic processing generally, whereas shifting and inhibition were not. These results also suggest that complex executive function tasks relate to semantic tasks through their shared relationship with language abilities. Overall, evidence from SA and SD patients does not differentiate representations and access mechanisms in the semantic system, as has previously been suggested. Implications for the storage-access distinction are discussed.

Left frontotemporal effective connectivity during semantic feature judgments in patients with chronic aphasia and age-matched healthy controls

Traditional models of neural reorganization of language skills in patients with chronic stroke-induced aphasia (PWA) propose activation of reperfused or spared left hemisphere tissue results in the most favorable language outcomes. However, these models do not fully explain variable behavioral recovery patterns observed in chronic patients. Instead, investigation of connectivity patterns of critical network nodes may elucidate better-informed recovery models. In the present study, we combined fMRI and dynamic causal modeling (DCM) to examine effective connectivity of a simple three-node left hemisphere network during a semantic feature decision task in 25 PWA and 18 age-matched neurologically intact healthy controls. The DCM model space utilized in Meier, Kapse, & Kiran (2016), which was organized according to exogenous input to one of three regions (i.e., left inferior frontal gyrus, pars triangularis [LIFGtri], left posterior middle temporal gyrus [LpMTG], or left middle frontal gyrus [LMFG]) implicated in various levels of lexical-semantic processing, was interrogated. This model space included all possible combinations of uni- and bidirectional task-modulated connections between LIFGtri, LMFG and LpMTG, resulting in 72 individual models that were partitioned into three separate families (i.e., Family #1: Input to LIFGtri, Family #2: Input to LMFG, Family #3: Input to LpMTG). Family-wise Bayesian model selection revealed Family #2: Input to LMFG best fit both patient and control data at a group level. Both groups relied heavily on LMFG's modulation of the other two model regions. By contrast, between-group differences in task-modulated coupling of LIFGtri and LpMTG were observed. Within the patient group, the strength of activity in LIFGtri and connectivity of LpMTG → LIFGtri were positively associated with lexical-semantic abilities inside and outside of the scanner, whereas greater recruitment of LpMTG was associated with poorer lexical-semantic skills.

The role of the right hemisphere in semantic control: A case-series comparison of right and left hemisphere stroke

Semantic control processes guide conceptual retrieval so that we are able to focus on non-dominant associations and features when these are required for the task or context, yet the neural basis of semantic control is not fully understood. Neuroimaging studies have emphasised the role of left inferior frontal gyrus (IFG) in controlled retrieval, while neuropsychological investigations of semantic control deficits have almost exclusively focussed on patients with left-sided damage (e.g., patients with semantic aphasia, SA). Nevertheless, activation in fMRI during demanding semantic tasks typically extends to right IFG. To investigate the role of the right hemisphere (RH) in semantic control, we compared nine RH stroke patients with 21 left-hemisphere SA patients, 11 mild SA cases and 12 healthy, aged-matched controls on semantic and executive tasks, plus experimental tasks that manipulated semantic control in paradigms particularly sensitive to RH damage. RH patients had executive deficits to parallel SA patients but they performed well on standard semantic tests. Nevertheless, multimodal semantic control deficits were found in experimental tasks involving facial emotions and the 'summation' of meaning across multiple items. On these tasks, RH patients showed effects similar to those in SA cases - multimodal deficits that were sensitive to distractor strength and cues and miscues, plus increasingly poor performance in cyclical matching tasks which repeatedly probed the same set of concepts. Thus, despite striking differences in single-item comprehension, evidence presented here suggests semantic control is bilateral, and disruption of this component of semantic cognition can be seen following damage to either hemisphere.

The Relationship between Frontotemporal Effective Connectivity during Picture Naming, Behavior, and Preserved Cortical Tissue in Chronic Aphasia

While several studies of task-based effective connectivity of normal language processing exist, little is known about the functional reorganization of language networks in patients with stroke-induced chronic aphasia. During oral picture naming, activation in neurologically intact individuals is found in "classic" language regions involved with retrieval of lexical concepts [e.g., left middle temporal gyrus (LMTG)], word form encoding [e.g., left posterior superior temporal gyrus, (LpSTG)], and controlled retrieval of semantic and phonological information [e.g., left inferior frontal gyrus (LIFG)] as well as domain-general regions within the multiple demands network [e.g., left middle frontal gyrus (LMFG)]. After stroke, lesions to specific parts of the left hemisphere language network force reorganization of this system. While individuals with aphasia have been found to recruit similar regions for language tasks as healthy controls, the relationship between the dynamic functioning of the language network and individual differences in underlying neural structure and behavioral performance is still unknown. Therefore, in the present study, we used dynamic causal modeling (DCM) to investigate differences between individuals with aphasia and healthy controls in terms of task-induced regional interactions between three regions (i.e., LIFG, LMFG, and LMTG) vital for picture naming. The DCM model space was organized according to exogenous input to these regions and partitioned into separate families. At the model level, random effects family wise Bayesian Model Selection revealed that models with driving input to LIFG best fit the control data whereas models with driving input to LMFG best fit the patient data. At the parameter level, a significant between-group difference in the connection strength from LMTG to LIFG was seen. Within the patient group, several significant relationships between network connectivity parameters, spared cortical tissue, and behavior were observed. Overall, this study provides some preliminary findings regarding how neural networks for language reorganize for individuals with aphasia and how brain connectivity relates to underlying structural integrity and task performance.

Cognitive dysfunction in patients with very mild Alzheimer's disease and amnestic mild cognitive impairment showing hemispheric asymmetries of hypometabolism on ¹⁸F-FDG PET

OBJECTIVE

We investigated cognitive dysfunction in patients with Alzheimer's disease (AD) and amnestic mild cognitive impairment (aMCI) who present hemispheric asymmetries of cerebral metabolic rate of glucose (CMRglc) decrease on (18) F-fluorodeoxyglucose positron emission tomography.

METHODS

Based on the hemispheric asymmetries of CMRglc decrease in the posterior cingulate cortex, precuneus, and parietotemporal cortex, the patients were divided into three groups (a left-dominant hypometabolism group, a right-dominant hypometabolism group, and a non-dominant hypometabolism group). CMRglc decrease in the whole brain was controlled among the three groups. All the patients underwent mini-mental state examination (MMSE), Wechsler Memory Scale-Revised (WMS-R), and Wechsler Adult Intelligent Scale-Third (WAIS-III).

RESULTS

There were no significant differences in MMSE and WAIS-III scores among the three groups. In WMS-R, the results indicated that the left-dominant group demonstrated significantly lower scores in verbal memory than the other two groups. Furthermore, the left-dominant group had a greater tendency to be diagnosed with AD rather than aMCI.

CONCLUSIONS

Patients with AD and aMCI showing left-dominant hypometabolism tend to show severer impairment in verbal memory function and to be diagnosed with AD dementia.

Automatic semantic encoding in verbal short-term memory: Evidence from the concreteness effect

The concreteness effect in verbal short-term memory (STM) tasks is assumed to be a consequence of semantic encoding in STM, with immediate recall of concrete words benefiting from richer semantic representations. We used the concreteness effect to test the hypothesis that semantic encoding in standard verbal STM tasks is a consequence of controlled, attention-demanding mechanisms of strategic semantic retrieval and encoding. Experiment 1 analysed the effect of presentation rate, with slow presentations being assumed to benefit strategic, time-dependent semantic encoding. Experiments 2 and 3 provided a more direct test of the strategic hypothesis by introducing three different concurrent attention-demanding tasks. Although Experiment 1 showed a larger concreteness effect with slow presentations, the following two experiments yielded strong evidence against the strategic hypothesis. Limiting available attention resources by concurrent tasks reduced global memory performance, but the concreteness effect was equivalent to that found in control conditions. We conclude that semantic effects in STM result from automatic semantic encoding and provide tentative explanations for the interaction between the concreteness effect and the presentation rate.

Capturing multidimensionality in stroke aphasia: mapping principal behavioural components to neural structures

Stroke aphasia is a multidimensional disorder in which patient profiles reflect variation along multiple behavioural continua. We present a novel approach to separating the principal aspects of chronic aphasic performance and isolating their neural bases. Principal components analysis was used to extract core factors underlying performance of 31 participants with chronic stroke aphasia on a large, detailed battery of behavioural assessments. The rotated principle components analysis revealed three key factors, which we labelled as phonology, semantic and executive/cognition on the basis of the common elements in the tests that loaded most strongly on each component. The phonology factor explained the most variance, followed by the semantic factor and then the executive-cognition factor. The use of principle components analysis rendered participants' scores on these three factors orthogonal and therefore ideal for use as simultaneous continuous predictors in a voxel-based correlational methodology analysis of high resolution structural scans. Phonological processing ability was uniquely related to left posterior perisylvian regions including Heschl's gyrus, posterior middle and superior temporal gyri and superior temporal sulcus, as well as the white matter underlying the posterior superior temporal gyrus. The semantic factor was uniquely related to left anterior middle temporal gyrus and the underlying temporal stem. The executive-cognition factor was not correlated selectively with the structural integrity of any particular region, as might be expected in light of the widely-distributed and multi-functional nature of the regions that support executive functions. The identified phonological and semantic areas align well with those highlighted by other methodologies such as functional neuroimaging and neurostimulation. The use of principle components analysis allowed us to characterize the neural bases of participants' behavioural performance more robustly and selectively than the use of raw assessment scores or diagnostic classifications because principle components analysis extracts statistically unique, orthogonal behavioural components of interest. As such, in addition to improving our understanding of lesion-symptom mapping in stroke aphasia, the same approach could be used to clarify brain-behaviour relationships in other neurological disorders.

Levels of processing in working memory: differential involvement of frontotemporal networks

How does the brain maintain to-be-remembered information in working memory (WM), particularly when the focus of attention is drawn to processing other information? Cognitive models of WM propose that when items are displaced from focal attention recall involves retrieval from long-term memory (LTM). In this fMRI study, we tried to clarify the role of LTM in performance on a WM task and the type of representation that is used to maintain an item in WM during rehearsal-filled versus distractor-filled delays. Participants made a deep or shallow levels-of-processing (LOP) decision about a single word at encoding and tried to recall the word after a delay filled with either rehearsal of the word or a distracting math task. Recalling one word after 10 sec of distraction demonstrated behavioral and neural indices of retrieval from LTM (i.e., LOP effects and medial-temporal lobe activity). In contrast, recall after rehearsal activated cortical areas that reflected reporting the word from focal attention. In addition, areas that showed an LOP effect at encoding (e.g., left ventrolateral VLPFC and the anterior temporal lobes [ATLs]) were reactivated at recall, especially when recall followed distraction. Moreover, activity in left VLPFC during encoding, left ATL during the delay, and left hippocampus during retrieval predicted recall success after distraction. Whereas shallow LOP and rehearsal-related areas supported active maintenance of one item in focal attention, the behavioral processes and neural substrates that support LTM supported recall of one item after it was displaced from focal attention.

Fusion and Fission of Cognitive Functions in the Human Parietal Cortex

How is higher cognitive function organized in the human parietal cortex? A century of neuropsychology and 30 years of functional neuroimaging has implicated the parietal lobe in many different verbal and nonverbal cognitive domains. There is little clarity, however, on how these functions are organized, that is, where do these functions coalesce (implying a shared, underpinning neurocomputation) and where do they divide (indicating different underlying neural functions). Until now, there has been no multi-domain synthesis in order to reveal where there is fusion or fission of functions in the parietal cortex. This aim was achieved through a large-scale activation likelihood estimation (ALE) analysis of 386 studies (3952 activation peaks) covering 8 cognitive domains. A tripartite, domain-general neuroanatomical division and 5 principles of cognitive organization were established, and these are discussed with respect to a unified theory of parietal functional organization.

Receptive vocabulary and semantic knowledge in children with SLI and children with Down syndrome

Receptive vocabulary and associated semantic knowledge were compared within and between groups of children with specific language impairment (SLI), children with Down syndrome (DS), and typically developing children. To overcome the potential confounding effects of speech or language difficulties on verbal tests of semantic knowledge, a novel task was devised based on picture-based semantic association tests used to assess adult patients with semantic dementia. Receptive vocabulary, measured by word-picture matching, of children with SLI was weak relative to chronological age and to nonverbal mental age but their semantic knowledge, probed across the same lexical items, did not differ significantly from that of vocabulary-matched typically developing children. By contrast, although receptive vocabulary of children with DS was a relative strength compared to nonverbal cognitive abilities (p < .0001), DS was associated with a significant deficit in semantic knowledge (p < .0001) indicative of dissociation between word-picture matching vocabulary and depth of semantic knowledge. Overall, these data challenge the integrity of semantic-conceptual development in DS and imply that contemporary theories of semantic cognition should also seek to incorporate evidence from atypical conceptual development.

Type-specific proactive interference in patients with semantic and phonological STM deficits

Prior neuropsychological evidence suggests that semantic and phonological components of short-term memory (STM) are functionally and neurologically distinct. The current paper examines proactive interference (PI) from semantic and phonological information in two STM-impaired patients, DS (semantic STM deficit) and AK (phonological STM deficit). In Experiment 1 probe recognition tasks with open and closed sets of stimuli were used. Phonological PI was assessed using nonword items, and semantic and phonological PI was assessed using words. In Experiment 2 phonological and semantic PI was elicited by an item recognition probe test with stimuli that bore phonological and semantic relations to the probes. The data suggested heightened phonological PI for the semantic STM patient, and exaggerated effects of semantic PI in the phonological STM case. The findings are consistent with an account of extremely rapid decay of activated type-specific representations in cases of severely impaired phonological and semantic STM.

Damage to temporo-parietal cortex decreases incidental activation of thematic relations during spoken word comprehension

Both taxonomic and thematic semantic relations have been studied extensively in behavioral studies and there is an emerging consensus that the anterior temporal lobe plays a particularly important role in the representation and processing of taxonomic relations, but the neural basis of thematic semantics is less clear. We used eye tracking to examine incidental activation of taxonomic and thematic relations during spoken word comprehension in participants with aphasia. Three groups of participants were tested: neurologically intact control participants (N=14), individuals with aphasia resulting from lesions in left hemisphere BA 39 and surrounding temporo-parietal cortex regions (N=7), and individuals with the same degree of aphasia severity and semantic impairment and anterior left hemisphere lesions (primarily inferior frontal gyrus and anterior temporal lobe) that spared BA 39 (N=6). The posterior lesion group showed reduced and delayed activation of thematic relations, but not taxonomic relations. In contrast, the anterior lesion group exhibited longer-lasting activation of taxonomic relations and did not differ from control participants in terms of activation of thematic relations. These results suggest that taxonomic and thematic semantic knowledge are functionally and neuroanatomically distinct, with the temporo-parietal cortex playing a particularly important role in thematic semantics.