Active maintenance of semantic representations

The role of variation in phonological and semantic working memory capacities in sentence comprehension: neural evidence from healthy and brain-damaged individuals

Research on the role of working memory (WM) in language processing has typically focused on WM for phonological information. However, considerable behavioral evidence supports the existence of a separate semantic WM system that plays a greater role in language processing. We review the neural evidence that supports the distinction between phonological and semantic WM capacities and discuss how individual differences in these capacities relate to sentence processing. In terms of neural substrates, findings from multivariate functional MRI for healthy participants and voxel-based lesion-symptom mapping for brain-damaged participants imply that the left supramarginal gyrus supports phonological WM, whereas the left inferior frontal gyrus (LIFG) and angular gyrus support semantic WM. In sentence comprehension, individual variation in semantic but not phonological WM related to performance in resolving semantic information and the LIFG region implicated in semantic WM showed fMRI activation during the resolution of semantic interference. Moreover, variation for brain-damaged participants in the integrity of a fiber tract supporting semantic WM had a greater relation to the processing of complex sentences than did the integrity of fiber tracts supporting phonological WM. Overall, the neural findings provide converging evidence regarding the distinction of these two capacities and the greater contribution of individual differences in semantic than phonological WM capacity to sentence processing.

Does the extension of free time trigger spontaneous elaborative strategies in working memory?

Elaboration has emerged as a potential maintenance mechanism involved in the substantial contribution of long-term memory (LTM) to working memory (WM) performance. The objective of the current study was to determine whether elaborative strategies could be spontaneously implemented under favorable conditions. Across four experiments, the distribution of free-time periods was manipulated in a complex span task, while keeping the total amount of free time and cognitive load constant. As elaboration requires time to be set up, Experiment 1 elicited better WM performance in a condition with fewer long free-time periods compared to a condition with many short free-time periods. However, because this benefit did not persist during delayed recall, the following experiments aimed to further investigate this effect by manipulating factors supposed to modulate elaboration. In Experiment 2, half of the participants received no specific instructions regarding strategies whereas the other half were encouraged to use elaborative strategies. In Experiment 3, the to-be-maintained stimuli did or did not have LTM representations that are essential for elaboration (i.e., words or pseudowords). Finally, the last experiment used a self-strategy report to better understand the nature of the WM maintenance strategies spontaneously employed by participants. Despite a consistent effect of free time manipulation on WM recall, the explanatory assumption of elaboration was challenged by the unexpected lack of effect on LTM recall and on the type of strategy reported. Alternative explanations stemming from well-known factors influencing WM performance are discussed, and emphasis is placed on the potential contribution of direct semantic maintenance in WM.

The mechanism of phonetic information in voice identity discrimination: a comparative study based on sighted and blind people

Purpose

The purpose of this study is to examine whether phonetic information functions and how phonetic information affects voice identity processing in blind people.

Method

To address the first inquiry, 25 normal sighted participants and 30 blind participants discriminated voice identity, when listening forward speech and backward speech from their own native language and another unfamiliar language. To address the second inquiry, combining articulatory suppression paradigm, 26 normal sighted participants and 26 blind participants discriminated voice identity, when listening forward speech from their own native language and another unfamiliar language.

Results

In Experiment 1, not only in the voice identity discrimination task with forward speech, but also in the discrimination task with backward speech, both the sighted and blind groups showed the superiority of the native language. This finding supports the view that backward speech still retains some phonetic information, and indicates that phonetic information can affect voice identity processing in sighted and blind people. In addition, only the superiority of the native language of sighted people was regulated by the speech manner, which is related to articulatory rehearsal. In Experiment 2, only the superiority of the native language of sighted people was regulated by articulatory suppression. This indicates that phonetic information may act in different ways on voice identity processing in sighted and blind people.

Conclusion

The heightened dependence on voice source information in blind people appears not to undermine the function of phonetic information, but it appears to change the functional mechanism of phonetic information. These findings suggest that the present phonetic familiarity model needs to be improved with respect to the mechanism of phonetic information.

The role of working memory loads on immediate and long-term sentence recall

It is well-established that both phonological and semantic knowledge influence verbal working memory. However, the focus has primarily been on understanding phonological effects despite evidence of semantic influences. Articulatory suppression is a well-established task for preventing phonological processing. Methods to prevent semantic processing have rarely been used in the past, highlighting a need for developing a semantic interference task. We, therefore, conceptualised two novel tasks - an animacy categorisation and semantic relatedness judgement task. This study explored the impact of phonological (articulatory suppression) and semantic loads (animacy categorisation and semantic relatedness judgement) on immediate and delayed sentence recall. Additionally, sentence concreteness (concrete vs. abstract sentences) indexed semantic knowledge in verbal working memory. Across two studies, immediate recall revealed that articulatory suppression (preventing phonological processing) increased the size of the concreteness effect, while the novel semantic tasks (preventing semantic processing) reduced it suggesting that our semantic tasks were indeed imposing a semantic load. Further, relative long-term performance showed that more new words were remembered in articulatory suppression, whereas recall was disproportionately impaired in the semantic relatedness task. Our experimental paradigm offers phonological and semantic suppression tasks that can be used in parallel to investigate the interactions between working memory and language.

The role of phonological and semantic representations in verbal short-term memory and delayed retention

It has been suggested that phonological representations play a central role in verbal short-term memory, but when semantic knowledge has been investigated, it has also been shown to influence verbal short-term memory. Explaining this interaction between verbal short-term memory and the linguistic system has produced different theoretical positions: whether semantic knowledge is used to redintegrate phonological traces or if there is direct activation of both phonological and semantic knowledge upon encountering a word. The present study employed a new paradigm to systematically examine phonological and semantic representations in verbal short-term memory as well as long-term impacts. Across two experiments, a list of words was presented sequentially, followed by a probe word. Participants were to judge whether the probe word rhymed or was synonymous with any items on the list. Delayed memory was also tested. In Experiment 1, we found that immediate performance was better for synonym than rhyme judgements, and this continued to be the case after a brief delay. In Experiment 2, under a fast-encoding, running-span paradigm, we found similar activation of phonological and semantic knowledge. Nevertheless, accuracy was again higher for items probed with the semantic than rhyme cue in the long term. Results showed that indeed there are short-term semantic effects, in addition to phonological effects. Further, semantic processing can occur in a highly automatic and rapid manner, with strong influence on long-term memory. These findings provide a new perspective on viewing verbal short-term memory as operating more dynamically within the context of a complex linguistic system.

The detrimental effect of semantic similarity in short-term memory tasks: A meta-regression approach

The literature suggests that semantic similarity has a weak or null effect for immediate serial reconstruction and a facilitative effect for immediate serial recall. These observed semantic similarity effects are inconsistent with the assumptions of short-term memory (STM) models on the detrimental effect of similarity (e.g., confusion) and with observations of a robust detrimental effect of phonological similarity. Our review indicates that the experimental results are likely dependent on the manipulation strength for semantic similarity and that manipulations used in previous studies might have affected semantic assvociation as well as semantic similarity. To address these possible issues, two indices are proposed: (a) strength of manipulation on semantic similarity, gained by quantifying semantic similarity based on Osgood and associates' dimensional view of semantics, and (b) inter-item associative strength, a possible confounding factor. Our review and the results of a meta-regression analysis using these two indices suggest that semantic similarity has a detrimental effect on both serial reconstruction and serial recall, while semantic association, which is correlated with semantic similarity, contributes to an apparent facilitative effect. An effect that is not attributable to similarity or association was also implied. Review on item and order memory further suggests the facilitative effect of semantic association on item memory and the detrimental effect of the semantic similarity on order memory. Based on our findings, we propose a unified explanation of observations of semantic similarity effects for both serial reconstruction and serial recall that is in good accord with STM models.

A new index of semantic short-term memory: Development and validation of the conceptual span task in Spanish

Mounting evidence from both cognitive and neuropsychological research points to the importance of conceptual and lexical-semantic contributors to short-term memory performance. Nonetheless, a standardized and well-controlled measure to assess semantic short-term memory was only recently developed for English-speakers, and no parallel measure exists for Spanish-speakers. In the conceptual replication and extension reported here, we develop and validate a Spanish adaptation of the Conceptual Span task as a tool to measure the semantic component of short-term memory. Two versions of the task were validated, the Clustered and the Non-Clustered Conceptual Span task, both in separate samples of 64 and 105 Spanish-speaking university students. We found that both versions of the Conceptual Span task correlate well with another widely used standardized measure of working memory capacity, the Reading Span task. The two versions also correlated, as expected, with discrimination of linguistic congruency as assessed by a semantic anomaly judgment task. Clustered Conceptual Span remained a significant predictor of Reading Span when controlling for several additional cognitive variables, including fluid reasoning, text comprehension, verbal fluency, ideational fluency, and speed of processing. Our results present evidence that the Spanish adaptation of both versions of the Conceptual Span task can yield reliable estimates of the active maintenance of semantic representations in verbal working memory–an under-investigated ability that is involved in diverse domains such as episodic memory retrieval, language processing, and comprehension. Thus, the Conceptual Span task validated here can be employed to predict individual variation in semantic short-term memory capacity in a broad range of research domains.

Separability of active semantic and phonological maintenance in verbal working memory

Models of verbal working memory that incorporate active memory maintenance, long-term memory networks, and attention control have been developed. Current studies suggest that semantic representations of words, evoked via long-term memory networks, are actively maintained until they are needed to fulfill a role. In other words, it is possible that some mechanism actively refreshes semantic representations of words, analogous to but independently from articulatory rehearsal which refreshes phonological representations. One valuable piece of evidence is a double dissociation, observed in a dual task paradigm in which manual tapping disrupted a semantic memory task while articulatory suppression disrupted a phonological memory task. However, in that study, the secondary tasks could have competed not only with the maintenance but also with the encoding activities. Additionally, the study items in the phonological memory tasks were words; hence, the discriminability of the memory tasks is doubtful. The present study, therefore, examined a potential double dissociation in situations where the secondary tasks could not compete with encoding, using a modified phonological memory task. Furthermore, this article discusses a potential mechanism for maintaining semantic representations.

Long-lasting semantic interference effects in object naming are not necessarily conceptually mediated

Long-lasting interference effects in picture naming are induced when objects are presented in categorically related contexts in both continuous and blocked cyclic paradigms. Less consistent context effects have been reported when the task is changed to semantic classification. Experiment 1 confirmed the recent finding of cumulative facilitation in the continuous paradigm with living/non-living superordinate categorization. To avoid a potential confound involving participants responding with the identical superordinate category in related contexts in the blocked cyclic paradigm, we devised a novel set of categorically related objects that also varied in terms of relative age – a core semantic type associated with the adjective word class across languages. Experiment 2 demonstrated the typical interference effect with these stimuli in basic level naming. In Experiment 3, using the identical blocked cyclic paradigm, we failed to observe semantic context effects when the same pictures were classified as younger–older. Overall, the results indicate the semantic context effects in the two paradigms do not share a common origin, with the effect in the continuous paradigm arising at the level of conceptual representations or in conceptual-to-lexical connections while the effect in the blocked cyclic paradigm most likely originates at a lexical level of representation. The implications of these findings for current accounts of long-lasting interference effects in spoken word production are discussed.