Phonological Similarity Effect in Complex Span Task

Verbal working memory encodes phonological and semantic information differently

Working memory (WM) is often tested through immediate serial recall of word lists. Performance in such tasks is negatively influenced by phonological similarity: People more often get the order of words wrong when they are phonologically similar to each other (e.g., cat, fat, mat). This phonological-similarity effect shows that phonology plays an important role for the representation of serial order in these tasks. By contrast, semantic similarity usually does not impact performance negatively. To resolve and understand this discrepancy, we tested the effects of phonological and semantic similarity for the retention of positional information in WM. Across six experiments (all Ns = 60 young adults), we manipulated between-item semantic and phonological similarity in tasks requiring participants to form and maintain new item-context bindings in WM. Participants were asked to retrieve items from their context, or the contexts from their item. For both retrieval directions, phonological similarity impaired WM for item-context bindings across all experiments. Semantic similarity did not. These results demonstrate that WM encodes phonological and semantic information differently. We propose a WM model accounting for semantic-similarity effects in WM, in which semantic knowledge supports WM through activated long-term memory.

Dynamic auditory contributions to error detection revealed in the discrimination of Same and Different syllable pairs

During speech production auditory regions operate in concert with the anterior dorsal stream to facilitate online error detection. As the dorsal stream also is known to activate in speech perception, the purpose of the current study was to probe the role of auditory regions in error detection during auditory discrimination tasks as stimuli are encoded and maintained in working memory. A priori assumptions are that sensory mismatch (i.e., error) occurs during the discrimination of Different (mismatched) but not Same (matched) syllable pairs. Independent component analysis was applied to raw EEG data recorded from 42 participants to identify bilateral auditory alpha rhythms, which were decomposed across time and frequency to reveal robust patterns of event related synchronization (ERS; inhibition) and desynchronization (ERD; processing) over the time course of discrimination events. Results were characterized by bilateral peri-stimulus alpha ERD transitioning to alpha ERS in the late trial epoch, with ERD interpreted as evidence of working memory encoding via Analysis by Synthesis and ERS considered evidence of speech-induced-suppression arising during covert articulatory rehearsal to facilitate working memory maintenance. The transition from ERD to ERS occurred later in the left hemisphere in Different trials than in Same trials, with ERD and ERS temporally overlapping during the early post-stimulus window. Results were interpreted to suggest that the sensory mismatch (i.e., error) arising from the comparison of the first and second syllable elicits further processing in the left hemisphere to support working memory encoding and maintenance. Results are consistent with auditory contributions to error detection during both encoding and maintenance stages of working memory, with encoding stage error detection associated with stimulus concordance and maintenance stage error detection associated with task-specific retention demands.

Verbal interference paradigms: A systematic review investigating the role of language in cognition

This paper presents a systematic review of the empirical literature that uses dual-task interference methods for investigating the on-line involvement of language in various cognitive tasks. In these studies, participants perform some primary task X putatively recruiting linguistic resources while also engaging in a secondary, concurrent task. If performance on the primary task decreases under interference, there is evidence for language involvement in the primary task. We assessed studies (N = 101) reporting at least one experiment with verbal interference and at least one control task (either primary or secondary). We excluded papers with an explicitly clinical, neurological, or developmental focus. The primary tasks identified include categorization, memory, mental arithmetic, motor control, reasoning (verbal and visuospatial), task switching, theory of mind, visual change, and visuospatial integration and wayfinding. Overall, the present review found that covert language is likely to play a facilitative role in memory and categorization when items to be remembered or categorized have readily available labels, when inner speech can act as a form of behavioral self-cuing (inhibitory control, task set reminders, verbal strategy), and when inner speech is plausibly useful as "workspace," for example, for mental arithmetic. There is less evidence for the role of covert language in cross-modal integration, reasoning relying on a high degree of visual detail or items low on nameability, and theory of mind. We discuss potential pitfalls and suggestions for streamlining and improving the methodology.

Forward Digit Span and Word Familiarity Do Not Correlate With Differences in Speech Recognition in Individuals With Cochlear Implants After Accounting for Auditory Resolution

Purpose In individuals with cochlear implants, speech recognition is not associated with tests of working memory that primarily reflect storage, such as forward digit span. In contrast, our previous work found that vocoded speech recognition in individuals with normal hearing was correlated with performance on a forward digit span task. A possible explanation for this difference across groups is that variability in auditory resolution across individuals with cochlear implants could conceal the true relationship between speech and memory tasks. Here, our goal was to determine if performance on forward digit span and speech recognition tasks are correlated in individuals with cochlear implants after controlling for individual differences in auditory resolution. Method We measured sentence recognition ability in 20 individuals with cochlear implants with Perceptually Robust English Sentence Test Open-set sentences. Spectral and temporal modulation detection tasks were used to assess individual differences in auditory resolution, auditory forward digit span was used to assess working memory storage, and self-reported word familiarity was used to assess vocabulary. Results Individual differences in speech recognition were predicted by spectral and temporal resolution. A correlation was found between forward digit span and speech recognition, but this correlation was not significant after controlling for spectral and temporal resolution. No relationship was found between word familiarity and speech recognition. Forward digit span performance was not associated with individual differences in auditory resolution. Conclusions Our findings support the idea that sentence recognition in individuals with cochlear implants is primarily limited by individual differences in working memory processing, not storage. Studies examining the relationship between speech and memory should control for individual differences in auditory resolution.

Acoustic-Phonetic Mismatches Impair Serial Recall of Degraded Words

Sequences of phonologically similar words are more difficult to remember than phonologically distinct sequences. This study investigated whether this difficulty arises in the acoustic similarity of auditory stimuli or in the corresponding phonological labels in memory. Participants reconstructed sequences of words which were degraded with a vocoder. We manipulated the phonological similarity of response options across two groups. One group was trained to map stimulus words onto phonologically similar response labels which matched the recorded word; the other group was trained to map words onto a set of plausible responses which were mismatched from the original recordings but were selected to have less phonological overlap. Participants trained on the matched responses were able to learn responses with less training and recall sequences more accurately than participants trained on the mismatched responses, even though the mismatched responses were more phonologically distinct from one another and participants were unaware of the mismatch. The relative difficulty of recalling items in the correct position was the same across both sets of response labels. Mismatched responses impaired recall accuracy across all positions except the final item in each list. These results are consistent with the idea that increased difficulty of mapping acoustic stimuli onto phonological forms impairs serial recall. Increased mapping difficulty could impair retention of memoranda and impede consolidation into phonological forms, which would impair recall in adverse listening conditions.

Animacy effects extend to working memory: results from serial order recall tasks

Words that represent animate entities (e.g., dog) are recalled from long-term memory more accurately than words representing inanimate entities (e.g., pan). In this research, we examined whether the animacy effect extends to working memory (WM). The potential roles of WM maintenance strategies (rehearsal and directed attention) were also examined. Participants performed serial order recall tasks with sets of 3, 4, 5 or 6 words that were either animate or inanimate. In stage 1 of Experiment 1, participants received no instructions regarding how to maintain the words. In stage 2, participants received either no instructions, sub-vocal rehearsal or directed attention instructions. In all instruction groups and at both stages, significant animacy effects were observed at set sizes of 4, 5 and 6 but not set size 3. The animacy effect was larger at set size 5 than other set sizes. In Experiment 2, participants completed the task with and without articulatory suppression. In both conditions, animacy effects were observed at set sizes 4, 5 and 6, but not at set size 3. The magnitude of the animacy effect declined as set size increased from 4 to 6. Animacy appears to enhance serial recall, but the effect is not dependent on rehearsal.

On some of the main criticisms of the modal model: Reappraisal from a TBRS perspective

The model developed by Atkinson and Shiffrin describes memory as a flow of information that enters and leaves a short-term storage and that in some cases consolidates into a long-term store. Their model has stimulated 50 years of memory research and, like every model, has also received several criticisms. It has been argued that a single short-term store in charge of both maintaining memory items and processing other cognitive tasks is not plausible. Some authors have evaluated the proposal of a rehearsal process as the unique way to transfer information into long-term memory as not being likely. Finally, the idea that information decays from the short-term store in the absence of rehearsal maintaining the memory traces has been and is still debated in the working memory literature. In this article, we reconsider these criticisms and show why they are not totally legitimate. We describe a recent working memory model, the time-based resource-sharing (TBRS) model (Barrouillet, P., & Camos, V. (2015). Working memory: Loss and reconstruction. Hove, UK: Psychology Press), that shares several theoretical assumptions with the model initially proposed by Atkinson and Shiffrin, assumptions supported by empirical findings. Consequently, the model proposed by Atkinson and Shiffrin in 1968 may be far from outdated and still provide an inspiring framework for memory study.

The effects of refreshing and elaboration on working memory performance, and their contributions to long-term memory formation

Refreshing and elaboration are cognitive processes assumed to underlie verbal working-memory maintenance and assumed to support long-term memory formation. Whereas refreshing refers to the attentional focussing on representations, elaboration refers to linking representations in working memory into existing semantic networks. We measured the impact of instructed refreshing and elaboration on working and long-term memory separately, and investigated to what extent both processes are distinct in their contributions to working as well as long-term memory. Compared with a no-processing baseline, immediate memory was improved by repeating the items, but not by refreshing them. There was no credible effect of elaboration on working memory, except when items were repeated at the same time. Long-term memory benefited from elaboration, but not from refreshing the words. The results replicate the long-term memory benefit for elaboration, but do not support its beneficial role for working memory. Further, refreshing preserves immediate memory, but does not improve it beyond the level achieved without any processing.

Does articulatory rehearsal help immediate serial recall?

Articulatory rehearsal is assumed to benefit verbal working memory. Yet, there is no experimental evidence supporting a causal link between rehearsal and serial-order memory, which is one of the hallmarks of working memory functioning. Across four experiments, we tested the hypothesis that rehearsal improves working memory by asking participants to rehearse overtly and by instructing different rehearsal schedules. In Experiments 1a, 1b, and 2, we compared an instructed cumulative-rehearsal condition against a free-rehearsal condition. The instruction increased the prevalence of cumulative rehearsal, but recall performance remained unchanged or decreased compared to the free-rehearsal baseline. Experiment 2 also tested the impact of a fixed rehearsal instruction; this condition yielded substantial performance costs compared to the baseline. Experiment 3 tested whether rehearsals (according to an experimenter-controlled protocol) are beneficial compared to a matched articulatory suppression condition that blocked rehearsals of the memoranda. Again, rehearsing the memoranda yielded no benefit compared to articulatory suppression. In sum, our results are incompatible with the notion that rehearsal is beneficial to working memory.

An examination of refreshing in between-category sequences

The present study focused on refreshing within a working memory (WM) context. Refreshing refers to the mechanism that brings back information into the focus of attention in order to counteract forgetting of memory traces. Despite some research on this topic, the exact nature of refreshing remains unclear. The present study investigated refreshing by means of the cognitive load (CL) effect. This effect is typically observed in complex span tasks, which combine processing and storage demands. It refers to the observation that WM performance depends on the CL of concurrent processing, defined as the proportion of time between list items that is occupied by concurrent processing and therefore not available to refresh memory items. Traditionally, the CL effect has been demonstrated using within-category memory sequences in which all memory items are drawn from one category (e.g., all words). Here, we show that the CL effect also applies to between-category memory sequences in which memory items are drawn from different categories (e.g., words, orientations, faces, etc.). The ensemble of the results adds to the domain-generality of the CL effect. Implications concerning the specific nature of refreshing and future research directions are discussed.

Mathematical transcription of the 'time-based resource sharing' theory of working memory

The time-based resource sharing (TBRS) model is a prominent model of working memory that is both predictive and simple. TBRS is a mainstream decay-based model and the most susceptible to competition with interference-based models. A connectionist implementation of TBRS, TBRS*, has recently been developed. However, TBRS* is an enriched version of TBRS, making it difficult to test general characteristics resulting from TBRS assumptions. Here, we describe a novel model, TBRS2, built to be more transparent and simple than TBRS*. TBRS2 is minimalist and allows only a few parameters. It is a straightforward mathematical transcription of TBRS that focuses exclusively on the activation level of memory items as a function of time. Its simplicity makes it possible to derive several theorems from the original TBRS and allows several variants of the refresh process to be tested without relying on particular architectures.

Semantic and Syntactic Interference in Sentence Comprehension: A Comparison of Working Memory Models

This study investigated the nature of the underlying working memory system supporting sentence processing through examining individual differences in sensitivity to retrieval interference effects during sentence comprehension. Interference effects occur when readers incorrectly retrieve sentence constituents which are similar to those required during integrative processes. We examined interference arising from a partial match between distracting constituents and syntactic and semantic cues, and related these interference effects to performance on working memory, short-term memory (STM), vocabulary, and executive function tasks. For online sentence comprehension, as measured by self-paced reading, the magnitude of individuals' syntactic interference effects was predicted by general WM capacity and the relation remained significant when partialling out vocabulary, indicating that the effects were not due to verbal knowledge. For offline sentence comprehension, as measured by responses to comprehension questions, both general WM capacity and vocabulary knowledge interacted with semantic interference for comprehension accuracy, suggesting that both general WM capacity and the quality of semantic representations played a role in determining how well interference was resolved offline. For comprehension question reaction times, a measure of semantic STM capacity interacted with semantic but not syntactic interference. However, a measure of phonological capacity (digit span) and a general measure of resistance to response interference (Stroop effect) did not predict individuals' interference resolution abilities in either online or offline sentence comprehension. The results are discussed in relation to the multiple capacities account of working memory (e.g., Martin and Romani, 1994; Martin and He, 2004), and the cue-based retrieval parsing approach (e.g., Lewis et al., 2006; Van Dyke et al., 2014). While neither approach was fully supported, a possible means of reconciling the two approaches and directions for future research are proposed.

Working memory still needs verbal rehearsal

The causal role of verbal rehearsal in working memory has recently been called into question. For example, the SOB-CS (Serial Order in a Box-Complex Span) model assumes that there is no maintenance process for the strengthening of items in working memory, but instead a process of removal of distractors that are involuntarily encoded and create interference with memory items. In the present study, we tested the idea that verbal working memory performance can be accounted for without assuming a causal role of the verbal rehearsal process. We demonstrate in two experiments using a complex span task and a Brown-Peterson paradigm that increasing the number of repetitions of the same distractor (the syllable ba that was read aloud at each of its occurrences on screen) has a detrimental effect on the concurrent maintenance of consonants whereas the maintenance of spatial locations remains unaffected. A detailed analysis of the tasks demonstrates that accounting for this effect within the SOB-CS model requires a series of unwarranted assumptions leading to undesirable further predictions contradicted by available experimental evidence. We argue that the hypothesis of a maintenance mechanism based on verbal rehearsal that is impeded by concurrent articulation still provides the simplest and most compelling account of our results.

Developmental improvement in strategies to maintain verbal information in working memory

Although it has been proposed that maintenance of verbal information in adults’ working memory relies on two strategies, articulatory rehearsal and attentional refreshing, little is known about the interplay of these strategies in children. To examine strategy changes around the age of seven, children were asked to maintain digits during a retention interval introduced between encoding and recall. In Experiment 1, this interval was either unfilled in a delayed span task or filled with an attention-demanding task in a Brown-Peterson task. This concurrent task was either silent or aloud to vary the availability of rehearsal. Experiment 2 introduced variation in the attentional demand of the concurrent task, and an independent concurrent articulation. As predicted, recall performance was better in older children, but was reduced under concurrent articulation or when attention was less available, bringing further evidence in favor of two maintenance strategies. Moreover, the measure of the availability of attention for refreshing was correlated with recall performance in eight- and seven-year-olds, though only when rehearsal was impeded for seven-year-olds, but it did not correlate with six-year-olds’ recall. This could suggest that rehearsal is the default strategy in young children who can adaptively switch to refreshing when articulatory processes are unavailable.

The impact of cognitive load on delayed recall

Recent studies have suggested that long-term retention of items studied in a working memory span task depends on the refreshing of memory items-more specifically, on the number of refreshing opportunities. However, it was previously shown that refreshing depends on the cognitive load of the concurrent task introduced in the working memory span task. Thus, cognitive load should determine the long-term retention of items assessed in a delayed-recall test if such retention relies on refreshing. In two experiments, while the amount of refreshing opportunities remained constant, we varied the cognitive load of the concurrent task by either introducing tasks differing in their attentional demands or varying the pace of the concurrent task. To verify that this effect was related to refreshing and not to any maintenance mechanism, we also manipulated the availability of subvocal rehearsal. Replicating previous results, increasing cognitive load reduced immediate recall. This increase also had a detrimental effect on delayed recall. Conversely, the addition of concurrent articulation reduced immediate but not delayed recall. This study shows that both working and episodic memory traces depend on the cognitive load of the concurrent task, whereas the use of rehearsal affects only working memory performance. These findings add further evidence of the dissociation between subvocal rehearsal and attentional refreshing.

A Working Memory System With Distributed Executive Control

Working memory consists of domain-specific storage facilities and domain-general executive control processes. In some working memory theories, these control processes are accounted for via a homunculus, the central executive. In the present article, the author defends a mechanistic view of executive control by adopting the position that executive control is situated in the context of goal-directed behavior to maintain and protect the goal and to select an action to attain the goal. On the basis of findings in task switching and dual tasking, he proposes an adapted multicomponent working memory model in which the central executive is replaced by three interacting components: an executive memory that maintains the task set, a collection of acquired procedural rules, and an engine that executes the procedural rules that match the ensemble of working memory contents. The strongest among the rules that match the ensemble of working memory contents is applied, resulting in changes of the working memory contents or in motor actions. According to this model, goals are attained when the route to the goals is known or can be searched when the route is unknown (problem solving). Empirical evidence for this proposal and new predictions are discussed.

Storing Verbal Information in Working Memory

Recent reexaminations of the storage of verbal information in working memory have distinguished two mechanisms of maintenance. While a language-based mechanism of rehearsal was long considered the specific means of maintaining verbal information in the short term, another attention-based mechanism of refreshing has been more recently described. New evidence has established that these two mechanisms are affected by different constraints inherent to their respective language-based and attentional natures, have different impacts on recall performance, and are sustained by distinct brain networks. Moreover, adults can use either one or the other mechanism based on strategic choice or instructions. This dissociation presents some similarities with a dichotomy put forward in the ’70s between mechanisms permitting short-term versus long-term maintenance, but many questions remain about the functioning of these mechanisms and their interplay.

Inner Speech: Development, Cognitive Functions, Phenomenology, and Neurobiology

Inner speech-also known as covert speech or verbal thinking-has been implicated in theories of cognitive development, speech monitoring, executive function, and psychopathology. Despite a growing body of knowledge on its phenomenology, development, and function, approaches to the scientific study of inner speech have remained diffuse and largely unintegrated. This review examines prominent theoretical approaches to inner speech and methodological challenges in its study, before reviewing current evidence on inner speech in children and adults from both typical and atypical populations. We conclude by considering prospects for an integrated cognitive science of inner speech, and present a multicomponent model of the phenomenon informed by developmental, cognitive, and psycholinguistic considerations. Despite its variability among individuals and across the life span, inner speech appears to perform significant functions in human cognition, which in some cases reflect its developmental origins and its sharing of resources with other cognitive processes.

Dissociating rehearsal and refreshing in the maintenance of verbal information in 8-year-old children

Recent models of working memory suggest that two systems are involved in verbal working memory: one is dedicated to the maintenance of phonological representations through verbal rehearsal, while the other would maintain multimodal representations through attentional refreshing (Camos et al., 2009; Baddeley, 2012). Previous studies provided evidence on the existence of these two maintenance systems, on their independence, and how they affect recall performance in adults. However, only one study had already explored the relationships between these two systems in children ( Tam et al., 2010). The aim of the present study was to further examine how the two systems account for working memory performance in children. Eight-year-old children performed complex span tasks in which the availability of either the rehearsal or the refreshing was impeded by a concurrent articulation or an attention-demanding task, respectively. Moreover, the phonological similarity of the memoranda was manipulated. Congruently with studies showing that older children can used these maintenance systems, impeding any of the two systems reduced recall performance. Moreover, the manipulation of the two mechanisms did not interact, as previously observed in adults. This suggests that the two maintenance mechanisms are independent in 8-year-old children as they are in adults. However, the results concerning the phonological similarity effect (PSE) differed from what is observed in adults. Whereas the PSE relies only on the availability of rehearsal in adults, a more complex pattern appeared in children: the concurrent articulation as well as the concurrent task modulated the emergence of the PSE.

Refreshing memory traces: thinking of an item improves retrieval from visual working memory

This article provides evidence that refreshing, a hypothetical attention-based process operating in working memory (WM), improves the accessibility of visual representations for recall. "Thinking of", one of several concurrently active representations, is assumed to refresh its trace in WM, protecting the representation from being forgotten. The link between refreshing and WM performance, however, has only been tenuously supported by empirical evidence. Here, we controlled which and how often individual items were refreshed in a color reconstruction task by presenting cues prompting participants to think of specific WM items during the retention interval. We show that the frequency with which an item is refreshed improves recall of this item from visual WM. Our study establishes a role of refreshing in recall from visual WM and provides a new method for studying the impact of refreshing on the amount of information we can keep accessible for ongoing cognition.

Attentional and non-attentional systems in the maintenance of verbal information in working memory: the executive and phonological loops

Working memory is the structure devoted to the maintenance of information at short term during concurrent processing activities. In this respect, the question regarding the nature of the mechanisms and systems fulfilling this maintenance function is of particular importance and has received various responses in the recent past. In the time-based resource-sharing (TBRS) model, we suggest that only two systems sustain the maintenance of information at the short term, counteracting the deleterious effect of temporal decay and interference. A non-attentional mechanism of verbal rehearsal, similar to the one described by Baddeley in the phonological loop model, uses language processes to reactivate phonological memory traces. Besides this domain-specific mechanism, an executive loop allows the reconstruction of memory traces through an attention-based mechanism of refreshing. The present paper reviews evidence of the involvement of these two independent systems in the maintenance of verbal memory items.

Two systems of maintenance in verbal working memory: evidence from the word length effect

The extended time-based resource-sharing (TBRS) model suggested a working memory architecture in which an executive loop and a phonological loop could both support the maintenance of verbal information. The consequence of such a framework is that phonological effects known to impact the maintenance of verbal information, like the word length effect (WLE), should depend on the use of the phonological loop, but should disappear under the maintenance by the executive loop. In two previous studies, introducing concurrent articulation in complex span tasks barely affected WLE, contradicting the prediction from the TBRS model. The present study re-evaluated the WLE in a complex span task while controlling for time parameters and the amount of concurrent articulation. Specifically, we used a computer-paced span task in which participants remembered lists of either short or long words while concurrently either articulating or making a location judgment. Whereas the WLE appeared when participants remained silent, concurrent articulation eliminated the effect. Introducing a concurrent attention demand reduced recall, but did not affect WLE, and did not interact with concurrent articulation. These results support the existence of two systems of maintenance for verbal information.