Lexical coherence in short-term memory: strategic reconstruction or "semantic glue"?

Predicting the Structure of a Lexical Environment from Properties of Verbal Working Memory

We analyzed a Japanese lexical database to investigate the structure of the lexical environment based on the hypothesis that the lexical environment is optimized for the functioning of verbal working memory. Our prediction was that, as a consequence of the cultural transmission of language, low-imageable meanings tend to be represented by frequent phonological patterns in the current vocabulary rather than infrequent phonological patterns. This prediction was based on two findings of previous laboratory studies on verbal working memory. (1) The quality of phonological (phonemic and accent) representations in verbal working memory depends on phonological regularity knowledge; therefore, short-term phonological representations are less robust for words with infrequent phonological patterns. (2) Phonological representations are underpinned by contributions from semantic knowledge; therefore, phonological representations of highly imageable words are more robust than those for low-imageable words. Our database analyses show that nouns with less imageable meanings tend to be associated with more frequent phonological patterns in Japanese vocabulary. This lexical structure can maintain the quality of phonological representations in verbal working memory through contributions of semantic and phonological regularity knowledge. Larger semantic contributions compensate for the less robust phonological representations of infrequent phonological forms. The quality of phonological representations is preserved by phonological regularity knowledge when larger semantic contributions are not expected.

Comprehension of Morse Code Predicted by Item Recall From Short-Term Memory

Purpose Morse code as a form of communication became widely used for telegraphy, radio and maritime communication, and military operations, and remains popular with ham radio operators. Some skilled users of Morse code are able to comprehend a full sentence as they listen to it, while others must first transcribe the sentence into its written letter sequence. Morse thus provides an interesting opportunity to examine comprehension differences in the context of skilled acoustic perception. Measures of comprehension and short-term memory show a strong correlation across multiple forms of communication. This study tests whether this relationship holds for Morse and investigates its underlying basis. Our analyses examine Morse and speech immediate serial recall, focusing on established markers of echoic storage, phonological-articulatory coding, and lexical-semantic support. We show a relationship between Morse short-term memory and Morse comprehension that is not explained by Morse perceptual fluency. In addition, we find that poorer serial recall for Morse compared to speech is primarily due to poorer item memory for Morse, indicating differences in lexical-semantic support. Interestingly, individual differences in speech item memory are also predictive of individual differences in Morse comprehension. Conclusions We point to a psycholinguistic framework to account for these results, concluding that Morse functions like "reading for the ears" (Maier et al., 2004) and that underlying differences in the integration of phonological and lexical-semantic knowledge impact both short-term memory and comprehension. The results provide insight into individual differences in the comprehension of degraded speech and strategies that build comprehension through listening experience. Supplemental Material https://doi.org/10.23641/asha.16451868.

Interactions Between Item Set and Vocoding in Serial Recall

OBJECTIVES

Serial recall of digits is frequently used to measure short-term memory span in various listening conditions. However, the use of digits may mask the effect of low quality auditory input. Digits have high frequency and are phonologically distinct relative to one another, so they should be easy to identify even with low quality auditory input. In contrast, larger item sets reduce listener ability to strategically constrain their expectations, which should reduce identification accuracy and increase the time and/or cognitive resources needed for identification when auditory quality is low. This diminished accuracy and increased cognitive load should interfere with memory for sequences of items drawn from large sets. The goal of this work was to determine whether this predicted interaction between auditory quality and stimulus set in short-term memory exists, and if so, whether this interaction is associated with processing speed, vocabulary, or attention.

DESIGN

We compared immediate serial recall within young adults with normal hearing across unprocessed and vocoded listening conditions for multiple stimulus sets. Stimulus sets were lists of digits (1 to 9), consonant-vowel-consonant (CVC) words (chosen from a list of 60 words), and CVC nonwords (chosen from a list of 50 nonwords). Stimuli were unprocessed or vocoded with an eight-channel noise vocoder. To support interpretation of responses, words and nonwords were selected to minimize inclusion of multiple phonemes from within a confusion cluster. We also measured receptive vocabulary (Peabody Picture Vocabulary Test [PPVT-4]), sustained attention (test of variables of attention [TOVA]), and repetition speed for individual items from each stimulus set under both listening conditions.

RESULTS

Vocoding stimuli had no impact on serial recall of digits, but reduced memory span for words and nonwords. This reduction in memory span was attributed to an increase in phonological confusions for nonwords. However, memory span for vocoded word lists remained reduced even after accounting for common phonetic confusions, indicating that lexical status played an additional role across listening conditions. Principal components analysis found two components that explained 84% of the variance in memory span across conditions. Component one had similar load across all conditions, indicating that participants had an underlying memory capacity, which was common to all conditions. Component two was loaded by performance in the vocoded word and nonword conditions, representing the sensitivity of memory span to vocoding of these stimuli. The order in which participants completed listening conditions had a small effect on memory span that could not account for the effect of listening condition. Repetition speed was fastest for digits, slower for words, and slowest for nonwords. On average, vocoding slowed repetition speed for all stimuli, but repetition speed was not predictive of individual memory span. Vocabulary and attention showed no correlation with memory span.

CONCLUSIONS

Our results replicated previous findings that low quality auditory input can impair short-term memory, and demonstrated that this impairment is sensitive to stimulus set. Using multiple stimulus sets in degraded listening conditions can isolate memory capacity (in digit span) from impaired item identification (in word and nonword span), which may help characterize the relationship between memory and speech recognition in difficult listening conditions.

Long-term associative learning predicts verbal short-term memory performance

Studies using tests such as digit span and nonword repetition have implicated short-term memory across a range of developmental domains. Such tests ostensibly assess specialized processes for the short-term manipulation and maintenance of information that are often argued to enable long-term learning. However, there is considerable evidence for an influence of long-term linguistic learning on performance in short-term memory tasks that brings into question the role of a specialized short-term memory system separate from long-term knowledge. Using natural language corpora, we show experimentally and computationally that performance on three widely used measures of short-term memory (digit span, nonword repetition, and sentence recall) can be predicted from simple associative learning operating on the linguistic environment to which a typical child may have been exposed. The findings support the broad view that short-term verbal memory performance reflects the application of long-term language knowledge to the experimental setting.

In the Beginning Was the Deed: Verbal Short-Term Memory as Object-Oriented Action

Our goal is not to present a new theory of verbal short-term memory (vSTM), but to supplant the concepts used to explain performance on vSTM tasks for some 60 years. We view the concepts of vSTM and its concomitant processes as reifications from observations of performance on these tasks. Millennia of refining, elaborating, and utilizing symbolic systems for representing the putative sounds of speech has seduced researchers into viewing verbal behavior as embodying the hallmarks of these systems, setting verbal material apart from other types of physical material with which people interact. Contrarily, we maintain that verbal material should be seen in the same light as other material. The way in which people encounter and manipulate it (e.g., in the microcosm of the vSTM setting) is to be understood with respect to processes that organize material into perceptual objects that may then be apprehended and manipulated by bodily effector systems. We outline how key empirical hallmarks of vSTM yield to this approach.

Short-term memory and long-term memory are still different

A commonly expressed view is that short-term memory (STM) is nothing more than activated long-term memory. If true, this would overturn a central tenet of cognitive psychology-the idea that there are functionally and neurobiologically distinct short- and long-term stores. Here I present an updated case for a separation between short- and long-term stores, focusing on the computational demands placed on any STM system. STM must support memory for previously unencountered information, the storage of multiple tokens of the same type, and variable binding. None of these can be achieved simply by activating long-term memory. For example, even a simple sequence of digits such as "1, 3, 1" where there are 2 tokens of the digit "1" cannot be stored in the correct order simply by activating the representations of the digits "1" and "3" in LTM. I also review recent neuroimaging data that has been presented as evidence that STM is activated LTM and show that these data are exactly what one would expect to see based on a conventional 2-store view. (PsycINFO Database Record

Children and adolescents' performance on a medium-length/nonsemantic word-list test

Word-list learning tasks are among the most important and frequently used tests for declarative memory evaluation. For example, the California Verbal Learning Test-Children's Version (CVLT-C) and Rey Auditory Verbal Learning Test provide important information about different cognitive-neuropsychological processes. However, the impact of test length (i.e., number of words) and semantic organization (i.e., type of words) on children's and adolescents' memory performance remains to be clarified, especially during this developmental stage. To explore whether a medium-length non-semantically organized test can produce the typical curvilinear performance that semantically organized tests produce, reflecting executive control, we studied and compared the cognitive performance of normal children and adolescents by utilizing mathematical modeling. The model is based on the first-order system transfer function and has been successfully applied to learning curves for the CVLT-C (15 words, semantically organized paradigm). Results indicate that learning nine semantically unrelated words produces typical curvilinear (executive function) performance in children and younger adolescents and that performance could be effectively analyzed with the mathematical model. This indicates that the exponential increase (curvilinear performance) of correctly learned words does not solely depend on semantic and/or length features. This type of test controls semantic and length effects and may represent complementary tools for executive function evaluation in clinical populations in which semantic and/or length processing are affected.

Questioning short-term memory and its measurement: Why digit span measures long-term associative learning

Traditional accounts of verbal short-term memory explain differences in performance for different types of verbal material by reference to inherent characteristics of the verbal items making up memory sequences. The role of previous experience with sequences of different types is ostensibly controlled for either by deliberate exclusion or by presenting multiple trials constructed from different random permutations. We cast doubt on this general approach in a detailed analysis of the basis for the robust finding that short-term memory for digit sequences is superior to that for other sequences of verbal material. Specifically, we show across four experiments that this advantage is not due to inherent characteristics of digits as verbal items, nor are individual digits within sequences better remembered than other types of individual verbal items. Rather, the advantage for digit sequences stems from the increased frequency, compared to other verbal material, with which digits appear in random sequences in natural language, and furthermore, relatively frequent digit sequences support better short-term serial recall than less frequent ones. We also provide corpus-based computational support for the argument that performance in a short-term memory setting is a function of basic associative learning processes operating on the linguistic experience of the rememberer. The experimental and computational results raise questions not only about the role played by measurement of digit span in cognition generally, but also about the way in which long-term memory processes impact on short-term memory functioning.

Limitless capacity: a dynamic object-oriented approach to short-term memory

The notion of capacity-limited processing systems is a core element of cognitive accounts of limited and variable performance, enshrined within the short-term memory construct. We begin with a detailed critical analysis of the conceptual bases of this view and argue that there are fundamental problems - ones that go to the heart of cognitivism more generally - that render it untenable. In place of limited capacity systems, we propose a framework for explaining performance that focuses on the dynamic interplay of three aspects of any given setting: the particular task that must be accomplished, the nature and form of the material upon which the task must be performed, and the repertoire of skills and perceptual-motor functions possessed by the participant. We provide empirical examples of the applications of this framework in areas of performance typically accounted for by reference to capacity-limited short-term memory processes.

tDCS to temporoparietal cortex during familiarisation enhances the subsequent phonological coherence of nonwords in immediate serial recall

Research has shown that direct current stimulation (tDCS) over left temporoparietal cortex - a region implicated in phonological processing - aids new word learning. The locus of this effect remains unclear since (i) experiments have not empirically separated the acquisition of phonological forms from lexical-semantic links and (ii) outcome measures have focused on learnt associations with a referent rather than phonological stability. We tested the hypothesis that left temporoparietal tDCS would strengthen the acquisition of phonological forms, even in the absence of the opportunity to acquire lexical-semantic associations. Participants were familiarised with nonwords paired with (i) photographs of concrete referents or (ii) blurred images where no clear features were visible. Nonword familiarisation proceeded under conditions of anodal tDCS and sham stimulation in different sessions. We examined the impact of these manipulations on the stability of the phonological trace in an immediate serial recall (ISR) task the following day, ensuring that any effects were due to the influence of tDCS on long-term learning and not a direct consequence of short-term changes in neural excitability. We found that only a few exposures to the phonological forms of nonwords were sufficient to enhance nonword ISR overall compared to entirely novel items. Anodal tDCS during familiarisation further enhanced the acquisition of phonological forms, producing a specific reduction in the frequency of phoneme migrations when sequences of nonwords were maintained in verbal short-term memory. More of the phonemes that were recalled were bound together as a whole correct nonword following tDCS. These data show that tDCS to left temporoparietal cortex can facilitate word learning by strengthening the acquisition of long-term phonological forms, irrespective of the availability of a concrete referent, and that the consequences of this learning can be seen beyond the learning task as strengthened phonological coherence in verbal short-term memory.

Language and short-term memory: the role of perceptual-motor affordance

The advantage for real words over nonwords in serial recall--the lexicality effect--is typically attributed to support for item-level phonology, either via redintegration, whereby partially degraded short-term traces are "cleaned up" via support from long-term representations of the phonological material or via the more robust temporary activation of long-term lexical phonological knowledge that derives from its combination with established lexical and semantic levels of representation. The much smaller effect of lexicality in serial recognition, where the items are re-presented in the recognition cue, is attributed either to the minimal role for redintegration from long-term memory or to the minimal role for item memory itself in such retrieval conditions. We show that the reduced lexicality effect in serial recognition is not a function of the retrieval conditions, but rather because previous demonstrations have used auditory presentation, and we demonstrate a robust lexicality effect for visual serial recognition in a setting where auditory presentation produces no such effect. Furthermore, this effect is abolished under conditions of articulatory suppression. We argue that linguistic knowledge affects the readiness with which verbal material is segmentally recoded via speech motor processes that support rehearsal and therefore affects tasks that involve recoding. On the other hand, auditory perceptual organization affords sequence matching in the absence of such a requirement for segmental recoding and therefore does not show such effects of linguistic knowledge.

Strong and long: Effects of word length on phonological binding in verbal short-term memory

This study examined the effects of item length on the contribution of linguistic knowledge to immediate serial recall (ISR). Long words are typically recalled more poorly than short words, reflecting the greater demands that they place on phonological encoding, rehearsal, and production. However, reverse word length effects—that is, better recall of long than short words—can also occur in situations in which phonological maintenance is difficult, suggesting that long words derive greater support from long-term lexical knowledge. In this study, long and short words and nonwords (containing one vs. three syllables) were presented for immediate serial recall in (a) pure lists and (b) unpredictable mixed lists of words and nonwords. The mixed-list paradigm is known to disrupt the phonological stability of words, encouraging their phonemes to recombine with the elements of other list items. In this situation, standard length effects were seen for nonwords, while length effects for words were absent or reversed. A detailed error analysis revealed that long words were more robust to the mixed-list manipulation than short words: Their phonemes were less likely to be omitted and to recombine with phonemes from other list items. These findings support an interactive view of short-term memory, in which long words derive greater benefits from lexical knowledge than short words—especially when their phonological integrity is challenged by the inclusion of nonwords in mixed lists.

The effect of concurrent semantic categorization on delayed serial recall

The influence of semantic processing on the serial ordering of items in short-term memory was explored using a novel dual-task paradigm. Participants engaged in 2 picture-judgment tasks while simultaneously performing delayed serial recall. List material varied in the presence of phonological overlap (Experiments 1 and 2) and in semantic content (concrete words in Experiment 1 and 3; nonwords in Experiments 2 and 3). Picture judgments varied in the extent to which they required accessing visual semantic information (i.e., semantic categorization and line orientation judgments). Results showed that, relative to line-orientation judgments, engaging in semantic categorization judgments increased the proportion of item-ordering errors for concrete lists but did not affect error proportions for nonword lists. Furthermore, although more ordering errors were observed for phonologically similar relative to dissimilar lists, no interactions were observed between the phonological overlap and picture-judgment task manipulations. These results demonstrate that lexical-semantic representations can affect the serial ordering of items in short-term memory. Furthermore, the dual-task paradigm provides a new method for examining when and how semantic representations affect memory performance.

Semantic memory is key to binding phonology: converging evidence from immediate serial recall in semantic dementia and healthy participants

Patients with semantic dementia (SD) make numerous phoneme migration errors when recalling lists of words they no longer fully understand, suggesting that word meaning makes a critical contribution to phoneme binding in verbal short-term memory. Healthy individuals make errors that appear similar when recalling lists of nonwords, which also lack semantic support. Although previous studies have assumed that the errors in these two groups stem from the same underlying cause, they have never been directly compared. We tackled this issue by examining immediate serial recall for SD patients and controls on "pure" word lists and "mixed" lists that contained a mixture of words and nonwords. SD patients were equally poor at pure and mixed lists and made numerous phoneme migration errors in both conditions. In contrast, controls recalled pure lists better than mixed lists and only produced phoneme migrations for mixed lists. We also examined the claim that semantic activation is critical for words in the primacy portion of the list. In fact, the effect of mixed lists was greatest for later serial positions in the control group and in the SD group recall was poorest towards the ends of lists. These results suggest that mixing nonwords with words in healthy participants closely mimics the impact of semantic degradation in SD on word list recall. The study provides converging evidence for the idea that lexical/semantic knowledge is an important source of constraint on phonological coherence, ensuring that phonemes in familiar words are bound to each other and emerge together in recall.