Abstract knowledge versus direct experience in processing of binomial expressions

Literacy overrides effects of animacy: A picture-naming study with pre-literate German children and adult speakers of German and Arabic

Animacy plays a key role for human cognition, which is also reflected in the way humans process language. However, while experiments on sentence processing show reliable effects of animacy on word order and grammatical function assignment, effects of animacy on conjoined noun phrases (e.g., fish and shoe vs. shoe and fish) have yielded inconsistent results. In the present study, we tested the possibility that effects of animacy are outranked by reading and writing habits. We examined adult speakers of German (left-to-right script) and speakers of Arabic (right-to-left script), as well as German preschool children who do not yet know how to read and write. Participants were tested in a picture naming task that presented an animate and an inanimate entity next to one another. On half of the trials, the animate entity was located on the left and, on the other half, it was located on the right side of the screen. We found that adult German and Arabic speakers differed in their order of naming. Whereas German speakers were much more likely to mention the animate entity first when it was presented on the left than on the right, a reverse tendency was observed for speakers of Arabic. Thus, in literate adults, the ordering of conjoined noun phrases was influenced by reading and writing habits rather than by the animacy status of an entity. By contrast, pre-literate children preferred to start their utterances with the animate entity regardless of position, suggesting that effects of animacy in adults have been overwritten by effects of literacy.

An Information-Theoretic Account of Availability Effects in Language Production

I present a computational-level model of language production in terms of a combination of information theory and control theory in which words are chosen incrementally in order to maximize communicative value subject to an information-theoretic capacity constraint. The theory generally predicts a tradeoff between ease of production and communicative accuracy. I apply the theory to two cases of apparent availability effects in language production, in which words are selected on the basis of their accessibility to a speaker who has not yet perfectly planned the rest of the utterance. Using corpus data on English relative clause complementizer dropping and experimental data on Mandarin noun classifier choice, I show that the theory reproduces the observed phenomena, providing an alternative account to Uniform Information Density and a promising general model of language production which is tightly linked to emerging theories in computational neuroscience.

FAB: A "Dummy's" program for self-paced forward and backward reading

The self-paced reading paradigm has been popular and widely used in psycholinguistic research for several decades. The tool described in this paper, FAB (Forward and Backward reading), is a tool created to hopefully and maximally reduce the coding demands and simplify the operation costs for experimental researchers and clinical researchers who are doing experimental work, in their designing, coding, implementing, and analyzing self-paced reading tasks. Its basis in web languages (HTML, JavaScript) also promotes experimental implementation and material sharing in our era of open science. In addition, FAB has a unique forward-and-backward mode that can track regressive-like behaviors that are usually only recordable using eye-tracking or mouse-tracking equipment. In this paper, the specific application and usage of FAB is demonstrated in one laboratory and two online validation experiments. We hope this free and open-sourced tool can benefit research in a diverse range of contexts where self-paced reading is desirable.

Information-theoretic principles in incremental language production

I apply a recently emerging perspective on the complexity of action selection, the rate-distortion theory of control, to provide a computational-level model of errors and difficulties in human language production, which is grounded in information theory and control theory. Language production is cast as the sequential selection of actions to achieve a communicative goal subject to a capacity constraint on cognitive control. In a series of calculations, simulations, corpus analyses, and comparisons to experimental data, I show that the model directly predicts some of the major known qualitative and quantitative phenomena in language production, including semantic interference and predictability effects in word choice; accessibility-based ("easy-first") production preferences in word order alternations; and the existence and distribution of disfluencies including filled pauses, corrections, and false starts. I connect the rate-distortion view to existing models of human language production, to probabilistic models of semantics and pragmatics, and to proposals for controlled language generation in the machine learning and reinforcement learning literature.

Generative cultural learning in children and adults: the role of compositionality and generativity in cultural evolution

Are human cultures distinctively cumulative because they are uniquely compositional? We addressed this question using a summative learning paradigm where participants saw different models build different tower elements, consisting of discrete actions and objects: stacking cubes (tower base) and linking squares (tower apex). These elements could be combined to form a tower that was optimal in terms of height and structural soundness. In addition to measuring copying fidelity, we explored whether children and adults (i) extended the knowledge demonstrated to additional tower elements and (ii) productively combined them. Results showed that children and adults copied observed demonstrations and applied them to novel exemplars. However, only adults in the imitation condition combined the two newly derived base and apex, relative to adults in a control group. Nonetheless, there were remarkable similarities between children's and adults' performance across measures. Composite measures capturing errors and overall generativity in children's and adults' performance produced few population by condition interactions. Results suggest that early in development, humans possess a suite of cognitive skills-compositionality and generativity-that transforms phylogenetically widespread social learning competencies into something that may be unique to our species, cultural learning; allowing human cultures to evolve towards greater complexity.

Thought disorder is correlated with atypical spoken binomial orderings

Thought disorder may be associated with subtle language abnormalities. Binomials are pairs of words of the same grammatical type that are joined by a conjunction that often have a preferred order (for example, “up and down” is more common than “down and up”). We analyzed speech transcripts from patients with first-episode psychosis and found that atypical ordering of binomial pairs was associated with thought disorder but not with other psychosis symptoms. These results illustrate the potential to generate objective, quantifiable measures of disorganized speech.

Robust Processing Advantage for Binomial Phrases with Variant Conjunctions

Prior research has shown that various types of conventional multiword chunks are processed faster than matched novel strings, but it is unclear whether this processing advantage extends to variant multiword chunks that are less formulaic. To determine whether the processing advantage of multiword chunks accommodates variations in the canonical phrasal template, we examined the robustness of the processing advantage (i.e., Predictability) of binomial phrases with non-canonical conjunctions (e.g., salt and also pepper; salt as well as pepper). Results from the cloze study (Experiment 1) showed that there was a high tendency of producing the canonical conjunct (pepper), even in the binomials that contained non-formulaic conjunctions. Consistent with these findings, results from two eye tracking studies (Experiments 2a and 2b) showed that canonical conjuncts were read faster than novel conjuncts that were matched on word length (e.g., paprika), even in the binomials with variant conjunctions. This robust online processing advantage was replicated in a self-paced reading study that compared all three Conjunction Types (Experiment 3). Taken together, these findings show that binomials with variant function words also receive facilitated processing relative to matched novel strings, even though both types of strings are neither conventional nor relatively frequent. Exploratory analyses revealed that this processing speed advantage was driven by the lexical-semantic association between the canonical conjuncts (salt-pepper), rather than lexical and phrasal frequency. Overall, these results highlight flexibility in the processing of multiword chunks that current models of multiword storage and processing must take into account.

Learning a language from inconsistent input: Regularization in child and adult learners

When linguistic input contains inconsistent use of grammatical forms, children produce these forms more consistently, a process called 'regularization.' Deaf children learning American Sign Language from parents who are non-native users of the language regularize their parents' inconsistent usages (Singleton & Newport, 2004). In studies of artificial languages containing inconsistently used morphemes (Hudson Kam & Newport, 2005, 2009), children, but not adults, regularized these forms. However, little is known about the precise circumstances in which such regularization occurs. In three experiments we investigate how the type of input variation and the age of learners affects regularization. Overall our results suggest that while adults tend to reproduce the inconsistencies found in their input, young children introduce regularity: they learn varying forms whose occurrence is conditioned and systematic, but they alter inconsistent variation to be more regular. Older children perform more like adults, suggesting that regularization changes with maturation and cognitive capacities.

Accessibility and Historical Change: An Emergent Cluster Led Uncles and Aunts to Become Aunts and Uncles

There are times when a curiously odd relic of language presents us with a thread, which when pulled, reveals deep and general facts about human language. This paper unspools such a case. Prior to 1930, English speakers uniformly preferred male-before-female word order in conjoined nouns such as uncles and aunts; nephews and nieces; men and women. Since then, at least a half dozen items have systematically reversed their preferred order (e.g., aunts and uncles, nieces and nephews) while others have not (men and women). We review evidence that the unusual reversals began with mother and dad(dy) and spread to semantically and morphologically related binomials over a period of decades. The present work proposes that three aspects of cognitive accessibility combine to quantify the probability of A&B order: (1) the relative accessibility of the A&B terms individually, (2) competition from B&A order, and critically, (3) cluster strength (i.e., similarity to related A'&B' cases). The emergent cluster of female-first binomials highlights the influence of semantic neighborhoods in memory retrieval. We suggest that cognitive accessibility can be used to predict the word order of both familiar and novel binomials generally, as well as the diachronic change focused on here.

Do Programmers Prefer Predictable Expressions in Code?

Source code is a form of human communication, albeit one where the information shared between the programmers reading and writing the code is constrained by the requirement that the code executes correctly. Programming languages are more syntactically constrained than natural languages, but they are also very expressive, allowing a great many different ways to express even very simple computations. Still, code written by developers is highly predictable, and many programming tools have taken advantage of this phenomenon, relying on language model surprisal as a guiding mechanism. While surprisal has been validated as a measure of cognitive load in natural language, its relation to human cognitive processes in code is still poorly understood. In this paper, we explore the relationship between surprisal and programmer preference at a small granularity-do programmers prefer more predictable expressions in code? Using meaning-preserving transformations, we produce equivalent alternatives to developer-written code expressions and run a corpus study on Java and Python projects. In general, language models rate the code expressions developers choose to write as more predictable than these transformed alternatives. Then, we perform two human subject studies asking participants to choose between two equivalent snippets of Java code with different surprisal scores (one original and transformed). We find that programmers do prefer more predictable variants, and that stronger language models like the transformer align more often and more consistently with these preferences.

Lack of selectivity for syntax relative to word meanings throughout the language network

To understand what you are reading now, your mind retrieves the meanings of words and constructions from a linguistic knowledge store (lexico-semantic processing) and identifies the relationships among them to construct a complex meaning (syntactic or combinatorial processing). Do these two sets of processes rely on distinct, specialized mechanisms or, rather, share a common pool of resources? Linguistic theorizing, empirical evidence from language acquisition and processing, and computational modeling have jointly painted a picture whereby lexico-semantic and syntactic processing are deeply inter-connected and perhaps not separable. In contrast, many current proposals of the neural architecture of language continue to endorse a view whereby certain brain regions selectively support syntactic/combinatorial processing, although the locus of such "syntactic hub", and its nature, vary across proposals. Here, we searched for selectivity for syntactic over lexico-semantic processing using a powerful individual-subjects fMRI approach across three sentence comprehension paradigms that have been used in prior work to argue for such selectivity: responses to lexico-semantic vs. morpho-syntactic violations (Experiment 1); recovery from neural suppression across pairs of sentences differing in only lexical items vs. only syntactic structure (Experiment 2); and same/different meaning judgments on such sentence pairs (Experiment 3). Across experiments, both lexico-semantic and syntactic conditions elicited robust responses throughout the left fronto-temporal language network. Critically, however, no regions were more strongly engaged by syntactic than lexico-semantic processing, although some regions showed the opposite pattern. Thus, contra many current proposals of the neural architecture of language, syntactic/combinatorial processing is not separable from lexico-semantic processing at the level of brain regions-or even voxel subsets-within the language network, in line with strong integration between these two processes that has been consistently observed in behavioral and computational language research. The results further suggest that the language network may be generally more strongly concerned with meaning than syntactic form, in line with the primary function of language-to share meanings across minds.

Lack of selectivity for syntax relative to word meanings throughout the language network

To understand what you are reading now, your mind retrieves the meanings of words and constructions from a linguistic knowledge store (lexico-semantic processing) and identifies the relationships among them to construct a complex meaning (syntactic or combinatorial processing). Do these two sets of processes rely on distinct, specialized mechanisms or, rather, share a common pool of resources? Linguistic theorizing, empirical evidence from language acquisition and processing, and computational modeling have jointly painted a picture whereby lexico-semantic and syntactic processing are deeply inter-connected and perhaps not separable. In contrast, many current proposals of the neural architecture of language continue to endorse a view whereby certain brain regions selectively support syntactic/combinatorial processing, although the locus of such "syntactic hub", and its nature, vary across proposals. Here, we searched for selectivity for syntactic over lexico-semantic processing using a powerful individual-subjects fMRI approach across three sentence comprehension paradigms that have been used in prior work to argue for such selectivity: responses to lexico-semantic vs. morpho-syntactic violations (Experiment 1); recovery from neural suppression across pairs of sentences differing in only lexical items vs. only syntactic structure (Experiment 2); and same/different meaning judgments on such sentence pairs (Experiment 3). Across experiments, both lexico-semantic and syntactic conditions elicited robust responses throughout the left fronto-temporal language network. Critically, however, no regions were more strongly engaged by syntactic than lexico-semantic processing, although some regions showed the opposite pattern. Thus, contra many current proposals of the neural architecture of language, syntactic/combinatorial processing is not separable from lexico-semantic processing at the level of brain regions-or even voxel subsets-within the language network, in line with strong integration between these two processes that has been consistently observed in behavioral and computational language research. The results further suggest that the language network may be generally more strongly concerned with meaning than syntactic form, in line with the primary function of language-to share meanings across minds.

Is All Formulaic Language Created Equal? Unpacking the Processing Advantage for Different Types of Formulaic Sequences

Research into recurrent, highly conventionalized "formulaic" sequences has shown a processing advantage compared to "novel" (non-formulaic) language. Studies of individual types of formulaic sequence often acknowledge the contribution of specific factors, but little work exists to compare the processing of different types of phrases with fundamentally different properties. We use eye-tracking to compare the processing of three types of formulaic phrases-idioms, binomials, and collocations-and consider whether overall frequency can explain the advantage for all three, relative to control phrases. Results show an advantage, as evidenced through shorter reading times, for all three types. While overall phrase frequency contributes much of the processing advantage, different types of phrase do show additional effects according to the specific properties that are relevant to each type: frequency, familiarity, and decomposability for idioms; predictability and semantic association for binomials; and mutual information for collocations. We discuss how the results contribute to our understanding of the representation and processing of multiword lexical units more broadly.

Statistical learning and Gestalt-like principles predict melodic expectations

Expectation, or prediction, has become a major theme in cognitive science. Music offers a powerful system for studying how expectations are formed and deployed in the processing of richly structured sequences that unfold rapidly in time. We ask to what extent expectations about an upcoming note in a melody are driven by two distinct factors: Gestalt-like principles grounded in the auditory system (e.g.a preference for subsequent notes to move in small intervals), and statistical learning of melodic structure. We use multinomial regression modeling to evaluate the predictions of computationally implemented models of melodic expectation against behavioral data from a musical cloze task, in which participants hear a novel melodic opening and are asked to sing the note they expect to come next. We demonstrate that both Gestalt-like principles and statistical learning contribute to listeners' online expectations. In conjunction with results in the domain of language, our results point to a larger-than-previously-assumed role for statistical learning in predictive processing across cognitive domains, even in cases that seem potentially governed by a smaller set of theoretically motivated rules. However, we also find that both of the models tested here leave much variance in the human data unexplained, pointing to a need for models of melodic expectation that incorporate underlying hierarchical and/or harmonic structure. We propose that our combined behavioral (melodic cloze) and modeling (multinomial regression) approach provides a powerful method for further testing and development of models of melodic expectation.

Heart and ____ or Give and ____? An Exploration of Variables That Influence Binomial Completion for Individuals With and Without Aphasia

PURPOSE

The goal of this research was to institute an evidence base behind commonly used elicitation materials known as binomials (e.g., "day and night") that are commonly used for persons with aphasia (PWAs). The study explored a number of linguistic variables that could influence successful binomial completion in nonaphasic adults and PWAs.

METHOD

Thirty nonaphasic adults and 11 PWAs were asked to verbally complete 128 binomials; responses were scored by accuracy and reaction time. Binomials were coded according to the following independent variables: frequency of usage, phonological (e.g., alliteration, rhyme) and semantic (i.e., antonymy) relationships, grammatical category of the response, and number of plausible binomial completions.

RESULTS

Regression analyses demonstrated that, for both groups, greater accuracy was predicted by presence of antonymy and absence of a phonological relationship. Though reaction time models differed between groups, items that elicited a greater number of response options led to longer latencies across participants.

CONCLUSION

Findings suggest that clinicians consider antonymy as well as the number of plausible responses for a given prompt when adapting the level of difficulty for their clients. Results also contribute to broader interdisciplinary research on how automatic language is processed in adults with and without neurogenic communication disorder.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.6030806.

Phrase frequency effects in free recall: Evidence for redintegration

Four experiments examined the effects of word and phrase frequency on free recall. Word frequency did not affect word recall, but when participants studied and recalled lists of compositional adjective-noun phrases (e.g. alcoholic beverages), phrase frequency had a consistently beneficial effect: both words from frequent phrases were more likely to be recalled than for infrequent phrases, providing evidence that long-term memory for phrases can aid in pattern completion, or redintegration. We explain these results and those of a previous study of phrase frequency effects in recognition memory (Jacobs et al., 2016) by assuming that the language processing system provides features that are linked to episodic contexts. Recall tasks map from these contexts to linguistic elements, and recognition maps from linguistic elements to contexts. Word and phrase frequency effects in both memory tasks emerge both within the language processing system and from multiple stored episodes, and the fact that the representations of phrases are tied to knowledge of their component words, rather than being representational islands.

Putting old tools to novel uses: The role of form accessibility in semantic extension

An increase in frequency of a form has been argued to result in semantic extension (Bybee, 2003; Zipf, 1949). Yet, research on the acquisition of lexical semantics suggests that a form that frequently co-occurs with a meaning gets restricted to that meaning (Xu & Tenenbaum, 2007). The current work reconciles these positions by showing that - through its effect on form accessibility - frequency causes semantic extension in production, while at the same time causing entrenchment in comprehension. Repeatedly experiencing a form paired with a specific meaning makes one more likely to re-use the form to express related meanings, while also increasing one's confidence that the form is never used to express those meanings. Recurrent pathways of semantic change are argued to result from a tug of war between the production-side pressure to reuse easily accessible forms and the comprehension-side confidence that one has seen all possible uses of a frequent form.