Developing incrementality in filler-gap dependency processing

Grammar and Expectation in Active Dependency Resolution: Experimental and Modeling Evidence From Norwegian

Filler-gap dependency resolution is often characterized as an active process. We probed the mechanisms that determine where and why comprehenders posit gaps during incremental processing using Norwegian as our test language. First, we investigated why active filler-gap dependency resolution is suspended inside island domains like embedded questions in some languages. Processing-based accounts hold that resource limitations prevent gap-filling in embedded questions across languages, while grammar-based accounts predict that active gap-filling is only blocked in languages where embedded questions are grammatical islands. In a self-paced reading study, we find that Norwegian participants exhibit filled-gap effects inside embedded questions, which are not islands in the language. The findings are consistent with grammar-based, but not processing, accounts. Second, we asked if active filler-gap processing can be understood as a special case of probabilistic ambiguity resolution within an expectation-based framework. To do so, we tested whether word-by-word surprisal values from a neural language model could predict the location and magnitude of filled-gap effects in our behavioral data. We find that surprisal accurately tracks the location of filled-gap effects but severely underestimates their magnitude. This suggests either that mechanisms above and beyond probabilistic ambiguity resolution are required to fully explain active gap-filling behavior or that surprisal values derived from long-short term memory are not good proxies for humans' incremental expectations during filler-gap resolution.

Online processing of which-questions in bilingual children: Evidence from eye-tracking

An emergent debate surrounds the nature of language processing in bilingual children as an extension of broader questions about their morphosyntactic development in comparison to monolinguals, with the picture so far being nuanced. This paper adds to this debate by investigating the processing of morphosyntactically complex which-questions (e.g., Which bear is chasing the camel?) using the visual world paradigm and is the first study to examine the online processing of such questions in bilingual children. For both groups, object which-questions were more difficult than subject which-questions, due to an initial misinterpretation that needed to be reanalysed. Both groups were aided by number mismatch between the two nouns in the sentence, especially in object which-questions. Our findings are in line with previous studies that have shown a slower processing speed in bilingual children relative to monolinguals but qualitatively similar patterns.

The Impact of Hearing Experience on Children's Use of Phonological and Semantic Information During Lexical Access

Purpose The purpose of this study was to examine the extent to which phonological competition and semantic priming influence lexical access in school-aged children with cochlear implants (CIs) and children with normal acoustic hearing. Method Participants included children who were 5-10 years of age with either normal hearing (n = 41) or bilateral severe to profound sensorineural hearing loss and used CIs (n = 13). All participants completed a two-alternative forced-choice task while eye gaze to visual images was recorded and quantified during a word recognition task. In this task, the target image was juxtaposed with a competitor image that was either a phonological onset competitor (i.e., shared the same initial consonant-vowel-consonant syllable as the target) or an unrelated distractor. Half of the trials were preceded by an image prime that was semantically related to the target image. Results Children with CIs showed evidence of phonological competition during real-time processing of speech. This effect, however, was less and occurred later in the time course of speech processing than what was observed in children with normal hearing. The presence of a semantically related visual prime reduced the effects of phonological competition in both groups of children but to a greater degree in children with CIs. Conclusions Children with CIs were able to process single words similarly to their counterparts with normal hearing. However, children with CIs appeared to have increased reliance on surrounding semantic information compared to their normal-hearing counterparts.

Syntactic Creativity Errors in Children's Wh-Questions

Previous work has reported that children creatively make syntactic errors that are ungrammatical in their target language, but are grammatical in another language. One of the most well-known examples is medial wh-question errors in English-speaking children's wh-questions (e.g., What do you think who the cat chased? from Thornton, 1990). The evidence for this non-target-like structure in both production and comprehension has been taken to support the existence of innate, syntactic parameters that define all possible grammatical variation, which serve as a top-down constraint guiding children's language acquisition process. The present study reports new story-based production and comprehension experiments that challenge this interpretation. While we replicated previous observations of medial wh-question errors in children's sentence production (Experiment 1), we saw a reduction in evidence indicating that English-speaking children assign interpretations that conform to the medial wh-question pattern (Experiment 2). Crucially, we found no correlation between production and comprehension errors (Experiment 3). We suggest that these errors are the result of children's immature sentence production mechanisms rather than immature grammatical knowledge.

Crossmodal Language Comprehension-Psycholinguistic Insights and Computational Approaches

Crossmodal interaction in situated language comprehension is important for effective and efficient communication. The relationship between linguistic and visual stimuli provides mutual benefit: While vision contributes, for instance, information to improve language understanding, language in turn plays a role in driving the focus of attention in the visual environment. However, language and vision are two different representational modalities, which accommodate different aspects and granularities of conceptualizations. To integrate them into a single, coherent system solution is still a challenge, which could profit from inspiration by human crossmodal processing. Based on fundamental psycholinguistic insights into the nature of situated language comprehension, we derive a set of performance characteristics facilitating the robustness of language understanding, such as crossmodal reference resolution, attention guidance, or predictive processing. Artificial systems for language comprehension should meet these characteristics in order to be able to perform in a natural and smooth manner. We discuss how empirical findings on the crossmodal support of language comprehension in humans can be applied in computational solutions for situated language comprehension and how they can help to mitigate the shortcomings of current approaches.