Grounding Language Processing: The Added Value of Specifying Linguistic/Compositional Representations and Processes

Abundant empirical evidence suggests that visual perception and motor responses are involved in language comprehension ('grounding'). However, when modeling the grounding of sentence comprehension on a word-by-word basis, linguistic representations and cognitive processes are rarely made fully explicit. This article reviews representational formalisms and associated (computational) models with a view to accommodating incremental and compositional grounding effects. Are different representation formats equally suitable and what mechanisms and representations do models assume to accommodate grounding effects? I argue that we must minimally specify compositional semantic representations, a set of incremental processes/mechanisms, and an explicit link from the assumed processes to measured behavior. Different representational formats can be contrasted in psycholinguistic modeling by holding the set of processes/mechanisms constant; contrasting different processes/mechanisms is possible by holding representations constant. Such psycholinguistic modeling could be applied across a wide range of experimental investigations and complement computational modeling.

The subjective meaning of cognitive architecture: a Marrian analysis

Marr famously decomposed cognitive theories into three levels. Newell, Pylyshyn, and Anderson offered parallel decompositions of cognitive architectures, which are psychologically plausible computational formalisms for expressing computational models of cognition. These analyses focused on the objective meaning of each level – how it supports computational models that correspond to cognitive phenomena. This paper develops a complementary analysis of the subjective meaning of each level – how it helps cognitive scientists understand cognition. It then argues against calls to eliminatively reduce higher levels to lower levels, for example, in the name of parsimony. Finally, it argues that the failure to attend to the multiple meanings and levels of cognitive architecture contributes to the current, disunified state of theoretical cognitive science.

Syntactic priming of relative clause attachments: persistence of structural configuration in sentence production

Three sentence completion experiments will be reported in which participants had to generate German equivalents of "the servant of the actress who..." (NP-of-NP-RC) constructions. Target fragments (which were unconstrained as to whether the relative pronoun permitted high or low attachment) were preceded by constrained prime fragments, which were either structurally congruent with the targets (Experiments 1 and 2) or structurally incongruent with the targets (anaphoric adverbial clauses rather than relative clauses (RCs), Experiment 3). While the first two experiments established reliable repetition of RC attachments between primes and targets, Experiment 3 failed to obtain a significant priming effect, indicating that RC attachment priming is dependent on a syntactic overlap between primes and targets. The results suggest a tendency of language producers to retain hierarchical syntactic relations over consecutive trials. Current models of syntactic priming in production do not offer an explanatory mechanism for this kind of observation as they presently stand.

Connectionist psycholinguistics: capturing the empirical data

Connectionist psycholinguistics is an emerging approach to modeling empirical data on human language processing using connectionist computational architectures. For almost 20 years, connectionist models have increasingly been used to model empirical data across many areas of language processing. We critically review four key areas: speech processing, sentence processing, language production, and reading aloud, and evaluate progress against three criteria: data contact, task veridicality, and input representativeness. Recent connectionist modeling efforts have made considerable headway toward meeting these criteria, although it is by no means clear whether connectionist (or symbolic) psycholinguistics will eventually provide an integrated model of full-scale human language processing.