1
|
Schlenter J, Westergaard M. What eye and hand movements tell us about expectations towards argument order: An eye- and mouse-tracking study in German. Acta Psychol (Amst) 2024; 246:104241. [PMID: 38613853 DOI: 10.1016/j.actpsy.2024.104241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Revised: 04/02/2024] [Accepted: 04/05/2024] [Indexed: 04/15/2024] Open
Abstract
Previous research on real-time sentence processing in German has shown that listeners use the morphological marking of accusative case on a sentence-initial noun phrase to not only interpret the current argument as the object and patient, but also to predict a plausible agent. So far, less is known about the use of case marking to predict the semantic role of upcoming arguments after the subject/agent has been encountered. In the present study, we examined the use of case marking for argument interpretation in transitive as well as ditransitive structures. We aimed to control for multiple factors that could have influenced processing in previous studies, including the animacy of arguments, world knowledge, and the perceptibility of the case cue. Our results from eye- and mouse-tracking indicate that the exploitation of the first case cue that enables the interpretation of the unfolding sentence is influenced by (i) the strength of argument order expectation and (ii) the perceptual salience of the case cue. PsycINFO code: 2720 Linguistics & Language & Speech.
Collapse
Affiliation(s)
- Judith Schlenter
- Department of Language and Culture, UiT The Arctic University of Norway, Tromsø 9037, Norway.
| | - Marit Westergaard
- Department of Language and Culture, UiT The Arctic University of Norway, Tromsø 9037, Norway; Department of Language and Literature, NTNU Norwegian University of Science and Technology, Trondheim 7491, Norway
| |
Collapse
|
2
|
Sala M, Vespignani F, Casalino L, Peressotti F. I know how you'll say it: evidence of speaker-specific speech prediction. Psychon Bull Rev 2024:10.3758/s13423-024-02488-2. [PMID: 38528302 DOI: 10.3758/s13423-024-02488-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/07/2024] [Indexed: 03/27/2024]
Abstract
Most models of language comprehension assume that the linguistic system is able to pre-activate phonological information. However, the evidence for phonological prediction is mixed and controversial. In this study, we implement a paradigm that capitalizes on the fact that foreign speakers usually make phonological errors. We investigate whether speaker identity (native vs. foreign) is used to make specific phonological predictions. Fifty-two participants were recruited to read sentence frames followed by a last spoken word which was uttered by either a native or a foreign speaker. They were required to perform a lexical decision on the last spoken word, which could be either semantically predictable or not. Speaker identity (native vs. foreign) may or may not be cued by the face of the speaker. We observed that the face cue is effective in speeding up the lexical decision when the word is predictable, but it is not effective when the word is not predictable. This result shows that speech prediction takes into account the phonological variability between speakers, suggesting that it is possible to pre-activate in a detailed and specific way the phonological representation of a predictable word.
Collapse
Affiliation(s)
- Marco Sala
- Departement of Developmental Psychology and Socialization, University of Padua, Padova, Italy.
| | - Francesco Vespignani
- Departement of Developmental Psychology and Socialization, University of Padua, Padova, Italy
| | - Laura Casalino
- Departement of Developmental Psychology and Socialization, University of Padua, Padova, Italy
| | - Francesca Peressotti
- Departement of Developmental Psychology and Socialization, University of Padua, Padova, Italy.
- Padua Neuroscience Center, University of Padua, Padova, Italy.
| |
Collapse
|
3
|
Huang L, Li X. The effects of lexical- and sentence-level contextual cues on Chinese word segmentation. Psychon Bull Rev 2024; 31:293-302. [PMID: 37578689 DOI: 10.3758/s13423-023-02336-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/10/2023] [Indexed: 08/15/2023]
Affiliation(s)
- Linjieqiong Huang
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, 16 Lincui Road, Beijing, China
| | - Xingshan Li
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, 16 Lincui Road, Beijing, China.
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China.
| |
Collapse
|
4
|
Liu X. Age differences in the recruitment of syntactic analysis and semantic plausibility during sentence comprehension. THE JOURNAL OF GENERAL PSYCHOLOGY 2023:1-23. [PMID: 37981754 DOI: 10.1080/00221309.2023.2283107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2023] [Accepted: 11/08/2023] [Indexed: 11/21/2023]
Abstract
Syntactic analysis and semantic plausibility provide important cues to build the meaningful representation of sentences. The purpose of this research is to explore the age-related differences in the use of syntactic analysis and semantic plausibility during sentence comprehension under different working memory load conditions. A sentence judgment task was implemented among a group of older and younger adults. Semantic plausibility (plausible, implausible) and syntactic consistency (consistent, inconsistent) were manipulated in the experimental stimuli, and working memory load (high, low) was varied by manipulating the presentation of the stimuli. The study revealed a stronger effect of semantic plausibility in older adults than in younger adults when working memory load was low. But no significant age difference in the effect of syntactic consistency was discovered. When working memory load was high, there was a stronger effect of semantic plausibility and a weaker effect of syntactic consistency in older adults than in younger adults, which suggests that older adults relied more on semantic plausibility and less on syntactic analysis than younger adults. The findings indicate that there is an age-related increase in the use of semantic plausibility, and a reduction in the use of syntactic analysis as working memory load increases.
Collapse
|
5
|
Shin GH, Mun S. Explainability of neural networks for child language: Agent-First strategy in comprehension of Korean active transitive construction. Dev Sci 2023; 26:e13405. [PMID: 37161692 DOI: 10.1111/desc.13405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2022] [Revised: 03/10/2023] [Accepted: 04/08/2023] [Indexed: 05/11/2023]
Abstract
This study investigates how neural networks address the properties of children's linguistic knowledge, with a focus on the Agent-First strategy in comprehension of an active transitive construction in Korean. We develop various neural-network models and measure their classification performance on the test stimuli used in a behavioural experiment involving scrambling and omission of sentential components at varying degrees. Results show that, despite some compatibility of these models' performance with the children's response patterns, their performance does not fully approximate the children's utilisation of this strategy, demonstrating by-model and by-condition asymmetries. This study's findings suggest that neural networks can utilise information about formal co-occurrences to access the intended message to a certain degree, but the outcome of this process may be substantially different from how a child (as a developing processor) engages in comprehension. This implies some limits of neural networks on revealing the developmental trajectories of child language. RESEARCH HIGHLIGHTS: This study investigates how neural networks address properties of child language. We focus on the Agent-First strategy in comprehension of Korean active transitive. Results show by-model/condition asymmetries against children's response patterns. This implies some limits of neural networks on revealing properties of child language.
Collapse
Affiliation(s)
- Gyu-Ho Shin
- Department of Linguistics, University of Illinois Chicago, Chicago, IL, USA
- Department of Asian Studies, Palacky University Olomouc, Olomouc, Czech Republic
| | - Seongmin Mun
- Humanities Research Institute, Ajou University, Suwon-si, Gyeonggi-do, South Korea
| |
Collapse
|
6
|
Li R, Shu S, Wang S, Liu Y, Li Y, Peng M. DAT-MT Accelerated Graph Fusion Dependency Parsing Model for Small Samples in Professional Fields. ENTROPY (BASEL, SWITZERLAND) 2023; 25:1444. [PMID: 37895565 PMCID: PMC10606639 DOI: 10.3390/e25101444] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Revised: 10/04/2023] [Accepted: 10/06/2023] [Indexed: 10/29/2023]
Abstract
The rapid development of information technology has made the amount of information in massive texts far exceed human intuitive cognition, and dependency parsing can effectively deal with information overload. In the background of domain specialization, the migration and application of syntactic treebanks and the speed improvement in syntactic analysis models become the key to the efficiency of syntactic analysis. To realize domain migration of syntactic tree library and improve the speed of text parsing, this paper proposes a novel approach-the Double-Array Trie and Multi-threading (DAT-MT) accelerated graph fusion dependency parsing model. It effectively combines the specialized syntactic features from small-scale professional field corpus with the generalized syntactic features from large-scale news corpus, which improves the accuracy of syntactic relation recognition. Aiming at the problem of high space and time complexity brought by the graph fusion model, the DAT-MT method is proposed. It realizes the rapid mapping of massive Chinese character features to the model's prior parameters and the parallel processing of calculation, thereby improving the parsing speed. The experimental results show that the unlabeled attachment score (UAS) and the labeled attachment score (LAS) of the model are improved by 13.34% and 14.82% compared with the model with only the professional field corpus and improved by 3.14% and 3.40% compared with the model only with news corpus; both indicators are better than DDParser and LTP 4 methods based on deep learning. Additionally, the method in this paper achieves a speedup of about 3.7 times compared to the method with a red-black tree index and a single thread. Efficient and accurate syntactic analysis methods will benefit the real-time processing of massive texts in professional fields, such as multi-dimensional semantic correlation, professional feature extraction, and domain knowledge graph construction.
Collapse
Affiliation(s)
- Rui Li
- State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430072, China; (R.L.); (S.S.); (S.W.); (Y.L.); (Y.L.)
| | - Shili Shu
- State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430072, China; (R.L.); (S.S.); (S.W.); (Y.L.); (Y.L.)
| | - Shunli Wang
- State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430072, China; (R.L.); (S.S.); (S.W.); (Y.L.); (Y.L.)
| | - Yang Liu
- State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430072, China; (R.L.); (S.S.); (S.W.); (Y.L.); (Y.L.)
| | - Yanhao Li
- State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430072, China; (R.L.); (S.S.); (S.W.); (Y.L.); (Y.L.)
| | | |
Collapse
|
7
|
Sauppe S, Naess Å, Roversi G, Meyer M, Bornkessel-Schlesewsky I, Bickel B. An Agent-First Preference in a Patient-First Language During Sentence Comprehension. Cogn Sci 2023; 47:e13340. [PMID: 37715510 DOI: 10.1111/cogs.13340] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2022] [Revised: 07/05/2023] [Accepted: 08/30/2023] [Indexed: 09/17/2023]
Abstract
The language comprehension system preferentially assumes that agents come first during incremental processing. While this might reflect a biologically fixed bias, shared with other domains and other species, the evidence is limited to languages that place agents first, and so the bias could also be learned from usage frequency. Here, we probe the bias with electroencephalography (EEG) in Äiwoo, a language that by default places patients first, but where sentence-initial nouns are still locally ambiguous between patient or agent roles. Comprehenders transiently interpreted nonhuman nouns as patients, eliciting a negativity when disambiguation was toward the less common agent-initial order. By contrast and against frequencies, human nouns were transiently interpreted as agents, eliciting an N400-like negativity when the disambiguation was toward patient-initial order. Consistent with the notion of a fixed property, the agent bias is robust against usage frequency for human referents. However, this bias can be reversed by frequency experience for nonhuman referents.
Collapse
Affiliation(s)
- Sebastian Sauppe
- Department of Comparative Language Science, University of Zurich
- Center for the Interdisciplinary Study of Language Evolution, University of Zurich
| | - Åshild Naess
- Department of Linguistics and Scandinavian Studies, University of Oslo
| | - Giovanni Roversi
- Department of Linguistics and Philosophy, Massachusetts Institute of Technology
| | - Martin Meyer
- Department of Comparative Language Science, University of Zurich
- Center for the Interdisciplinary Study of Language Evolution, University of Zurich
- Cognitive Psychology Unit, Psychological Institute, University of Klagenfurt
| | - Ina Bornkessel-Schlesewsky
- Cognitive Neuroscience Laboratory, Australian Research Centre for Interactive and Virtual Environments, University of South Australia
| | - Balthasar Bickel
- Department of Comparative Language Science, University of Zurich
- Center for the Interdisciplinary Study of Language Evolution, University of Zurich
| |
Collapse
|
8
|
Stanojević M, Brennan JR, Dunagan D, Steedman M, Hale JT. Modeling Structure-Building in the Brain With CCG Parsing and Large Language Models. Cogn Sci 2023; 47:e13312. [PMID: 37417470 DOI: 10.1111/cogs.13312] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Revised: 06/07/2023] [Accepted: 06/17/2023] [Indexed: 07/08/2023]
Abstract
To model behavioral and neural correlates of language comprehension in naturalistic environments, researchers have turned to broad-coverage tools from natural-language processing and machine learning. Where syntactic structure is explicitly modeled, prior work has relied predominantly on context-free grammars (CFGs), yet such formalisms are not sufficiently expressive for human languages. Combinatory categorial grammars (CCGs) are sufficiently expressive directly compositional models of grammar with flexible constituency that affords incremental interpretation. In this work, we evaluate whether a more expressive CCG provides a better model than a CFG for human neural signals collected with functional magnetic resonance imaging (fMRI) while participants listen to an audiobook story. We further test between variants of CCG that differ in how they handle optional adjuncts. These evaluations are carried out against a baseline that includes estimates of next-word predictability from a transformer neural network language model. Such a comparison reveals unique contributions of CCG structure-building predominantly in the left posterior temporal lobe: CCG-derived measures offer a superior fit to neural signals compared to those derived from a CFG. These effects are spatially distinct from bilateral superior temporal effects that are unique to predictability. Neural effects for structure-building are thus separable from predictability during naturalistic listening, and those effects are best characterized by a grammar whose expressive power is motivated on independent linguistic grounds.
Collapse
Affiliation(s)
| | | | | | | | - John T Hale
- Google DeepMind
- Department of Linguistics, University of Georgia
| |
Collapse
|
9
|
Zhang Y, Ryskin R, Gibson E. A noisy-channel approach to depth-charge illusions. Cognition 2023; 232:105346. [PMID: 36512866 DOI: 10.1016/j.cognition.2022.105346] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Revised: 10/24/2022] [Accepted: 11/28/2022] [Indexed: 12/14/2022]
Abstract
The "depth-charge" sentence, No head injury is too trivial to be ignored, is often interpreted as "no matter how trivial head injuries are, we should not ignore them" while the literal meaning is the opposite - "we should ignore them". Four decades of research have failed to resolve the source of this entrenched semantic illusion. Here we adopt the noisy-channel framework for language comprehension to provide a potential explanation. We hypothesize that depth-charge sentences result from inferences whereby comprehenders derive the interpretation by weighing the plausibility of possible readings of the depth-charge sentences against the likelihood of plausible sentences being produced with errors. In four experiments, we find that (1) the more plausible the intended meaning of the depth-charge sentence is, the more likely the sentence is to be misinterpreted; and (2) the higher the likelihood of our hypothesized noise operations, the more likely depth-charge sentences are to be misinterpreted. These results suggest that misinterpretation is affected by both world knowledge and the distance between the depth-charge sentence and a plausible alternative, which is consistent with the noisy-channel framework.
Collapse
Affiliation(s)
- Yuhan Zhang
- Department of Linguistics, Harvard University, Boylston Hall, Cambridge, MA 02138, USA.
| | - Rachel Ryskin
- Department of Cognitive & Information Sciences, University of California, Merced, 5200 North Lake Rd., Merced, CA 95343, USA.
| | - Edward Gibson
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, 43 Vassar St., Cambridge, MA, 02139, USA.
| |
Collapse
|
10
|
Do we rely on good-enough processing in reading under auditory and visual noise? PLoS One 2023; 18:e0277429. [PMID: 36693033 PMCID: PMC9873184 DOI: 10.1371/journal.pone.0277429] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Accepted: 10/27/2022] [Indexed: 01/25/2023] Open
Abstract
Noise, as part of real-life communication flow, degrades the quality of linguistic input and affects language processing. According to predictions of the noisy-channel and good-enough processing models, noise should make comprehenders rely more on word-level semantics instead of actual syntactic relations. However, empirical evidence supporting this prediction is still lacking. For the first time, we investigated whether auditory (three-talker babble) and visual (short idioms appearing next to a target sentence on the screen) noise would trigger greater reliance on semantics and make readers of Russian sentences process the sentences superficially. Our findings suggest that, although Russian speakers generally relied on semantics in sentence comprehension, neither auditory nor visual noise increased this reliance. The only effect of noise on semantic processing was found in reading speed under auditory noise measured by first fixation duration: only without noise, the semantically implausible sentences were read slower than semantically plausible ones. These results do not support the predictions of the study based on the noisy-channel and good-enough processing models, which is discussed in light of the methodological differences among the studies of noise and their possible limitations.
Collapse
|
11
|
Van Os M, Kray J, Demberg V. Rational speech comprehension: Interaction between predictability, acoustic signal, and noise. Front Psychol 2022; 13:914239. [PMID: 36591096 PMCID: PMC9802670 DOI: 10.3389/fpsyg.2022.914239] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Accepted: 11/30/2022] [Indexed: 12/23/2022] Open
Abstract
Introduction During speech comprehension, multiple sources of information are available to listeners, which are combined to guide the recognition process. Models of speech comprehension posit that when the acoustic speech signal is obscured, listeners rely more on information from other sources. However, these models take into account only word frequency information and local contexts (surrounding syllables), but not sentence-level information. To date, empirical studies investigating predictability effects in noise did not carefully control the tested speech sounds, while the literature investigating the effect of background noise on the recognition of speech sounds does not manipulate sentence predictability. Additionally, studies on the effect of background noise show conflicting results regarding which noise type affects speech comprehension most. We address this in the present experiment. Methods We investigate how listeners combine information from different sources when listening to sentences embedded in background noise. We manipulate top-down predictability, type of noise, and characteristics of the acoustic signal, thus creating conditions which differ in the extent to which a specific speech sound is masked in a way that is grounded in prior work on the confusability of speech sounds in noise. Participants complete an online word recognition experiment. Results and discussion The results show that participants rely more on the provided sentence context when the acoustic signal is harder to process. This is the case even when interactions of the background noise and speech sounds lead to small differences in intelligibility. Listeners probabilistically combine top-down predictions based on context with noisy bottom-up information from the acoustic signal, leading to a trade-off between the different types of information that is dependent on the combination of a specific type of background noise and speech sound.
Collapse
Affiliation(s)
- Marjolein Van Os
- Department of Language Science and Technology, Saarland University, Saarbrücken, Germany,*Correspondence: Marjolein Van Os,
| | - Jutta Kray
- Department of Psychology, Saarland University, Saarbrücken, Germany
| | - Vera Demberg
- Department of Language Science and Technology, Saarland University, Saarbrücken, Germany,Department of Computer Science, Saarland University, Saarbrücken, Germany
| |
Collapse
|
12
|
Sun K, Wang R. Semantic similarity and mutual information predicting sentence comprehension: the case of dangling topic construction in Chinese. JOURNAL OF COGNITIVE PSYCHOLOGY 2022. [DOI: 10.1080/20445911.2022.2154781] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Affiliation(s)
- Kun Sun
- Department of Linguistics, University of Tubingen, Tubingen, Germany
| | - Rong Wang
- The Institute of Natural Language Processing, University of Stuttgart, Stuttgart, Germany
- Department of English, Hangzhou Dianzi University, Hangzhou, People’s Republic of China
| |
Collapse
|
13
|
Fedorenko E, Ryskin R, Gibson E. Agrammatic output in non-fluent, including Broca's, aphasia as a rational behavior. APHASIOLOGY 2022; 37:1981-2000. [PMID: 38213953 PMCID: PMC10782888 DOI: 10.1080/02687038.2022.2143233] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Accepted: 10/31/2022] [Indexed: 01/13/2024]
Abstract
Background Speech of individuals with non-fluent, including Broca's, aphasia is often characterized as "agrammatic" because their output mostly consists of nouns and, to a lesser extent, verbs and lacks function words, like articles and prepositions, and correct morphological endings. Among the earliest accounts of agrammatic output in the early 1900s was the "economy of effort" idea whereby agrammatic output is construed as a way of coping with increases in the cost of language production. This idea resurfaced in the 1980s, but in general, the field of language research has largely focused on accounts of agrammatism that postulated core deficits in syntactic knowledge. Aims We here revisit the economy of effort hypothesis in light of increasing emphasis in cognitive science on rational and efficient behavior. Main contribution The critical idea is as follows: there is a cost per unit of linguistic output, and this cost is greater for patients with non-fluent aphasia. For a rational agent, this increase leads to shorter messages. Critically, the informative parts of the message should be preserved and the redundant ones (like the function words and inflectional markers) should be omitted. Although economy of effort is unlikely to provide a unifying account of agrammatic output in all patients-the relevant population is too heterogeneous and the empirical landscape too complex for any single-factor explanation-we argue that the idea of agrammatic output as a rational behavior was dismissed prematurely and appears to provide a plausible explanation for a large subset of the reported cases of expressive aphasia. Conclusions The rational account of expressive agrammatism should be evaluated more carefully and systematically. On the basic research side, pursuing this hypothesis may reveal how the human mind and brain optimize communicative efficiency in the presence of production difficulties. And on the applied side, this construal of expressive agrammatism emphasizes the strengths of some patients to flexibly adapt utterances in order to communicate in spite of grammatical difficulties; and focusing on these strengths may be more effective than trying to "fix" their grammar.
Collapse
Affiliation(s)
- Evelina Fedorenko
- Massachusetts Institute of Technology, Brain & Cognitive Sciences Department
- Massachusetts Institute of Technology, McGovern Institute for Brain Research
- Speech and Hearing in Bioscience and Technology program at Harvard University
| | - Rachel Ryskin
- University of California at Merced, Cognitive & Information Sciences Department
| | - Edward Gibson
- Massachusetts Institute of Technology, Brain & Cognitive Sciences Department
| |
Collapse
|
14
|
Kulmizev A, Nivre J. Schrödinger's tree-On syntax and neural language models. Front Artif Intell 2022; 5:796788. [PMID: 36325030 PMCID: PMC9618648 DOI: 10.3389/frai.2022.796788] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2021] [Accepted: 09/02/2022] [Indexed: 11/05/2022] Open
Abstract
In the last half-decade, the field of natural language processing (NLP) has undergone two major transitions: the switch to neural networks as the primary modeling paradigm and the homogenization of the training regime (pre-train, then fine-tune). Amidst this process, language models have emerged as NLP's workhorse, displaying increasingly fluent generation capabilities and proving to be an indispensable means of knowledge transfer downstream. Due to the otherwise opaque, black-box nature of such models, researchers have employed aspects of linguistic theory in order to characterize their behavior. Questions central to syntax-the study of the hierarchical structure of language-have factored heavily into such work, shedding invaluable insights about models' inherent biases and their ability to make human-like generalizations. In this paper, we attempt to take stock of this growing body of literature. In doing so, we observe a lack of clarity across numerous dimensions, which influences the hypotheses that researchers form, as well as the conclusions they draw from their findings. To remedy this, we urge researchers to make careful considerations when investigating coding properties, selecting representations, and evaluating via downstream tasks. Furthermore, we outline the implications of the different types of research questions exhibited in studies on syntax, as well as the inherent pitfalls of aggregate metrics. Ultimately, we hope that our discussion adds nuance to the prospect of studying language models and paves the way for a less monolithic perspective on syntax in this context.
Collapse
Affiliation(s)
- Artur Kulmizev
- Computational Linguistics Group, Department of Linguistics and Philology, Uppsala University, Uppsala, Sweden
| | - Joakim Nivre
- Computational Linguistics Group, Department of Linguistics and Philology, Uppsala University, Uppsala, Sweden
- RISE Research Institutes of Sweden, Kista, Sweden
| |
Collapse
|
15
|
Brothers T, Zeitlin M, Perrachione AC, Choi C, Kuperberg G. Domain-general conflict monitoring predicts neural and behavioral indices of linguistic error processing during reading comprehension. J Exp Psychol Gen 2022; 151:1502-1519. [PMID: 34843366 PMCID: PMC9888606 DOI: 10.1037/xge0001130] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
Abstract
The ability to detect and respond to linguistic errors is critical for successful reading comprehension, but these skills can vary considerably across readers. In the current study, healthy adults (age 18-35) read short discourse scenarios for comprehension while monitoring for the presence of semantic anomalies. Using a factor analytic approach, we examined if performance in nonlinguistic conflict monitoring tasks (Stroop, AX-CPT) would predict individual differences in neural and behavioral measures of linguistic error processing. Consistent with this hypothesis, domain-general conflict monitoring predicted both readers' end-of-trial acceptability judgments and the amplitude of a late neural response (the P600) evoked by linguistic anomalies. The influence on the P600 was nonlinear, suggesting that online neural responses to linguistic errors are influenced by both the effectiveness and efficiency of domain-general conflict monitoring. These relationships were also highly specific and remained after controlling for variability in working memory capacity and verbal knowledge. Finally, we found that domain-general conflict monitoring also predicted individual variability in measures of reading comprehension, and that this relationship was partially mediated by behavioral measures of linguistic error detection. These findings inform our understanding of the role of domain-general executive functions in reading comprehension, with potential implications for the diagnosis and treatment of language impairments. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Collapse
Affiliation(s)
- Trevor Brothers
- Tufts University,Martinos Center for Biomedical Imaging, Massachusetts General Hospital
| | | | | | | | - Gina Kuperberg
- Tufts University,Martinos Center for Biomedical Imaging, Massachusetts General Hospital
| |
Collapse
|
16
|
Qiu Z, Ferreira F. “He May Certainly Have Forgotten”: Processing of Nested Epistemic Expressions. DISCOURSE PROCESSES 2022. [DOI: 10.1080/0163853x.2022.2077064] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
- Zhuang Qiu
- Department of Linguistics, University of California
| | | |
Collapse
|
17
|
Poulsen M, Nielsen JL, Vang Christensen R. Remembering sentences is not all about memory: Convergent and discriminant validity of syntactic knowledge and its relationship with reading comprehension. JOURNAL OF CHILD LANGUAGE 2022; 49:349-365. [PMID: 33785087 DOI: 10.1017/s0305000921000210] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Recent studies have found correlations between sentence-level tests and reading comprehension. However, the task demands of sentence-level tests are not well understood. The present study investigated syntactic knowledge as a construct by examining the convergent and discriminant validity of two sentence-level tasks, sentence comprehension and sentence repetition, designed to test syntactic knowledge and their relation with reading comprehension. Results from 86 Grade 6 students showed that the syntax tests were more highly correlated with each other than with tests of working memory and vocabulary. This suggests that the syntax measures tap into a set of skills that are at least partially separate from these other cognitive constructs. Furthermore, syntactic knowledge explained unique variance in reading comprehension beyond controls. The syntax tasks were working memory dependent, but working memory was not the primary reason why syntax tasks are correlated with reading comprehension.
Collapse
Affiliation(s)
- Mads Poulsen
- Department of Nordic Studies and Linguistics University of Copenhagen, Copenhagen, Denmark. E-mail: ; ;
| | - Jessie Leigh Nielsen
- Department of Nordic Studies and Linguistics University of Copenhagen, Copenhagen, Denmark. E-mail: ; ;
| | - Rikke Vang Christensen
- Department of Nordic Studies and Linguistics University of Copenhagen, Copenhagen, Denmark. E-mail: ; ;
| |
Collapse
|
18
|
Brothers T, Hoversten LJ, Traxler MJ. Bilinguals on the garden-path: Individual differences in syntactic ambiguity resolution. BILINGUALISM (CAMBRIDGE, ENGLAND) 2021; 24:612-627. [PMID: 35669170 PMCID: PMC9164278 DOI: 10.1017/s1366728920000711] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
Syntactic parsing plays a central role in the interpretation of sentences, but it is unclear to what extent non-native speakers can deploy native-like grammatical knowledge during online comprehension. The current eye-tracking study investigated how Chinese-English bilinguals and native English speakers respond to syntactic category and subcategorization information while reading sentences with OBJECT-SUBJECT ambiguities. We also obtained measures of English language experience, working memory capacity, and executive function to determine how these cognitive variables influence online parsing. During reading, monolinguals and bilinguals showed similar GARDEN-PATH EFFECTS related to syntactic reanalysis, but native English speakers responded more robustly to VERB SUBCATEGORIZATION cues. Readers with greater language experience and executive function showed increased sensitivity to verb subcategorization cues, but parsing was not influenced by working memory capacity. These results are consistent with exposure-based accounts of bilingual sentence processing, and they support a link between syntactic processing and domain-general cognitive control.
Collapse
Affiliation(s)
- Trevor Brothers
- Tufts University, Department of Psychology, Center for Mind and Brain
| | - Liv J Hoversten
- University of California, Santa Cruz, Department of Psychology, Center for Mind and Brain
| | - Matthew J Traxler
- University of California, Davis, Department of Psychology, Center for Mind and Brain
| |
Collapse
|
19
|
Rehrig GL, Cheng M, McMahan BC, Shome R. Why are the batteries in the microwave?: Use of semantic information under uncertainty in a search task. COGNITIVE RESEARCH-PRINCIPLES AND IMPLICATIONS 2021; 6:32. [PMID: 33855644 PMCID: PMC8046897 DOI: 10.1186/s41235-021-00294-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/18/2020] [Accepted: 03/23/2021] [Indexed: 11/10/2022]
Abstract
A major problem in human cognition is to understand how newly acquired information and long-standing beliefs about the environment combine to make decisions and plan behaviors. Over-dependence on long-standing beliefs may be a significant source of suboptimal decision-making in unusual circumstances. While the contribution of long-standing beliefs about the environment to search in real-world scenes is well-studied, less is known about how new evidence informs search decisions, and it is unclear whether the two sources of information are used together optimally to guide search. The present study expanded on the literature on semantic guidance in visual search by modeling a Bayesian ideal observer's use of long-standing semantic beliefs and recent experience in an active search task. The ability to adjust expectations to the task environment was simulated using the Bayesian ideal observer, and subjects' performance was compared to ideal observers that depended on prior knowledge and recent experience to varying degrees. Target locations were either congruent with scene semantics, incongruent with what would be expected from scene semantics, or random. Half of the subjects were able to learn to search for the target in incongruent locations over repeated experimental sessions when it was optimal to do so. These results suggest that searchers can learn to prioritize recent experience over knowledge of scenes in a near-optimal fashion when it is beneficial to do so, as long as the evidence from recent experience was learnable.
Collapse
Affiliation(s)
- Gwendolyn L Rehrig
- Department of Psychology, University of California, Davis, CA, 95616, USA.
| | - Michelle Cheng
- School of Social Sciences, Nanyang Technological University, Singapore, 639798, Singapore
| | - Brian C McMahan
- Department of Computer Science, Rutgers University-New Brunswick, New Brunswick, USA
| | - Rahul Shome
- Department of Computer Science, Rice University, Houston, USA
| |
Collapse
|
20
|
Hubert Lyall I, Järvikivi J. Listener's personality traits predict changes in pupil size during auditory language comprehension. Sci Rep 2021; 11:5443. [PMID: 33686122 PMCID: PMC7940482 DOI: 10.1038/s41598-021-84886-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2020] [Accepted: 02/19/2021] [Indexed: 01/31/2023] Open
Abstract
Research suggests that listeners' comprehension of spoken language is concurrently affected by linguistic and non-linguistic factors, including individual difference factors. However, there is no systematic research on whether general personality traits affect language processing. We correlated 88 native English-speaking participants' Big-5 traits with their pupillary responses to spoken sentences that included grammatical errors, "He frequently have burgers for dinner"; semantic anomalies, "Dogs sometimes chase teas"; and statements incongruent with gender stereotyped expectations, such as "I sometimes buy my bras at Hudson's Bay", spoken by a male speaker. Generalized additive mixed models showed that the listener's Openness, Extraversion, Agreeableness, and Neuroticism traits modulated resource allocation to the three different types of unexpected stimuli. No personality trait affected changes in pupil size across the board: less open participants showed greater pupil dilation when processing sentences with grammatical errors; and more introverted listeners showed greater pupil dilation in response to both semantic anomalies and socio-cultural clashes. Our study is the first one demonstrating that personality traits systematically modulate listeners' online language processing. Our results suggest that individuals with different personality profiles exhibit different patterns of the allocation of cognitive resources during real-time language comprehension.
Collapse
Affiliation(s)
- Isabell Hubert Lyall
- grid.17089.37Department of Linguistics, University of Alberta, Edmonton, AB T6G 2R3 Canada
| | - Juhani Järvikivi
- grid.17089.37Department of Linguistics, University of Alberta, Edmonton, AB T6G 2R3 Canada
| |
Collapse
|
21
|
Huang Y, Jiang M, Guo Q, Wang Y. Delving Into the Working Mechanism of Prediction in Sentence Comprehension: An ERP Study. Front Psychol 2021; 12:608379. [PMID: 33679524 PMCID: PMC7933546 DOI: 10.3389/fpsyg.2021.608379] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2020] [Accepted: 01/27/2021] [Indexed: 12/05/2022] Open
Abstract
The present study aims to delineate the working mechanism of prediction in sentence comprehension, by disentangling the influence of the facilitated general memory retrieval from the coexistent influence of the predicted language-specific semantic and/or syntactic information for the first time. The results support that prediction might influence the downstream cognitive processing in two aspects: (1) the pre-activated information facilitates the retrieval of a matched input in memory and, (2) the pre-activated information interacts with higher-level semantic/syntactic processing. More importantly, the present findings suggest that these two types of influences seem to occur at different stages of sentence comprehension: the facilitated memory retrieval of the input modulates N400 amplitude and the latency of post-N400 late central-parietal positivity/P600, while the predicted semantic/syntactic information and/or their interactions modulate the amplitude of the late positivity. The present findings would be helpful for interpreting the underlying mechanism of observed effects in prediction studies.
Collapse
Affiliation(s)
- Yunlong Huang
- Advanced Innovation Center for Future Education, Beijing Normal University, Beijing, China
| | - Minghu Jiang
- School of Humanities and Social Sciences, Tsinghua University, Beijing, China
| | - Qian Guo
- Department of Foreign Languages and Literatures, Tsinghua University, Beijing, China
| | - Yuling Wang
- School of Humanities and Social Sciences, Tsinghua University, Beijing, China
| |
Collapse
|
22
|
Beier EJ, Chantavarin S, Rehrig G, Ferreira F, Miller LM. Cortical Tracking of Speech: Toward Collaboration between the Fields of Signal and Sentence Processing. J Cogn Neurosci 2021; 33:574-593. [PMID: 33475452 DOI: 10.1162/jocn_a_01676] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
In recent years, a growing number of studies have used cortical tracking methods to investigate auditory language processing. Although most studies that employ cortical tracking stem from the field of auditory signal processing, this approach should also be of interest to psycholinguistics-particularly the subfield of sentence processing-given its potential to provide insight into dynamic language comprehension processes. However, there has been limited collaboration between these fields, which we suggest is partly because of differences in theoretical background and methodological constraints, some mutually exclusive. In this paper, we first review the theories and methodological constraints that have historically been prioritized in each field and provide concrete examples of how some of these constraints may be reconciled. We then elaborate on how further collaboration between the two fields could be mutually beneficial. Specifically, we argue that the use of cortical tracking methods may help resolve long-standing debates in the field of sentence processing that commonly used behavioral and neural measures (e.g., ERPs) have failed to adjudicate. Similarly, signal processing researchers who use cortical tracking may be able to reduce noise in the neural data and broaden the impact of their results by controlling for linguistic features of their stimuli and by using simple comprehension tasks. Overall, we argue that a balance between the methodological constraints of the two fields will lead to an overall improved understanding of language processing as well as greater clarity on what mechanisms cortical tracking of speech reflects. Increased collaboration will help resolve debates in both fields and will lead to new and exciting avenues for research.
Collapse
|
23
|
Abstract
This article addresses the question of whether the human parsing mechanism (HPM) derives sentence meaning always from representations that are computed algorithmically or whether the HPM sometimes resorts to non-algorithmic strategies that may result in misinterpretations. Misinterpretation effects for noncanonical sentences, such as passives, constitute important evidence in favour of models allowing for nonveridical representations. However, it is unclear whether these effects reflect errors in the mapping of form to meaning, or difficulties specific to the procedure used to test comprehension. We report two experiments combining two different comprehension tasks to address these alternative possibilities. In Experiment 1, participants first judged the plausibility of canonical and noncanonical sentences and then named the agent or patient of the sentence. In Experiment 2, the order of the two tasks was reversed. Both tasks require the correct identification of agent or patient/theme, but differ regarding the complexity of operations required to complete the task successfully. In both experiments, participants made a substantial number of errors with agent/patient naming, even when they had correctly assessed sentence plausibility. We conclude that misinterpretation effects do not indicate parsing errors and therefore cannot serve as evidence for non-algorithmic processing. Our results support models of the HPM that assume algorithmic processing only.
Collapse
Affiliation(s)
- Michael Meng
- Merseburg University of Applied Sciences, Merseburg, Germany
| | - Markus Bader
- Goethe University Frankfurt, Frankfurt am Main, Germany
| |
Collapse
|
24
|
Diachek E, Blank I, Siegelman M, Affourtit J, Fedorenko E. The Domain-General Multiple Demand (MD) Network Does Not Support Core Aspects of Language Comprehension: A Large-Scale fMRI Investigation. J Neurosci 2020; 40:4536-4550. [PMID: 32317387 PMCID: PMC7275862 DOI: 10.1523/jneurosci.2036-19.2020] [Citation(s) in RCA: 76] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2019] [Revised: 03/02/2020] [Accepted: 04/05/2020] [Indexed: 11/21/2022] Open
Abstract
Aside from the language-selective left-lateralized frontotemporal network, language comprehension sometimes recruits a domain-general bilateral frontoparietal network implicated in executive functions: the multiple demand (MD) network. However, the nature of the MD network's contributions to language comprehension remains debated. To illuminate the role of this network in language processing in humans, we conducted a large-scale fMRI investigation using data from 30 diverse word and sentence comprehension experiments (481 unique participants [female and male], 678 scanning sessions). In line with prior findings, the MD network was active during many language tasks. Moreover, similar to the language-selective network, which is robustly lateralized to the left hemisphere, these responses were stronger in the left-hemisphere MD regions. However, in contrast with the language-selective network, the MD network responded more strongly (1) to lists of unconnected words than to sentences, and (2) in paradigms with an explicit task compared with passive comprehension paradigms. Indeed, many passive comprehension tasks failed to elicit a response above the fixation baseline in the MD network, in contrast to strong responses in the language-selective network. Together, these results argue against a role for the MD network in core aspects of sentence comprehension, such as inhibiting irrelevant meanings or parses, keeping intermediate representations active in working memory, or predicting upcoming words or structures. These results align with recent evidence of relatively poor tracking of the linguistic signal by the MD regions during naturalistic comprehension, and instead suggest that the MD network's engagement during language processing reflects effort associated with extraneous task demands.SIGNIFICANCE STATEMENT Domain-general executive processes, such as working memory and cognitive control, have long been implicated in language comprehension, including in neuroimaging studies that have reported activation in domain-general multiple demand (MD) regions for linguistic manipulations. However, much prior evidence has come from paradigms where language interpretation is accompanied by extraneous tasks. Using a large fMRI dataset (30 experiments/481 participants/678 sessions), we demonstrate that MD regions are engaged during language comprehension in the presence of task demands, but not during passive reading/listening, conditions that strongly activate the frontotemporal language network. These results present a fundamental challenge to proposals whereby linguistic computations, such as inhibiting irrelevant meanings, keeping representations active in working memory, or predicting upcoming elements, draw on domain-general executive resources.
Collapse
Affiliation(s)
- Evgeniia Diachek
- Department of Psychology, Vanderbilt University, Nashville, Tennessee 37203
| | - Idan Blank
- Department of Psychology, University of California at Los Angeles, Los Angeles, California 90095
| | - Matthew Siegelman
- Department of Psychology, Columbia University, New York, New York 10027
| | - Josef Affourtit
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139
- Department of Psychiatry, Massachusetts General Hospital, Charlestown, Massachusetts 02129
| |
Collapse
|
25
|
von der Malsburg T, Poppels T, Levy RP. Implicit Gender Bias in Linguistic Descriptions for Expected Events: The Cases of the 2016 United States and 2017 United Kingdom Elections. Psychol Sci 2020; 31:115-128. [PMID: 31913768 PMCID: PMC7197219 DOI: 10.1177/0956797619890619] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2018] [Accepted: 09/26/2019] [Indexed: 12/03/2022] Open
Abstract
Gender stereotypes influence subjective beliefs about the world, and this is reflected in our use of language. But do gender biases in language transparently reflect subjective beliefs? Or is the process of translating thought to language itself biased? During the 2016 United States (N = 24,863) and 2017 United Kingdom (N = 2,609) electoral campaigns, we compared participants' beliefs about the gender of the next head of government with their use and interpretation of pronouns referring to the next head of government. In the United States, even when the female candidate was expected to win, she pronouns were rarely produced and induced substantial comprehension disruption. In the United Kingdom, where the incumbent female candidate was heavily favored, she pronouns were preferred in production but yielded no comprehension advantage. These and other findings suggest that the language system itself is a source of implicit biases above and beyond previously known biases, such as those measured by the Implicit Association Test.
Collapse
Affiliation(s)
- Titus von der Malsburg
- Department of Linguistics, University of
Potsdam
- Department of Brain and Cognitive
Sciences, Massachusetts Institute of Technology
| | - Till Poppels
- Department of Linguistics, University of
California San Diego
| | - Roger P. Levy
- Department of Brain and Cognitive
Sciences, Massachusetts Institute of Technology
- Department of Linguistics, University of
California San Diego
| |
Collapse
|
26
|
Mollica F, Siegelman M, Diachek E, Piantadosi ST, Mineroff Z, Futrell R, Kean H, Qian P, Fedorenko E. Composition is the Core Driver of the Language-selective Network. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2020; 1:104-134. [PMID: 36794007 PMCID: PMC9923699 DOI: 10.1162/nol_a_00005] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/09/2019] [Accepted: 12/19/2019] [Indexed: 05/11/2023]
Abstract
The frontotemporal language network responds robustly and selectively to sentences. But the features of linguistic input that drive this response and the computations that these language areas support remain debated. Two key features of sentences are typically confounded in natural linguistic input: words in sentences (a) are semantically and syntactically combinable into phrase- and clause-level meanings, and (b) occur in an order licensed by the language's grammar. Inspired by recent psycholinguistic work establishing that language processing is robust to word order violations, we hypothesized that the core linguistic computation is composition, and, thus, can take place even when the word order violates the grammatical constraints of the language. This hypothesis predicts that a linguistic string should elicit a sentence-level response in the language network provided that the words in that string can enter into dependency relationships as in typical sentences. We tested this prediction across two fMRI experiments (total N = 47) by introducing a varying number of local word swaps into naturalistic sentences, leading to progressively less syntactically well-formed strings. Critically, local dependency relationships were preserved because combinable words remained close to each other. As predicted, word order degradation did not decrease the magnitude of the blood oxygen level-dependent response in the language network, except when combinable words were so far apart that composition among nearby words was highly unlikely. This finding demonstrates that composition is robust to word order violations, and that the language regions respond as strongly as they do to naturalistic linguistic input, providing that composition can take place.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Hope Kean
- Brain & Cognitive Sciences Department, MIT
| | - Peng Qian
- Brain & Cognitive Sciences Department, MIT
| | | |
Collapse
|
27
|
Neural Signal to Violations of Abstract Rules Using Speech-Like Stimuli. eNeuro 2019; 6:ENEURO.0128-19.2019. [PMID: 31551251 PMCID: PMC6787344 DOI: 10.1523/eneuro.0128-19.2019] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2019] [Revised: 07/27/2019] [Accepted: 07/27/2019] [Indexed: 11/30/2022] Open
Abstract
As the evidence of predictive processes playing a role in a wide variety of cognitive domains increases, the brain as a predictive machine becomes a central idea in neuroscience. In auditory processing, a considerable amount of progress has been made using variations of the Oddball design, but most of the existing work seems restricted to predictions based on physical features or conditional rules linking successive stimuli. To characterize the predictive capacity of the brain to abstract rules, we present here two experiments that use speech-like stimuli to overcome limitations and avoid common confounds. Pseudowords were presented in isolation, intermixed with infrequent deviants that contained unexpected phoneme sequences. As hypothesized, the occurrence of unexpected sequences of phonemes reliably elicited an early prediction error signal. These prediction error signals do not seemed to be modulated by attentional manipulations due to different task instructions, suggesting that the predictions are deployed even when the task at hand does not volitionally involve error detection. In contrast, the amount of syllables congruent with a standard pseudoword presented before the point of deviance exerted a strong modulation. Prediction error’s amplitude doubled when two congruent syllables were presented instead of one, despite keeping local transitional probabilities constant. This suggests that auditory predictions can be built integrating information beyond the immediate past. In sum, the results presented here further contribute to the understanding of the predictive capabilities of the human auditory system when facing complex stimuli and abstract rules.
Collapse
|
28
|
Basirat A, Allart É, Brunellière A, Martin Y. Audiovisual speech segmentation in post-stroke aphasia: a pilot study. Top Stroke Rehabil 2019; 26:588-594. [PMID: 31369358 DOI: 10.1080/10749357.2019.1643566] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Abstract
Background: Stroke may cause sentence comprehension disorders. Speech segmentation, i.e. the ability to detect word boundaries while listening to continuous speech, is an initial step allowing the successful identification of words and the accurate understanding of meaning within sentences. It has received little attention in people with post-stroke aphasia (PWA).Objectives: Our goal was to study speech segmentation in PWA and examine the potential benefit of seeing the speakers' articulatory gestures while segmenting sentences.Methods: Fourteen PWA and twelve healthy controls participated in this pilot study. Performance was measured with a word-monitoring task. In the auditory-only modality, participants were presented with auditory-only stimuli while in the audiovisual modality, visual speech cues (i.e. speaker's articulatory gestures) accompanied the auditory input. The proportion of correct responses was calculated for each participant and each modality. Visual enhancement was then calculated in order to estimate the potential benefit of seeing the speaker's articulatory gestures.Results: Both in auditory-only and audiovisual modalities, PWA performed significantly less well than controls, who had 100% correct performance in both modalities. The performance of PWA was correlated with their phonological ability. Six PWA used the visual cues. Group level analysis performed on PWA did not show any reliable difference between the auditory-only and audiovisual modalities (median of visual enhancement = 7% [Q1 - Q3: -5 - 39]).Conclusion: Our findings show that speech segmentation disorder may exist in PWA. This points to the importance of assessing and training speech segmentation after stroke. Further studies should investigate the characteristics of PWA who use visual speech cues during sentence processing.
Collapse
Affiliation(s)
- Anahita Basirat
- UMR 9193 - SCALab - Sciences Cognitives et Sciences Affectives, Univ. Lille, CNRS, CHU Lille, Lille, France
| | - Étienne Allart
- Neurorehabilitation Unit, Lille University Medical Center, Lille, France.,Inserm U1171, University Lille, Degenerative and Vascular Cognitive Disorders, Lille, France
| | - Angèle Brunellière
- UMR 9193 - SCALab - Sciences Cognitives et Sciences Affectives, Univ. Lille, CNRS, CHU Lille, Lille, France
| | | |
Collapse
|
29
|
Bousquet K, Swaab TY, Long DL. The use of context in resolving syntactic ambiguity: Structural and semantic influences. LANGUAGE, COGNITION AND NEUROSCIENCE 2019; 35:43-57. [PMID: 32953924 PMCID: PMC7500530 DOI: 10.1080/23273798.2019.1622750] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/12/2018] [Accepted: 05/07/2019] [Indexed: 06/10/2023]
Abstract
Verb bias facilitates parsing of temporarily ambiguous sentences, but it is unclear when and how comprehenders use probabilistic knowledge about the combinatorial properties of verbs in context. In a self-paced reading experiment, participants read direct object/sentential complement sentences. Reading time in the critical region was investigated as a function of three forms of bias: structural bias (the frequency with which a verb appears in direct object/sentential complement sentences), lexical bias (the simple co-occurrence of verbs and other lexical items), and global bias (obtained from norming data about the use of verbs with specific noun phrases). For reading times at the critical word, structural bias was the only reliable predictor. However, global bias was superior to structural and lexical bias at the post-critical word and for offline acceptability ratings. The results suggest that structural information about verbs is available immediately, but that context-specific, semantic information becomes increasingly informative as processing proceeds.
Collapse
|
30
|
The “semantic P600” in second language processing: When syntax conflicts with semantics. Neuropsychologia 2019; 127:131-147. [DOI: 10.1016/j.neuropsychologia.2019.02.010] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2018] [Revised: 12/21/2018] [Accepted: 02/17/2019] [Indexed: 11/23/2022]
|
31
|
Liu X, Wang W, Wang H. Age differences in the effect of animacy on Mandarin sentence processing. PeerJ 2019; 7:e6437. [PMID: 30783575 PMCID: PMC6378088 DOI: 10.7717/peerj.6437] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2018] [Accepted: 01/11/2019] [Indexed: 11/26/2022] Open
Abstract
Animate nouns are preferred for grammatical subjects, whereas inanimate nouns are preferred for grammatical objects. Animacy provides important semantic cues for sentence comprehension. However, how individuals’ ability to use this animacy cue changes with advancing age is still not clear. The current study investigated whether older adults and younger adults were differentially sensitive to this semantic constraint in processing Mandarin relative clauses, using a self-paced reading paradigm. The sentences used in the study contained subject relative clauses or object relative clauses and had animate or inanimate subjects. The results indicate that the animacy manipulation affected the younger adults more than the older adults in online processing. Younger adults had longer reading times for all segments in subject relative clauses than in object relative clauses when the subjects were inanimate, whereas there was no significant difference in reading times between subject and object relative clauses when the subjects were animate. In the older group, animacy was not found to influence the processing difficulty of subject relative clauses and object relative clauses. Compared with younger adults, older adults were less sensitive to animacy constraints in relative clause processing. The findings indicate that the use of animacy cues became less efficient in the ageing population. The results can be explained by the capacity constrained comprehension theory, according to which older adults have greater difficulty in integrating semantic information with syntactic processing due to the lack of sufficient cognitive resources.
Collapse
Affiliation(s)
- Xinmiao Liu
- School of English for Specific Purposes, Beijing Foreign Studies University, Beijing, China
| | - Wenbin Wang
- National Research Centre for Foreign Language Education, Beijing Foreign Studies University, Beijing, China
| | - Haiyan Wang
- Language and Brain Science Center, School of Translation Studies, Qufu Normal University, Rizhao, Shandong, China
| |
Collapse
|
32
|
Kamide Y, Kukona A. The Influence of Globally Ungrammatical Local Syntactic Constraints on Real-Time Sentence Comprehension: Evidence From the Visual World Paradigm and Reading. Cogn Sci 2018; 42:2976-2998. [PMID: 30341784 DOI: 10.1111/cogs.12694] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2016] [Revised: 09/13/2018] [Accepted: 09/19/2018] [Indexed: 11/28/2022]
Abstract
We investigated the influence of globally ungrammatical local syntactic constraints on sentence comprehension, as well as the corresponding activation of global and local representations. In Experiment 1, participants viewed visual scenes with objects like a carousel and motorbike while hearing sentences with noun phrase (NP) or verb phrase (VP) modifiers like "The girl who likes the man (from London/very much) will ride the carousel." In both cases, "girl" and "ride" predicted carousel as the direct object; however, the locally coherent combination "the man from London will ride…" in NP cases alternatively predicted motorbike. During "ride," local constraints, although ruled out by the global constraints, influenced prediction as strongly as global constraints: While motorbike was fixated less than carousel in VP cases, it was fixated as much as carousel in NP cases. In Experiment 2, these local constraints likewise slowed reading times. We discuss implications for theories of sentence processing.
Collapse
Affiliation(s)
- Yuki Kamide
- Division of Psychology, University of Dundee
| | | |
Collapse
|
33
|
Fedorenko E, Williams ZM, Ferreira VS. Remaining Puzzles about Morpheme Production in the Posterior Temporal Lobe. Neuroscience 2018; 392:160-163. [PMID: 30278250 DOI: 10.1016/j.neuroscience.2018.09.032] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2018] [Revised: 09/18/2018] [Accepted: 09/22/2018] [Indexed: 11/19/2022]
Abstract
Using data from time-resolved cortical stimulation, intracranial neural recordings, and focal surgical resections, Lee et al. (2018) demonstrate that a small area within left posterior superior temporal gyrus (pSTG) supports the ability to produce functional morphemes but not other basic aspects of language production or comprehension. These findings are intriguing because they raise important questions about the functional architecture of language processing, including critically, the relationship between production and comprehension. Here, we highlight some of the puzzles that remain and that we hope will guide future empirical explorations of the cognitive and neural mechanisms that support our capacity for language.
Collapse
Affiliation(s)
- Evelina Fedorenko
- Department of Psychiatry, Massachusetts General Hospital/Harvard Medical School, Boston, MA, United States; McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, United States.
| | - Ziv M Williams
- Department of Neurosurgery, Massachusetts General Hospital/Harvard Medical School, Boston, MA, United States; Program in Neuroscience, Harvard Medical School, Boston, MA, United States
| | | |
Collapse
|
34
|
Christianson K, Luke SG, Hussey EK, Wochna KL. Why reread? Evidence from garden-path and local coherence structures. Q J Exp Psychol (Hove) 2017; 70:1380-1405. [DOI: 10.1080/17470218.2016.1186200] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
Two eye-tracking experiments were conducted to compare the online reading and offline comprehension of main verb/reduced relative garden-path sentences and local coherence sentences. Rereading of early material in garden-path reduced relatives should be revisionary, aimed at reanalysing an earlier misparse; however, rereading of early material in a local coherence reduced relative need only be confirmatory, as the original parse of the earlier portion of these sentences is ultimately correct. Results of online and offline measures showed that local coherence structures elicited signals of reading disruption that arose earlier and lasted longer, and local coherence comprehension was also better than garden path comprehension. Few rereading measures in either sentence type were predicted by structural features of these sentences, nor was rereading related to comprehension accuracy, which was extremely low overall. Results are discussed with respect to selective reanalysis and good-enough processing.
Collapse
Affiliation(s)
- Kiel Christianson
- Departments of Educational Psychology, University of Illinois, Urbana-Champaign, Champaign, IL, USA
- Beckman Institute for Advanced Science and Technology, University of Illinois, Urbana-Champaign, Urbana, IL, USA
| | - Steven G. Luke
- College of Family, Home, and Social Sciences, Brigham Young University, Provo, UT, USA
| | - Erika K. Hussey
- Beckman Institute for Advanced Science and Technology, University of Illinois, Urbana-Champaign, Urbana, IL, USA
| | | |
Collapse
|
35
|
Abstract
The extent to which the sleeping brain processes sensory information remains unclear. This is particularly true for continuous and complex stimuli such as speech, in which information is organized into hierarchically embedded structures. Recently, novel metrics for assessing the neural representation of continuous speech have been developed using noninvasive brain recordings that have thus far only been tested during wakefulness. Here we investigated, for the first time, the sleeping brain's capacity to process continuous speech at different hierarchical levels using a newly developed Concurrent Hierarchical Tracking (CHT) approach that allows monitoring the neural representation and processing-depth of continuous speech online. Speech sequences were compiled with syllables, words, phrases, and sentences occurring at fixed time intervals such that different linguistic levels correspond to distinct frequencies. This enabled us to distinguish their neural signatures in brain activity. We compared the neural tracking of intelligible versus unintelligible (scrambled and foreign) speech across states of wakefulness and sleep using high-density EEG in humans. We found that neural tracking of stimulus acoustics was comparable across wakefulness and sleep and similar across all conditions regardless of speech intelligibility. In contrast, neural tracking of higher-order linguistic constructs (words, phrases, and sentences) was only observed for intelligible speech during wakefulness and could not be detected at all during nonrapid eye movement or rapid eye movement sleep. These results suggest that, whereas low-level auditory processing is relatively preserved during sleep, higher-level hierarchical linguistic parsing is severely disrupted, thereby revealing the capacity and limits of language processing during sleep.SIGNIFICANCE STATEMENT Despite the persistence of some sensory processing during sleep, it is unclear whether high-level cognitive processes such as speech parsing are also preserved. We used a novel approach for studying the depth of speech processing across wakefulness and sleep while tracking neuronal activity with EEG. We found that responses to the auditory sound stream remained intact; however, the sleeping brain did not show signs of hierarchical parsing of the continuous stream of syllables into words, phrases, and sentences. The results suggest that sleep imposes a functional barrier between basic sensory processing and high-level cognitive processing. This paradigm also holds promise for studying residual cognitive abilities in a wide array of unresponsive states.
Collapse
|
36
|
Andrews G, Ogden JE, Halford GS. Resolving Conflicts Between Syntax and Plausibility in Sentence Comprehension. Adv Cogn Psychol 2017; 13:11-27. [PMID: 28458748 PMCID: PMC5404470 DOI: 10.5709/acp-0203-8] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2016] [Accepted: 11/01/2016] [Indexed: 11/23/2022] Open
Abstract
Comprehension of plausible and implausible object- and subject-relative clause
sentences with and without prepositional phrases was examined. Undergraduates
read each sentence then evaluated a statement as consistent or inconsistent with
the sentence. Higher acceptance of consistent than inconsistent statements
indicated reliance on syntactic analysis. Higher acceptance of
plausible than implausible statements reflected reliance on semantic
plausibility. There was greater reliance on semantic plausibility
and lesser reliance on syntactic analysis for more complex object-relatives and
sentences with prepositional phrases than for less complex subject-relatives and
sentences without prepositional phrases. Comprehension accuracy and confidence
were lower when syntactic analysis and semantic plausibility yielded conflicting
interpretations. The conflict effect on comprehension was significant for
complex sentences but not for less complex sentences. Working memory capacity
predicted resolution of the syntax-plausibility conflict in
more and less complex items only when sentences and statements were presented
sequentially. Fluid intelligence predicted resolution of the conflict in more
and less complex items under sequential and simultaneous presentation.
Domain-general processes appear to be involved in resolving syntax-plausibility
conflicts in sentence comprehension.
Collapse
Affiliation(s)
- Glenda Andrews
- Menzies Institute of Health Queensland, Griffith University, Gold
Coast, Australia
| | - Jessica E. Ogden
- School of Applied Psychology, Griffith University, Gold Coast,
Australia
| | - Graeme S. Halford
- School of Applied Psychology, Griffith University, Mt Gravatt,
Australia
| |
Collapse
|
37
|
Simard D, Labelle M, Bergeron A. Measuring Metasyntactic Abilities: On a Classification of Metasyntactic Tasks. JOURNAL OF PSYCHOLINGUISTIC RESEARCH 2017; 46:433-456. [PMID: 27507147 DOI: 10.1007/s10936-016-9445-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Researchers working on metasyntactic abilities (i.e., the metalinguistic ability associated with syntax) face the problem of defining and measuring them. Metasyntactic abilities is a multifaceted concept, which encompasses various types of behaviours, from being able to intentionally manipulate syntactic structures to being able to state syntactic rules, and the way in which it is defined and measured varies greatly from one study to another. The present paper proposes a theoretically informed classification of syntax related tasks. The first part presents previous research defining and distinguishing various types of syntactic and metasyntactic abilities and their interrelations. In the second part, commonly used tasks are described and analyzed in terms of the framework presented, with the aim of better pinpointing the type of ability measured by each task. Ultimately, with this analysis of commonly used tasks, we hope to offer criteria for discriminating between the various measures of metasyntactic abilities.
Collapse
Affiliation(s)
- Daphnée Simard
- Département de linguistique, Université du Québec à Montréal, C.P. 8888, Succursale Centre Ville, Montreal, H3C 3P8, Canada.
| | - Marie Labelle
- Département de linguistique, Université du Québec à Montréal, C.P. 8888, Succursale Centre Ville, Montreal, H3C 3P8, Canada
| | - Annie Bergeron
- Département de linguistique, Université du Québec à Montréal, C.P. 8888, Succursale Centre Ville, Montreal, H3C 3P8, Canada
| |
Collapse
|
38
|
Henderson JM. Gaze Control as Prediction. Trends Cogn Sci 2017; 21:15-23. [DOI: 10.1016/j.tics.2016.11.003] [Citation(s) in RCA: 98] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2016] [Revised: 11/07/2016] [Accepted: 11/08/2016] [Indexed: 11/25/2022]
|
39
|
The relationship between priming and linguistic representations is mediated by processing constraints. Behav Brain Sci 2017; 40:e310. [PMID: 29342736 DOI: 10.1017/s0140525x17000589] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Understanding the nature of linguistic representations undoubtedly will benefit from multiple types of evidence, including structural priming. Here, we argue that successfully gaining linguistic insights from structural priming requires us to better understand (1) the precise mappings between linguistic input and comprehenders' syntactic knowledge; and (2) the role of cognitive faculties such as memory and attention in structural priming.
Collapse
|
40
|
Kukona A, Braze D, Johns CL, Mencl WE, Van Dyke JA, Magnuson JS, Pugh KR, Shankweiler DP, Tabor W. The real-time prediction and inhibition of linguistic outcomes: Effects of language and literacy skill. Acta Psychol (Amst) 2016; 171:72-84. [PMID: 27723471 PMCID: PMC5138490 DOI: 10.1016/j.actpsy.2016.09.009] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2016] [Revised: 09/16/2016] [Accepted: 09/21/2016] [Indexed: 11/15/2022] Open
Abstract
Recent studies have found considerable individual variation in language comprehenders' predictive behaviors, as revealed by their anticipatory eye movements during language comprehension. The current study investigated the relationship between these predictive behaviors and the language and literacy skills of a diverse, community-based sample of young adults. We found that rapid automatized naming (RAN) was a key determinant of comprehenders' prediction ability (e.g., as reflected in predictive eye movements to a white cake on hearing "The boy will eat the white…"). Simultaneously, comprehension-based measures predicted participants' ability to inhibit eye movements to objects that shared features with predictable referents but were implausible completions (e.g., as reflected in eye movements to a white but inedible white car). These findings suggest that the excitatory and inhibitory mechanisms that support prediction during language processing are closely linked with specific cognitive abilities that support literacy. We show that a self-organizing cognitive architecture captures this pattern of results.
Collapse
Affiliation(s)
- Anuenue Kukona
- Division of Psychology, De Montfort University, Leicester, United Kingdom.
| | - David Braze
- Haskins Laboratories, New Haven, CT, United States
| | | | | | | | - James S Magnuson
- Haskins Laboratories, New Haven, CT, United States; Department of Psychology, University of Connecticut, Storrs, CT, United States
| | - Kenneth R Pugh
- Haskins Laboratories, New Haven, CT, United States; Department of Psychology, University of Connecticut, Storrs, CT, United States
| | - Donald P Shankweiler
- Haskins Laboratories, New Haven, CT, United States; Department of Psychology, University of Connecticut, Storrs, CT, United States
| | - Whitney Tabor
- Haskins Laboratories, New Haven, CT, United States; Department of Psychology, University of Connecticut, Storrs, CT, United States
| |
Collapse
|
41
|
Ivanova I, Branigan HP, McLean JF, Costa A, Pickering MJ. Do you what I say? People reconstruct the syntax of anomalous utterances. LANGUAGE, COGNITION AND NEUROSCIENCE 2016; 32:175-189. [PMID: 29152525 PMCID: PMC5685527 DOI: 10.1080/23273798.2016.1236976] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/25/2015] [Accepted: 09/07/2016] [Indexed: 06/07/2023]
Abstract
We frequently experience and successfully process anomalous utterances. Here we examine whether people do this by 'correcting' syntactic anomalies to yield well-formed representations. In two structural priming experiments, participants' syntactic choices in picture description were influenced as strongly by previously comprehended anomalous (missing-verb) prime sentences as by well-formed prime sentences. Our results suggest that comprehenders can reconstruct the constituent structure of anomalous utterances - even when such utterances lack a major structural component such as the verb. These results also imply that structural alignment in dialogue is unaffected if one interlocutor produces anomalous utterances.
Collapse
Affiliation(s)
- Iva Ivanova
- Departament de Psicologia Bàsica, Universitat de Barcelona, Spain
| | | | - Janet F. McLean
- Department of Psychology, University of Edinburgh, United Kingdom
| | - Albert Costa
- Departament de Tecnologies de la Informació i les Comunicacions, Universitat Pompeu Fabra, Spain
- Institució Catalana de Recerca i Estudis Avançats (ICREA), Spain
| | | |
Collapse
|
42
|
Brothers T, Traxler MJ. Anticipating syntax during reading: Evidence from the boundary change paradigm. J Exp Psychol Learn Mem Cogn 2016; 42:1894-1906. [PMID: 27123753 DOI: 10.1037/xlm0000257] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Previous evidence suggests that grammatical constraints have a rapid influence during language comprehension, particularly at the level of word categories (noun, verb, preposition). These findings are in conflict with a recent study from Angele, Laishley, Rayner, and Liversedge (2014), in which sentential fit had no early influence on word skipping rates during reading. In the present study, we used a gaze-contingent boundary change paradigm to manipulate the syntactic congruity of an upcoming noun or verb outside of participants' awareness. Across 3 experiments (total N = 148), we observed higher skipping rates for syntactically valid previews (The admiral would not confess . . .), when compared with violation previews (The admiral would not surgeon . . .). Readers were less likely to skip an ungrammatical continuation, even when that word was repeated within the same sentence (The admiral would not admiral . . .), suggesting that word-class constraints can take precedence over lexical repetition effects. To our knowledge, these results provide the first evidence for an influence of syntactic context during parafoveal word recognition. On the basis of the early time-course of this effect, we argue that readers can use grammatical constraints to generate syntactic expectations for upcoming words. (PsycINFO Database Record
Collapse
|
43
|
Christianson K. When language comprehension goes wrong for the right reasons: Good-enough, underspecified, or shallow language processing. Q J Exp Psychol (Hove) 2016; 69:817-28. [PMID: 26785102 DOI: 10.1080/17470218.2015.1134603] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
This paper contains an overview of language processing that can be described as "good enough", "underspecified", or "shallow". The central idea is that a nontrivial proportion of misunderstanding, misinterpretation, and miscommunication can be attributed not to random error, but instead to processing preferences of the human language processing system. In other words, the very architecture of the language processor favours certain types of processing errors because in a majority of instances, this "fast and frugal", less effortful processing is good enough to support communication. By way of historical background, connections are made between this relatively recent facet of psycholinguistic study, other recent language processing models, and related concepts in other areas of cognitive science. Finally, the nine papers included in this special issue are introduced as representative of novel explorations of good-enough, or underspecified, language processing.
Collapse
Affiliation(s)
- Kiel Christianson
- a Department of Educational Psychology , University of Illinois, College of Education , Champaign , IL , USA
| |
Collapse
|
44
|
Kuperberg GR, Jaeger TF. What do we mean by prediction in language comprehension? LANGUAGE, COGNITION AND NEUROSCIENCE 2015; 31:32-59. [PMID: 27135040 PMCID: PMC4850025 DOI: 10.1080/23273798.2015.1102299] [Citation(s) in RCA: 374] [Impact Index Per Article: 41.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/24/2015] [Accepted: 09/28/2015] [Indexed: 05/05/2023]
Abstract
We consider several key aspects of prediction in language comprehension: its computational nature, the representational level(s) at which we predict, whether we use higher level representations to predictively pre-activate lower level representations, and whether we 'commit' in any way to our predictions, beyond pre-activation. We argue that the bulk of behavioral and neural evidence suggests that we predict probabilistically and at multiple levels and grains of representation. We also argue that we can, in principle, use higher level inferences to predictively pre-activate information at multiple lower representational levels. We also suggest that the degree and level of predictive pre-activation might be a function of the expected utility of prediction, which, in turn, may depend on comprehenders' goals and their estimates of the relative reliability of their prior knowledge and the bottom-up input. Finally, we argue that all these properties of language understanding can be naturally explained and productively explored within a multi-representational hierarchical actively generative architecture whose goal is to infer the message intended by the producer, and in which predictions play a crucial role in explaining the bottom-up input.
Collapse
Affiliation(s)
- Gina R. Kuperberg
- Department of Psychology and Center for Cognitive Science, Tufts University
- Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School
| | - T. Florian Jaeger
- Department of Brain and Cognitive Sciences, Department of Computer Science, Department of Linguistics, University of Rochester
| |
Collapse
|
45
|
Bachrach A, Jola C, Pallier C. Neuronal bases of structural coherence in contemporary dance observation. Neuroimage 2015; 124:464-472. [PMID: 26348557 DOI: 10.1016/j.neuroimage.2015.08.072] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2015] [Revised: 08/19/2015] [Accepted: 08/22/2015] [Indexed: 11/27/2022] Open
Abstract
The neuronal processes underlying dance observation have been the focus of an increasing number of brain imaging studies over the past decade. However, the existing literature mainly dealt with effects of motor and visual expertise, whereas the neural and cognitive mechanisms that underlie the interpretation of dance choreographies remained unexplored. Hence, much attention has been given to the action observation network (AON) whereas the role of other potentially relevant neuro-cognitive mechanisms such as mentalizing (theory of mind) or language (narrative comprehension) in dance understanding is yet to be elucidated. We report the results of an fMRI study where the structural coherence of short contemporary dance choreographies was manipulated parametrically using the same taped movement material. Our participants were all trained dancers. The whole-brain analysis argues that the interpretation of structurally coherent dance phrases involves a subpart (superior parietal) of the AON as well as mentalizing regions in the dorsomedial prefrontal cortex. An ROI analysis based on a similar study using linguistic materials (Pallier et al., 2011) suggests that structural processing in language and dance might share certain neural mechanisms.
Collapse
Affiliation(s)
- Asaf Bachrach
- Cognitive Neuroimaging Unit, CEA DSV/I2BM, INSERM, UniversitéParis-Sud, Université Paris-Saclay, NeuroSpin center, 91191Gif/Yvette, France; Structures Formelles du Langage UMR 7023 (CNRS - Université Paris 8), Paris 75017, France.
| | - Corinne Jola
- Cognitive Neuroimaging Unit, CEA DSV/I2BM, INSERM, UniversitéParis-Sud, Université Paris-Saclay, NeuroSpin center, 91191Gif/Yvette, France; Division of Psychology, Abertay University , Dundee DD1 1HG, UK
| | - Christophe Pallier
- Cognitive Neuroimaging Unit, CEA DSV/I2BM, INSERM, UniversitéParis-Sud, Université Paris-Saclay, NeuroSpin center, 91191Gif/Yvette, France
| |
Collapse
|