1
|
de Varda AG, Marelli M, Amenta S. Cloze probability, predictability ratings, and computational estimates for 205 English sentences, aligned with existing EEG and reading time data. Behav Res Methods 2023:10.3758/s13428-023-02261-8. [PMID: 37880511 DOI: 10.3758/s13428-023-02261-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/25/2023] [Indexed: 10/27/2023]
Abstract
We release a database of cloze probability values, predictability ratings, and computational estimates for a sample of 205 English sentences (1726 words), aligned with previously released word-by-word reading time data (both self-paced reading and eye-movement records; Frank et al., Behavior Research Methods, 45(4), 1182-1190. 2013) and EEG responses (Frank et al., Brain and Language, 140, 1-11. 2015). Our analyses show that predictability ratings are the best predictors of the EEG signal (N400, P600, LAN) self-paced reading times, and eye movement patterns, when spillover effects are taken into account. The computational estimates are particularly effective at explaining variance in the eye-tracking data without spillover. Cloze probability estimates have decent overall psychometric accuracy and are the best predictors of early fixation patterns (first fixation duration). Our results indicate that the choice of the best measurement of word predictability in context critically depends on the processing index being considered.
Collapse
Affiliation(s)
- Andrea Gregor de Varda
- Department of Psychology, University of Milano - Bicocca, Piazza dell'Ateneo Nuovo 1, Milano, MI 20126, Italy.
| | - Marco Marelli
- Department of Psychology, University of Milano - Bicocca, Piazza dell'Ateneo Nuovo 1, Milano, MI 20126, Italy
| | - Simona Amenta
- Department of Psychology, University of Milano - Bicocca, Piazza dell'Ateneo Nuovo 1, Milano, MI 20126, Italy
| |
Collapse
|
2
|
Foroni F, Marmolejo-Ramos F, Wilcox R, de Bastiani F, Semin GR. A multi-analyses approach of inductive/deductive asymmetry in the affective priming paradigm. Br J Psychol 2023. [PMID: 36718567 DOI: 10.1111/bjop.12634] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 10/24/2022] [Accepted: 01/06/2023] [Indexed: 02/01/2023]
Abstract
Rapidly evaluating our environment's beneficial and detrimental features is critical for our successful functioning. A classic paradigm used to investigate such fast and automatic evaluations is the affective priming (AP) paradigm, where participants classify valenced target stimuli (e.g., words) as good or bad while ignoring the valenced primes (e.g., words). We investigate the differential impact that verbs and adjectives used as primes and targets have on the AP paradigm. Based on earlier work on the Linguistic Category Model, we expect AP effect to be modulated by non-evaluative properties of the word stimuli, such as the linguistic category (e.g., if the prime is an adjective and the target is a verb versus the reverse). A reduction in the magnitude of the priming effect was predicted for adjective-verb prime-target pairs compared to verb-adjective prime-target pairs. Moreover, we implemented a modified crowdsourcing of statistical analyses implementing independently three different statistical approaches. Deriving our conclusions on the converging/diverging evidence provided by the different approaches, we show a clear deductive/inductive asymmetry in AP paradigm (exp. 1), that this asymmetry does not require a focus on the evaluative dimension to emerge (exp. 2) and that the semantic-based asymmetry weakly extends to valence (exp. 3).
Collapse
Affiliation(s)
- Francesco Foroni
- School of Behavioural and Health Sciences, Faculty of Health Sciences, Australian Catholic University, Strathfield, New South Wales, Australia
| | - Fernando Marmolejo-Ramos
- Centre for Change and Complexity in Learning, University of South Australia, Adelaide, Australia
| | - Rand Wilcox
- Department of Psychology, University of Southern California Dornsife, Los Angeles, USA
| | | | - Gün R Semin
- ISPA Instituto Universitário
- ISPA, William James Centre for Research, Lisbon, Portugal.,Faculty of Social and Behavioral Sciences, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
3
|
Onnis L, Huettig F. Can prediction and retrodiction explain whether frequent multi-word phrases are accessed 'precompiled' from memory or compositionally constructed on the fly? Brain Res 2021; 1772:147674. [PMID: 34606750 DOI: 10.1016/j.brainres.2021.147674] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2021] [Revised: 09/23/2021] [Accepted: 09/27/2021] [Indexed: 11/19/2022]
Abstract
An important debate on the architecture of the language faculty has been the extent to which it relies on a compositional system that constructs larger units from morphemes to words to phrases to utterances on the fly and in real time using grammatical rules; or a system that chunks large preassembled, stored units of language from memory; or some combination of both approaches. Good empirical evidence exists for both 'computed' and 'large stored' forms in language, but little is known about what shapes multi-word storage/ access or compositional processing. Here we explored whether predictive and retrodictive processes are a likely determinant of multi-word storage/ processing. Our results suggest that forward and backward predictability are independently informative in determining the lexical cohesiveness of multi-word phrases. In addition, our results call for a reevaluation of the role of retrodiction in contemporary language processing accounts (cf. Ferreira and Chantavarin, 2018).
Collapse
Affiliation(s)
- Luca Onnis
- School of Social Sciences, University of Genoa, Genoa, Italy
| | - Falk Huettig
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands; Centre for Language Studies, Radboud University, Nijmegen, The Netherlands
| |
Collapse
|
4
|
Brothers T, Kuperberg GR. Word predictability effects are linear, not logarithmic: Implications for probabilistic models of sentence comprehension. JOURNAL OF MEMORY AND LANGUAGE 2021; 116:104174. [PMID: 33100508 PMCID: PMC7584137 DOI: 10.1016/j.jml.2020.104174] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
During language comprehension, we routinely use information from the prior context to help identify the meaning of individual words. While measures of online processing difficulty, such as reading times, are strongly influenced by contextual predictability, there is disagreement about the mechanisms underlying this lexical predictability effect, with different models predicting different linking functions - linear (Reichle, Rayner & Pollatsek, 2003) or logarithmic (Levy, 2008). To help resolve this debate, we conducted two highly-powered experiments (self-paced reading, N = 216; cross-modal picture naming, N = 36), and a meta-analysis of prior eye-tracking while reading studies (total N = 218). We observed a robust linear relationship between lexical predictability and word processing times across all three studies. Beyond their methodological implications, these findings also place important constraints on predictive processing models of language comprehension. In particular, these results directly contradict the empirical predictions of surprisal theory, while supporting a proportional pre-activation account of lexical prediction effects in comprehension.
Collapse
Affiliation(s)
- Trevor Brothers
- Department of Psychology, Tufts University, Medford, MA
USA
- Department of Psychiatry and the Athinoula A. Martinos
Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical
School, Boston, MA USA
| | - Gina R. Kuperberg
- Department of Psychology, Tufts University, Medford, MA
USA
- Department of Psychiatry and the Athinoula A. Martinos
Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical
School, Boston, MA USA
| |
Collapse
|
5
|
Gollan TH, Smirnov DS, Salmon DP, Galasko D. Failure to stop autocorrect errors in reading aloud increases in aging especially with a positive biomarker for Alzheimer's disease. Psychol Aging 2020; 35:1016-1025. [PMID: 32584071 PMCID: PMC8357184 DOI: 10.1037/pag0000550] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
Abstract
The present study examined the effects of aging and CSF biomarkers of Alzheimer's disease (AD) on the ability to control production of unexpected words in connected speech elicited by reading aloud. Fifty-two cognitively healthy participants aged 66-86 read aloud 6 paragraphs with 10 malapropisms including 5 on content words (e.g., "window cartons" that elicited autocorrect errors to "window curtains") and 5 on function words (e.g., "thus concept" that elicited autocorrections to "this concept") and completed a battery of neuropsychological tests including a standardized Stroop task. Reading aloud elicited more autocorrect errors on function than content words, but these were equally correlated with age and Aβ1-42 levels. The ability to stop autocorrect errors declined in aging and with lower (more AD-like) levels of Aβ1-42, and multiplicatively so, such that autocorrect errors were highest in the oldest-old with the lowest Aβ1-42 levels. Critically, aging effects were significant even when controlling statistically for Aβ1-42. Finally, both autocorrect and Stroop errors were correlated with Aβ1-42, but only autocorrect errors captured unique variance in predicting Aβ1-42 levels. Reading aloud requires simultaneous planning and monitoring of upcoming speech. These results suggest that healthy aging leads to decline in the ability to intermittently monitor for and detect conflict during speech planning and that subtle cognitive changes in preclinical AD magnify this aging deficit. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Collapse
Affiliation(s)
- Tamar H. Gollan
- Department of Psychiatry, University of California, San Diego
| | - Denis S. Smirnov
- Department of Neurosciences, University of California, San Diego
| | - David P. Salmon
- Department of Neurosciences, University of California, San Diego
| | - Douglas Galasko
- Department of Neurosciences, University of California, San Diego
| |
Collapse
|
6
|
Eijk L, Fletcher A, McAuliffe M, Janse E. The Effects of Word Frequency and Word Probability on Speech Rhythm in Dysarthria. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2020; 63:2833-2845. [PMID: 32783579 DOI: 10.1044/2020_jslhr-19-00389] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Purpose In healthy speakers, the more frequent and probable a word is in its context, the shorter the word tends to be. This study investigated whether these probabilistic effects were similarly sized for speakers with dysarthria of different severities. Method Fifty-six speakers of New Zealand English (42 speakers with dysarthria and 14 healthy speakers) were recorded reading the Grandfather Passage. Measurements of word duration, frequency, and transitional word probability were taken. Results As hypothesized, words with a higher frequency and probability tended to be shorter in duration. There was also a significant interaction between word frequency and speech severity. This indicated that the more severe the dysarthria, the smaller the effects of word frequency on speakers' word durations. Transitional word probability also interacted with speech severity, but did not account for significant unique variance in the full model. Conclusions These results suggest that, as the severity of dysarthria increases, the duration of words is less affected by probabilistic variables. These findings may be due to reductions in the control and execution of muscle movement exhibited by speakers with dysarthria.
Collapse
Affiliation(s)
- Lotte Eijk
- Centre for Language Studies, Radboud University, Nijmegen, the Netherlands
| | - Annalise Fletcher
- Department of Audiology and Speech-Language Pathology, University of North Texas, Denton
| | - Megan McAuliffe
- School of Psychology, Speech and Hearing, New Zealand Institute of Language, Brain, and Behaviour, University of Canterbury
| | - Esther Janse
- Centre for Language Studies, Radboud University, Nijmegen, the Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Nijmegen, the Netherlands
| |
Collapse
|
7
|
Gollan TH, Goldrick M. Aging deficits in naturalistic speech production and monitoring revealed through reading aloud. Psychol Aging 2018; 34:25-42. [PMID: 30265018 DOI: 10.1037/pag0000296] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The current study investigated how aging affects production and self-correction of errors in connected speech elicited via a read aloud task. Thirty-five cognitively healthy older and 56 younger participants read aloud 6 paragraphs in each of three conditions increasing in difficulty: (a) normal, (b) nouns-swapped (in which nouns were shuffled across pairs of sentences in each paragraph), and (c) exchange (in which adjacent words in every two sentences were reversed in order). Reading times and errors increased with task difficulty, but self-correction rates were lowest in the nouns-swapped condition. Older participants read aloud more slowly, and after controlling for aging-related advantages in vocabulary knowledge, produced more speech errors (especially in the normal condition), and self-corrected errors less often than younger participants. Exploratory analysis of error types revealed that aging increased the rate of function word substitution errors (saying the instead of a), whereas younger participants omitted content words more often than did older participants. This pattern of aging deficits reveals powerful effects of vocabulary knowledge on speech production and suggests aging speakers can compensate for aging-related decline in control over speech production with their higher vocabulary knowledge and careful attention to speech planning in more difficult speaking conditions. These results suggest a model of speech production in which planning of speech is relatively automatic, whereas monitoring and self-correction are more attention-demanding, in turn leaving speech production relatively intact in aging. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Collapse
|