1
|
Bohn M, Prein J, Koch T, Bee RM, Delikaya B, Haun D, Gagarina N. oREV: An item response theory-based open receptive vocabulary task for 3- to 8-year-old children. Behav Res Methods 2024; 56:2595-2605. [PMID: 37407786 PMCID: PMC10991070 DOI: 10.3758/s13428-023-02169-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/14/2023] [Indexed: 07/07/2023]
Abstract
Individual differences in early language abilities are an important predictor of later life outcomes. High-quality, easy-access measures of language abilities are rare, especially in the preschool and primary school years. The present study describes the construction of a new receptive vocabulary task for children between 3 and 8 years of age. The task was implemented as a browser-based web application, allowing for both in-person and remote data collection via the internet. Based on data from N = 581 German-speaking children, we estimated the psychometric properties of each item in a larger initial item pool via item response modeling. We then applied an automated item selection procedure to select an optimal subset of items based on item difficulty and discrimination. The so-constructed task has 22 items and shows excellent psychometric properties with respect to reliability, stability, and convergent and discriminant validity. The construction, implementation, and item selection process described here makes it easy to extend the task or adapt it to different languages. All materials and code are freely accessible to interested researchers. The task can be used via the following website: https://ccp-odc.eva.mpg.de/orev-demo .
Collapse
Affiliation(s)
- Manuel Bohn
- Department of Comparative Cultural Psychology, Max Planck Institute for Evolutionary Anthropology, Deutscher Platz 6, 04103, Leipzig, Germany.
- Institut für Psychologie, Leuphana Universität Lüneburg, Lüneburg, Germany.
| | - Julia Prein
- Department of Comparative Cultural Psychology, Max Planck Institute for Evolutionary Anthropology, Deutscher Platz 6, 04103, Leipzig, Germany
| | - Tobias Koch
- Institut für Psychologie, Friedrich-Schiller-Universität Jena, Jena, Germany
| | - R Maximilian Bee
- Institut für Psychologie, Friedrich-Schiller-Universität Jena, Jena, Germany
| | - Büsra Delikaya
- Leibniz-Zentrum Allgemeine Sprachwissenschaft, Berlin, Germany
| | - Daniel Haun
- Department of Comparative Cultural Psychology, Max Planck Institute for Evolutionary Anthropology, Deutscher Platz 6, 04103, Leipzig, Germany
| | | |
Collapse
|
2
|
Gerwien J, Filip M, Smolík F. Noun imageability and the processing of sensory-based information. Q J Exp Psychol (Hove) 2023:17470218231216304. [PMID: 37953293 DOI: 10.1177/17470218231216304] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2023]
Abstract
The aim of this study was to test whether the availability of internal imagery elicited by words is related to ratings of word imageability. Participants are presented with target words and, after a delay allowing for processing of the word, answer questions regarding the size or weight of the word referents. Target words differ with respect to imageability. Results show faster responses to questions for high imageability words than for low imageability words. The type of question (size/weight) modulates reaction times suggesting a dominance of the visual domain over the physical-experience domain in concept representation. Results hold across two different languages (Czech/German). These findings provide further insights into the representations underlying word meaning and the role of word imageability in language acquisition and processing.
Collapse
Affiliation(s)
- Johannes Gerwien
- Institute for German as a Foreign Language Philology, Heidelberg University, Heidelberg, Germany
| | - Maroš Filip
- Institute of Psychology, Academy of Sciences of the Czech Republic, Prague, Czech Republic
| | - Filip Smolík
- Institute of Psychology, Academy of Sciences of the Czech Republic, Prague, Czech Republic
| |
Collapse
|
3
|
Rodriguez-Cuadrado S, Hinojosa JA, Guasch M, Romero-Rivas C, Sabater L, Suárez-Coalla P, Ferré P. Subjective age of acquisition norms for 1604 English words by Spanish L2 speakers of English and their relationship with lexico-semantic, affective, sociolinguistic and proficiency variables. Behav Res Methods 2023; 55:4437-4454. [PMID: 36477592 PMCID: PMC10700429 DOI: 10.3758/s13428-022-02026-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/12/2022] [Indexed: 12/12/2022]
Abstract
Psycholinguistic studies have shown that there are many variables implicated in language comprehension and production. At the lexical level, subjective age of acquisition (AoA), the estimate of the age at which a word is acquired, is key for stimuli selection in psycholinguistic studies. AoA databases in English are often used when testing a variety of phenomena in second language (L2) speakers of English. However, these have limitations, as the norms are not provided by the target population (L2 speakers of English) but by native English speakers. In this study, we asked native Spanish L2 speakers of English to provide subjective AoA ratings for 1604 English words, and investigated whether factors related to 14 lexico-semantic and affective variables, both in Spanish and English, and to the speakers' profile (i.e., sociolinguistic variables and L2 proficiency), were related to the L2 AoA ratings. We used boosted regression trees, an advanced form of regression analysis based on machine learning and boosting algorithms, to analyse the data. Our results showed that the model accounted for a relevant proportion of deviance (58.56%), with the English AoA provided by native English speakers being the strongest predictor for L2 AoA. Additionally, L2 AoA correlated with L2 reaction times. Our database is a useful tool for the research community running psycholinguistic studies in L2 speakers of English. It adds knowledge about which factors-linked to the characteristics of both the linguistic stimuli and the speakers-affect L2 subjective AoA. The database and the data can be downloaded from: https://osf.io/gr8xd/?view_only=73b01dccbedb4d7897c8d104d3d68c46 .
Collapse
Affiliation(s)
- Sara Rodriguez-Cuadrado
- Departamento Interfacultativo de Psicología Evolutiva y de la Educación, Facultad de Formación del Profesorado y Educación, Universidad Autónoma de Madrid, C/ Francisco Tomás y Valiente, n° 3, 28049, Madrid, Spain.
| | - José Antonio Hinojosa
- Instituto Pluridisciplinar, Universidad Complutense de Madrid, Madrid, Spain
- Departamento Psicología Experimental, Procesos Cognitivos y Logopedia, Universidad Complutense de Madrid, Madrid, Spain
- Centro de Investigación Nebrija en Cognición (CINC), Universidad Nebrija, Madrid, Spain
| | - Marc Guasch
- Departamento de Psicología y CRAMC, Universitat Rovira i Virgili, Tarragona, Spain
| | - Carlos Romero-Rivas
- Departamento Interfacultativo de Psicología Evolutiva y de la Educación, Facultad de Formación del Profesorado y Educación, Universidad Autónoma de Madrid, C/ Francisco Tomás y Valiente, n° 3, 28049, Madrid, Spain
| | - Lucía Sabater
- Departamento Interfacultativo de Psicología Evolutiva y de la Educación, Facultad de Formación del Profesorado y Educación, Universidad Autónoma de Madrid, C/ Francisco Tomás y Valiente, n° 3, 28049, Madrid, Spain
- Instituto Pluridisciplinar, Universidad Complutense de Madrid, Madrid, Spain
| | - Paz Suárez-Coalla
- Departamento de Psicología y Grupo de Investigación INCO, Universidad de Oviedo, Oviedo, Spain
| | - Pilar Ferré
- Departamento de Psicología y CRAMC, Universitat Rovira i Virgili, Tarragona, Spain
| |
Collapse
|
4
|
Lee ST, van Heuven WJB, Price JM, Leong CXR. Translation norms for Malay and English words: The effects of word class, semantic variability, lexical characteristics, and language proficiency on translation. Behav Res Methods 2023; 55:3585-3601. [PMID: 36219309 DOI: 10.3758/s13428-022-01977-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/06/2022] [Indexed: 11/08/2022]
Abstract
Translation equivalents are widely used in bilingual research concerning word processing (e.g., Eddington & Tokowicz, 2013; Jouravlev & Jared, 2020) and second-language vocabulary learning (e.g., Bracken et al., 2017; Degani et al., 2014). Although translation norms exist in several languages, to date there are no Malay-English translation norms. This study presents the first Malay-English translation norms collected with highly proficient Malay-English bilinguals. Furthermore, the study investigates the impact of lexical characteristics on translation ambiguity. The forward translation (FT) task (N = 30) collected English translations for 1004 Malay words selected from the Malay Lexicon Project (Yap et al., 2010), and subsequently the backward translation (BT) task (N = 30) gathered Malay translations for 845 English words obtained from the FT phase. The data revealed a high prevalence of translation ambiguity in both translation directions. Specifically, verbs, adjectives, and class-ambiguous words were more translation-ambiguous than nouns. Furthermore, within-language semantic variability and word length were positively correlated with translation ambiguity, whereas word frequency only correlated with translation ambiguity in FT. Word length and word frequency of the source words and their translations were positively correlated. Intriguingly, only in FT were bilinguals with higher Malay proficiency more likely to provide accurate and dominant translations for the Malay words. These findings contrast with those reported in translation norming studies involving other language pairs. The translation norms provide a useful resource for bilingual language studies involving Malay-English bilinguals.
Collapse
Affiliation(s)
- Soon Tat Lee
- School of Psychology, University of Nottingham, Jalan Broga, 43500, Semenyih, Selangor, Malaysia
| | | | - Jessica M Price
- School of Psychology, University of Nottingham, Jalan Broga, 43500, Semenyih, Selangor, Malaysia
| | - Christine Xiang Ru Leong
- School of Psychology, University of Nottingham, Jalan Broga, 43500, Semenyih, Selangor, Malaysia.
| |
Collapse
|
5
|
Wolna A, Łuniewska M, Haman E, Wodniecka Z. Polish norms for a set of colored drawings of 168 objects and 146 actions with predictors of naming performance. Behav Res Methods 2023; 55:2706-2732. [PMID: 35915359 PMCID: PMC10439080 DOI: 10.3758/s13428-022-01923-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/28/2022] [Indexed: 11/08/2022]
Abstract
In this study, we present the first database of pictures and their corresponding psycholinguistic norms for Polish: the CLT database. In this norming study, we used the pictures from Cross-Linguistic Lexical Tasks (CLT): a set of colored drawings of 168 object and 146 actions. The CLT pictures were carefully created to provide a valid tool for multicultural comparisons. The pictures are accompanied by norms for Naming latencies, Name agreement, Goodness of depiction, Image agreement, Concept familiarity, Age of acquisition, Imageability, Lexical frequency, and Word complexity. We also report analyses of predictors of Naming latencies for pictures of objects and actions. Our results show that Name agreement, Concept familiarity, and Lexical frequency are significant predictors of Naming latencies for pictures of both objects and actions. Additionally, Age of acquisition significantly predicts Naming latencies of pictures of objects. The CLT database is freely available at osf.io/gp9qd. The full set of CLT pictures, including additional variants of pictures, is available on request at osf.io/y2cwr.
Collapse
Affiliation(s)
- Agata Wolna
- Institute of Psychology, Jagiellonian University, Kraków, Poland.
| | | | - Ewa Haman
- Faculty of Psychology, University of Warsaw, Warsaw, Poland
| | - Zofia Wodniecka
- Institute of Psychology, Jagiellonian University, Kraków, Poland.
| |
Collapse
|
6
|
Tjuka A, Forkel R, List JM. Curating and extending data for language comparison in Concepticon and NoRaRe. OPEN RESEARCH EUROPE 2023; 2:141. [PMID: 37645322 PMCID: PMC10446050 DOI: 10.12688/openreseurope.15380.3] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 05/16/2023] [Indexed: 08/31/2023]
Abstract
Language comparison requires user-friendly tools that facilitate the standardization of linguistic data. We present two resources built on the basis of a standardized cross-linguistic format and show how the data is curated and extended. The first resource, the Concepticon, is a reference catalog for standardized concepts from linguistic research. While curating the Concepticon, we found that a variety of studies in distinct research fields collected information on word properties. However, until recently, no resource existed that contained these data to enable the comparison of the different word properties across languages. This gap was filled by the Database of Norms, Ratings, and Relations (NoRaRe), which is an extension of the Concepticon. Here, we present the major release of both resources - Concepticon Version 3.0 and NoRaRe Version 1.0 - which represents an important step in our data development. We show that extending and adapting the data curation workflow in Concepticon to NoRaRe is useful for the standardization of cross-linguistic datasets. In addition, combining datasets from different research fields enables studies grounded in language comparison. Concepticon and NoRaRe include lexical data for various languages, tools for test-driven data curation, and the possibility for data reuse. The first major release of NoRaRe is also accompanied by a new web application that allows convenient access to the data.
Collapse
Affiliation(s)
- Annika Tjuka
- Department of Linguistic and Cultural Evolution, Max Planck Institute for Evolutionary Anthropology, Leipzig, Saxony, 04103, Germany
| | - Robert Forkel
- Department of Linguistic and Cultural Evolution, Max Planck Institute for Evolutionary Anthropology, Leipzig, Saxony, 04103, Germany
| | - Johann-Mattis List
- Department of Linguistic and Cultural Evolution, Max Planck Institute for Evolutionary Anthropology, Leipzig, Saxony, 04103, Germany
- Chair for Multilingual Computational Linguistics, University of Passau, Passau, Bavaria, 94032, Germany
| |
Collapse
|
7
|
Tjuka A, Forkel R, List JM. Linking norms, ratings, and relations of words and concepts across multiple language varieties. Behav Res Methods 2022; 54:864-884. [PMID: 34357536 PMCID: PMC9046307 DOI: 10.3758/s13428-021-01650-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/10/2021] [Indexed: 11/30/2022]
Abstract
Psychologists and linguists collect various data on word and concept properties. In psychology, scholars have accumulated norms and ratings for a large number of words in languages with many speakers. In linguistics, scholars have accumulated cross-linguistic information about the relations between words and concepts. Until now, however, there have been no efforts to combine information from the two fields, which would allow comparison of psychological and linguistic properties across different languages. The Database of Cross-Linguistic Norms, Ratings, and Relations for Words and Concepts (NoRaRe) is the first attempt to close this gap. Building on a reference catalog that offers standardization of concepts used in historical and typological language comparison, it integrates data from psychology and linguistics, collected from 98 data sets, covering 65 unique properties for 40 languages. The database is curated with the help of manual, automated, semi-automated workflows and uses a software API to control and access the data. The database is accessible via a web application, the software API, or using scripting languages. In this study, we present how the database is structured, how it can be extended, and how we control the quality of the data curation process. To illustrate its application, we present three case studies that test the validity of our approach, the accuracy of our workflows, and the integrative potential of the database. Due to regular version updates, the NoRaRe database has the potential to advance research in psychology and linguistics by offering researchers an integrated perspective on both fields.
Collapse
Affiliation(s)
- Annika Tjuka
- Max Planck Institute for the Science of Human History, Kahlaische Str. 10, 07745, Jena, Germany.
| | - Robert Forkel
- Max Planck Institute for Evolutionary Anthropology, Deutscher Platz 6, 04103, Leipzig, Germany
| | - Johann-Mattis List
- Max Planck Institute for Evolutionary Anthropology, Deutscher Platz 6, 04103, Leipzig, Germany
| |
Collapse
|
8
|
Taha J, Stojanovik V, Pagnamenta E. Sentence Repetition as a Clinical Marker of Developmental Language Disorder: Evidence From Arabic. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2021; 64:4876-4899. [PMID: 34780284 DOI: 10.1044/2021_jslhr-21-00244] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
PURPOSE Research on the typical and impaired grammatical acquisition of Arabic is limited. This study systematically examined the morphosyntactic abilities of Arabic-speaking children with and without developmental language disorder (DLD) using a novel sentence repetition task. The usefulness of the task as an indicator of DLD in Arabic was determined. METHOD A LITMUS (Language Impairment Testing in Multilingual Settings) sentence repetition task was developed in Palestinian Arabic (LITMUS-SR-PA-72) and administered to 30 children with DLD (M = 61.50 months, SD = 11.27) and 60 age-matched typically developing (TD) children (M = 63.85 months, SD = 10.16). The task targeted grammatical structures known to be problematic for Arabic-speaking children with DLD (language specific) and children with DLD across languages (language independent). Responses were scored using binary, error, and structural scoring methods. RESULTS Children with DLD scored below TD children on the LITMUS-SR-PA-72, in general, and in the repetition of language-specific and language-independent structures. The frequency of morphosyntactic errors was higher in the DLD group relative to the TD group. Despite the large similarity of the type of morphosyntactic errors between the two groups, some atypical errors were exclusively produced by the DLD group. The three scoring methods showed good diagnostic power in the discrimination between children with DLD and children without DLD. CONCLUSIONS Sentence repetition was an area of difficulty for Palestinian Arabic-speaking children with DLD. The DLD group demonstrated difficulties with language-specific and language-independent structures, particularly complex sentences with noncanonical word order. Most grammatical errors made by the DLD group resembled those of the TD group and were mostly omissions or substitutions of grammatical affixes or omissions of function words. SR appears to hold promise as a good indicator for the presence or absence of DLD in Arabic. Further validation of these findings using population-based studies is warranted. Supplemental Material https://doi.org/10.23641/asha.16968043.
Collapse
Affiliation(s)
- Juhayna Taha
- School of Psychology and Clinical Language Sciences, University of Reading, United Kingdom
| | - Vesna Stojanovik
- School of Psychology and Clinical Language Sciences, University of Reading, United Kingdom
| | - Emma Pagnamenta
- School of Psychology and Clinical Language Sciences, University of Reading, United Kingdom
| |
Collapse
|
9
|
De Marco M, Blackburn DJ, Venneri A. Serial Recall Order and Semantic Features of Category Fluency Words to Study Semantic Memory in Normal Ageing. Front Aging Neurosci 2021; 13:678588. [PMID: 34413764 PMCID: PMC8370562 DOI: 10.3389/fnagi.2021.678588] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Accepted: 07/09/2021] [Indexed: 11/13/2022] Open
Abstract
Background: Category Fluency Test (CFT) is a common measure of semantic memory (SM). Test performance, however, is also influenced by other cognitive functions. We here propose a scoring procedure that quantifies the correlation between the serial recall order (SRO) of words retrieved during the CFT and a number of linguistic features, to obtain purer SM measures. To put this methodology to the test, we addressed a proof-of-concept hypothesis whereby, in alignment with the literature, older adults would show better SM. Methods: Ninety participants (45 aged 18-21 years; 45 aged 70-81 years) with normal neurological and cognitive functioning completed a 1-min CFT. SRO was scored as an ordinal variable incrementing by one unit for each valid entry. Each word was also scored for 16 additional linguistic features. Participant-specific normalised correlation coefficients were calculated between SRO and each feature and were analysed with group comparisons and graph theory. Results: Younger adults showed more negative correlations between SRO and "valence" (a feature of words pleasantness). This was driven by the first five words generated. When analysed with graph theory, SRO had significantly higher degree and lower betweenness centrality among older adults. Conclusion: In older adults, SM relies significantly less on pleasantness of entries typically retrieved without semantic control. Moreover, graph-theory metrics indicated better optimised links between SRO and linguistic features in this group. These findings are aligned with the principle whereby SM processes tend to solidify with ageing. Although additional work is needed in support of an SRO-based item-level scoring procedure of CFT performance, these initial findings suggest that this methodology could be of help in characterising SM in a purer form.
Collapse
Affiliation(s)
- Matteo De Marco
- Department of Life Sciences, Brunel University London, London, United Kingdom.,Department of Neuroscience, The University of Sheffield, Sheffield, United Kingdom
| | - Daniel J Blackburn
- Department of Neuroscience, The University of Sheffield, Sheffield, United Kingdom
| | - Annalena Venneri
- Department of Life Sciences, Brunel University London, London, United Kingdom.,Department of Neuroscience, The University of Sheffield, Sheffield, United Kingdom
| |
Collapse
|