Picture perfect: A stimulus set of 225 pairs of matched clipart and photographic images normed by Mechanical Turk and laboratory participants

How do Antecedent Semantics Influence Pronoun Interpretation? Evidence from Eye Movements

Pronoun interpretation is often described as relying on a comprehender's mental model of discourse. For example, in some psycholinguistic accounts, interpreting pronouns involves a process of retrieval, whereby a pronoun is resolved by accessing information from its linguistic antecedent. However, linguistic antecedents are neither necessary nor sufficient for interpreting a pronoun, and even when an antecedent has been introduced in earlier discourse, there is little evidence for the retrieval of linguistic form. The current study extends our understanding of pronoun interpretation by examining whether the semantics of antecedent expressions are retrieved from representations of past discourse. Participants were instructed to move displayed objects in a Visual World eye-tracking task. In some cases, the semantics of the antecedent were no longer viable after an instruction was completed (e.g., "Move the house on the left to area 12," where the result was that a different house is now the leftmost one). In this case, retrieving antecedent semantics at the point of hearing a subsequent pronoun ("Now, move it…") should entail a processing penalty. Instead, the results showed that antecedent semantics have no direct effect on interpretation, raising additional questions about the role that retrieval might play in pronoun interpretation.

Integration of visual context in early and late bilingual language processing: evidence from eye-tracking

Previous research on the processing of language embedded in a rich visual context has revealed the strong effect that a recently viewed action event has on language comprehension. It has been shown that listeners are more likely to view the target object of a recently performed event than look at the target object of a plausible future event during sentence utterance, regardless of the tense cue. In the current visual-world eye-tracking experiments, we tested the strength of the recently observed visual context with a group of English monolingual and two groups of English-French early and late bilingual speakers. By comparing these different groups, we examined whether bilingual speakers, as a consequence of greater cognitive flexibility when integrating visual context and language information, show early anticipatory eye-movements toward the target object. We further asked whether early and late bilinguals show differences in their processing. The findings of the three eye-tracking experiments revealed an overall preference for the recently seen event. However, as a result of the early provision of tense cue, this preference was quickly diminished in all three groups. Moreover, the bilingual groups showed an earlier decrease in reliance on the recently seen event compared to monolingual speakers and the early bilinguals showed anticipatory eye-movements toward the plausible future event target. Furthermore, a post-experimental memory test revealed that the bilingual groups recalled the future events marginally better than the recent events, whereas the reverse was found in the monolingual groups.

Cognitive Writing Process Characteristics in Alzheimer's Disease

In this article, we explore if the observation of writing behavior can assist in the screening and follow-up of mild cognitive impairment (MCI) and mild dementia due to Alzheimer's disease (AD). To this end, we examined the extent to which overall writing process measures and pausing behavior during writing differed between 15 cognitively impaired patients and 15 age- and gender-matched healthy controls. Participants completed two typed picture description tasks that were registered with Inputlog, a keystroke logging program that captures keyboard activity during text production. The following variables were analyzed with mixed-effects models: time on task; number of characters, pauses and Pause-bursts per minute; proportion of pause time; duration of Pause-bursts; and pause time between words. For pause time between words, also the effect of pauses preceding specific word categories was analyzed. Results showed a main effect of group on all variables. In addition, for pause time between words a main effect of part-of-speech was found as well. Results indicate that writing process analysis can possibly serve as a supplementary tool for the screening and follow-up of AD.

Ratings of name agreement and semantic categorization of 247 colored clipart pictures by young German children

Developmental and longitudinal studies with children increasingly use pictorial stimuli in cognitive, psychologic, and psycholinguistic research. To enhance validity and comparability within and across those studies, the use of normed pictures is recommended. Besides, creating picture sets and evaluating them in rating studies is very time consuming, in particular regarding samples of young children in which testing time is rather limited. As there is an increasing number of studies that investigate young German children's semantic language processing with colored clipart stimuli, this work provides a first set of 247 colored cliparts with ratings of German native speaking children aged 4 to 6 years. We assessed two central rating aspects of pictures: Name agreement (Do pictures elicit the intended name of an object?) and semantic categorization (Are objects classified as members of the intended semantic category?). Our ratings indicate that children are proficient in naming and even better in semantic categorization of objects, whereas both seems to improve with increasing age of young childhood. Finally, this paper discusses some features of pictorial objects that might be important for children's name agreement and semantic categorization and could be considered in future picture rating studies.

Linguistic Redundancy and its Effects on Younger and Older Adults' Real-Time Comprehension and Memory

Redundant modifiers can facilitate referential interpretation by narrowing attention to intended referents. This is intriguing because, on traditional accounts, redundancy should impair comprehension. Little is known, however, about the effects of redundancy on older adults' comprehension. Older adults may show different patterns due to age-related decline (e.g., processing speed and memory) or their greater proclivity for linguistic redundancy, as suggested in language production studies. The present study explores the effects of linguistic redundancy on younger and older listeners' incremental referential processing, judgments of informativity, and downstream memory performance. In an eye tracking task, gaze was monitored as listeners followed instructions from a social robot referring to a unique object within a multi-object display. Critical trials were varied in terms of modifier type ("…closed/purple/[NONE] umbrella") and whether displays contained another object matching target properties (closed purple notebook), making modifiers less effective at narrowing attention. Relative to unmodified descriptions, redundant color modifiers facilitated comprehension, particularly when they narrowed attention to a single referent. Descriptions with redundant state modifiers always impaired real-time comprehension. In contrast, memory measures showed faster recognition of objects previously described with redundant state modifiers. Although color and state descriptions had different effects on referential processing and memory, informativity judgments showed participants perceived them as informationally redundant to the same extent relative to unmodified descriptions. Importantly, the patterns did not differ by listener age. Together, the results show that the effects of linguistic redundancy are stable across adulthood but vary as a function of modifier type, visual context, and the measured phenomenon.

RealPic: Picture norms of real-world common items

Pictures are often used as stimuli in several fields, such as psychology and neuroscience. However, co-occurring image-related properties might impact their processing, emphasizing the importance of validating such materials to guarantee the quality of research and professional practices. This is particularly relevant for pictures of common items because of their wide applicability potential. Normative studies have already been conducted to create and validate such pictures, yet most of them focused on stimulus without naturalistic elements (e.g., line drawings). Norms for real-world pictures of common items are rare, and their normative examination does not always simultaneously assess affective, semantic and perceptive dimensions, namely in the Portuguese context. Real-world pictures constitute pictorial representations of the world with realistic details (e.g., natural color or position), thus improving their ecological validity and their suitability for empirical studies or intervention purposes. Consequently, the establishment of norms for real-world pictures is mandatory for exploring their ecological richness and to uncover their impact across several relevant dimensions. In this study, we established norms for 596 real-world pictures of common items (e.g., tomato, drum) selected from existing databases and distributed into 12 categories. The pictures were evaluated on nine dimensions by a Portuguese sample. The results present the norms by item, by dimension and their correlations as well as cross-cultural analyses. RealPic is a culturally based dataset that offers systematic and flexible standards and is suitable for selecting stimuli while controlling for confounding effects in empirical tasks and interventional applications.

A Systematic Review of Normative Studies Using Images of Common Objects

Common objects comprise living and non-living things people interact with in their daily-lives. Images depicting common objects are extensively used in different fields of research and intervention, such as linguistics, psychology, and education. Nevertheless, their adequate use requires the consideration of several factors (e.g., item-differences, cultural-context and confounding correlated variables), and careful validation procedures. The current study presents a systematic review of the available published norms for images of common objects. A systematic search using PRISMA guidelines indicated that despite their extensive use, the production of norms for such stimuli with adult populations is quite limited (N = 55), particularly for more ecological images, such as photos (N = 14). Among the several dimensions in which the items were assessed, the most commonly referred in our sample were familiarity, visual complexity and name agreement, illustrating some consistency across the reported dimensions while also indicating the limited examination of other potentially relevant dimensions for image processing. The lack of normative studies simultaneously examining affective, perceptive and semantic dimensions was also documented. The number of such normative studies has been increasing in the last years and published in relevant peer-reviewed journals. Moreover, their datasets and norms have been complying with current open science practices. Nevertheless, they are still scarcely cited and replicated in different linguistic and cultural contexts. The current study brings important theoretical contributions by characterizing images of common objects stimuli and their culturally-based norms while highlighting several important features that are likely to be relevant for future stimuli selection and evaluative procedures. The systematic scrutiny of these normative studies is likely to stimulate the production of new, robust and contextually-relevant normative datasets and to provide tools for enhancing the quality of future research and intervention.

IMABASE: A new set of 313 colourised line drawings standardised in French for name agreement, image agreement, conceptual familiarity, age-of-acquisition, and imageability

We provide normative data for a new set of 313 colourised line drawings. The drawings were standardised on name agreement (N = 60 participants), image agreement (N = 34), conceptual familiarity (N = 36), age of acquisition (N = 35), and imageability (N = 35). Objective visual complexity measures are given for the pictures, and objective word frequencies are provided for the modal names of the drawings. Reliability measures for the collected norms are very high. There are high levels of agreement between the names given by the participants and the drawings and comparative analyses indicate that the distribution of name agreement scores is very similar in both our own database and the MultiPic database (Duñabeitia et al., 2018). A novel "picture-choice task" used to assess name-image agreement (N = 30) reveals that the great majority of the IMABASE pictures that are also present in MultiPic are rated as providing better pictorial representations of the corresponding concepts. Finally, most of the correlations are comparable with those reported in other normative studies on colourised drawings. The whole set of pictures is freely available from https://leadserv.u-bourgogne.fr/~lead/imabase/ and the norms are available as Supplementary Material.

PicPsy: A new bank of 106 photographs and line drawings with written naming norms for Spanish-speaking children and adults

The use of pictures as experimental stimuli is a frequent practice in psychological and educational research. In addition, picture-naming task allows the study of different cognitive processes such as perception, attention, memory and language. Line drawings have been widely used in research to date but it has begun to be highlighted the need for more ecological stimuli such as photographs. However, normative data of a photographic set has not been published yet for use with children. We present PicPsy, a new standardized bank of photographs and matched line drawing. We collected written picture-naming norms for name agreement, unknown responses, alternative names, familiarity and visual complexity. A total of 118 native Spanish-speaking children in grades 3-4 participated in the study. For comparison purposes, 89 adults were also included in the study. Child and adult performance was highly correlated, but we found significant age group differences in all variables examined except for visual complexity. Researchers and teachers could benefit from using the new standardized bank reported here which is published under public domain license. The data and materials for this research are available at the Open Science Framework, https://osf.io/nyf3t/.

Examining the influence of picture format on children's naming responses

Digital photography has facilitated the use of more ecological stimuli than line drawings as experimental stimuli. However, there is lack of evidence regarding the effect of the picture format on children’s naming agreement. The present work investigated whether the format of presentation of the pictures (line drawing or photograph) affects naming task performance in children. Two naming task experiments are reported using 106 concepts depicted both as a photograph and as a matched drawing delineated directly from the photograph. Thirty-eight and thirty-four Spanish-speaking children from 8 to 10 years old participated in Experiment 1 and Experiment 2, respectively. We examined name agreement measures (H index, percentage of modal name, and alternative responses) and subjective scales (familiarity and visual complexity). The results revealed a significant main effect of format in all of the variables except for familiarity, indicating better name agreement indices and higher visual complexity values for the photograph format than for the line drawing format. Additionally, line drawings were more likely to produce alternative incorrect names. The implications of these findings for psychoeducational research and practice are discussed.