Distributional analyses in the picture–word interference paradigm: Exploring the semantic interference and the distractor frequency effects

Semantic Stroop interference is modulated by the availability of executive resources: Insights from delta-plot analyses and cognitive load manipulation

We investigated whether, during visual word recognition, semantic processing is modulated by attentional control mechanisms directed at matching semantic information with task-relevant goals. In previous research, we analyzed the semantic Stroop interference as a function of response latency (delta-plot analyses) and found that this phenomenon mainly occurs in the slowest responses. Here, we investigated whether this pattern is due to reduced ability to proactively maintain the task goal in these slowest trials. In two pairs of experiments, participants completed two semantic Stroop tasks: a classic semantic Stroop task (Experiment 1A and 2A) and a semantic Stroop task combined with an n-back task (Experiment 1B and 2B). The two pairs of experiments only differed in the trial pace, which was slightly faster in Experiments 2A and 2B than in Experiments 1A and 1B. By taxing the executive control system, the n-back task was expected to hinder proactive control. Delta-plot analyses of the semantic Stroop task replicated the enhanced effect in the slowest responses, but only under sufficient time pressure. Combining the semantic Stroop task with the n-back task produced a change in the distributional profile of semantic Stroop interference, which we ascribe to a general difficulty in the use of proactive control. Our findings suggest that semantic Stroop interference is, to some extent, dependent on the available executive resources, while also being sensitive to subtle variations in task conditions.

Different types of semantic interference, same lapses of attention: Evidence from Stroop tasks

This research investigated the possibility that semantic control mechanisms are recruited only when the interfering semantic information does not overlap with task-relevant semantic dimensions. To reach this goal, we investigated two semantic types of Stroop interference-the semantic and the taboo Stroop effects-and used delta-plots to investigate the role of attentional and semantic control in these two interference phenomena. The semantic Stroop effect, where interference stems from the task-relevant color-related information, was absent in faster responses, whereas it steeply increased in the slowest ones. Contrary to our predictions, the same pattern was detected even for the taboo Stroop interference, with no trace of selective suppression of the interfering semantic connotation, despite its dissociation from any task-relevant semantic dimension. Further, there was a significant correlation between the increase of the two effects in the slowest responses, pointing towards a common underlying processing dynamic. We identified such common background with lapses of executive attention in maintaining task goals and schema, which in turn make the participants performance more prone to interference phenomena. Finally, the absence of any interference effects in the fastest responses suggests that an effective filtering of the distracting word stimuli can be implemented in the context of Stroop paradigms.

Mental chronometry of speaking in dialogue: Semantic interference turns into facilitation

Numerous studies demonstrate that the production of words is delayed when speakers process in temporal proximity semantically related words. Yet the experimental settings underlying this effect are different from those under which we typically speak. This study demonstrates that semantic interference disappears, and can even turn into facilitation, when semantically related words are embedded in a meaningful communicative exchange. Experiment 1 and 3 (each N = 32 university students) implemented a picture-word interference task in a game played between two participants: one named the distractor word and, after a stimulus-onset-asynchrony of -150 ms or -650 ms, the other named a semantically related or unrelated target picture. Semantic interference reappeared with identical experimental parameters in a single-person picture-word interference setting (Experiment 2, N = 32). We conclude that the inhibitory context effects leading to semantic interference in single-subject settings are attenuated whereas facilitatory effects are enhanced in communicative settings.

Distributional properties of semantic interference in picture naming: Bayesian meta-analyses

Studies of word production often make use of picture-naming tasks, including the picture-word-interference task. In this task, participants name pictures with superimposed distractor words. They typically need more time to name pictures when the distractor word is semantically related to the picture than when it is unrelated (the semantic interference effect). The present study examines the distributional properties of this effect in a series of Bayesian meta-analyses. Meta-analytic estimates of the semantic interference effect first show that the effect is present throughout the reaction time distribution and that it increases throughout the distribution. Second, we find a correlation between a participant’s mean semantic interference effect and the change in the effect in the tail of the reaction time distribution, which has been argued to reflect the involvement of selective inhibition in the naming task. Finally, we show with simulated data that this correlation emerges even when no inhibition is used to generate the data, which suggests that inhibition is not needed to explain this relationship.

An Information-Theoretic Account of Semantic Interference in Word Production

I present a computational-level model of semantic interference effects in online word production within a rate–distortion framework. I consider a bounded-rational agent trying to produce words. The agent's action policy is determined by maximizing accuracy in production subject to computational constraints. These computational constraints are formalized using mutual information. I show that semantic similarity-based interference among words falls out naturally from this setup, and I present a series of simulations showing that the model captures some of the key empirical patterns observed in Stroop and Picture–Word Interference paradigms, including comparisons to human data from previous experiments.

Modeling the distributional dynamics of attention and semantic interference in word production

In recent years, it has become clear that attention plays an important role in spoken word production. Some of this evidence comes from distributional analyses of reaction time (RT) in regular picture naming and picture-word interference. Yet we lack a mechanistic account of how the properties of RT distributions come to reflect attentional processes and how these processes may in turn modulate the amount of conflict between lexical representations. Here, we present a computational account according to which attentional lapses allow for existing conflict to build up unsupervised on a subset of trials, thus modulating the shape of the resulting RT distribution. Our process model resolves discrepancies between outcomes of previous studies on semantic interference. Moreover, the model's predictions were confirmed in a new experiment where participants' motivation to remain attentive determined the size and distributional locus of semantic interference in picture naming. We conclude that process modeling of RT distributions importantly improves our understanding of the interplay between attention and conflict in word production. Our model thus provides a framework for interpreting distributional analyses of RT data in picture naming tasks.

Bilingualism and Processing Speed in Typically Developing Children and Children With Developmental Language Disorder

Purpose The aim of the current study was to investigate whether dual language experience modulates processing speed in typically developing (TD) children and in children with developmental language disorder (DLD). We also examined whether processing speed predicted vocabulary and sentence-level abilities in receptive and expressive modalities. Method We examined processing speed in monolingual and bilingual school-age children (ages 8-12 years) with and without DLD. TD children (35 monolinguals, 24 bilinguals) and children with DLD (17 monolinguals, 10 bilinguals) completed a visual choice reaction time task. The Clinical Evaluation of Language Fundamentals, the Peabody Picture Vocabulary Test, and the Expressive Vocabulary Test were used as language measures. Results The children with DLD exhibited slower response times relative to TD children. Response time was not modified by bilingual experience, neither in children with typical development nor children with DLD. Also, we found that faster processing speed was related to higher language abilities, but this relationship was not significant when socioeconomic status was controlled for. The magnitude of the association did not differ between the monolingual and bilingual groups across the language measures. Conclusions Slower processing speed is related to lower language abilities in children. Processing speed is minimally influenced by dual language experience, at least within this age range. Supplemental Material https://doi.org/10.23641/asha.12210311.

A novel multi-word paradigm for investigating semantic context effects in language production

Semantic context modulates precision and speed of language production. Using different experimental designs including the Picture-Word-Interference (PWI) paradigm, it has consistently been shown that categorically related distractor words (e.g., cat) inhibit retrieval of the target picture name (dog). Here we introduce a novel variant of the PWI paradigm in which we present 8 words prior to a to be named target picture. Within this set, the number of words categorically related was varied between 3 and 5, and the picture to be named was either related or unrelated to the respective category. To disentangle interacting effects of semantic context we combined different naming paradigms manipulating the number of competitors and assessing the effect of repeated naming instances. Evaluating processing of the cohort by eye-tracking provided us with a metric of the (implicit) recognition of the semantic cohort. Results replicate the interference effect in that overall naming of pictures categorically related to the distractor set was slower compared to unrelated pictures. However, interference did not increase with increasing number of distractors. Tracking this effect across naming repetitions, we found that interference is prominent at the first naming instance of every picture only, whereby it is stable across distractor conditions, but dissipates across the experiment. Regarding eye-tracking our data show that participants fixated longer on semantically related items, indicating the identification of the lexico-semantic cohort. Our findings confirm the validity of the novel paradigm and indicate that besides interference during first exposure, repeated exposure to the semantic context may facilitate picture naming and counteract lexical interference.

Bilingualism and Attention in Typically Developing Children and Children With Developmental Language Disorder

Purpose The aim of the current study was to investigate whether dual language experience modulates the efficiency of the 3 attentional networks (alerting, orienting, and executive control) in typically developing (TD) children and in children with developmental language disorder (DLD). Method We examined the attentional networks in monolingual and bilingual school-aged children (ages 8-12 years) with and without DLD. TD children (35 monolinguals, 23 bilinguals) and children with DLD (17 monolinguals, 9 bilinguals) completed the Attention Network Test (Fan et al., 2002; Fan, McCandliss, Fossella, Flombaum, & Posner, 2005). Results Children with DLD exhibited poorer executive control than TD children, but executive control was not modified by bilingual experience. The bilingual group with DLD and both TD groups exhibited an orienting effect, but the monolingual group with DLD did not. No group differences were found for alerting. Conclusions Children with DLD have weak executive control skills. These skills are minimally influenced by dual language experience, at least in this age range. A potential bilingual advantage in orienting may be present in the DLD group.

Detection and Attention for Auditory, Visual, and Audiovisual Speech in Children with Hearing Loss

OBJECTIVES

Efficient multisensory speech detection is critical for children who must quickly detect/encode a rapid stream of speech to participate in conversations and have access to the audiovisual cues that underpin speech and language development, yet multisensory speech detection remains understudied in children with hearing loss (CHL). This research assessed detection, along with vigilant/goal-directed attention, for multisensory versus unisensory speech in CHL versus children with normal hearing (CNH).

DESIGN

Participants were 60 CHL who used hearing aids and communicated successfully aurally/orally and 60 age-matched CNH. Simple response times determined how quickly children could detect a preidentified easy-to-hear stimulus (70 dB SPL, utterance "buh" presented in auditory only [A], visual only [V], or audiovisual [AV] modes). The V mode formed two facial conditions: static versus dynamic face. Faster detection for multisensory (AV) than unisensory (A or V) input indicates multisensory facilitation. We assessed mean responses and faster versus slower responses (defined by first versus third quartiles of response-time distributions), which were respectively conceptualized as: faster responses (first quartile) reflect efficient detection with efficient vigilant/goal-directed attention and slower responses (third quartile) reflect less efficient detection associated with attentional lapses. Finally, we studied associations between these results and personal characteristics of CHL.

RESULTS

Unisensory A versus V modes: Both groups showed better detection and attention for A than V input. The A input more readily captured children's attention and minimized attentional lapses, which supports A-bound processing even by CHL who were processing low fidelity A input. CNH and CHL did not differ in ability to detect A input at conversational speech level. Multisensory AV versus A modes: Both groups showed better detection and attention for AV than A input. The advantage for AV input was facial effect (both static and dynamic faces), a pattern suggesting that communication is a social interaction that is more than just words. Attention did not differ between groups; detection was faster in CHL than CNH for AV input, but not for A input. Associations between personal characteristics/degree of hearing loss of CHL and results: CHL with greatest deficits in detection of V input had poorest word recognition skills and CHL with greatest reduction of attentional lapses from AV input had poorest vocabulary skills. Both outcomes are consistent with the idea that CHL who are processing low fidelity A input depend disproportionately on V and AV input to learn to identify words and associate them with concepts. As CHL aged, attention to V input improved. Degree of HL did not influence results.

CONCLUSIONS

Understanding speech-a daily challenge for CHL-is a complex task that demands efficient detection of and attention to AV speech cues. Our results support the clinical importance of multisensory approaches to understand and advance spoken communication by CHL.

Multi-factor analysis in language production: Sequential sampling models mimic and extend regression results

For multi-factor analyses of response times, descriptive models (e.g., linear regression) arguably constitute the dominant approach in psycholinguistics. In contrast empirical cognitive models (e.g., sequential sampling models, SSMs) may fit fewer factors simultaneously, but decompose the data into several dependent variables (a multivariate result), offering more information to analyze. While SSMs are notably popular in the behavioural sciences, they are not significantly developed in language production research. To contribute to the development of this modelling in language, we (i) examine SSMs as a measurement modelling approach for spoken word activation dynamics, and (ii) formally compare SSMs to the default method, regression. SSMs model response activation or selection mechanisms in time, and calculate how they are affected by conditions, persons, and items. While regression procedures also model condition effects, it is only in respect to the mean RT, and little work has been previously done to compare these approaches. Through analyses of two language production experiments, we show that SSMs reproduce regression predictors, and further extend these effects through a multivariate decomposition (cognitive parameters). We also examine a combined regression-SSM approach that is hierarchical Bayesian, which can jointly model more conditions than classic SSMs, and importantly, achieve by-item modelling with other conditions. In this analysis, we found that spoken words principally differed from one another by their activation rates and production times, but not their thresholds to be activated.

Distributional analysis of semantic interference in picture naming

In picture–word interference experiments, participants name pictures (e.g., of a cat) while trying to ignore distractor words. Mean response time (RT) is typically longer with semantically related distractor words (e.g., dog) than with unrelated words (e.g., shoe), called semantic interference. Previous research has examined the RT distributional characteristics of distractor effects by performing ex-Gaussian analyses, which reveal whether effects are present in the normal part of the distribution (the μ parameter), its long right tail (the τ parameter), or both. One previous study linked the semantic interference effect selectively to the distribution tail. In the present study, we replicated the semantic interference effect in the mean picture naming RTs. Distributional analysis of the RTs and those of a previous study revealed that semantic interference was present in both μ and τ. These results provide evidence that the effect is not selectively linked to the τ parameter, and they warn against any simple one-to-one mapping between semantic interference and distributional parameters.

Lesions to Lateral Prefrontal Cortex Impair Lexical Interference Control in Word Production

Speaking is an action that requires control, for example, to prevent interference from distracting or competing information present in the speaker’s environment. Control over task performance is thought to depend on the lateral prefrontal cortex (PFC). However, the neuroimaging literature does not show a consistent relation between left PFC and interference control in word production. Here, we examined the role of left PFC in interference control in word production by testing six patients with lesions to left PFC (centered around the ventrolateral PFC) on a control-demanding task. Patients and age-matched controls named pictures presented along with distractor words, inducing within-trial interference effects. We varied the degree of competing information from distractors to increase the need for interference control. Distractors were semantically related, phonologically related, unrelated to the picture name, or neutral (XXX). Both groups showed lexical interference (slower responses with unrelated than neutral distractors), reflecting naming difficulty in the presence of competing linguistic information. Relative to controls, all six left PFC patients had larger lexical interference effects. By contrast, patients did not show a consistent semantic interference effect (reflecting difficulty in selecting amongst semantic competitors) whereas the controls did. This suggests different control mechanisms may be engaged in semantic compared to lexical interference resolution in this paradigm. Finally, phonological facilitation (faster responses with phonological than unrelated distractors) was larger in patients than in controls. These findings suggest that the lateral PFC is a necessary structure in providing control over lexical interference in word production, possibly through an early attentional blocking mechanism. By contrast, the left PFC does not seem critical in semantic interference resolution in the picture-word interference paradigm.