A stimulus set of words and pictures matched for visual and semantic similarity

Testing the involvement of low-level visual representations during spoken word processing with non-Western students and meditators practicing Sudarshan Kriya Yoga

Previous studies, using the Continuous Flash Suppression (CFS) paradigm, observed that (Western) university students are better able to detect otherwise invisible pictures of objects when they are presented with the corresponding spoken word shortly before the picture appears. Here we attempted to replicate this effect with non-Western university students in Goa (India). A second aim was to explore the performance of (non-Western) meditators practicing Sudarshan Kriya Yoga in Goa in the same task. Some previous literature suggests that meditators may excel in some tasks that tap visual attention, for example by exercising better endogenous and exogenous control of visual awareness than non-meditators. The present study replicated the finding that congruent spoken cue words lead to significantly higher detection sensitivity than incongruent cue words in non-Western university students. Our exploratory meditator group also showed this detection effect but both frequentist and Bayesian analyses suggest that the practice of meditation did not modulate it. Overall, our results provide further support for the notion that spoken words can activate low-level category-specific visual features that boost the basic capacity to detect the presence of a visual stimulus that has those features. Further research is required to conclusively test whether meditation can modulate visual detection abilities in CFS and similar tasks.

Recognizing non-native spoken words in background noise increases interference from the native language

Listeners frequently recognize spoken words in the presence of background noise. Previous research has shown that noise reduces phoneme intelligibility and hampers spoken-word recognition - especially for non-native listeners. In the present study, we investigated how noise influences lexical competition in both the non-native and the native language, reflecting the degree to which both languages are co-activated. We recorded the eye movements of native Dutch participants as they listened to English sentences containing a target word while looking at displays containing four objects. On target-present trials, the visual referent depicting the target word was present, along with three unrelated distractors. On target-absent trials, the target object (e.g., wizard) was absent. Instead, the display contained an English competitor, overlapping with the English target in phonological onset (e.g., window), a Dutch competitor, overlapping with the English target in phonological onset (e.g., wimpel, pennant), and two unrelated distractors. Half of the sentences was masked by speech-shaped noise; the other half was presented in quiet. Compared to speech in quiet, noise delayed fixations to the target objects on target-present trials. For target-absent trials, we observed that the likelihood for fixation biases towards the English and Dutch onset competitors (over the unrelated distractors) was larger in noise than in quiet. Our data thus show that the presence of background noise increases lexical competition in the task-relevant non-native (English) and in the task-irrelevant native (Dutch) language. The latter reflects stronger interference of one's native language during non-native spoken-word recognition under adverse conditions.

Context and target recollection for words and pictures in young adults with developmental dyslexia

Introduction

The specificity of memory functioning in developmental dyslexia is well known and intensively studied. However, most research has been devoted to working memory, and many uncertain issues about episodic memory remain practically unexplored. Moreover, most studies have investigated memory in children and adolescents-much less research has been conducted on adults. The presented study explored the specificity of context and target memory functioning for verbal and nonverbal stimuli in young adults with developmental dyslexia.

Methods

The dual recollection theory, which distinguishes context recollection, target recollection, and familiarity as the processes underlying memory performance in the conjoint recognition paradigm, was adopted as the theoretical basis for the analysis of memory processes. The employed measurement model, a multinomial processing tree model, allowed us to assess the individual contributions of the basic memory processes to memory task performance.

Results

The research sample consisted of 82 young adults (41 with diagnosed dyslexia). The results showed significant differences in both verbal and nonverbal memory and context and target recollection between the dyslexic and the typically developing groups. These differences are not global; they only involve specific memory processes.

Discussion

In line with previous studies using multinomial modeling, this shows that memory functioning in dyslexia cannot be characterized as a simple impairment but is a much more complex phenomenon that includes compensatory mechanisms. Implications of the findings and possible limitations are discussed, pointing to the need for further investigation of the relationship between context memory functioning and developmental dyslexia, taking into account the type of material being processed.

Distinguishing semantic control and phonological control and their role in aphasic deficits: A task switching investigation

People use cognitive control across many contexts in daily life, yet it remains unclear how cognitive control is used in contexts involving language. Distinguishing language-specific cognitive control components may be critical to understanding aphasia, which can co-occur with cognitive control deficits. For example, deficits in control of semantic representations (i.e., semantic control), are thought to contribute to semantic deficits in aphasia. Conversely, little is known about control of phonological representations (i.e., phonological control) in aphasia. We developed a switching task to investigate semantic and phonological control in 32 left hemisphere stroke survivors with aphasia and 37 matched controls. We found that phonological and semantic control were related, but dissociate in the presence of switching demands. People with aphasia exhibited group-wise impairment at phonological control, although individual impairments were subtle except in one case. Several individuals with aphasia exhibited frank semantic control impairments, and these individuals had relative deficits on other semantic tasks. The present findings distinguish semantic control from phonological control, and confirm that semantic control impairments contribute to semantic deficits in aphasia.

Is semantic processing impaired near the hands?

In a sentence decision task, Davoli et al. (2010) found that the semantic analysis of sentences differed depending on whether the participants' hands were close to or far from the computer screen. According to the authors, the findings reflected an impoverishment of semantic processing near the hands. In the current study, we examine this explanation by asking whether hand position affects 1) other aspects of sentence processing, such as syntactic analysis, 2) semantic processing at the individual word level, and 3) performance in a picture naming task that requires access to meaning. In Experiment 1, participants judged the acceptability of sentences, half of which included semantic or syntactic violations. In Experiment 2, only semantically acceptable or nonacceptable sentences were presented. In Experiment 3, participants performed a go/nogo semantic categorization task on individual words. In Experiment 4, participants performed a picture naming task. Participants performed these tasks both with their hands near to and far from the computer screen. Regardless of the task, we found no evidence of impoverished semantic processing near the hands.

A behavioural dataset for studying individual differences in language skills

This resource contains data from 112 Dutch adults (18-29 years of age) who completed the Individual Differences in Language Skills test battery that included 33 behavioural tests assessing language skills and domain-general cognitive skills likely involved in language tasks. The battery included tests measuring linguistic experience (e.g. vocabulary size, prescriptive grammar knowledge), general cognitive skills (e.g. working memory, non-verbal intelligence) and linguistic processing skills (word production/comprehension, sentence production/comprehension). Testing was done in a lab-based setting resulting in high quality data due to tight monitoring of the experimental protocol and to the use of software and hardware that were optimized for behavioural testing. Each participant completed the battery twice (i.e., two test days of four hours each). We provide the raw data from all tests on both days as well as pre-processed data that were used to calculate various reliability measures (including internal consistency and test-retest reliability). We encourage other researchers to use this resource for conducting exploratory and/or targeted analyses of individual differences in language and general cognitive skills.

Levels-of-processing effects on context and target recollection for words and pictures

The effects of levels of processing (LoP) on memory performance have been extensively studied in cognitive psychology for about half a century. The initial observation of superior memory for words studied under a semantic orienting task rather than a perceptual orienting task elicited a theoretical debate about the underlying mechanisms of this effect. Next, research on LoP effects was extended to pictorial stimuli and connected with analyses of recollection and familiarity processes of recognition memory. The main aim of the current study was to explore the effects of LoP on two distinct components of recollection memory: context recollection, and target recollection-processes recently differentiated in dual-recollection theory. Verbal and pictorial materials were used in several experiments and the participants were asked to remember the study context defined by the kind of orienting task performed. LoP effects were confirmed for context and target recollection when words were used as stimuli. However, reversed LoP effects for context recollection were found in experiments using pictures as the to-be-remembered material. The function of the distinctiveness of pictorial material and the role of the effortfulness of cognitive operations for recollection were analysed and discussed from the perspective of the sensory-semantic model and the source monitoring framework.

Activating Semantic Knowledge During Spoken Words and Environmental Sounds: Evidence From the Visual World Paradigm

Two visual world experiments investigated the activation of semantically related concepts during the processing of environmental sounds and spoken words. Participants heard environmental sounds such as barking or spoken words such as "puppy" while viewing visual arrays with objects such as a bone (semantically related competitor) and candle (unrelated distractor). In Experiment 1, a puppy (target) was also included in the visual array; in Experiment 2, it was not. During both types of auditory stimuli, competitors were fixated significantly more than distractors, supporting the coactivation of semantically related concepts in both cases; comparisons of the two types of auditory stimuli also revealed significantly larger effects with environmental sounds than spoken words. We discuss implications of these results for theories of semantic knowledge.

Visual context constrains language-mediated anticipatory eye movements

Contemporary accounts of anticipatory language processing assume that individuals predict upcoming information at multiple levels of representation. Research investigating language-mediated anticipatory eye gaze typically assumes that linguistic input restricts the domain of subsequent reference (visual target objects). Here, we explored the converse case: Can visual input restrict the dynamics of anticipatory language processing? To this end, we recorded participants' eye movements as they listened to sentences in which an object was predictable based on the verb's selectional restrictions ("The man peels a banana"). While listening, participants looked at different types of displays: the target object (banana) was either present or it was absent. On target-absent trials, the displays featured objects that had a similar visual shape as the target object (canoe) or objects that were semantically related to the concepts invoked by the target (monkey). Each trial was presented in a long preview version, where participants saw the displays for approximately 1.78 s before the verb was heard (pre-verb condition), and a short preview version, where participants saw the display approximately 1 s after the verb had been heard (post-verb condition), 750 ms prior to the spoken target onset. Participants anticipated the target objects in both conditions. Importantly, robust evidence for predictive looks to objects related to the (absent) target objects in visual shape and semantics was found in the post-verb but not in the pre-verb condition. These results suggest that visual information can restrict language-mediated anticipatory gaze and delineate theoretical accounts of predictive processing in the visual world.

Extrafoveal attentional capture by object semantics

There is ongoing debate on whether object meaning can be processed outside foveal vision, making semantics available for attentional guidance. Much of the debate has centred on whether objects that do not fit within an overall scene draw attention, in complex displays that are often difficult to control. Here, we revisited the question by reanalysing data from three experiments that used displays consisting of standalone objects from a carefully controlled stimulus set. Observers searched for a target object, as per auditory instruction. On the critical trials, the displays contained no target but objects that were semantically related to the target, visually related, or unrelated. Analyses using (generalized) linear mixed-effects models showed that, although visually related objects attracted most attention, semantically related objects were also fixated earlier in time than unrelated objects. Moreover, semantic matches affected the very first saccade in the display. The amplitudes of saccades that first entered semantically related objects were larger than 5° on average, confirming that object semantics is available outside foveal vision. Finally, there was no semantic capture of attention for the same objects when observers did not actively look for the target, confirming that it was not stimulus-driven. We discuss the implications for existing models of visual cognition.

Are visual processes causally involved in "perceptual simulation" effects in the sentence-picture verification task?

Many studies have shown that sentences implying an object to have a certain shape produce a robust reaction time advantage for shape-matching pictures in the sentence-picture verification task. Typically, this finding has been interpreted as evidence for perceptual simulation, i.e., that access to implicit shape information involves the activation of modality-specific visual processes. It follows from this proposal that disrupting visual processing during sentence comprehension should interfere with perceptual simulation and obliterate the match effect. Here we directly test this hypothesis. Participants listened to sentences while seeing either visual noise that was previously shown to strongly interfere with basic visual processing or a blank screen. Experiments 1 and 2 replicated the match effect but crucially visual noise did not modulate it. When an interference technique was used that targeted high-level semantic processing (Experiment 3) however the match effect vanished. Visual noise specifically targeting high-level visual processes (Experiment 4) only had a minimal effect on the match effect. We conclude that the shape match effect in the sentence-picture verification paradigm is unlikely to rely on perceptual simulation.

The shape of things to come in speech production: Visual form interference during lexical access

Naming a picture is slower in categorically related compared with unrelated contexts, an effect termed semantic interference. This effect has informed the development of all contemporary models of lexical access in speech production. However, category members typically share visual features, so semantic interference might in part reflect this confound. Surprisingly, little work has addressed this issue, and the relative absence of evidence for visual form interference has been proposed to be problematic for production models implementing competitive lexical selection mechanisms. In a series of five experiments using two different naming paradigms, we demonstrate a reliable visual form interference effect in the absence of a category relation and show the effect is more likely to originate during lexical or later response selection than during perceptual/conceptual processing. We conclude visual form interference in naming is a significant complicating factor for studies of semantic interference effects and discuss the implications for current accounts of lexical access in spoken word production.