Support for lateralization of the Whorf effect beyond the realm of color discrimination

The Flickr frequency norms: What 17 years of images tagged online tell us about lexical processing

Word frequency is one of the best predictors of language processing. Typically, word frequency norms are entirely based on natural-language text data, thus representing what the literature typically refers to as purely linguistic experience. This study presents Flickr frequency norms as a novel word frequency measure from a domain-specific corpus inherently tied to extra-linguistic information: words used as image tags on social media. To obtain Flickr frequency measures, we exploited the photo-sharing platform Flickr Image (containing billions of photos) and extracted the number of uploaded images tagged with each of the words considered in the lexicon. Here, we systematically examine the peculiarities of Flickr frequency norms and show that Flickr frequency is a hybrid metrics, lying at the intersection between language and visual experience and with specific biases induced by being based on image-focused social media. Moreover, regression analyses indicate that Flickr frequency captures additional information beyond what is already encoded in existing norms of linguistic, sensorimotor, and affective experience. Therefore, these new norms capture aspects of language usage that are missing from traditional frequency measures: a portion of language usage capturing the interplay between language and vision, which - this study demonstrates - has its own impact on word processing. The Flickr frequency norms are openly available on the Open Science Framework (https://osf.io/2zfs3/).

Colour perception changes with basic colour word comprehension

Recent work has investigated the origin of infant colour categories, showing pre-linguistic infants categorise colour even in the absence of colour words. These infant categories are similar but not identical to adult categories, giving rise to an important question about how infant colour perception changes with the learning of colour words. Here we present two novel paradigms in which 12- and 19-month-old participants learning English as their first language were assessed on their perception of colour, while data on their colour word comprehension were also collected. Results indicate that participants' perception of colours close to the colour category boundaries dramatically change after colour word learning. The results highlight the shift made from infant colour categories to adult-like linguistically mediated colour categories that accompanies colour word learning. RESEARCH HIGHLIGHTS: We aimed to test whether colour perception is linguistically mediated in infants. We used novel eye-tracking and pupillometry paradigms to test infant colour perception either side of learning colour words. Infants' discrimination of colour changes after learning colour words, suggesting a shift due to colour word learning. A shift from pre-linguistic colour representation to linguistically mediated colour representation is discussed.

Invariant categorical color regions across illuminant change coincide with focal colors

Are there regions in a color space where color categories are invariant across illuminant changes? If so, what characteristics make them more stable than other regions? To address these questions, we asked observers to give a color name to 424 colored surfaces, presented one at a time, under various chromatic illuminants. Results showed a high degree of categorical color constancy, especially under illuminants that occur in the natural environment. It was also shown that surfaces selected as a focal color (the best example of a color category) are more resistant to illuminant change than nonfocal color samples. We additionally ran an asymmetric color matching experiment to quantify the shift of color appearance induced by illuminant changes using surfaces that were all named gray, thereby disentangling the appearance-based color constancy from the categorical color constancy (which are often confounded). Results suggested that the appearance of color samples largely shifted owing to illuminant changes, even though all samples were named gray; showing that the constancy of a color category is substantially more robust than the constancy of color appearance.

Colour Categorization and its Effect on Perception: A Conceptual Replication

The presented study examines the question of colour categorization in relation to the hypothesis of linguistic relativity. The study is based on research conducted by Gilbert et al. (2006) and their claim that linguistic colour categorization in a particular language helps colour recognition and speeds the process of colour discrimination for colours from different linguistic categories but only for the right visual field. Our study approached the research question differently. We used the same methodology as Gilbert's team et al. (2006), but we used different colour categories in the Czech language and significantly enlarged the number of participants to 106 undergraduate psychology students. Our results show that the fastest reaction times were in trials when the target was located in the left visual field, quite opposite from the Gilbert's et al. (2006) study. We argue that this finding is based on different processes than simple colour linguistic categorisation and attentional processes actually play an important role in the task.

The foreign language effects on strategic behavior games

The present study examined foreign language effects on the decisions made in a series of strategic behavioral games (e.g., the Prisoner's Dilemma, the Oligopolistic Competition, and the Volunteer's Dilemma). We recruited 154 native Chinese-speaking university students, with English as their second language, as participants. They were asked to make decisions while playing four simple behavioral games in either Chinese or English language version and to complete a Language History Questionnaire. The results showed that 1) the participants in each language group performed differently in the Prisoner's Dilemma Game and in one condition of the Volunteer's Dilemma Game which involved a relatively high level of uncertainty; and 2) foreign language proficiency, frequency of application and cultural identity triggered by the corresponding foreign language moderated the foreign language effects. This pattern of results is consistent with the Cultural Accommodation Hypothesis and the risk-aversion preference to use one's native language.

Verbal interference paradigms: A systematic review investigating the role of language in cognition

This paper presents a systematic review of the empirical literature that uses dual-task interference methods for investigating the on-line involvement of language in various cognitive tasks. In these studies, participants perform some primary task X putatively recruiting linguistic resources while also engaging in a secondary, concurrent task. If performance on the primary task decreases under interference, there is evidence for language involvement in the primary task. We assessed studies (N = 101) reporting at least one experiment with verbal interference and at least one control task (either primary or secondary). We excluded papers with an explicitly clinical, neurological, or developmental focus. The primary tasks identified include categorization, memory, mental arithmetic, motor control, reasoning (verbal and visuospatial), task switching, theory of mind, visual change, and visuospatial integration and wayfinding. Overall, the present review found that covert language is likely to play a facilitative role in memory and categorization when items to be remembered or categorized have readily available labels, when inner speech can act as a form of behavioral self-cuing (inhibitory control, task set reminders, verbal strategy), and when inner speech is plausibly useful as "workspace," for example, for mental arithmetic. There is less evidence for the role of covert language in cross-modal integration, reasoning relying on a high degree of visual detail or items low on nameability, and theory of mind. We discuss potential pitfalls and suggestions for streamlining and improving the methodology.

¡Hola! Nice to Meet You: Language Mixing and Biographical Information Processing

In bilingual communities, social interactions take place in both single- and mixed-language contexts. Some of the information shared in multilingual conversations, such as interlocutors' personal information, is often required in consequent social encounters. In this study, we explored whether the autobiographical information provided in a single-language context is better remembered than in an equivalent mixed-language situation. More than 400 Basque-Spanish bilingual (pre) teenagers were presented with new persons who introduced themselves by either using only Spanish or only Basque, or by inter-sententially mixing both languages. Different memory measures were collected immediately after the initial exposure to the new pieces of information (immediate recall and recognition) and on the day after (delayed recall and recognition). In none of the time points was the information provided in a mixed-language fashion worse remembered than that provided in a strict one-language context. Interestingly, the variability across participants in their sociodemographic and linguistic variables had a negligible impact on the effects. These results are discussed considering their social and educational implications for bilingual communities.

Motives and Laterality: Exploring the Links

Objectives

We explored associations between the needs for power, achievement, and affiliation and functional cerebral asymmetries (FCAs), guided by three established hypotheses about the nature of these associations.

Methods

One-hundred-and-seven participants completed picture-story measures of dispositional motives and activity inhibition (AI), a frequent moderator of motive-behavior associations, tasks measuring FCAs (line bisection, chimeric emotional face judgments, turning bias, perceptual and response asymmetries on the Poffenberger task), self-reported laterality preferences (handedness, footedness, ear and eye preference), and interhemispheric interaction (crossed-uncrossed difference). They also completed an experiment manipulating hand contractions (left, right, both, neither) while they worked on a second picture-story motive measure.

Results

Dispositional power motivation was associated with stronger rightward asymmetry and less interhemispheric transfer in high-AI and stronger leftward asymmetry and more interhemispheric transfer in low-AI individuals. For the affiliation motive, findings were fewer and in the opposite direction of those for the power motive. These findings emerged for men, but not for women. Left- or right-hand contractions led to increases in power and achievement motivation, but not affiliation motivation. Only left-hand contractions led to decreased AI.

Conclusions

We discuss these findings in the context of sex-dimorphic organizing and activating effects of steroids on motives and laterality.

Visual perspective-taking and image-like representations: We don't see it

The ability to represent another agent's visual perspective has recently been attributed to a process called "perceptual simulation", whereby we generate an image-like or "quasi-perceptual" representation of another agent's vision. In an extensive series of experiments we tested this notion. Adult observers were presented with pictures of an agent looking at two horizontal lines, one of which was closer to the agent and hence appeared longer from his/her visual perspective. In each case approximately as many participants judged the closer line to appear shorter as longer (to the agent), i.e., failures to take the agent's perspective. This occurred when clear depth cues were added to emphasise the agent's location relative to the stimuli, when the agent was moved closer to the lines, when the lines were oriented vertically, when judgments could be made while viewing the image, and when participants imagined themselves in the agent's place. It also persisted when we asked participants to imagine what a photo taken from the same location as the agent would show, ruling out a misinterpretation of the instructions. Overall, our data suggest that adults attempt to solve visual perspective-taking problems by drawing upon naïve and often erroneous ideas about how vision works.

Associative and Identity Words Promote the Speed of Visual Categorization: A Hierarchical Drift Diffusion Account

Words can either boost or hinder the processing of visual information, which can lead to facilitation or interference of the behavioral response. We investigated the stage (response execution or target processing) of verbal interference/facilitation in the response priming paradigm with a gender categorization task. Participants in our study were asked to judge whether the presented stimulus was a female or male face that was briefly preceded by a gender word either congruent (prime: "man," target: "man"), incongruent (prime: "woman," target: "man") or neutral (prime: "day," target: "man") with respect to the face stimulus. We investigated whether related word-picture pairs resulted in faster reaction times in comparison to the neutral word-picture pairs (facilitation) and whether unrelated word-picture pairs resulted in slower reaction times in comparison to neutral word-picture pairs (interference). We further examined whether these effects (if any) map onto response conflict or aspects of target processing. In addition, identity ("man," "woman") and associative ("tie," "dress") primes were introduced to investigate the cognitive mechanisms of semantic and Stroop-like effects in response priming (introduced respectively by associations and identity words). We analyzed responses and reaction times using the drift diffusion model to examine the effect of facilitation and/or interference as a function of the prime type. We found that regardless of prime type words introduce a facilitatory effect, which maps to the processes of visual attention and response execution.

Grammatical gender and linguistic relativity: A systematic review

Many languages assign nouns to a grammatical gender class, such that "bed" might be assigned masculine gender in one language (e.g., Italian) but feminine gender in another (e.g., Spanish). In the context of research assessing the potential for language to influence thought (the linguistic relativity hypothesis), a number of scholars have investigated whether grammatical gender assignment "rubs off" on concepts themselves, such that Italian speakers might conceptualize beds as more masculine than Spanish speakers do. We systematically reviewed 43 pieces of empirical research examining grammatical gender and thought, which together tested 5,895 participants. We classified the findings in terms of their support for this hypothesis and assessed the results against parameters previously identified as potentially influencing outcomes. Overall, we found that support was strongly task- and context-dependent, and rested heavily on outcomes that have clear and equally viable alternative explanations. We also argue that it remains unclear whether grammatical gender is in fact a useful tool for investigating relativity.

Is Language Required to Represent Others' Mental States? Evidence From Beliefs and Other Representations

An important part of our Theory of Mind-the ability to reason about other people's unobservable mental states-is the ability to attribute false beliefs to others. We investigated whether processing these false beliefs, as well as similar but nonmental representations, is reliant on language. Participants watched videos in which a protagonist hides a gift and either takes a photo of it or writes a text about its location before a second person inadvertently moves the present to a different location, thereby rendering the belief and either the photo or text false. At the same time, participants performed either a concurrent verbal interference task (rehearsing strings of digits) or a visual interference task (remembering a visual pattern). Results showed that performance on false belief trials did not decline under verbal interference relative to visual interference. We interpret these findings as further support for the view that language does not form an essential part of the process of reasoning online ("in the moment") about false beliefs.

Effects of meaningfulness on perception: Alpha-band oscillations carry perceptual expectations and influence early visual responses

Perceptual experience results from a complex interplay of bottom-up input and prior knowledge about the world, yet the extent to which knowledge affects perception, the neural mechanisms underlying these effects, and the stages of processing at which these two sources of information converge, are still unclear. In several experiments we show that language, in the form of verbal labels, both aids recognition of ambiguous “Mooney” images and improves objective visual discrimination performance in a match/non-match task. We then used electroencephalography (EEG) to better understand the mechanisms of this effect. The improved discrimination of images previously labeled was accompanied by a larger occipital-parietal P1 evoked response to the meaningful versus meaningless target stimuli. Time-frequency analysis of the interval between the cue and the target stimulus revealed increases in the power of posterior alpha-band (8–14 Hz) oscillations when the meaning of the stimuli to be compared was trained. The magnitude of the pre-target alpha difference and the P1 amplitude difference were positively correlated across individuals. These results suggest that prior knowledge prepares the brain for upcoming perception via the modulation of alpha-band oscillations, and that this preparatory state influences early (~120 ms) stages of visual processing.

Newly learned categories induce pre-attentive categorical perception of faces

Face perception is modulated by categorical information in faces, which is known as categorical perception (CP) of faces. However, it remains unknown whether CP of faces is humans’ inborn capability or the result of acquired categories. Here, we examined whether and when newly learned categories affect face perception. A short-term training method was employed in which participants learned new categories of face stimuli. Behaviorally, using an AB-X discrimination task, we found that the discrimination accuracy of face pairs from different learned categories was significantly higher than that of faces from the same category. Neurally, using a visual oddball task, we found that deviant stimuli whose category differed from standard stimuli evoked a larger N170. Importantly, the visual mismatch negativity (vMMN), starting from 140 ms after stimuli onset, was stronger with the between-category deviants than with the within-category deviants under the unattended condition. Altogether, our study provides empirical evidence indicating that CP of faces could be induced by newly learned categories, and this effect occurs automatically during an early stage of processing.

One Label or Two? Linguistic Influences on the Similarity Judgment of Objects between English and Japanese Speakers

Recent findings have re-examined the linguistic influence on cognition and perception, while identifying evidence that supports the Whorfian hypothesis. We examine how English and Japanese speakers perceive similarity of pairs of objects, by using two sets of stimuli: one in which two distinct linguistic categories apply to respective object images in English, but only one linguistic category applies in Japanese; and another in which two distinct linguistic categories apply to respective object images in Japanese, but only one applies in English. We conducted four studies and tested different groups of participants in each of them. In Study 1, we asked participants to name the two objects before engaging in the similarity judgment task. Here, we expected a strong linguistic effect. In Study 2, we asked participants to engage in the same task without naming, where we assumed that the condition is close enough to our daily visual information processing where language is not necessarily prompted. We further explored whether the language still influences the similarity perception by asking participants to engage in the same task basing on the visual similarity (Study 3) and the functional similarity (Study 4). The results overall indicated that English and Japanese speakers perceived the two objects to be more similar when they were in the same linguistic categories than when they were in different linguistic categories in their respective languages. Implications for research testing the Whorfian hypothesis and the requirement for methodological development beyond behavioral measures are discussed.

Cooperating or competing in three languages: cultural accommodation or alienation?

Purpose

The purpose of this paper is to study the effect of using foreign languages on cooperative behavior in a prisoner’s dilemma setting. The cultural accommodation hypothesis suggests that people are less cooperative in English, associated with the Anglophone cultural cluster, than in French, which is – as is Belgium – associated with the more cooperative Latin European cultural cluster.

Design/methodology/approach

Choices are framed as pricing strategies in the context of duopolistic competition. In total, 422 Flemish-Belgium participants with English and French as foreign and Dutch as their native language played in one of three language treatments.

Findings

While the authors observe differences between the native and both foreign languages, which are moderated by gender, the authors do not find any difference in effects between the two foreign languages that are associated with different cultures. Extending cultural accommodation arguments, the data suggests an effect specific to the use of the two selected foreign languages.

Originality/value

The authors contribute to this literature by reporting an experimental test of cultural accommodation and alienation effects related to two foreign languages. The authors explore novel arguments, related to cognitive psychology and gender effects.

Cross-Cultural Analysis of Prototypicality Norms Used by Male and Female Persian and American Speakers

Human beings generally cut the realities of the world in various ways in order to express their thoughts and interact with other people. Naturally, words are linguistic categories which carry the intended concepts; however, humans tend to economize by bundling words into different conceptual classes. Accordingly, the present study sought to explore the prototypicality norms used by male and female Persian and American speakers adopting a cross cultural analysis. For this purpose, from the existing prototypes, four conceptual categories; namely, vehicles, vegetables, furniture, and clothes were randomly selected and used as the tertium comparationis for determining the way 120 male and female monolingual American and Persian speakers, sixty from each language, ranked the category membership of different conceptual members belonging to the targeted prototypes. The analysis of the obtained data based on participants' ranking of the prototypes along with the respective frequency values revealed that gender and culture played a significant role in identifying the category membership of various members of a given concept across different languages. The findings can have important implications for language teachers, material designers, and second language students since culture is an overriding factor in language learning.

Categorical Perception Beyond the Basic Level: The Case of Warm and Cool Colors

Categories can affect our perception of the world, rendering between-category differences more salient than within-category ones. Across many studies, such categorical perception (CP) has been observed for the basic-level categories of one's native language. Other research points to categorical distinctions beyond the basic level, but it does not demonstrate CP for such distinctions. Here we provide such a demonstration. Specifically, we show CP in English speakers for the non-basic distinction between "warm" and "cool" colors, claimed to represent the earliest stage of color lexicon evolution. Notably, the advantage for discriminating colors that straddle the warm-cool boundary was restricted to the right visual field-the same behavioral signature previously observed for basic-level categories. This pattern held in a replication experiment with increased power. Our findings show that categorical distinctions beyond the basic-level repertoire of one's native language are psychologically salient and may be spontaneously accessed during normal perceptual processing.

Chromatic Perceptual Learning but No Category Effects without Linguistic Input

Perceptual learning involves an improvement in perceptual judgment with practice, which is often specific to stimulus or task factors. Perceptual learning has been shown on a range of visual tasks but very little research has explored chromatic perceptual learning. Here, we use two low level perceptual threshold tasks and a supra-threshold target detection task to assess chromatic perceptual learning and category effects. Experiment 1 investigates whether chromatic thresholds reduce as a result of training and at what level of analysis learning effects occur. Experiment 2 explores the effect of category training on chromatic thresholds, whether training of this nature is category specific and whether it can induce categorical responding. Experiment 3 investigates the effect of category training on a higher level, lateralized target detection task, previously found to be sensitive to category effects. The findings indicate that performance on a perceptual threshold task improves following training but improvements do not transfer across retinal location or hue. Therefore, chromatic perceptual learning is category specific and can occur at relatively early stages of visual analysis. Additionally, category training does not induce category effects on a low level perceptual threshold task, as indicated by comparable discrimination thresholds at the newly learned hue boundary and adjacent test points. However, category training does induce emerging category effects on a supra-threshold target detection task. Whilst chromatic perceptual learning is possible, learnt category effects appear to be a product of left hemisphere processing, and may require the input of higher level linguistic coding processes in order to manifest.

The behavioral and neural effects of language on motion perception

Perception does not function as an isolated module but is tightly linked with other cognitive functions. Several studies have demonstrated an influence of language on motion perception, but it remains debated at which level of processing this modulation takes place. Some studies argue for an interaction in perceptual areas, but it is also possible that the interaction is mediated by "language areas" that integrate linguistic and visual information. Here, we investigated whether language-perception interactions were specific to the language-dominant left hemisphere by comparing the effects of language on visual material presented in the right (RVF) and left visual fields (LVF). Furthermore, we determined the neural locus of the interaction using fMRI. Participants performed a visual motion detection task. On each trial, the visual motion stimulus was presented in either the LVF or in the RVF, preceded by a centrally presented word (e.g., "rise"). The word could be congruent, incongruent, or neutral with regard to the direction of the visual motion stimulus that was presented subsequently. Participants were faster and more accurate when the direction implied by the motion word was congruent with the direction of the visual motion stimulus. Interestingly, the speed benefit was present only for motion stimuli that were presented in the RVF. We observed a neural counterpart of the behavioral facilitation effects in the left middle temporal gyrus, an area involved in semantic processing of verbal material. Together, our results suggest that semantic information about motion retrieved in language regions may automatically modulate perceptual decisions about motion.

Words Jump-Start Vision: A Label Advantage in Object Recognition

People use language to shape each other's behavior in highly flexible ways. Effects of language are often assumed to be "high-level" in that, whereas language clearly influences reasoning, decision making, and memory, it does not influence low-level visual processes. Here, we test the prediction that words are able to provide top-down guidance at the very earliest stages of visual processing by acting as powerful categorical cues. We investigated whether visual processing of images of familiar animals and artifacts was enhanced after hearing their name (e.g., "dog") compared with hearing an equally familiar and unambiguous nonverbal sound (e.g., a dog bark) in 14 English monolingual speakers. Because the relationship between words and their referents is categorical, we expected words to deploy more effective categorical templates, allowing for more rapid visual recognition. By recording EEGs, we were able to determine whether this label advantage stemmed from changes to early visual processing or later semantic decision processes. The results showed that hearing a word affected early visual processes and that this modulation was specific to the named category. An analysis of ERPs showed that the P1 was larger when people were cued by labels compared with equally informative nonverbal cues-an enhancement occurring within 100 ms of image onset, which also predicted behavioral responses occurring almost 500 ms later. Hearing labels modulated the P1 such that it distinguished between target and nontarget images, showing that words rapidly guide early visual processing.

Hemispheric asymmetry in the influence of language on visual perception

Many studies have shown that language can affect visual perception; however, our understanding of the neural basis of linguistic influence is inadequate. This can be investigated by examining the hemispheric asymmetry of linguistic influence. The left and right hemispheres are dominant in close and distant semantic processing, respectively. In this study, we investigated whether the hemispheric asymmetry of semantic processing led to hemispheric asymmetry for concept priming on the detection of objects degraded by continuous flash suppression. We combined a priming paradigm with the divided visual field paradigm and used continuous flash suppression, which renders objects invisible. The results indicated that the hemispheric asymmetry of semantic processing led to a right lateralization in the influence of more abstract concepts on visual perception. The lateralization of brain connectomes may be the underlying neural basis of this effect.

Is the left hemisphere androcentric? Evidence of the learned categorical perception of gender

Effects of language learning on categorical perception have been detected in multiple domains. We extended the methods of these studies to gender and pitted the predictions of androcentrism theory and the spatial agency bias against each other. Androcentrism is the tendency to take men as the default gender and is socialized through language learning. The spatial agency bias is a tendency to imagine men before women in the left-right axis in the direction of one's written language. We examined how gender-ambiguous faces were categorized as female or male when presented in the left visual fields (LVFs) and right visual fields (RVFs) to 42 native speakers of English. When stimuli were presented in the RVF rather than the LVF, participants (1) applied a lower threshold to categorize stimuli as male and (2) categorized clearly male faces as male more quickly. Both findings support androcentrism theory suggesting that the left hemisphere, which is specialized for language, processes face stimuli as male-by-default more readily than the right hemisphere. Neither finding evidences an effect of writing direction predicted by the spatial agency bias on the categorization of gender-ambiguous faces.

Foundations of children's numerical and mathematical skills: the roles of symbolic and nonsymbolic representations of numerical magnitude

Numerical and mathematical skills are critical predictors of academic success. The last three decades have seen a substantial growth in our understanding of how the human mind and brain represent and process numbers. In particular, research has shown that we share with animals the ability to represent numerical magnitude (the total number of items in a set) and that preverbal infants can process numerical magnitude. Further research has shown that similar processing signatures characterize numerical magnitude processing across species and developmental time. These findings suggest that an approximate system for nonsymbolic (e.g., dot arrays) numerical magnitude representation serves as the basis for the acquisition of cultural, symbolic (e.g., Arabic numerals) representations of numerical magnitude. This chapter explores this hypothesis by reviewing studies that have examined the relation between individual differences in nonsymbolic numerical magnitude processing and symbolic math abilities (e.g., arithmetic). Furthermore, we examine the extent to which the available literature provides strong evidence for a link between symbolic and nonsymbolic representations of numerical magnitude at the behavioral and neural levels of analysis. We conclude that claims that symbolic number abilities are grounded in the approximate system for the nonsymbolic representation of numerical magnitude are not strongly supported by the available evidence. Alternative models and future research directions are discussed.

Does the semantic content of verbal categories influence categorical perception? An ERP study

Accumulating evidence suggests that visual perception and, in particular, visual discrimination, can be influenced by verbal category boundaries. One issue that still awaits systematic investigation is the specific influence of semantic contents of verbal categories on categorical perception (CP). We tackled this issue with a learning paradigm in which initially unfamiliar, yet realistic objects were associated with either bare labels lacking explicit semantic content or labels that were accompanied by enriched semantic information about the specific meaning of the label. Two to three days after learning, the EEG was recorded while participants performed a lateralized oddball task. Newly acquired verbal category boundaries modulated low-level aspects of visual perception as early as 100-150 ms after stimulus onset, suggesting a genuine influence of language on perception. Importantly, this effect was not further influenced by enriched semantic category information, suggesting that bare labels and the associated minimal and predominantly perceptual information are sufficient for CP. Distinct effects of semantic knowledge independent of category boundaries were found subsequently, starting at about 200 ms, possibly reflecting selective attention to semantically meaningful visual features.

Compound words prompt arbitrary semantic associations in conceptual memory

Linguistic relativity theory has received empirical support in domains such as color perception and object categorization. It is unknown, however, whether relations between words idiosyncratic to language impact non-verbal representations and conceptualizations. For instance, would one consider the concepts of horse and sea as related were it not for the existence of the compound seahorse? Here, we investigated such arbitrary conceptual relationships using a non-linguistic picture relatedness task in participants undergoing event-related brain potential recordings. Picture pairs arbitrarily related because of a compound and presented in the compound order elicited N400 amplitudes similar to unrelated pairs. Surprisingly, however, pictures presented in the reverse order (as in the sequence horse–sea) reduced N400 amplitudes significantly, demonstrating the existence of a link in memory between these two concepts otherwise unrelated. These results break new ground in the domain of linguistic relativity by revealing predicted semantic associations driven by lexical relations intrinsic to language.

Seeing Objects through the Language Glass

Recent streams of research support the Whorfian hypothesis according to which language affects one's perception of the world. However, studies of object categorization in different languages have heavily relied on behavioral measures that are fuzzy and inconsistent. Here, we provide the first electrophysiological evidence for unconscious effects of language terminology on object perception. Whereas English has two words for cup and mug, Spanish labels those two objects with the word “taza.” We tested native speakers of Spanish and English in an object detection task using a visual oddball paradigm, while measuring event-related brain potentials. The early deviant-related negativity elicited by deviant stimuli was greater in English than in Spanish participants. This effect, which relates to the existence of two labels in English versus one in Spanish, substantiates the neurophysiological evidence that language-specific terminology affects object categorization.

How does language change perception: a cautionary note

The relationship of language, perception, and action has been the focus of recent studies exploring the representation of conceptual knowledge. A substantial literature has emerged, providing ample demonstrations of the intimate relationship between language and perception. The appropriate characterization of these interactions remains an important challenge. Recent evidence involving visual search tasks has led to the hypothesis that top-down input from linguistic representations may sharpen visual feature detectors, suggesting a direct influence of language on early visual perception. We present two experiments to explore this hypothesis. Experiment 1 demonstrates that the benefits of linguistic priming in visual search may arise from a reduction in the demands on working memory. Experiment 2 presents a situation in which visual search performance is disrupted by the automatic activation of irrelevant linguistic representations, a result consistent with the idea that linguistic and sensory representations interact at a late, response-selection stage of processing. These results raise a cautionary note: While language can influence performance on a visual search, the influence need not arise from a change in perception per se.

Color categories and color appearance

We examined categorical effects in color appearance in two tasks, which in part differed in the extent to which color naming was explicitly required for the response. In one, we measured the effects of color differences on perceptual grouping for hues that spanned the blue-green boundary, to test whether chromatic differences across the boundary were perceptually exaggerated. This task did not require overt judgments of the perceived colors, and the tendency to group showed only a weak and inconsistent categorical bias. In a second case, we analyzed results from two prior studies of hue scaling of chromatic stimuli (De Valois, De Valois, Switkes, & Mahon, 1997; Malkoc, Kay, & Webster, 2005), to test whether color appearance changed more rapidly around the blue-green boundary. In this task observers directly judge the perceived color of the stimuli and these judgments tended to show much stronger categorical effects. The differences between these tasks could arise either because different signals mediate color grouping and color appearance, or because linguistic categories might differentially intrude on the response to color and/or on the perception of color. Our results suggest that the interaction between language and color processing may be highly dependent on the specific task and cognitive demands and strategies of the observer, and also highlight pronounced individual differences in the tendency to exhibit categorical responses.

Electrophysiological evidence for the left-lateralized effect of language on preattentive categorical perception of color

Previous studies have shown that the effect of language on categorical perception of color is stronger when stimuli are presented in the right visual field than in the left. To examine whether this lateralized effect occurs preattentively at an early stage of processing, we monitored the visual mismatch negativity, which is a component of the event-related potential of the brain to an unfamiliar stimulus among a temporally presented series of stimuli. In the oddball paradigm we used, the deviant stimuli were unrelated to the explicit task. A significant interaction between color-pair type (within-category vs. between-category) and visual field (left vs. right) was found. The amplitude of the visual mismatch negativity component evoked by the within-category deviant was significantly smaller than that evoked by the between-category deviant when displayed in the right visual field, but no such difference was observed for the left visual field. This result constitutes electroencephalographic evidence that the lateralized Whorf effect per se occurs out of awareness and at an early stage of processing.

Redundant spoken labels facilitate perception of multiple items

Because of the strong associations between verbal labels and the visual objects that they denote, hearing a word may quickly guide the deployment of visual attention to the named objects. We report six experiments in which we investigated the effect of hearing redundant (noninformative) object labels on the visual processing of multiple objects from the named category. Even though the word cues did not provide additional information to the participants, hearing a label resulted in faster detection of attention probes appearing near the objects denoted by the label. For example, hearing the word chair resulted in more effective visual processing of all of the chairs in a scene relative to trials in which the participants attended to the chairs without actually hearing the label. This facilitation was mediated by stimulus typicality. Transformations of the stimuli that disrupted their association with the label while preserving the low-level visual features eliminated the facilitative effect of the labels. In the final experiment, we show that hearing a label improves the accuracy of locating multiple items matching the label, even when eye movements are restricted. We posit that verbal labels dynamically modulate visual processing via top-down feedback--an instance of linguistic labels greasing the wheels of perception.

Newly trained lexical categories produce lateralized categorical perception of color

Linguistic categories have been shown to influence perceptual discrimination, to do so preferentially in the right visual field, to fail to do so when competing demands are made on verbal memory, and to vary with the color-term boundaries of different languages. However, because there are strong commonalities across languages in the placement of color-term boundaries, the question remains open whether observed categorical perception for color can be entirely a result of learned categories or may rely to some degree on innate ones. We show here that lateralized color categorical perception can be entirely the result of learned categories. In a visual search task, reaction times to targets were faster in the right than the left visual field when the target and distractor colors, initially sharing the same linguistic term (e.g., "blue"), became between-category colors after training (i.e., when two different shades of blue had each acquired a new name). A control group, whose conditions exactly matched those of the experimental group except that no new categories were introduced, did not show this effect, establishing that the effect was not dependent on increased familiarity with either the color stimuli or the task. The present results show beyond question that lateralized categorical perception of color can reflect strictly learned color categories, even artificially learned categories that violate both universal tendencies in color naming and the categorization pattern of the language of the subject.

Conceptual penetration of visual processing

In traditional hierarchical models of information processing, visual representations feed into conceptual systems, but conceptual categories do not exert an influence on visual processing. We provide evidence, across four experiments, that conceptual information can in fact penetrate early visual processing, rather than merely biasing the output of perceptual systems. Participants performed physical-identity judgments on visually equidistant pairs of letter stimuli that were either in the same conceptual category (Bb) or in different categories (Bp). In the case of nonidentical letters, response times were longer when the stimuli were from the same conceptual category, but only when the letters were presented sequentially. The differences in effect size between simultaneous and sequential trials rules out a decision-level account. An additional experiment using animal silhouettes replicated the major effects found with letters. Thus, performance on an explicitly visual task was influenced by conceptual categories. This effect depended on processing time, immediately preceding experience, and stimulus typicality, which suggests that it was produced by the direct influence of category knowledge on perception, rather than by a postperceptual decision bias.

Language regions of brain are operative in color perception

The effect of language on the categorical perception of color is stronger for stimuli in the right visual field (RVF) than in the left visual field, but the neural correlates of the behavioral RVF advantage are unknown. Here we present brain activation maps revealing how language is differentially engaged in the discrimination of colored stimuli presented in either visual hemifield. In a rapid, event-related functional MRI study, we measured subjects' brain activity while they performed a visual search task. Compared with colors from the same lexical category, discrimination of colors from different linguistic categories provoked stronger and faster responses in the left hemisphere language regions, particularly when the colors were presented in the RVF. In addition, activation of visual areas 2/3, responsible for color perception, was much stronger for RVF stimuli from different linguistic categories than for stimuli from the same linguistic category. Notably, the enhanced activity of visual areas 2/3 coincided with the enhanced activity of the left posterior temporoparietal language region, suggesting that this language region may serve as a top-down control source that modulates the activation of the visual cortex. These findings shed light on the brain mechanisms that underlie the hemifield- dependent effect of language on visual perception.

Lateralization of categorical perception of color changes with color term acquisition

Categorical perception (CP) of color is the faster and more accurate discrimination of two colors from different categories than two colors from the same category, even when same- and different-category chromatic separations are equated. In adults, color CP is lateralized to the left hemisphere (LH), whereas in infants, it is lateralized to the right hemisphere (RH). There is evidence that the LH bias in color CP in adults is due to the influence of color terms in the LH. Here we show that the RH to LH switch in color CP occurs when the words that distinguish the relevant category boundary are learned. A colored target was shown in either the left- or right-visual field on either the same- or different-category background, with equal hue separation for both conditions. The time to initiate an eye movement toward the target from central fixation at target onset was recorded. Color naming and comprehension was assessed. Toddlers were faster at detecting targets on different- than same-category backgrounds and the extent of CP did not vary with level of color term knowledge. However, for toddlers who knew the relevant color terms, the category effect was found only for targets in the RVF (LH), whereas for toddlers learning the color terms, the category effect was found only for targets in the LVF (RH). The findings suggest that lateralization of color CP changes with color term acquisition, and provide evidence for the influence of language on the functional organization of the brain.

Language affects patterns of brain activation associated with perceptual decision

Well over half a century ago, Benjamin Lee Whorf [Carroll JB (1956) Language, Thought, and Reality: Selected Writings of Benjamin Lee Whorf (MIT Press, Cambridge, MA)] proposed that language affects perception and thought and is used to segment nature, a hypothesis that has since been tested by linguistic and behavioral studies. Although clear Whorfian effects have been found, it has not yet been demonstrated that language influences brain activity associated with perception and/or immediate postperceptual processes (referred hereafter as "perceptual decision"). Here, by using functional magnetic resonance imaging, we show that brain regions mediating language processes participate in neural networks activated by perceptual decision. When subjects performed a perceptual discrimination task on easy-to-name and hard-to-name colored squares, largely overlapping cortical regions were identified, which included areas of the occipital cortex critical for color vision and regions in the bilateral frontal gyrus. Crucially, however, in comparison with hard-to-name colored squares, perceptual discrimination of easy-to-name colors evoked stronger activation in the left posterior superior temporal gyrus and inferior parietal lobule, two regions responsible for word-finding processes, as demonstrated by a localizer experiment that uses an explicit color patch naming task. This finding suggests that the language-processing areas of the brain are directly involved in visual perceptual decision, thus providing neuroimaging support for the Whorf hypothesis.