THE INFLUENCE OF CONCEPTUAL KNOWLEDGE ON VISUAL DISCRIMINATION

Processing of visual hapaxes in picture naming task: An event-related potential study

Object recognition and visual categorization are typically swift and seemingly effortless tasks that involve numerous underlying processes. In our investigation, we utilized a picture naming task to explore the processing of rarely encountered objects (visual hapaxes) in comparison to common objects. Our aim was to determine the stage at which these rare objects are classified as unnamable. Contrary to our expectations and in contrast to some prior research on event-related potentials (ERPs) with novel and atypical objects, no differences between conditions were observed in the late time windows corresponding to the P300 or N400 components. However, distinctive patterns between hapaxes and common objects surfaced in three early time windows, corresponding to the posterior N1 and P2 waves, as well as a widespread N2 wave. According to the ERP data, the differentiation between hapaxes and common objects occurs within the first 380 ms of the processing line, involving only limited and indirect top-down influence.

Mental simulation of colour properties during language comprehension: influence of context and comprehension stages

Many studies have shown that mental simulation may occur during language comprehension. Supporting evidence is derived from the matching effects in the sentence-picture verification (SPV) task often used to assess mental simulations of object properties, such as size, orientation, and shape. However, mixed results have been obtained regarding object colour, with researchers reporting matching or mismatching effects. This study investigated the impact of colour information clarity within sentences on the process of mental simulation during language comprehension. Employing the SPV task and using novel objects, we examined whether there is a mental simulation of colour after excluding typical/atypical colour bias and how varying levels of colour information clarity in sentences influence the emergence of matching effects at different stages of comprehension. To address these issues, we conducted two experiments. In Experiment 1, the participants read normal sentences and subsequently engaged in picture verification with a novel object after a 500 ms delay. In Experiment 2, the participants encountered sentences containing both clear and unclear colour information and, after either a 0 ms or 1500 ms interval, completed picture verification tasks with a novel object. Null effects were found in the 500 ms condition for normal sentences and the 0 ms condition for unclear colour information sentences. A mismatching effect appeared in the 0 ms condition after clear colour information sentences, and a matching effect appeared in the 1500 ms condition for all sentences. The results indicated that after excluding colour bias, the participants still formed mental simulations of colour during language comprehension. Our results also indicated that ongoing colour simulation with time pressure impacted the participant responses. The participants ignored unclear colour information under time pressure, but without time pressure, they constructed simulations that were as detailed as possible, regardless of whether the implicit colour information in the sentence was clear.

Differential effects of intrinsic properties of natural scenes and interference mechanisms on recognition processes in long-term visual memory

Humans display remarkable long-term visual memory (LTVM) processes. Even though images may be intrinsically memorable, the fidelity of their visual representations, and consequently the likelihood of successfully retrieving them, hinges on their similarity when concurrently held in LTVM. In this debate, it is still unclear whether intrinsic features of images (perceptual and semantic) may be mediated by mechanisms of interference generated at encoding, or during retrieval, and how these factors impinge on recognition processes. In the current study, participants (32) studied a stream of 120 natural scenes from 8 semantic categories, which varied in frequencies (4, 8, 16 or 32 exemplars per category) to generate different levels of category interference, in preparation for a recognition test. Then they were asked to indicate which of two images, presented side by side (i.e. two-alternative forced-choice), they remembered. The two images belonged to the same semantic category but varied in their perceptual similarity (similar or dissimilar). Participants also expressed their confidence (sure/not sure) about their recognition response, enabling us to tap into their metacognitive efficacy (meta-d'). Additionally, we extracted the activation of perceptual and semantic features in images (i.e. their informational richness) through deep neural network modelling and examined their impact on recognition processes. Corroborating previous literature, we found that category interference and perceptual similarity negatively impact recognition processes, as well as response times and metacognitive efficacy. Moreover, images semantically rich were less likely remembered, an effect that trumped a positive memorability boost coming from perceptual information. Critically, we did not observe any significant interaction between intrinsic features of images and interference generated either at encoding or during retrieval. All in all, our study calls for a more integrative understanding of the representational dynamics during encoding and recognition enabling us to form, maintain and access visual information.

Instant Effects of Semantic Information on Visual Perception

Does our perception of an object change once we discover what function it serves? We showed human participants (n = 48, 31 females and 17 males) pictures of unfamiliar objects either together with keywords matching their function, leading to semantically informed perception, or together with nonmatching keywords, resulting in uninformed perception. We measured event-related potentials to investigate at which stages in the visual processing hierarchy these two types of object perception differed from one another. We found that semantically informed compared with uninformed perception was associated with larger amplitudes in the N170 component (150-200 ms), reduced amplitudes in the N400 component (400-700 ms), and a late decrease in alpha/beta band power. When the same objects were presented once more without any information, the N400 and event-related power effects persisted, and we also observed enlarged amplitudes in the P1 component (100-150 ms) in response to objects for which semantically informed perception had taken place. Consistent with previous work, this suggests that obtaining semantic information about previously unfamiliar objects alters aspects of their lower-level visual perception (P1 component), higher-level visual perception (N170 component), and semantic processing (N400 component, event-related power). Our study is the first to show that such effects occur instantly after semantic information has been provided for the first time, without requiring extensive learning.SIGNIFICANCE STATEMENT There has been a long-standing debate about whether or not higher-level cognitive capacities, such as semantic knowledge, can influence lower-level perceptual processing in a top-down fashion. Here we could show, for the first time, that information about the function of previously unfamiliar objects immediately influences cortical processing within less than 200 ms. Of note, this influence does not require training or experience with the objects and related semantic information. Therefore, our study is the first to show effects of cognition on perception while ruling out the possibility that prior knowledge merely acts by preactivating or altering stored visual representations. Instead, this knowledge seems to alter perception online, thus providing a compelling case against the impenetrability of perception by cognition.

A Computational Model of Context-Dependent Encodings During Category Learning

Although current exemplar models of category learning are flexible and can capture how different features are emphasized for different categories, they still lack the flexibility to adapt to local changes in category learning, such as the effect of different sequences of study. In this paper, we introduce a new model of category learning, the Sequential Attention Theory Model (SAT-M), in which the encoding of each presented item is influenced not only by its category assignment (global context) as in other exemplar models, but also by how its properties relate to the properties of temporally neighboring items (local context). By fitting SAT-M to data from experiments comparing category learning with different sequences of trials (interleaved vs. blocked), we demonstrate that SAT-M captures the effect of local context and predicts when interleaved or blocked training will result in better testing performance across three different studies. Comparatively, ALCOVE, SUSTAIN, and a version of SAT-M without locally adaptive encoding provided poor fits to the results. Moreover, we evaluated the direct prediction of the model that different sequences of training change what learners encode and determined that the best-fit encoding parameter values match learners' looking times during training.

Use of superordinate labels yields more robust and human-like visual representations in convolutional neural networks

Human visual recognition is outstandingly robust. People can recognize thousands of object classes in the blink of an eye (50–200 ms) even when the objects vary in position, scale, viewpoint, and illumination. What aspects of human category learning facilitate the extraction of invariant visual features for object recognition? Here, we explore the possibility that a contributing factor to learning such robust visual representations may be a taxonomic hierarchy communicated in part by common labels to which people are exposed as part of natural language. We did this by manipulating the taxonomic level of labels (e.g., superordinate-level [mammal, fruit, vehicle] and basic-level [dog, banana, van]), and the order in which these training labels were used during learning by a Convolutional Neural Network. We found that training the model with hierarchical labels yields visual representations that are more robust to image transformations (e.g., position/scale, illumination, noise, and blur), especially when images were first trained with superordinate labels and then fine-tuned with basic labels. We also found that Superordinate-label followed by Basic-label training best predicts functional magnetic resonance imaging responses in visual cortex and behavioral similarity judgments recorded while viewing naturalistic images. The benefits of training with superordinate labels in the earlier stages of category learning is discussed in the context of representational efficiency and generalization.

Mutual Information and Categorical Perception

Categorical perception refers to the enhancement of perceptual sensitivity near category boundaries, generally along dimensions that are informative about category membership. However, it remains unclear exactly which dimensions are treated as informative and why. This article reports a series of experiments in which subjects were asked to learn statistically defined categories in a novel, unfamiliar 2D perceptual space of shapes. Perceptual discrimination was tested before and after category learning of various features in the space, each defined by its position and orientation relative to the maximally informative dimension. The results support a remarkably simple generalization: The magnitude of improvement in perceptual discrimination of each feature is proportional to the mutual information between the feature and the category variable. This finding suggests a rational basis for categorical perception in which the precision of perceptual discrimination is tuned to the statistical structure of the environment.

Interaction between image and text during the process of biblical art reception

In our exploratory study, we ask how naive observers, without a distinct religious background, approach biblical art that combines image and text. For this purpose, we choose the book ‘New biblical figures of the Old and New Testament’ published in 1569 as source of the stimuli. This book belongs to the genre of illustrated Bibles, which were very popular during the Reformation. Since there is no empirical knowledge regarding the interaction between image and text during the process of such biblical art reception, we selected four relevant images from the book and measured the eye movements of participants in order to characterize and quantify their scanning behavior related to such stimuli in terms of i) looking at text (text usage), ii) text vs. image interaction measures (semantic or contextual relevance of text), and iii) narration. We show that texts capture attention early in the process of inspection and that text and image interact. Moreover, semantics of texts are used to guide eye movements later through the image, supporting the formation of the narrative.

Expectations affect the perception of material properties

Many objects that we encounter have typical material qualities: spoons are hard, pillows are soft, and Jell-O dessert is wobbly. Over a lifetime of experiences, strong associations between an object and its typical material properties may be formed, and these associations not only include how glossy, rough, or pink an object is, but also how it behaves under force: we expect knocked over vases to shatter, popped bike tires to deflate, and gooey grilled cheese to hang between two slices of bread when pulled apart. Here we ask how such rich visual priors affect the visual perception of material qualities and present a particularly striking example of expectation violation. In a cue conflict design, we pair computer-rendered familiar objects with surprising material behaviors (a linen curtain shattering, a porcelain teacup wrinkling, etc.) and find that material qualities are not solely estimated from the object's kinematics (i.e., its physical [atypical] motion while shattering, wrinkling, wobbling etc.); rather, material appearance is sometimes “pulled” toward the “native” motion, shape, and optical properties that are associated with this object. Our results, in addition to patterns we find in response time data, suggest that visual priors about materials can set up high-level expectations about complex future states of an object and show how these priors modulate material appearance.

Effects of Language on Visual Perception

Does language change what we perceive? Does speaking different languages cause us to perceive things differently? We review the behavioral and electrophysiological evidence for the influence of language on perception, with an emphasis on the visual modality. Effects of language on perception can be observed both in higher-level processes such as recognition and in lower-level processes such as discrimination and detection. A consistent finding is that language causes us to perceive in a more categorical way. Rather than being fringe or exotic, as they are sometimes portrayed, we discuss how effects of language on perception naturally arise from the interactive and predictive nature of perception.

Exemplar learning reveals the representational origins of expert category perception

Irrespective of whether one has substantial perceptual expertise for a class of stimuli, an observer invariably encounters novel exemplars from this class. To understand how novel exemplars are represented, we examined the extent to which previous experience with a category constrains the acquisition and nature of representation of subsequent exemplars from that category. Participants completed a perceptual training paradigm with either novel other-race faces (category of experience) or novel computer-generated objects (YUFOs) that included pairwise similarity ratings at the beginning, middle, and end of training, and a 20-d visual search training task on a subset of category exemplars. Analyses of pairwise similarity ratings revealed multiple dissociations between the representational spaces for those learning faces and those learning YUFOs. First, representational distance changes were more selective for faces than YUFOs; trained faces exhibited greater magnitude in representational distance change relative to untrained faces, whereas this trained-untrained distance change was much smaller for YUFOs. Second, there was a difference in where the representational distance changes were observed; for faces, representations that were closer together before training exhibited a greater distance change relative to those that were farther apart before training. For YUFOs, however, the distance changes occurred more uniformly across representational space. Last, there was a decrease in dimensionality of the representational space after training on YUFOs, but not after training on faces. Together, these findings demonstrate how previous category experience governs representational patterns of exemplar learning as well as the underlying dimensionality of the representational space.

Dynamic interactive theory as a domain-general account of social perception

The perception of social categories, emotions, and personality traits from others' faces each have been studied extensively but in relative isolation. We synthesize emerging findings suggesting that, in each of these domains of social perception, both a variety of bottom-up facial features and top-down social cognitive processes play a part in driving initial perceptions. Among such top-down processes, social-conceptual knowledge in particular can have a fundamental structuring role in how we perceive others' faces. Extending the Dynamic Interactive framework (Freeman & Ambady, 2011), we outline a perspective whereby the perception of social categories, emotions, and traits from faces can all be conceived as emerging from an integrated system relying on domain-general cognitive properties. Such an account of social perception would envision perceptions to be a rapid, but gradual, process of negotiation between the variety of visual cues inherent to a person and the social cognitive knowledge an individual perceiver brings to the perceptual process. We describe growing evidence in support of this perspective as well as its theoretical implications for social psychology.

Fixating the eyes of a speaker provides sufficient visual information to modulate early auditory processing

In face-to-face conversations, when listeners process and combine information obtained from hearing and seeing a speaker, they mostly look at the eyes rather than at the more informative mouth region. Measuring event-related potentials, we tested whether fixating the speaker's eyes is sufficient for gathering enough visual speech information to modulate early auditory processing, or whether covert attention to the speaker's mouth is needed. Results showed that when listeners fixated the eye region of the speaker, the amplitudes of the auditory evoked N1 and P2 were reduced when listeners heard and saw the speaker than when they only heard her. These cross-modal interactions also occurred when, in addition, attention was restricted to the speaker's eye region. Fixating the speaker's eyes thus provides listeners with sufficient visual information to facilitate early auditory processing. The spread of covert attention to the mouth area is not needed to observe audiovisual interactions.

Individual differences in object recognition

There is substantial evidence for individual differences in personality and cognitive abilities, but we lack clear intuitions about individual differences in visual abilities. Previous work on this topic has typically compared performance with only 2 categories, each measured with only 1 task. This approach is insufficient for demonstration of domain-general effects. Most previous work has used familiar object categories, for which experience may vary between participants and categories, thereby reducing correlations that would stem from a common factor. In Study 1, we adopted a latent variable approach to test for the first time whether there is a domain-general object recognition ability, o. We assessed whether shared variance between latent factors representing performance for each of 5 novel object categories could be accounted for by a single higher-order factor. On average, 89% of the variance of lower-order factors denoting performance on novel object categories could be accounted for by a higher-order factor, providing strong evidence for o. Moreover, o also accounted for a moderate proportion of variance in tests of familiar object recognition. In Study 2, we assessed whether the strong association across categories in object recognition is due to third-variable influences. We find that o has weak to moderate associations with a host of cognitive, perceptual, and personality constructs and that a clear majority of the variance in and covariance between performance on different categories is independent of fluid intelligence. This work provides the first demonstration of a reliable, specific, and domain-general object recognition ability, and suggest a rich framework for future work in this area. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

General Transformations of Object Representations in Human Visual Cortex

The brain actively represents incoming information, but these representations are only useful to the extent that they flexibly reflect changes in the environment. How does the brain transform representations across changes, such as in size or viewing angle? We conducted a fMRI experiment and a magnetoencephalography experiment in humans (both sexes) in which participants viewed objects before and after affine viewpoint changes (rotation, translation, enlargement). We used a novel approach, representational transformation analysis, to derive transformation functions that linked the distributed patterns of brain activity evoked by an object before and after an affine change. Crucially, transformations derived from one object could predict a postchange representation for novel objects. These results provide evidence of general operations in the brain that are distinct from neural representations evoked by particular objects and scenes.SIGNIFICANCE STATEMENT The dominant focus in cognitive neuroscience has been on how the brain represents information, but these representations are only useful to the extent that they flexibly reflect changes in the environment. How does the brain transform representations, such as linking two states of an object, for example, before and after an object undergoes a physical change? We used a novel method to derive transformations between the brain activity evoked by an object before and after an affine viewpoint change. We show that transformations derived from one object undergoing a change generalized to a novel object undergoing the same change. This result shows that there are general perceptual operations that transform object representations from one state to another.

Quaddles: A multidimensional 3-D object set with parametrically controlled and customizable features

Many studies of vision and cognition require novel three-dimensional object sets defined by a parametric feature space. Creating such sets and verifying that they are suitable for a given task, however, can be time-consuming and effortful. Here we present a new set of multidimensional objects, Quaddles, designed for studies of feature-based learning and attention, but adaptable for many research purposes. Quaddles have features that are all equally visible from any angle around the vertical axis and can be designed to be equally discriminable along feature dimensions; these objects do not show strong or consistent response biases, with a small number of quantified exceptions. They are available as two-dimensional images, rotating videos, and FBX object files suitable for use with any modern video game engine. We also provide scripts that can be used to generate hundreds of thousands of further Quaddles, as well as examples and tutorials for modifying Quaddles or creating completely new object sets from scratch, with the aim to speed up the development time of future novel-object studies.

Perceiving Sophisticated Minds Influences Perceptual Individuation

In six studies, we investigated how ascribing humanlike versus animallike minds to targets influences how easily targets are individuated. Across the studies, participants learned to discriminate among a variety of "aliens" (actually Greebles). Our initial study showed that participants' ability to learn to individuate targets was related to beliefs that targets had sophisticated minds. Investigating the directionality of this relationship, we found that learning to better recognize the targets did not affect perceptions of mind (Study 2). However, when targets were described as having sophisticated humanlike (relative to simplistic animallike) mental faculties, perceivers indicated more motivation to individuate (Study 3) and were more successful individuating them (Studies 4 and 5). Finally, we showed that increased self-similarity mediated the relationship between targets' mental sophistication and perceivers' motivation to individuate (Study 6). These findings indicate ascribing sophisticated mental faculties to others has implications for how we individuate them.

Tracking Multiple Statistics: Simultaneous Learning of Object Names and Categories in English and Mandarin Speakers

Two experiments were conducted to examine adult learners' ability to extract multiple statistics in simultaneously presented visual and auditory input. Experiment 1 used a cross-situational learning paradigm to test whether English speakers were able to use co-occurrences to learn word-to-object mappings and concurrently form object categories based on the commonalities across training stimuli. Experiment 2 replicated the first experiment and further examined whether speakers of Mandarin, a language in which final syllables of object names are more predictive of category membership than English, were able to learn words and form object categories when trained with the same type of structures. The results indicate that both groups of learners successfully extracted multiple levels of co-occurrence and used them to learn words and object categories simultaneously. However, marked individual differences in performance were also found, suggesting possible interference and competition in processing the two concurrent streams of regularities.

Frontotemporal lobar degeneration and social behaviour: Dissociation between the knowledge of its consequences and its conceptual meaning

Inappropriate social behaviour is an early symptom of frontotemporal lobar degeneration (FTLD) in both behavioural variant frontotemporal dementia (bvFTD) and semantic dementia (SD) subtypes. Knowledge of social behaviour is essential for appropriate social conduct. The superior anterior temporal lobe (ATL) has been identified as one key neural component for the conceptual knowledge of social behaviour, but it is unknown whether this is dissociable from knowledge of the consequences of social behaviour. Here, we used a newly-developed test of knowledge about long-term and short-term consequences of social behaviour to investigate its impairment in patients with FTLD relative to a previously-developed test of social conceptual knowledge. We included 19 healthy elderly control participants and 19 consecutive patients with features of bvFTD or SD and defined dissociations as performance differences between tasks for each patient (Bonferroni-corrected p < .05). Knowledge of long-term consequences was selectively impaired relative to short-term consequences in five patients and the reverse dissociation occurred in one patient. Six patients showed a selective impairment of social concepts relative to long-term consequences with the reverse dissociation occurring in one patient. These results corroborate the hypothesis that knowledge of long-term consequences of social behaviour is dissociable from knowledge of short-term consequences, as well as of social conceptual knowledge. Confirming our hypothesis, we found that patients with more marked grey matter (GM) volume loss in frontopolar relative to right superior ATL regions of interest exhibited poorer knowledge of the long-term consequences of social behaviour relative to the knowledge of its conceptual meaning and vice versa (n = 15). These findings support the hypothesis that frontopolar and ATL regions represent distinct aspects of social knowledge. This suggests that rather than being unable to suppress urges to behave inappropriately, FTLD patients often lose the knowledge of what appropriate social behaviour is and can therefore not be expected to behave accordingly.

Learning Warps Object Representations in the Ventral Temporal Cortex

The human ventral temporal cortex (VTC) plays a critical role in object recognition. Although it is well established that visual experience shapes VTC object representations, the impact of semantic and contextual learning is unclear. In this study, we tracked changes in representations of novel visual objects that emerged after learning meaningful information about each object. Over multiple training sessions, participants learned to associate semantic features (e.g., "made of wood," "floats") and spatial contextual associations (e.g., "found in gardens") with novel objects. fMRI was used to examine VTC activity for objects before and after learning. Multivariate pattern similarity analyses revealed that, after learning, VTC activity patterns carried information about the learned contextual associations of the objects, such that objects with contextual associations exhibited higher pattern similarity after learning. Furthermore, these learning-induced increases in pattern information about contextual associations were correlated with reductions in pattern information about the object's visual features. In a second experiment, we validated that these contextual effects translated to real-life objects. Our findings demonstrate that visual object representations in VTC are shaped by the knowledge we have about objects and show that object representations can flexibly adapt as a consequence of learning with the changes related to the specific kind of newly acquired information.

Category Learning Stretches Neural Representations in Visual Cortex

We review recent work that shows how learning to categorize objects changes how those objects are represented in the mind and the brain. After category learning, visual perception of objects is enhanced along perceptual dimensions that were relevant to the learned categories, an effect we call dimensional modulation (DM). DM stretches object representations along category-relevant dimensions and shrinks them along category-irrelevant dimensions. The perceptual advantage for category-relevant dimensions extends beyond categorization and can be observed during visual discrimination and other tasks that do not depend on the learned categories. fMRI shows that category learning causes ventral stream neural populations in visual cortex representing objects along a category-relevant dimension to become more distinct. These results are consistent with a view that specific aspects of cognitive tasks associated with objects can account for how our visual system responds to objects.

Goals and task difficulty expectations modulate striatal responses to feedback

The striatum plays a critical role in learning from reward, and it has been implicated in learning from performance-related feedback as well. Positive and negative performance-related feedback is known to engage the striatum during learning by eliciting a response similar to the reinforcement signal for extrinsic rewards and punishments. Feedback is an important tool used to teach new skills and promote healthful lifestyle changes, so it is important to understand how motivational contexts can modulate its effectiveness at promoting learning. While it is known that striatal responses scale with subjective factors influencing the desirability of rewards, it is less clear how expectations and goals might modulate the striatal responses to cognitive feedback during learning. We used functional magnetic resonance imaging to investigate the effects of task difficulty expectations and achievement goals on feedback processing during learning. We found that individuals who scored high in normative goals, which reflect a desire to outperform other students academically, showed the strongest effects of our manipulation. High levels of normative goals were associated with greater performance gains and exaggerated striatal sensitivity to positive versus negative feedback during blocks that were expected to be more difficult. Our findings suggest that normative goals may enhance performance when difficulty expectations are high, while at the same time modulating the subjective value of feedback as processed in the striatum.

Does the semantic content of verbal categories influence categorical perception? An ERP study

Accumulating evidence suggests that visual perception and, in particular, visual discrimination, can be influenced by verbal category boundaries. One issue that still awaits systematic investigation is the specific influence of semantic contents of verbal categories on categorical perception (CP). We tackled this issue with a learning paradigm in which initially unfamiliar, yet realistic objects were associated with either bare labels lacking explicit semantic content or labels that were accompanied by enriched semantic information about the specific meaning of the label. Two to three days after learning, the EEG was recorded while participants performed a lateralized oddball task. Newly acquired verbal category boundaries modulated low-level aspects of visual perception as early as 100-150 ms after stimulus onset, suggesting a genuine influence of language on perception. Importantly, this effect was not further influenced by enriched semantic category information, suggesting that bare labels and the associated minimal and predominantly perceptual information are sufficient for CP. Distinct effects of semantic knowledge independent of category boundaries were found subsequently, starting at about 200 ms, possibly reflecting selective attention to semantically meaningful visual features.

Knowledge is power: how conceptual knowledge transforms visual cognition

In this review, we synthesize the existing literature demonstrating the dynamic interplay between conceptual knowledge and visual perceptual processing. We consider two theoretical frameworks that demonstrate interactions between processes and brain areas traditionally considered perceptual or conceptual. Specifically, we discuss categorical perception, in which visual objects are represented according to category membership, and highlight studies showing that category knowledge can penetrate early stages of visual analysis. We next discuss the embodied account of conceptual knowledge, which holds that concepts are instantiated in the same neural regions required for specific types of perception and action, and discuss the limitations of this framework. We additionally consider studies showing that gaining abstract semantic knowledge about objects and faces leads to behavioral and electrophysiological changes that are indicative of more efficient stimulus processing. Finally, we consider the role that perceiver goals and motivation may play in shaping the interaction between conceptual and perceptual processing. We hope to demonstrate how pervasive such interactions between motivation, conceptual knowledge, and perceptual processing are in our understanding of the visual environment, and to demonstrate the need for future research aimed at understanding how such interactions arise in the brain.

Visual appearance interacts with conceptual knowledge in object recognition

Objects contain rich visual and conceptual information, but do these two types of information interact? Here, we examine whether visual and conceptual information interact when observers see novel objects for the first time. We then address how this interaction influences the acquisition of perceptual expertise. We used two types of novel objects (Greebles), designed to resemble either animals or tools, and two lists of words, which described non-visual attributes of people or man-made objects. Participants first judged if a word was more suitable for describing people or objects while ignoring a task-irrelevant image, and showed faster responses if the words and the unfamiliar objects were congruent in terms of animacy (e.g., animal-like objects with words that described human). Participants then learned to associate objects and words that were either congruent or not in animacy, before receiving expertise training to rapidly individuate the objects. Congruent pairing of visual and conceptual information facilitated observers' ability to become a perceptual expert, as revealed in a matching task that required visual identification at the basic or subordinate levels. Taken together, these findings show that visual and conceptual information interact at multiple levels in object recognition.

Cognitive and anatomical underpinnings of the conceptual knowledge for common objects and familiar people: a repetitive transcranial magnetic stimulation study

Several studies have addressed the issue of how knowledge of common objects is organized in the brain, whereas the cognitive and anatomical underpinnings of familiar people knowledge have been less explored. Here we applied repetitive transcranial magnetic stimulation (rTMS) over the left and right temporal poles before asking healthy individuals to perform a speeded word-to-picture matching task using familiar people and common objects as stimuli. We manipulated two widely used semantic variables, namely the semantic distance and the familiarity of stimuli, to assess whether the semantic organization of familiar people knowledge is similar to that of common objects. For both objects and faces we reliably found semantic distance and familiarity effects, with less accurate and slower responses for stimulus pairs that were more closely related and less familiar. However, the effects of semantic variables differed across categories, with semantic distance effects larger for objects and familiarity effects larger for faces, suggesting that objects and faces might share a partially comparable organization of their semantic representations. The application of rTMS to the left temporal pole modulated, for both categories, semantic distance, but not familiarity effects, revealing that accessing object and face concepts might rely on overlapping processes within left anterior temporal regions. Crucially, rTMS of the left temporal pole affected only the recognition of pairs of stimuli that could be discriminated at specific levels of categorization (e.g., two kitchen tools or two famous persons), with no effect for discriminations at either superordinate or individual levels. Conversely, rTMS of the right temporal pole induced an overall slowing of reaction times that positively correlated with the visual similarity of the stimuli, suggesting a more perceptual rather than semantic role of the right anterior temporal regions. Results are discussed in the light of current models of face and object semantic representations in the brain.

Perceptual training for visual search

People are better at visual search than the best fully automated methods. Despite this, visual search remains a difficult perceptual task. The goal of this investigation was to experimentally test the ways in which visual search performance could be improved through two categories of training interventions: perceptual training and conceptual training. To determine the effects of each training on a later performance task, the two types of trainings were manipulated using a between-subjects design (conceptual vs. perceptual × training present vs. training absent). Perceptual training led to speed and accuracy improvements in visual search. Issues with the design and administration of the conceptual training limited conclusions on its effectiveness but provided useful lessons for conceptual training design. The results suggest that when the visual search task involves detecting heterogeneous or otherwise unpredictable stimuli, perceptual training can improve visual search performance. Similarly, careful consideration of the performance task and training design is required to evaluate the effectiveness of conceptual training.

PRACTITIONER SUMMARY

Visual search is a difficult, yet critical, task in industries such as baggage screening and radiology. This study investigated the effectiveness of perceptual training for visual search. The results suggest that when visual search involves detecting heterogeneous or otherwise unpredictable stimuli, perceptual training may improve the speed and accuracy of visual search.

Implicit statistical learning and language skills in bilingual children

PURPOSE

Implicit statistical learning in 2 nonlinguistic domains (visual and auditory) was used to investigate (a) whether linguistic experience influences the underlying learning mechanism and (b) whether there are modality constraints in predicting implicit statistical learning with age and language skills.

METHOD

Implicit statistical learning was examined in visual and auditory domains. One hundred twelve English native speaking monolinguals and Spanish-English bilinguals age 5-13 years participated in the study. Language skills were measured by standardized language tests.

RESULTS

The overall results showed that all children implicitly learned statistical regularities above chance level in both modalities. However, there was no group difference between monolingual and bilingual children on either visual or auditory tasks. Lastly, a different tendency in predicting implicit statistical learning was observed for each group. In the monolingual group, both age and language scores significantly explained auditory statistical learning, whereas age explained visual statistical learning. In the bilingual group, age explained auditory statistical learning, and nothing was significant for visual statistical learning.

CONCLUSIONS

These findings are discussed in terms of the extent to which implicit statistical learning is influenced by internal and external factors and a consideration of important notions when testing bilingual children's language skills.

Deaf and hearing children's plural noun spelling

The present study examines deaf and hearing children's spelling of plural nouns. Severe literacy impairments are well documented in the deaf, which are believed to be a consequence of phonological awareness limitations. Fifty deaf (mean chronological age 13;10 years, mean reading age 7;5 years) and 50 reading-age-matched hearing children produced spellings of regular, semiregular, and irregular plural nouns in Experiment 1 and nonword plurals in Experiment 2. Deaf children performed reading-age appropriately on rule-based (regular and semiregular) plurals but were significantly less accurate at spelling irregular plurals. Spelling of plural nonwords and spelling error analyses revealed clear evidence for use of morphology. Deaf children used morphological generalization to a greater degree than their reading-age-matched hearing counterparts. Also, hearing children combined use of phonology and morphology to guide spelling, whereas deaf children appeared to use morphology without phonological mediation. Therefore, use of morphology in spelling can be independent of phonology and is available to the deaf despite limited experience with spoken language. Indeed, deaf children appear to be learning about morphology from the orthography. Education on more complex morphological generalization and exceptions may be highly beneficial not only for the deaf but also for other populations with phonological awareness limitations.

Is interpolation cognitively encapsulated? Measuring the effects of belief on Kanizsa shape discrimination and illusory contour formation

Contour interpolation is a perceptual process that fills-in missing edges on the basis of how surrounding edges (inducers) are spatiotemporally related. Cognitive encapsulation refers to the degree to which perceptual mechanisms act in isolation from beliefs, expectations, and utilities (Pylyshyn, 1999). Is interpolation encapsulated from belief? We addressed this question by having subjects discriminate briefly-presented, partially-visible fat and thin shapes, the edges of which either induced or did not induce illusory contours (relatable and non-relatable conditions, respectively). Half the trials in each condition incorporated task-irrelevant distractor lines, known to disrupt the filling-in of contours. Half of the observers were told that the visible parts of the shape belonged to a single thing (group strategy); the other half were told that the visible parts were disconnected (ungroup strategy). It was found that distractor lines strongly impaired performance in the relatable condition, but minimally in the non-relatable condition; that strategy did not alter the effects of the distractor lines for either the relatable or non-relatable stimuli; and that cognitively grouping relatable fragments improved performance whereas cognitively grouping non-relatable fragments did not. These results suggest that (1) filling-in effects during illusory contour formation cannot be easily removed via strategy; (2) filling-in effects cannot be easily manufactured from stimuli that fail to elicit interpolation; and (3) actively grouping fragments can readily improve discrimination performance, but only when those fragments form interpolated contours. Taken together, these findings indicate that discriminating filled-in shapes depends on strategy but the filling-in process itself may be encapsulated from belief.

On the perception of probable things: neural substrates of associative memory, imagery, and perception

Perception is influenced both by the immediate pattern of sensory inputs and by memories acquired through prior experiences with the world. Throughout much of its illustrious history, however, study of the cellular basis of perception has focused on neuronal structures and events that underlie the detection and discrimination of sensory stimuli. Relatively little attention has been paid to the means by which memories interact with incoming sensory signals. Building upon recent neurophysiological/behavioral studies of the cortical substrates of visual associative memory, I propose a specific functional process by which stored information about the world supplements sensory inputs to yield neuronal signals that can account for visual perceptual experience. This perspective represents a significant shift in the way we think about the cellular bases of perception.

Depth of Conceptual Knowledge Modulates Visual Processes during Word Reading

Recent evidence suggests that conceptual knowledge modulates early visual stages of object recognition. The present study investigated whether similar modulations can be observed also for the recognition of object names, that is, for symbolic representations with only arbitrary relationships between their visual features and the corresponding conceptual knowledge. In a learning paradigm, we manipulated the amount of information provided about initially unfamiliar visual objects while controlling for perceptual stimulus properties and exposure. In a subsequent test session with electroencephalographic recordings, participants performed several tasks on either the objects or their written names. For objects as well as names, knowledge effects were observed as early as about 120 msec in the P1 component of the ERP, reflecting perceptual processing in extrastriate visual cortex. These knowledge-dependent modulations of early stages of visual word recognition suggest that information about word meanings may modulate the perception of arbitrarily related visual features surprisingly early.

Training experts: individuation without naming is worth it

There is growing evidence that individuation experience is necessary for development of expert object discrimination that transfers to new exemplars. Individuation training in human studies has primarily used label association tasks where labels are learned at both the individual and more abstract (basic) level, and expertise criterion requires that individual-level judgments become as fast as basic-level judgments. However, there are training situations when the use of labels is not practical (e.g., with animals or some clinical populations). Moreover, labeling itself can facilitate object discrimination, thus it is unclear what role labels play in the acquisition of expertise in such training paradigms. Here, participants completed an online game that did not require labels in which they interacted with novel objects (Greebles) or control objects (Yufos). Games either required individuation or categorization. We then assessed the impact of this exposure on an abridged Greeble training paradigm. As expected, participants who played Yufo games or Greeble categorization games showed a significant basic-level advantage for Greebles in the abridged training paradigm, typical of novices. However, participants who played the Greeble identity game showed a reduced basic-level advantage, suggesting that individuation without labels may be sufficient to acquire perceptual expertise.

Conceptual distinctiveness supports detailed visual long-term memory for real-world objects

Humans have a massive capacity to store detailed information in visual long-term memory. The present studies explored the fidelity of these visual long-term memory representations and examined how conceptual and perceptual features of object categories support this capacity. Observers viewed 2,800 object images with a different number of exemplars presented from each category. At test, observers indicated which of 2 exemplars they had previously studied. Memory performance was high and remained quite high (82% accuracy) with 16 exemplars from a category in memory, demonstrating a large memory capacity for object exemplars. However, memory performance decreased as more exemplars were held in memory, implying systematic categorical interference. Object categories with conceptually distinctive exemplars showed less interference in memory as the number of exemplars increased. Interference in memory was not predicted by the perceptual distinctiveness of exemplars from an object category, though these perceptual measures predicted visual search rates for an object target among exemplars. These data provide evidence that observers' capacity to remember visual information in long-term memory depends more on conceptual structure than perceptual distinctiveness.

A Multimodal Neural Network Recruited by Expertise with Musical Notation

Prior neuroimaging work on visual perceptual expertise has focused on changes in the visual system, ignoring possible effects of acquiring expert visual skills in nonvisual areas. We investigated expertise for reading musical notation, a skill likely to be associated with multimodal abilities. We compared brain activity in music-reading experts and novices during perception of musical notation, Roman letters, and mathematical symbols and found selectivity for musical notation for experts in a widespread multimodal network of areas. The activity in several of these areas was correlated with a behavioral measure of perceptual fluency with musical notation, suggesting that activity in nonvisual areas can predict individual differences in visual expertise. The visual selectivity for musical notation is distinct from that for faces, single Roman letters, and letter strings. Implications of the current findings to the study of visual perceptual expertise, music reading, and musical expertise are discussed.

Neural correlates of exemplar novelty processing under different spatial attention conditions

The detection of novel events and their identification is a basic prerequisite in a rapidly changing environment. Recently, the processing of novelty has been shown to rely on the hippocampus and to be associated with activity in reward-related areas. The present study investigated the influence of spatial attention on neural processing of novel relative to frequently presented standard and target stimuli. Never-before-seen Mandelbrot-fractals absent of semantic content were employed as stimulus material. Consistent with current theories, novelty activated a widespread network of brain areas including the hippocampus. No activity, however, could be observed in reward-related areas with the novel stimuli absent of a semantic meaning employed here. In the perceptual part of the novelty-processing network a region in the lingual gyrus was found to specifically process novel events when they occurred outside the focus of spatial attention. These findings indicate that the initial detection of unexpected novel events generally occurs in specialized perceptual areas within the ventral visual stream, whereas activation of reward-related areas appears to be restricted to events that do possess a semantic content indicative of the biological relevance of the stimulus.

The effect of categorisation on sensitivity to second-order relations in novel objects

Adults appear to be more sensitive to configural information, including second-order relations (the spacing of features), in faces than in other objects. Superior processing of second-order relations in faces may arise from our experience of identifying faces at the individual level of categorisation (eg Bob versus John) but other objects at the basic level of categorisation (eg table versus chair; Gauthier and Tarr, 1997 Vision Research 37 1673- 1682). We simulated this learning difference with novel stimuli (comprised of blobs) by having two groups view the same stimuli but learn to identify the objects only at the basic level (based on the number of constituent blobs) or at both the basic level and individual level (based on the spacing, or second-order relations, of the blobs) of categorisation. Results from two experiments showed that, after training, observers in the individual-level training group were more sensitive to the second-order relations in novel exemplars of the learned category than observers in the basic-level training group. This is the first demonstration of specific improvement in sensitivity to second-order relations after training with non-face stimuli. The findings are consistent with the hypothesis that adults are more sensitive to second-order relations in faces than in other objects, at least in part, because they have more experience identifying faces at the individual level of categorisation.

Language is not just for talking: redundant labels facilitate learning of novel categories

In addition to having communicative functions, verbal labels may play a role in shaping concepts. Two experiments assessed whether the presence of labels affected category formation. Subjects learned to categorize "aliens" as those to be approached or those to be avoided. After accuracy feedback on each response was provided, a nonsense label was either presented or not. Providing nonsense category labels facilitated category learning even though the labels were redundant and all subjects had equivalent experience with supervised categorization of the stimuli. A follow-up study investigated differences between learning verbal and nonverbal associations and showed that learning a nonverbal association did not facilitate categorization. The findings show that labels make category distinctions more concrete and bear directly on the language-and-thought debate.

Sources of error in picture naming under time pressure

We used a deadline procedure to investigate how time pressure may influence the processes involved in picture naming. The deadline exaggerated errors found under naming without deadline. There were also category differences in performance between living and nonliving things and, in particular, for animals versus fruit and vegetables. The majority of errors were visuallyand semantically related to the target (e. celery-asparagus), and there was a greater proportion of these errors made to living things. Importantly, there were also more visual-semantic errors to animals than to fruit and vegetables. In addition, there were a smaller number of pure semantic errors (e.g., nut-bolt), which were made predominantly to nonliving things. The different kinds of error were correlated with different variables. Overall, visual-semantic errors were associated with visual complexity and visual similarity, whereas pure semantic errors were associated with imageability and age of acquisition. However, for animals, visual-semantic errors were associated with visual complexity, whereas for fruit and vegetables they were associated with visual similarity. We discuss these findings in terms of theories of category-specific semantic impairment and models of picture naming.