Accessing Semantic Person Knowledge: Temporal Dynamics of Nonstrategic Categorical and Associative Priming

Prediction error processing and sharpening of expected information across the face-processing hierarchy

The perception and neural processing of sensory information are strongly influenced by prior expectations. The integration of prior and sensory information can manifest through distinct underlying mechanisms: focusing on unexpected input, denoted as prediction error (PE) processing, or amplifying anticipated information via sharpened representation. In this study, we employed computational modeling using deep neural networks combined with representational similarity analyses of fMRI data to investigate these two processes during face perception. Participants were cued to see face images, some generated by morphing two faces, leading to ambiguity in face identity. We show that expected faces were identified faster and perception of ambiguous faces was shifted towards priors. Multivariate analyses uncovered evidence for PE processing across and beyond the face-processing hierarchy from the occipital face area (OFA), via the fusiform face area, to the anterior temporal lobe, and suggest sharpened representations in the OFA. Our findings support the proposition that the brain represents faces grounded in prior expectations.

How does price variance among purchase channels affect consumers’ cognitive process when shopping online?

The rise of a flourishing online shopping market has expanded the range of purchase channels available to consumers. Meanwhile, the competition among channels has become increasingly fierce. In this study, the changes in cognitive processes caused by price variance among channels were investigated using event-related potentials. Several daily necessities with low or high price variance between a self-operated business channel and third-party seller channels were chosen as the study objects from a well-known electronic business platform. Thirty participants’ electroencephalograms were collected while they faced higher or lower price variance during the experiment. The results showed that small price variances between the two channels tended to intensify component N2, while big price variances tended to diminish component P3. These results suggest that N2 may reflect consumers’ identification process for price variance and inhibition of a planned response, while P3 may reflect the activation of attention caused by task difficulty due to price variance. These findings indicate that the changes in ERP components N2 and P3 may act as cognitive indices that measure customers’ identification and attention distribution when considering product price variances among online purchase channels.

Exploring the Representations of Individual Entities in the Brain Combining EEG and Distributional Semantics

Semantic knowledge about individual entities (i.e., the referents of proper names such as Jacinta Ardern) is fine-grained, episodic, and strongly social in nature, when compared with knowledge about generic entities (the referents of common nouns such as politician). We investigate the semantic representations of individual entities in the brain; and for the first time we approach this question using both neural data, in the form of newly-acquired EEG data, and distributional models of word meaning, employing them to isolate semantic information regarding individual entities in the brain. We ran two sets of analyses. The first set of analyses is only concerned with the evoked responses to individual entities and their categories. We find that it is possible to classify them according to both their coarse and their fine-grained category at appropriate timepoints, but that it is hard to map representational information learned from individuals to their categories. In the second set of analyses, we learn to decode from evoked responses to distributional word vectors. These results indicate that such a mapping can be learnt successfully: this counts not only as a demonstration that representations of individuals can be discriminated in EEG responses, but also as a first brain-based validation of distributional semantic models as representations of individual entities. Finally, in-depth analyses of the decoder performance provide additional evidence that the referents of proper names and categories have little in common when it comes to their representation in the brain.

Temporal Dynamics of the Neural Representation of Social Relationships

Humans can rapidly encode information from faces to support social judgments and facilitate interactions with others. We can also recall complex knowledge about those individuals, such as their social relationships with others, but the time course of this process has not been examined in detail. This study addressed the temporal dynamics of emerging visual and social relationship information using EEG and representational similarity analysis. Participants (female = 23, male = 10) became familiar with a 10-person social network, and were then shown faces of that network's members while EEG was recorded. To examine the temporal dynamics of the cognitive processes related to face perception, we compared the similarity structure of neural pattern responses to models of visual processing, face shape similarity, person identity, and social relationships. We found that all types of information are associated with neural patterns after a face is seen. Visual models became significant early after image onset, and identity across a change in facial expression was uniquely associated with neural patterns at several points throughout the time course. Additionally, a model reflecting perceived frequency of social interaction was present beginning at ∼110 ms, even in the absence of an explicit task to think about the relationships among the network members. This study highlights the speed and salience of social information relating to group dynamics that are present in the brain during person perception.SIGNIFICANCE STATEMENT We live our lives in social groups where complex relationships form among and around us. It is likely that some of the information about social relationships that we observe is integral during person perception, to better help us interact in differing situations with a variety of people. However, when exactly this information becomes relevant has been unclear. In this study, we present evidence that information reflecting observed relationships among a social network is spontaneously represented in whole-brain patterns shortly following presentation of a face. These results are consistent with neuroimaging studies showing spontaneous spatial representation of social network characteristics, and contribute novel insights into the timing of these neural processes.

An Analysis of Famous Person Semantic Memory in Aging

BACKGROUND

In contrast to most memory systems that decline with age, semantic memory tends to remain relatively stable across the life span. However, what exactly is stable remains unclear. Is it the quantity of information available or the organization of semantic memory, i.e., the connections between semantic items? Even less is known about semantic memory for celebrities, a subsystem of semantic memory. In the present study, we studied the organization of person-specific semantic memory and its stability in aging.

METHODS

We designed a word association task based on a previous study, which consisted in providing the first word that came to the mind of the participants (15 participants for each age group 20-30, 40-50 and 60-70 years old) for 144 celebrities. We developed a new taxonomy of associated responses as the responses associated with celebrities name could in principle be very varied.

RESULTS

We found that most responses (>90%) could be grouped into five categories (subjective; superordinate general; superordinate specific; imagery and activities). The elderly group did not differ from the other two groups in term of errors or reaction time suggesting they performed the task well. However, they also provided associations that were less precise and less based on imagery. In contrast, the middle-age group provided the most precise associations.

CONCLUSION

These results support the idea of a durable person-specific semantic memory in aging but show changes in the type of associations that elders provide. Future work should aim at studying patients with early semantic impairment, as they could be different from the healthy elders on such semantic association task.

Neuroimaging results suggest the role of prediction in cross-domain priming

The repetition of a stimulus leads to shorter reaction times as well as to the reduction of neural activity. Previous encounters with closely related stimuli (primes) also lead to faster and often to more accurate processing of subsequent stimuli (targets). For instance, if the prime is a name, and the target is a face, the recognition of a persons’ face is facilitated by prior presentation of his/her name. A possible explanation for this phenomenon is that the prime allows predicting the occurrence of the target. To the best of our knowledge, so far, no study tested the neural correlates of such cross-domain priming with fMRI. To fill this gap, here we used names of famous persons as primes, and congruent or incongruent faces as targets. We found that congruent primes not only reduced RT, but also lowered the BOLD signal in bilateral fusiform (FFA) and occipital (OFA) face areas. This suggests that semantic information affects not only behavioral performance, but also neural responses in relatively early processing stages of the occipito-temporal cortex. We interpret our results in the framework of predictive coding theories.

When appearance does not match accent: neural correlates of ethnicity-related expectancy violations

Most research on ethnicity in neuroscience and social psychology has focused on visual cues. However, accents are central social markers of ethnicity and strongly influence evaluations of others. Here, we examine how varying auditory (vocal accent) and visual (facial appearance) information about others affects neural correlates of ethnicity-related expectancy violations. Participants listened to standard German and Turkish-accented speakers and were subsequently presented with faces whose ethnic appearance was either congruent or incongruent to these voices. We expected that incongruent targets (e.g. German accent/Turkish face) would be paralleled by a more negative N2 event-related brain potential (ERP) component. Results confirmed this, suggesting that incongruence was related to more effortful processing of both Turkish and German target faces. These targets were also subjectively judged as surprising. Additionally, varying lateralization of ERP responses for Turkish and German faces suggests that the underlying neural generators differ, potentially reflecting different emotional reactions to these targets. Behavioral responses showed an effect of violated expectations: German-accented Turkish-looking targets were evaluated as most competent of all targets. We suggest that bringing together neural and behavioral measures of expectancy violations, and using both visual and auditory information, yields a more complete picture of the processes underlying impression formation.

Getting connected: Both associative and semantic links structure semantic memory for newly learned persons

The present study examined whether semantic memory for newly learned people is structured by visual co-occurrence, shared semantics, or both. Participants were trained with pairs of simultaneously presented (i.e., co-occurring) preexperimentally unfamiliar faces, which either did or did not share additionally provided semantic information (occupation, place of living, etc.). Semantic information could also be shared between faces that did not co-occur. A subsequent priming experiment revealed faster responses for both co-occurrence/no shared semantics and no co-occurrence/shared semantics conditions, than for an unrelated condition. Strikingly, priming was strongest in the co-occurrence/shared semantics condition, suggesting additive effects of these factors. Additional analysis of event-related brain potentials yielded priming in the N400 component only for combined effects of visual co-occurrence and shared semantics, with more positive amplitudes in this than in the unrelated condition. Overall, these findings suggest that both semantic relatedness and visual co-occurrence are important when novel information is integrated into person-related semantic memory.

Automatic response activation in sequential affective priming: an ERP study

Affective priming effects denote faster responses when two successively presented affective stimuli match in valence than when they mismatch. Two mechanisms have been proposed for their explanation: (i) Priming of affective information within a semantic network or distributed memory system (semantic priming). (ii) Automatic activation of the evaluative response through the affective prime (response priming). In this experiment, we sought more direct evidence for prime-induced response activations with measurement of the lateralized readiness potential (LRP). Onset of the stimulus-locked LRP was earlier in affectively congruent trials than in incongruent trials. In addition, priming modulated the LRP-amplitude of slow responses, indicating greater activation of the incorrect response hand in affectively incongruent trials. Onset of the response-locked LRP and peak latency of the P300 component were not modulated by priming but the amplitude of the N400 component was. In combination, these results suggest that both, semantic priming and response priming constitute affective priming effects in the evaluative categorization task.

The relation between depressive symptoms and semantic memory in amnestic mild cognitive impairment and in late-life depression

Semantic deficits have been documented in the prodromal phase of Alzheimer's disease, but it is unclear whether these deficits are associated with non-cognitive manifestations. For instance, recent evidence indicates that cognitive deficits in elders with amnestic mild cognitive impairment (aMCI) are modulated by concomitant depressive symptoms. The purposes of this study were to (i) investigate if semantic memory impairment in aMCI is modulated according to the presence (aMCI-D group) or absence (aMCI group) of depressive symptoms, and (ii) compare semantic memory performance of aMCI and aMCI-D groups to that of patients with late-life depression (LLD). Seventeen aMCI, 16 aMCI-D, 15 LLD, and 26 healthy control participants were administered a semantic questionnaire assessing famous person knowledge. Results showed that performance of aMCI-D patients was impaired compared to the control and LLD groups. However, in the aMCI group performance was comparable to that of all other groups. Overall, these findings suggest that semantic deficits in aMCI are somewhat associated with the presence of concomitant depressive symptoms. However, depression alone cannot account solely for the semantic deficits since LLD patients showed no semantic memory impairment in this study. Future studies should aim at clarifying the association between depression and semantic deficits in older adults meeting aMCI criteria. (JINS, 2011, 17, 865-874).

Sharing One Biographical Detail Elicits Priming between Famous Names: Empirical and Computational Approaches

In this paper three experiments and corresponding model simulations are reported that investigate the priming of famous name recognition in order to explore the structure of the part of the semantic system dealing with people. Consistent with empirical findings, novel computational simulations using Burton et al.'s interactive activation and competition model point to a conceptual distinction between how priming is initiated in single- and double-familiarity tasks, indicating that priming should be weaker or non-existent for the single-familiarity task. Experiment 1 demonstrates that, within a double-familiarity framework using famous names, categorical, and associative priming are reliable effects. Pushing the model to the limit, it predicts that pairs of celebrities who are neither associatively nor categorically related but who share single biographical features, both died in a car crash for example, should prime each other. Experiment 2 investigated this in a double-familiarity task but the effect was not observed. We therefore simulated and realized a pairwise learning task that was conceptually similar to the double-familiarity-decision task but allowed to strengthen the underlying connections. Priming based on a single biographical feature could be found both in simulations and the experiment. The effect was not due to visual or name similarity which were controlled for and participants did not report using the biographical links between the people to learn the pairs. The results are interpreted to lend further support to structural models of the memory for persons. Furthermore, the results are consistent with the idea that episodic features known about people are stored in semantic memory and are automatically activated when encountering that person.