Electrophysiological potentials reveal cortical mechanisms for mental imagery, mental simulation, and grounded (embodied) cognition

Multiple mechanisms of visual prediction as revealed by the timecourse of scene-object facilitation

Not only semantic, but also recently learned arbitrary associations have the potential to facilitate visual processing in everyday life-for example, knowledge of a (moveable) object's location at a specific time may facilitate visual processing of that object. In our prior work, we showed that previewing a scene can facilitate processing of recently associated objects at the level of visual analysis (Smith and Federmeier in Journal of Cognitive Neuroscience, 32(5):783-803, 2020). In the current study, we assess how rapidly this facilitation unfolds by manipulating scene preview duration. We then compare our results to studies using well-learned object-scene associations in a first-pass assessment of whether systems consolidation might speed up high-level visual prediction. In two ERP experiments (N = 60), we had participants study categorically organized novel object-scene pairs in an explicit paired associate learning task. At test, we varied contextual pre-exposure duration, both between (200 vs. 2500 ms) and within subjects (0-2500 ms). We examined the N300, an event-related potential component linked to high-level visual processing of objects and scenes and found that N300 effects of scene congruity increase with longer scene previews, up to approximately 1-2 s. Similar results were obtained for response times and in a separate component-neutral ERP analysis of visual template matching. Our findings contrast with prior evidence that scenes can rapidly facilitate visual processing of commonly associated objects. This raises the possibility that systems consolidation might mediate different kinds of predictive processing with different temporal profiles.

Neural signatures of imaginary motivational states: desire for music, movement and social play

The literature has demonstrated the potential for detecting accurate electrical signals that correspond to the will or intention to move, as well as decoding the thoughts of individuals who imagine houses, faces or objects. This investigation examines the presence of precise neural markers of imagined motivational states through the combining of electrophysiological and neuroimaging methods. 20 participants were instructed to vividly imagine the desire to move, listen to music or engage in social activities. Their EEG was recorded from 128 scalp sites and analysed using individual standardized Low-Resolution Brain Electromagnetic Tomographies (LORETAs) in the N400 time window (400-600 ms). The activation of 1056 voxels was examined in relation to the 3 motivational states. The most active dipoles were grouped in eight regions of interest (ROI), including Occipital, Temporal, Fusiform, Premotor, Frontal, OBF/IF, Parietal, and Limbic areas. The statistical analysis revealed that all motivational imaginary states engaged the right hemisphere more than the left hemisphere. Distinct markers were identified for the three motivational states. Specifically, the right temporal area was more relevant for "Social Play", the orbitofrontal/inferior frontal cortex for listening to music, and the left premotor cortex for the "Movement" desire. This outcome is encouraging in terms of the potential use of neural indicators in the realm of brain-computer interface, for interpreting the thoughts and desires of individuals with locked-in syndrome.

Neural correlates of recalled sadness, joy, and fear states: a source reconstruction EEG study

Introduction

The capacity to understand the others' emotional states, particularly if negative (e.g. sadness or fear), underpins the empathic and social brain. Patients who cannot express their emotional states experience social isolation and loneliness, exacerbating distress. We investigated the feasibility of detecting non-invasive scalp-recorded electrophysiological signals that correspond to recalled emotional states of sadness, fear, and joy for potential classification.

Methods

The neural activation patterns of 20 healthy and right-handed participants were studied using an electrophysiological technique. Analyses were focused on the N400 component of Event-related potentials (ERPs) recorded during silent recall of subjective emotional states; Standardized weighted Low-resolution Electro-magnetic Tomography (swLORETA) was employed for source reconstruction. The study classified individual patterns of brain activation linked to the recollection of three distinct emotional states into seven regions of interest (ROIs).

Results

Statistical analysis (ANOVA) of the individual magnitude values revealed the existence of a common emotional circuit, as well as distinct brain areas that were specifically active during recalled sad, happy and fearful states. In particular, the right temporal and left superior frontal areas were more active for sadness, the left limbic region for fear, and the right orbitofrontal cortex for happy affective states.

Discussion

In conclusion, this study successfully demonstrated the feasibility of detecting scalp-recorded electrophysiological signals corresponding to internal and subjective affective states. These findings contribute to our understanding of the emotional brain, and have potential applications for future BCI classification and identification of emotional states in LIS patients who may be unable to express their emotions, thus helping to alleviate social isolation and sense of loneliness.

Recurrent connectivity supports higher-level visual and semantic object representations in the brain

Visual object recognition has been traditionally conceptualised as a predominantly feedforward process through the ventral visual pathway. While feedforward artificial neural networks (ANNs) can achieve human-level classification on some image-labelling tasks, it's unclear whether computational models of vision alone can accurately capture the evolving spatiotemporal neural dynamics. Here, we probe these dynamics using a combination of representational similarity and connectivity analyses of fMRI and MEG data recorded during the recognition of familiar, unambiguous objects. Modelling the visual and semantic properties of our stimuli using an artificial neural network as well as a semantic feature model, we find that unique aspects of the neural architecture and connectivity dynamics relate to visual and semantic object properties. Critically, we show that recurrent processing between the anterior and posterior ventral temporal cortex relates to higher-level visual properties prior to semantic object properties, in addition to semantic-related feedback from the frontal lobe to the ventral temporal lobe between 250 and 500 ms after stimulus onset. These results demonstrate the distinct contributions made by semantic object properties in explaining neural activity and connectivity, highlighting it as a core part of object recognition not fully accounted for by current biologically inspired neural networks.

Measuring brain potentials of imagination linked to physiological needs and motivational states

Introduction

While EEG signals reflecting motor and perceptual imagery are effectively used in brain computer interface (BCI) contexts, little is known about possible indices of motivational states. In the present study, electrophysiological markers of imagined motivational states, such as craves and desires were investigated.

Methods

Event-related potentials (ERPs) were recorded in 31 participants during perception and imagery elicited by the presentation of 360 pictograms. Twelve micro-categories of needs, subdivided into four macro-categories, were considered as most relevant for a possible BCI usage, namely: primary visceral needs (e.g., hunger, linked to desire of food); somatosensory thermal and pain sensations (e.g., cold, linked to desire of warm), affective states (e.g., fear: linked to desire of reassurance) and secondary needs (e.g., desire to exercise or listen to music). Anterior N400 and centroparietal late positive potential (LPP) were measured and statistically analyzed.

Results

N400 and LPP were differentially sensitive to the various volition stats, depending on their sensory, emotional and motivational poignancy. N400 was larger to imagined positive appetitive states (e.g., play, cheerfulness) than negative ones (sadness or fear). In addition, N400 was of greater amplitude during imagery of thermal and nociceptive sensations than other motivational or visceral states. Source reconstruction of electromagnetic dipoles showed the activation of sensorimotor areas and cerebellum for movement imagery, and of auditory and superior frontal areas for music imagery.

Discussion

Overall, ERPs were smaller and more anteriorly distributed during imagery than perception, but showed some similarity in terms of lateralization, distribution, and category response, thus indicating some overlap in neural processing, as also demonstrated by correlation analyses. In general, anterior frontal N400 provided clear markers of subjects’ physiological needs and motivational states, especially cold, pain, and fear (but also sadness, the urgency to move, etc.), than can signal life-threatening conditions. It is concluded that ERP markers might potentially allow the reconstruction of mental representations related to various motivational states through BCI systems.

Cortical activity involved in perception and imagery of visual stimuli in a subject with aphantasia. An EEG case report

Aphantasia has been described as the inability to voluntarily evoke mental images using the "mind's eye." We studied a congenital aphantasic subject using neuropsychological testsand 64 channel EEG recordings, in order to studycortical activity involved in perception and imagery evaluating event-related potentials(N170, P200, N250). The subject is in the normal range of the neuropsychological tests performed, except for specific imagery tests. The EEG results show that when he evokes the same mental image, he starts the evoking process from left temporal instead of frontal areas, he does not activate occipital visual nor left anterior parietal areas.

Integrating unsupervised and reinforcement learning in human categorical perception: A computational model

Categorical perception identifies a tuning of human perceptual systems that can occur during the execution of a categorisation task. Despite the fact that experimental studies and computational models suggest that this tuning is influenced by task-independent effects (e.g., based on Hebbian and unsupervised learning, UL) and task-dependent effects (e.g., based on reward signals and reinforcement learning, RL), no model studies the UL/RL interaction during the emergence of categorical perception. Here we have investigated the effects of this interaction, proposing a system-level neuro-inspired computational architecture in which a perceptual component integrates UL and RL processes. The model has been tested with a categorisation task and the results show that a balanced mix of unsupervised and reinforcement learning leads to the emergence of a suitable categorical perception and the best performance in the task. Indeed, an excessive unsupervised learning contribution tends to not identify task-relevant features while an excessive reinforcement learning contribution tends to initially learn slowly and then to reach sub-optimal performance. These results are consistent with the experimental evidence regarding categorical activations of extrastriate cortices in healthy conditions. Finally, the results produced by the two extreme cases of our model can explain the existence of several factors that may lead to sensory alterations in autistic people.

Multiple Levels of Heuristic Reasoning Processes in Scientific Model Construction

Science historians have recognized the importance of heuristic reasoning strategies for constructing theories, but their extent and degree of organization are still poorly understood. This paper first consolidates a set of important heuristic strategies for constructing scientific models from three books, including studies in the history of genetics and electromagnetism, and an expert think-aloud study in the field of mechanics. The books focus on qualitative reasoning strategies (processes) involved in creative model construction, scientific breakthroughs, and conceptual change. Twenty four processes are examined, most of which are field-general, but all are heuristic in not being guaranteed to work. An organizing framework is then proposed as a four-level hierarchy of nested reasoning processes and subprocesses at different size and time scales, including: Level (L4) Several longer-time-scale Major Modeling Modes, such as Model Evolution and Model Competition; the former mode utilizes: (L3) Modeling Cycle Phases of Model Generation, Evaluation, and Modification under Constraints; which can utilize: (L2) Thirteen Tactical Heuristic Processes, e.g., Analogy, Infer new model feature (e.g., by running the model), etc.; many of which selectively utilize: (L1) Grounded Imagistic Processes, namely Mental Simulations and Structural Transformations. Incomplete serial ordering in the framework gives it an intermediate degree of organization that is neither anarchistic nor fully algorithmic. Its organizational structure is hypothesized to promote a difficult balance between divergent and convergent processes as it alternates between them in modeling cycles with increasingly constrained modifications. Videotaped think-aloud protocols that include depictive gestures and other imagery indicators indicate that the processes in L1 above can be imagistic. From neurological evidence that imagery uses many of the same brain regions as actual perception and action, it is argued that these expert reasoning processes are grounded in the sense of utilizing the perceptual and motor systems, and interconnections to and possible benefits for reasoning processes at higher levels are examined. The discussion examines whether this grounding and the various forms of organization in the framework may begin to explain how processes that are only sometimes useful and not guaranteed to work can combine successfully to achieve innovative scientific model construction.

Cursed Concepts: New insights on combinatorial processing from ERP correlates of swearing in context

Expressives (damn) convey speaker attitude and when used in context (Tom lost the damn dog) can be flexibly applied locally to the noun (dog) or globally to the whole sentence (the situation). We used ERPs to explore brain responses to expressives in sentences. Participants read expressive, descriptive, and pseudoword adjectives followed by nouns in sentences (The damn/black/flerg dog peed on the couch). At the adjective late-positivity-component (LPC), expressives and descriptives showed no difference, suggesting reduced social threat and that readers employ a 'wait-and-see' strategy to interpret expressives. Nouns preceded by expressives elicited a larger frontal P200, as well as reduced N400 and LPC than nouns preceded by descriptives. We associated the frontal P200 with emotional salience, the frontal N400 with mental imagery, and the LPC with cognitive load for combinatorics. We suggest that expressive adjectives are not bound to conceptual integration and conclude that parsers wait-and-see what is being damned.

Mental Simulation to Promote Exercise Intentions and Behaviors

Mental simulation, which employs specific patterns of imagery, can increase the intention to exercise as well as actual engagement in exercise. The present studies explored the effects of mental simulation on the intention to engage in exercise while regulating emotions. The first study confirmed that mental simulation did promote intentions of participants. The second found that video-primed mental simulation was a more effective method of exercise intention promotion than semantic-primed and image-primed mental simulation. In the third study, it was found that combining process-based and outcome-based mental simulations increased exercise intentions. Positive emotions mediated imagery ability and intention to exercise. The final study found that the mental simulation interventions most effective for exercise adherence were those that balanced the valence of process and outcome components in such a way that a challenging process results in a positive outcome, or a smooth process results in a negative outcome. Each of these results has practical implications for exercise interventions that will be discussed.

How to do Better N400 Studies: Reproducibility, Consistency and Adherence to Research Standards in the Existing Literature

Given the complexity of ERP recording and processing pipeline, the resulting variability of methodological options, and the potential for these decisions to influence study outcomes, it is important to understand how ERP studies are conducted in practice and to what extent researchers are transparent about their data collection and analysis procedures. The review gives an overview of methodology reporting in a sample of 132 ERP papers, published between January 1980 – June 2018 in journals included in two large databases: Web of Science and PubMed. Because ERP methodology partly depends on the study design, we focused on a well-established component (the N400) in the most commonly assessed population (healthy neurotypical adults), in one of its most common modalities (visual images). The review provides insights into 73 properties of study design, data pre-processing, measurement, statistics, visualization of results, and references to supplemental information across studies within the same subfield. For each of the examined methodological decisions, the degree of consistency, clarity of reporting and deviations from the guidelines for best practice were examined. Overall, the results show that each study had a unique approach to ERP data recording, processing and analysis, and that at least some details were missing from all papers. In the review, we highlight the most common reporting omissions and deviations from established recommendations, as well as areas in which there was the least consistency. Additionally, we provide guidance for a priori selection of the N400 measurement window and electrode locations based on the results of previous studies.

The N300: An Index for Predictive Coding of Complex Visual Objects and Scenes

Predictive coding models can simulate known perceptual or neuronal phenomena, but there have been fewer attempts to identify a reliable neural signature of predictive coding for complex stimuli. In a pair of studies, we test whether the N300 component of the event-related potential, occurring 250–350-ms poststimulus-onset, has the response properties expected for such a signature of perceptual hypothesis testing at the level of whole objects and scenes. We show that N300 amplitudes are smaller to representative (“good exemplars”) compared with less representative (“bad exemplars”) items from natural scene categories. Integrating these results with patterns observed for objects, we establish that, across a variety of visual stimuli, the N300 is responsive to statistical regularity, or the degree to which the input is “expected” (either explicitly or implicitly) based on prior knowledge, with statistically regular images evoking a reduced response. Moreover, we show that the measure exhibits context-dependency; that is, we find the N300 sensitivity to category representativeness when stimuli are congruent with, but not when they are incongruent with, a category pre-cue. Thus, we argue that the N300 is the best candidate to date for an index of perceptual hypotheses testing for complex visual objects and scenes.

Dynamic activity patterns in the anterior temporal lobe represents object semantics

The anterior temporal lobe (ATL) is considered a crucial area for the representation of transmodal concepts. Recent evidence suggests that specific regions within the ATL support the representation of individual object concepts, as shown by studies combining multivariate analysis methods and explicit measures of semantic knowledge. This research looks to further our understanding by probing conceptual representations at a spatially and temporally resolved neural scale. Representational similarity analysis was applied to human intracranial recordings from anatomically defined lateral to medial ATL sub-regions. Neural similarity patterns were tested against semantic similarity measures, where semantic similarity was defined by a hybrid corpus-based and feature-based approach. Analyses show that the perirhinal cortex, in the medial ATL, significantly related to semantic effects around 200 to 400 ms, and were greater than more lateral ATL regions. Further, semantic effects were present in low frequency (theta and alpha) oscillatory phase signals. These results provide converging support that more medial regions of the ATL support the representation of basic-level visual object concepts within the first 400 ms, and provide a bridge between prior fMRI and MEG work by offering detailed evidence for the presence of conceptual representations within the ATL.

When a second language hits a native language. What ERPs (do and do not) tell us about language retrieval difficulty in bilingual language production

The accumulating evidence suggests that prior usage of a second language (L2) leads to processing costs on the subsequent production of a native language (L1). However, it is unclear what mechanism underlies this effect. It has been proposed that the L1 cost reflects inhibition of L1 representation acting during L1 production; however, previous studies exploring this issue were inconclusive. It is also unsettled whether the mechanism operates on the whole-language level or is restricted to translation equivalents in the two languages. We report a study that allowed us to address both issues behaviorally with the use of ERPs while focusing on the consequences of using L2 on the production of L1. In our experiment, native speakers of Polish (L1) and learners of English (L2) named a set of pictures in L1 following a set of pictures in either L1 or L2. Half of the pictures were repeated from the preceding block and half were new; this enabled dissociation of the effects on the level of the whole language from those specific to individual lexical items. Our results are consistent with the notion that language after-effects operate at a whole-language level. Behaviorally, we observed a clear processing cost on the whole-language level and a small facilitation on the item-specific level. The whole-language effect was accompanied by an enhanced, fronto-centrally distributed negativity in the 250-350 ms time-window which we identified as the N300 (in contrast to previous research, which probably misidentified the effect as the N2), a component that presumably reflects retrieval difficulty of relevant language representations during picture naming. As such, unlike previous studies that reported N2 for naming pictures in L1 after L2 use, we propose that the reported ERPs (N300) indicate that prior usage of L2 hampers lexical access to names in L1. Based on the literature, the after-effects could be caused by L1 inhibition and/or L2 interference, but the ERPs so far have not been informative about the causal mechanism.

Neural Signatures of Learning Novel Object-Scene Associations

Objects are perceived within rich visual contexts, and statistical associations may be exploited to facilitate their rapid recognition. Recent work using natural scene-object associations suggests that scenes can prime the visual form of associated objects, but it remains unknown whether this relies on an extended learning process. We asked participants to learn categorically structured associations between novel objects and scenes in a paired associate memory task while ERPs were recorded. In the test phase, scenes were first presented (2500 msec), followed by objects that matched or mismatched the scene; degree of contextual mismatch was manipulated along visual and categorical dimensions. Matching objects elicited a reduced N300 response, suggesting visuostructural priming based on recently formed associations. Amplitude of an extended positivity (onset ∼200 msec) was sensitive to visual distance between the presented object and the contextually associated target object, most likely indexing visual template matching. Results suggest recent associative memories may be rapidly recruited to facilitate object recognition in a top-down fashion, with clinical implications for populations with impairments in hippocampal-dependent memory and executive function.

How do Asians perceive Caucasian eyes? Electrophysiological correlates of perceiving racial differences from the eyes region of the face

Past research has found that several brain event-related potentials (ERPs) were sensitive to the perception of ethnic differences displayed on human faces. This body of research suggests that the phenomenon of "race perception" involves a cascade of cognitive processes that includes both automatic and overt attentional mechanisms. However, most of these studies used stimuli depicting whole faces rather than stimuli depicting separate facial features. Therefore, it is still largely unknown if ERP responses to racial differences are the result of a holistic processing of the whole face, or whether they can be accounted for by the perception of single facial features. To address this issue, we examined whether a single facial feature, the eyes region, can provide sufficient information to trigger known ERP correlates of race perception such as the P2, the N400 and the Late Positive Complex (LPC). Specifically, we showed pictures depicting only the eyes region of Caucasian and Asian faces to a sample of Asian participants. We found that the P2 was larger for other-race (OR) compared to same-race (SR) eyes, and that the N400 was larger for SR compared to OR eyes. The effects on the P2 may suggest an enhanced vigilance response to OR eyes whereas the N400 effect could reflect a signal of familiarity triggered by SR eyes. These results indicate that a specific facial feature, the eyes region, can account for known effects of race perception on early brain potentials. Our findings also indicate that well-known early neural correlates of race perception can be triggered in the absence of a holistic processing of the whole face.

Perceptual and conceptual processing of visual objects across the adult lifespan

Making sense of the external world is vital for multiple domains of cognition, and so it is crucial that object recognition is maintained across the lifespan. We investigated age differences in perceptual and conceptual processing of visual objects in a population-derived sample of 85 healthy adults (24-87 years old) by relating measures of object processing to cognition across the lifespan. Magnetoencephalography (MEG) was recorded during a picture naming task to provide a direct measure of neural activity, that is not confounded by age-related vascular changes. Multiple linear regression was used to estimate neural responsivity for each individual, namely the capacity to represent visual or semantic information relating to the pictures. We find that the capacity to represent semantic information is linked to higher naming accuracy, a measure of task-specific performance. In mature adults, the capacity to represent semantic information also correlated with higher levels of fluid intelligence, reflecting domain-general performance. In contrast, the latency of visual processing did not relate to measures of cognition. These results indicate that neural responsivity measures relate to naming accuracy and fluid intelligence. We propose that maintaining neural responsivity in older age confers benefits in task-related and domain-general cognitive processes, supporting the brain maintenance view of healthy cognitive ageing.

Oscillatory Dynamics of Perceptual to Conceptual Transformations in the Ventral Visual Pathway

Object recognition requires dynamic transformations of low-level visual inputs to complex semantic representations. Although this process depends on the ventral visual pathway, we lack an incremental account from low-level inputs to semantic representations and the mechanistic details of these dynamics. Here we combine computational models of vision with semantics and test the output of the incremental model against patterns of neural oscillations recorded with magnetoencephalography in humans. Representational similarity analysis showed visual information was represented in low-frequency activity throughout the ventral visual pathway, and semantic information was represented in theta activity. Furthermore, directed connectivity showed visual information travels through feedforward connections, whereas visual information is transformed into semantic representations through feedforward and feedback activity, centered on the anterior temporal lobe. Our research highlights that the complex transformations between visual and semantic information is driven by feedforward and recurrent dynamics resulting in object-specific semantics.

More than a feeling: The bidirectional convergence of semantic visual object and somatosensory processing

Prevalent theories of semantic processing assert that the sensorimotor system plays a functional role in the semantic processing of manipulable objects. While motor execution has been shown to impact object processing, involvement of the somatosensory system has remained relatively unexplored. Therefore, we developed two novel priming paradigms. In Experiment 1, participants received a vibratory hand prime (on half the trials) prior to viewing a picture of either an object interacted primarily with the hand (e.g., a cup) or the foot (e.g., a soccer ball) and reported how they would interact with it. In Experiment 2, the same objects became the prime and participants were required to identify whether the vibratory stimulation occurred to their hand or foot. In both experiments, somatosensory priming effects arose for the hand objects, while foot objects showed no priming benefits. These results suggest that object semantic knowledge bidirectionally converges with the somatosensory system.

Literary narrative as a cognitive structure in the brain

This paper proposes that literary narrative is the result of an unconscious computation in the brain, a computation that arises from the dynamical interaction of specific innate and representational lower-order neuronal circuits and mappings. It is also proposed that these specific circuits constitute the fundamental building blocks of literary narrative. The analysis further suggests that as literary narrative evolves in the brain, its development is influenced by an evolutionarily-biased broad class of attractors known as archetypes. In this context, a description of literary narrative is devised, and six phases leading to the production of literary narrative are then identified. The description presented here may have applications in the production of literary narrative by artificial systems.

Understanding What We See: How We Derive Meaning From Vision

Recognising objects goes beyond vision, and requires models that incorporate different aspects of meaning. Most models focus on superordinate categories (e.g., animals, tools) which do not capture the richness of conceptual knowledge. We argue that object recognition must be seen as a dynamic process of transformation from low-level visual input through categorical organisation to specific conceptual representations. Cognitive models based on large normative datasets are well-suited to capture statistical regularities within and between concepts, providing both category structure and basic-level individuation. We highlight recent research showing how such models capture important properties of the ventral visual pathway. This research demonstrates that significant advances in understanding conceptual representations can be made by shifting the focus from studying superordinate categories to basic-level concepts.

Top-down modulation of visual processing and knowledge after 250 ms supports object constancy of category decisions

People categorize objects more slowly when visual input is highly impoverished instead of optimal. While bottom-up models may explain a decision with optimal input, perceptual hypothesis testing (PHT) theories implicate top-down processes with impoverished input. Brain mechanisms and the time course of PHT are largely unknown. This event-related potential study used a neuroimaging paradigm that implicated prefrontal cortex in top-down modulation of occipitotemporal cortex. Subjects categorized more impoverished and less impoverished real and pseudo objects. PHT theories predict larger impoverishment effects for real than pseudo objects because top-down processes modulate knowledge only for real objects, but different PHT variants predict different timing. Consistent with parietal-prefrontal PHT variants, around 250 ms, the earliest impoverished real object interaction started on an N3 complex, which reflects interactive cortical activity for object cognition. N3 impoverishment effects localized to both prefrontal and occipitotemporal cortex for real objects only. The N3 also showed knowledge effects by 230 ms that localized to occipitotemporal cortex. Later effects reflected (a) word meaning in temporal cortex during the N400, (b) internal evaluation of prior decision and memory processes and secondary higher-order memory involving anterotemporal parts of a default mode network during posterior positivity (P600), and (c) response related activity in posterior cingulate during an anterior slow wave (SW) after 700 ms. Finally, response activity in supplementary motor area during a posterior SW after 900 ms showed impoverishment effects that correlated with RTs. Convergent evidence from studies of vision, memory, and mental imagery which reflects purely top-down inputs, indicates that the N3 reflects the critical top-down processes of PHT. A hybrid multiple-state interactive, PHT and decision theory best explains the visual constancy of object cognition.

Neuromagnetic brain activities associated with perceptual categorization and sound-content incongruency: a comparison between monosyllabic words and pitch names

In human cultures, the perceptual categorization of musical pitches relies on pitch-naming systems. A sung pitch name concurrently holds the information of fundamental frequency and pitch name. These two aspects may be either congruent or incongruent with regard to pitch categorization. The present study aimed to compare the neuromagnetic responses to musical and verbal stimuli for congruency judgments, for example a congruent pair for the pitch C4 sung with the pitch name do in a C-major context (the pitch-semantic task) or for the meaning of a word to match the speaker’s identity (the voice-semantic task). Both the behavioral data and neuromagnetic data showed that congruency detection of the speaker’s identity and word meaning was slower than that of the pitch and pitch name. Congruency effects of musical stimuli revealed that pitch categorization and semantic processing of pitch information were associated with P2m and N400m, respectively. For verbal stimuli, P2m and N400m did not show any congruency effect. In both the pitch-semantic task and the voice-semantic task, we found that incongruent stimuli evoked stronger slow waves with the latency of 500–600 ms than congruent stimuli. These findings shed new light on the neural mechanisms underlying pitch-naming processes.

Neuroelectric Correlates of Pragmatic Emotional Incongruence Processing: Empathy Matters

The emotions people feel can be simulated internally based on emotional situational contexts. In the present study, we assessed the behavioral and neuroelectric effects of seeing an unexpected emotional facial expression. We investigated the correct answer rate, response times and Event-Related Potential (ERP) effects during an incongruence paradigm between emotional faces and sentential contexts allowing emotional inferences. Most of the 36 healthy participants were recruited from a larger population (1 463 subjects), based on their scores on the Empathy Questionnaire (EQ). Regression analyses were conducted on these ratings using EQ factors as predictors (cognitive empathy, emotional reactivity and social skills). Recognition of pragmatic emotional incongruence was less accurate (P < .05) and slower (P < .05) than recognition of congruence. The incongruence effect on response times was inversely predicted by social skills. A significant N400 incongruence effect was found at the centro-parietal (P < .001) and centro-posterior midline (P < .01) electrodes. Cognitive empathy predicted the incongruence effect in the left occipital region, in the N400 time window. Finally, incongruence effects were also found on the LPP wave, in frontal midline and dorso-frontal regions, (P < .05), with no modulation by empathy. Processing pragmatic emotional incongruence is more cognitively demanding than congruence (as reflected by both behavioral and ERP data). This processing shows modulation by personality factors at the behavioral (through self-reported social skills) and neuroelectric levels (through self-reported cognitive empathy).

Dynamic information processing states revealed through neurocognitive models of object semantics

Recognising objects relies on highly dynamic, interactive brain networks to process multiple aspects of object information. To fully understand how different forms of information about objects are represented and processed in the brain requires a neurocognitive account of visual object recognition that combines a detailed cognitive model of semantic knowledge with a neurobiological model of visual object processing. Here we ask how specific cognitive factors are instantiated in our mental processes and how they dynamically evolve over time. We suggest that coarse semantic information, based on generic shared semantic knowledge, is rapidly extracted from visual inputs and is sufficient to drive rapid category decisions. Subsequent recurrent neural activity between the anterior temporal lobe and posterior fusiform supports the formation of object-specific semantic representations - a conjunctive process primarily driven by the perirhinal cortex. These object-specific representations require the integration of shared and distinguishing object properties and support the unique recognition of objects. We conclude that a valuable way of understanding the cognitive activity of the brain is though testing the relationship between specific cognitive measures and dynamic neural activity. This kind of approach allows us to move towards uncovering the information processing states of the brain and how they evolve over time.

Electrophysiological brain dynamics during the esthetic judgment of human bodies and faces

This experiment investigated how the esthetic judgment of human body and face modulates cognitive and affective processes. We hypothesized that judgments on ugliness and beauty would elicit separable event-related brain potentials (ERP) patterns, depending on the esthetic value of body and faces in both genders. In a pretest session, participants evaluated images in a range from very ugly to very beautiful, what generated three sets of beautiful, ugly and neutral faces and bodies. In the recording session, they performed a task consisting in a beautiful-neutral-ugly judgment. Cognitive and affective effects were observed on a differential pattern of ERP components (P200, P300 and LPC). Main findings revealed a P200 amplitude increase to ugly images, probably the result of a negativity bias in attentional processes. A P300 increase was found mostly to beautiful images, particularly to female bodies, consistent with the salience of these stimuli, particularly for stimulus categorization. LPC appeared significantly larger to both ugly and beautiful images, probably reflecting later, decision processes linked to keeping information in working memory. This finding was especially remarkable for ugly male faces. Our findings are discussed on the ground of evolutionary and adaptive value of esthetics in person evaluation. This article is part of a Special Issue entitled Hold Item.

[Mental Imagery: Neurophysiology and Implications in Psychiatry]

OBJECTIVE

To provide an explanation about what mental imagery is and some implications in psychiatry.

METHODS

This article is a narrative literature review.

RESULTS

There are many terms in which imagery representations are described in different fields of research. They are defined as perceptions in the absence of an external stimulus, and can be created in any sensory modality. Their neurophysiological substrate is almost the same as the one activated during sensory perception. There is no unified theory about its function, but it is possibly the way that our brain uses and manipulates the information to respond to the environment.

CONCLUSIONS

Mental imagery is an everyday phenomenon, and when it occurs in specific patterns it can be a sign of mental disorders.

Inhibitory control and visuo-spatial reversibility in Piaget's seminal number conservation task: a high-density ERP study

The present high-density event-related potential (ERP) study on 13 adults aimed to determine whether number conservation relies on the ability to inhibit the overlearned length-equals-number strategy and then imagine the shortening of the row that was lengthened. Participants performed the number-conservation task and, after the EEG session, the mental imagery task. In the number-conservation task, first two rows with the same number of tokens and the same length were presented on a computer screen (COV condition) and then, the tokens in one of the two rows were spread apart (INT condition). Participants were instructed to determine whether the two rows had an identical number of tokens. In the mental imagery task, two rows with different lengths but the same number of tokens were presented and participants were instructed to imagine the tokens in the longer row aligning with the tokens in the shorter row. In the number-conservation task, we found that the amplitudes of the centro-parietal N2 and fronto-central P3 were higher in the INT than in the COV conditions. In addition, the differences in response times between the two conditions were correlated with the differences in the amplitudes of the fronto-central P3. In light of previous results reported on the number-conservation task in adults, the present results suggest that inhibition might be necessary to succeed the number-conservation task in adults even when the transformation of the length of one of the row is displayed. Finally, we also reported correlations between the speed at which participants could imagine the shortening of one of the row in the mental imagery task, the speed at which participants could determine that the two rows had the same number of tokens after the tokens in one of the row were spread apart and the latency of the late positive parietal component in the number-conservation task. Therefore, performing the number-conservation task might involve mental transformation processes in adults.

Assessing vividness of mental imagery: The Plymouth Sensory Imagery Questionnaire

Mental imagery may occur in any sensory modality, although visual imagery has been most studied. A sensitive measure of the vividness of imagery across a range of modalities is needed: the shorter version of Bett's Questionnaire upon Mental Imagery (Sheehan, , J. Clin. Psychology, 23, 386) uses outdated items and has an unreliable factor structure. We report the development and initial validation of the Plymouth Sensory Imagery Questionnaire (Psi-Q) comprising items for each of the following modalities: Vision, Sound, Smell, Taste, Touch, Bodily Sensation, and Emotional Feeling. An exploratory factor analysis on a 35-item form indicated that these modalities formed separate factors, rather than a single imagery factor, and this was replicated by confirmatory factor analysis. The Psi-Q was validated against the Spontaneous Use of Imagery Scale (Reisberg et al., , Appl. Cogn. Psychology, 17, 147) and Marks' (, J. Mental Imagery, 19, 153) Vividness of Visual Imagery Questionnaire-2 (VVIQ-2). A short 21-item form comprising the best three items from the seven factors correlated with the total score and subscales of the full form, and with the VVIQ-2. Inspection of the data shows that while visual and sound imagery is most often rated as vivid, individuals who rate one modality as strong and the other as weak are not uncommon. Findings are interpreted within a working memory framework and point to the need for further research to identify the specific cognitive processes underlying the vividness of imagery across sensory modalities.