Cortical mechanisms specific to explicit visual object recognition

Face-Specific Activity in the Ventral Stream Visual Cortex Linked to Conscious Face Perception

When presented with visual stimuli of face images, the ventral stream visual cortex of the human brain exhibits face-specific activity that is modulated by the physical properties of the input images. However, it is still unclear whether this activity relates to conscious face perception. We explored this issue by using the human intracranial electroencephalography technique. Our results showed that face-specific activity in the ventral stream visual cortex was significantly higher when the subjects subjectively saw faces than when they did not, even when face stimuli were presented in both conditions. In addition, the face-specific neural activity exhibited a more reliable neural response and increased posterior-anterior direction information transfer in the "seen" condition than the "unseen" condition. Furthermore, the face-specific neural activity was significantly correlated with performance. These findings support the view that face-specific activity in the ventral stream visual cortex is linked to conscious face perception.

Network mechanisms of ongoing brain activity's influence on conscious visual perception

Sensory inputs enter a constantly active brain, whose state is always changing from one moment to the next. Currently, little is known about how ongoing, spontaneous brain activity participates in online task processing. We employed 7 Tesla fMRI and a threshold-level visual perception task to probe the effects of prestimulus ongoing brain activity on perceptual decision-making and conscious recognition. Prestimulus activity originating from distributed brain regions, including visual cortices and regions of the default-mode and cingulo-opercular networks, exerted a diverse set of effects on the sensitivity and criterion of conscious recognition, and categorization performance. We further elucidate the mechanisms underlying these behavioral effects, revealing how prestimulus activity modulates multiple aspects of stimulus processing in highly specific and network-dependent manners. These findings reveal heretofore unknown network mechanisms underlying ongoing brain activity's influence on conscious perception, and may hold implications for understanding the precise roles of spontaneous activity in other brain functions.

Ultrahigh Field fMRI Reveals Different Roles of the Temporal and Frontoparietal Cortices in Subjective Awareness

A central question in consciousness theories is whether one is dealing with a dichotomous ("all-or-none") or a gradual phenomenon. In this 7T fMRI study, we investigated whether dichotomy or gradualness in fact depends on the brain region associated with perceptual awareness reports. Both male and female human subjects performed an emotion discrimination task (fear vs neutral bodies) presented under continuous flash suppression with trial-based perceptual awareness measures. Behaviorally, recognition sensitivity increased linearly with increased stimuli awareness and was at chance level during perceptual unawareness. Physiologically, threat stimuli triggered a slower heart rate than neutral ones during "almost clear" stimulus experience, indicating freezing behavior. Brain results showed that activity in the occipitotemporal, parietal, and frontal regions as well as in the amygdala increased with increased stimulus awareness while early visual areas showed the opposite pattern. The relationship between temporal area activity and perceptual awareness best fitted a gradual model while the activity in frontoparietal areas fitted a dichotomous model. Furthermore, our findings illustrate that specific experimental decisions, such as stimulus type or the approach used to evaluate awareness, play pivotal roles in consciousness studies and warrant careful consideration.

The role of parietal beta-band activity in the resolution of visual crowding

Visual crowding is the difficulty in identifying an object when surrounded by neighbouring flankers, representing a bottleneck for object perception. Crowding arises not only from the activity of visual areas but also from parietal areas and fronto-parietal network activity. Parietal areas would provide the dorsal-to-ventral guidance for object identification and the fronto-parietal network would modulate the attentional resolution. Several studies highlighted the relevance of beta oscillations (15-25 Hz) in these areas for visual crowding and other connatural visual phenomena. In the present study, we investigated the differential contribution of beta oscillations in the parietal cortex and fronto-parietal network in the resolution of visual crowding. During a crowding task with letter stimuli, high-definition transcranial Alternating Current Stimulation (tACS) in the beta band (18 Hz) was delivered bilaterally on parietal sites, on the right fronto-parietal network, and in a sham regime. Resting-state EEG was recorded before and after stimulation to measure tACS-induced aftereffects. The influence of crowding was reduced only when tACS was delivered bilaterally on parietal sites. In this condition, beta power was reduced after the stimulation. Furthermore, the magnitude of tACS-induced aftereffects varied as a function of individual differences in beta oscillations. Results corroborate the link between parietal beta oscillations and visual crowding, providing fundamental insights on brain rhythms underlying the dorsal-to-ventral guidance in visual perception and suggesting that beta tACS can induce plastic changes in these areas. Remarkably, these findings open new possibilities for neuromodulatory interventions for disorders characterised by abnormal crowding, such as dyslexia.

Preliminary Evidence for Global Properties in Human Listeners During Natural Auditory Scene Perception

Theories of auditory and visual scene analysis suggest the perception of scenes relies on the identification and segregation of objects within it, resembling a detail-oriented processing style. However, a more global process may occur while analyzing scenes, which has been evidenced in the visual domain. It is our understanding that a similar line of research has not been explored in the auditory domain; therefore, we evaluated the contributions of high-level global and low-level acoustic information to auditory scene perception. An additional aim was to increase the field's ecological validity by using and making available a new collection of high-quality auditory scenes. Participants rated scenes on 8 global properties (e.g., open vs. enclosed) and an acoustic analysis evaluated which low-level features predicted the ratings. We submitted the acoustic measures and average ratings of the global properties to separate exploratory factor analyses (EFAs). The EFA of the acoustic measures revealed a seven-factor structure explaining 57% of the variance in the data, while the EFA of the global property measures revealed a two-factor structure explaining 64% of the variance in the data. Regression analyses revealed each global property was predicted by at least one acoustic variable (R2 = 0.33-0.87). These findings were extended using deep neural network models where we examined correlations between human ratings of global properties and deep embeddings of two computational models: an object-based model and a scene-based model. The results support that participants' ratings are more strongly explained by a global analysis of the scene setting, though the relationship between scene perception and auditory perception is multifaceted, with differing correlation patterns evident between the two models. Taken together, our results provide evidence for the ability to perceive auditory scenes from a global perspective. Some of the acoustic measures predicted ratings of global scene perception, suggesting representations of auditory objects may be transformed through many stages of processing in the ventral auditory stream, similar to what has been proposed in the ventral visual stream. These findings and the open availability of our scene collection will make future studies on perception, attention, and memory for natural auditory scenes possible.

Neural processing of prototypicality and simplicity of product design in forming design preferences

The current study investigates the neural correlates when processing prototypicality and simplicity-affecting the preference of product design. Despite its significance, not much is known about how our brain processes these visual qualities of design when forming design preferences. We posit that, although fluency is the perceptual judgment accounting for the positive effects of both prototypicality and simplicity on design preference, the neural substrates for the fluency judgment associated with prototypicality would differ from those associated with simplicity. To investigate these issues, we conducted an fMRI study of preference decisions for actual product designs with different levels of prototypicality and simplicity. The results show a significant functional gradient between the preference processing of simplicity and prototypicality-i.e., involvement of the early ventral stream of visual information processing for simplicity evaluation but recruitment of the late ventral stream and parietal-frontal brain regions for prototypicality evaluation. The interaction between the simplicity and prototypicality evaluations was found in the extrastriate cortex in the right hemisphere. The segregated brain involvements suggest that the fluency judgment for prototypicality and simplicity contribute to preference choice in different levels of cognitive hierarchy in the perceptual mechanism of the design preference.

Beta oscillations in vision: a (preconscious) neural mechanism for the dorsal visual stream?

Neural oscillations in alpha (8-12 Hz) and beta (13-30 Hz) frequency bands are thought to reflect feedback/reentrant loops and large-scale cortical interactions. In the last decades a main effort has been made in linking perception with alpha-band oscillations, with converging evidence showing that alpha oscillations have a key role in the temporal and featural binding of visual input, configuring the alpha rhythm a key determinant of conscious visual experience. Less attention has been historically dedicated to link beta oscillations and visual processing. Nonetheless, increasing studies report that task conditions that require to segregate/integrate stimuli in space, to disentangle local/global shapes, to spatially reorganize visual inputs, and to achieve motion perception or form-motion integration, rely on the activity of beta oscillations, with a main hub in parietal areas. In the present review, we summarize the evidence linking oscillations within the beta band and visual perception. We propose that beta oscillations represent a neural code that supports the functionality of the magnocellular-dorsal (M-D) visual pathway, serving as a fast primary neural code to exert top-down influences on the slower parvocellular-ventral visual pathway activity. Such M-D-related beta activity is proposed to act mainly pre-consciously, providing the spatial coordinates of vision and guiding the conscious extraction of objects identity that are achieved with slower alpha rhythms in ventral areas. Finally, within this new theoretical framework, we discuss the potential role of M-D-related beta oscillations in visuo-spatial attention, oculo-motor behavior and reading (dis)abilities.

Dyslexia Due to Visual Impairments

Reading involves many different abilities that are necessary or sufficient conditions for fluent and flawless reading. The absence of one necessary or of all sufficient conditions is a cause of dyslexia. The present study investigates whether too short fixation times and an impaired ability to recognize a string of letters simultaneously are causes of dyslexia. The frequency and types of reading mistakes were investigated in a tachistoscopic pseudoword experiment with 100 children with dyslexia to test the impact of too short fixation times and the attempts of children with dyslexia to recognize more letters simultaneously than they can when reading pseudowords. The experiment demonstrates that all types of reading mistakes disappear when the fixation time increases and/or the number of letters that the children try to recognize simultaneously is reduced. The results cannot be interpreted as being due to altered visual crowding, impaired attention, or impaired phonological awareness, but can be regarded as an effect of impaired temporal summation and a dysfunction in the ventral stream of the visual system.

How children learn to understand language meanings: a neural model of adult-child multimodal interactions in real-time

This article describes a biological neural network model that can be used to explain how children learn to understand language meanings about the perceptual and affective events that they consciously experience. This kind of learning often occurs when a child interacts with an adult teacher to learn language meanings about events that they experience together. Multiple types of self-organizing brain processes are involved in learning language meanings, including processes that control conscious visual perception, joint attention, object learning and conscious recognition, cognitive working memory, cognitive planning, emotion, cognitive-emotional interactions, volition, and goal-oriented actions. The article shows how all of these brain processes interact to enable the learning of language meanings to occur. The article also contrasts these human capabilities with AI models such as ChatGPT. The current model is called the ChatSOME model, where SOME abbreviates Self-Organizing MEaning.

Event-related brain potential markers of visual and auditory perception: A useful tool for brain computer interface systems

OBJECTIVE

A majority of BCI systems, enabling communication with patients with locked-in syndrome, are based on electroencephalogram (EEG) frequency analysis (e.g., linked to motor imagery) or P300 detection. Only recently, the use of event-related brain potentials (ERPs) has received much attention, especially for face or music recognition, but neuro-engineering research into this new approach has not been carried out yet. The aim of this study was to provide a variety of reliable ERP markers of visual and auditory perception for the development of new and more complex mind-reading systems for reconstructing the mental content from brain activity.

METHODS

A total of 30 participants were shown 280 color pictures (adult, infant, and animal faces; human bodies; written words; checkerboards; and objects) and 120 auditory files (speech, music, and affective vocalizations). This paradigm did not involve target selection to avoid artifactual waves linked to decision-making and response preparation (e.g., P300 and motor potentials), masking the neural signature of semantic representation. Overall, 12,000 ERP waveforms × 126 electrode channels (1 million 512,000 ERP waveforms) were processed and artifact-rejected.

RESULTS

Clear and distinct category-dependent markers of perceptual and cognitive processing were identified through statistical analyses, some of which were novel to the literature. Results are discussed from the view of current knowledge of ERP functional properties and with respect to machine learning classification methods previously applied to similar data.

CONCLUSION

The data showed a high level of accuracy (p ≤ 0.01) in the discriminating the perceptual categories eliciting the various electrical potentials by statistical analyses. Therefore, the ERP markers identified in this study could be significant tools for optimizing BCI systems [pattern recognition or artificial intelligence (AI) algorithms] applied to EEG/ERP signals.

Activity in the Fronto-Parietal and Visual Cortex Is Modulated by Feature-Based Attentional Weighting

In day-to-day dynamic activities where sensory input is abundant, stimulus representations in the visual cortex are modulated based on their attentional priority. Several studies have established the top-down role of a fronto-parietal dorsal attention network in selective attention. In the current study, we aimed to investigate whether activity of subregions of this network and the visual cortex is modulated by feature-based attentional weighting, and if so, whether their timecourses of activity are correlated. To this end, we analyzed fMRI data of 28 healthy subjects, who performed a feature-based go/no-go task. Participants had to attend to one or two colored streams of sinusoidal gratings and respond to each grating in the task-relevant stream(s) except to a single non-target grating. Univariate and multivariate fMRI results indicated that activity in bilateral fronto-parietal (frontal eye fields, intraparietal sulcus and superior parietal lobe) and visual (V1-V4, lateral occipital cortex and fusiform gyrus) regions was modulated by selecting one instead of attending to two gratings. Functional connectivity was not significantly different between fronto-parietal and visual regions when attending to one as opposed to two gratings. Our study demonstrates that activity in subregions of both the fronto-parietal and visual cortex is modified by feature-based attentional weighting.

All-or-none neural mechanisms underlying face categorization: evidence from the N170

Categorization of visual stimuli is an intrinsic aspect of human perception. Whether the cortical mechanisms underlying categorization operate in an all-or-none or graded fashion remains unclear. In this study, we addressed this issue in the context of the face-specific N170. Specifically, we investigated whether N170 amplitudes grade with the amount of face information available in an image, or a full response is generated whenever a face is perceived. We employed linear mixed-effects modeling to inspect the dependency of N170 amplitudes on stimulus properties and duration, and their relationships to participants' subjective perception. Consistent with previous studies, we found a stronger N170 evoked by faces presented for longer durations. However, further analysis with equivalence tests revealed that this duration effect was eliminated when only faces perceived with high confidence were considered. Therefore, previous evidence supporting the graded hypothesis is more likely to be an artifact of mixing heterogeneous "all" and "none" trial types in signal averaging. These results support the hypothesis that the N170 is generated in an all-or-none manner and, by extension, suggest that categorization of faces may follow a similar pattern.

OUP accepted manuscript

Myasthenia gravis is an autoimmune disease affecting neuromuscular transmission and causing skeletal muscle weakness. Additionally, systemic inflammation, cognitive deficits and autonomic dysfunction have been described. However, little is known about myasthenia gravis-related reorganization of the brain. In this study, we thus investigated the structural and functional brain changes in myasthenia gravis patients. Eleven myasthenia gravis patients (age: 70.64 ± 9.27; 11 males) were compared to age-, sex- and education-matched healthy controls (age: 70.18 ± 8.98; 11 males). Most of the patients (n = 10, 0.91%) received cholinesterase inhibitors. Structural brain changes were determined by applying voxel-based morphometry using high-resolution T₁-weighted sequences. Functional brain changes were assessed with a neuropsychological test battery (including attention, memory and executive functions), a spatial orientation task and brain-derived neurotrophic factor blood levels. Myasthenia gravis patients showed significant grey matter volume reductions in the cingulate gyrus, in the inferior parietal lobe and in the fusiform gyrus. Furthermore, myasthenia gravis patients showed significantly lower performance in executive functions, working memory (Spatial Span, P = 0.034, d = 1.466), verbal episodic memory (P = 0.003, d = 1.468) and somatosensory-related spatial orientation (Triangle Completion Test, P = 0.003, d = 1.200). Additionally, serum brain-derived neurotrophic factor levels were significantly higher in myasthenia gravis patients (P = 0.001, d = 2.040). Our results indicate that myasthenia gravis is associated with structural and functional brain alterations. Especially the grey matter volume changes in the cingulate gyrus and the inferior parietal lobe could be associated with cognitive deficits in memory and executive functions. Furthermore, deficits in somatosensory-related spatial orientation could be associated with the lower volumes in the inferior parietal lobe. Future research is needed to replicate these findings independently in a larger sample and to investigate the underlying mechanisms in more detail.

Visual adaptation and 7T fMRI reveal facial identity processing in the human brain under shallow interocular suppression

Face identity is represented at a high level of the visual hierarchy. Whether the human brain can process facial identity information in the absence of visual awareness remains unclear. In this study, we investigated potential face identity representation through face-identity adaptation with the adapting faces interocularly suppressed by Continuous Flash Suppression (CFS) noise, a modified binocular rivalry paradigm. The strength of interocular suppression was manipulated by varying the contrast of CFS noise. While obeservers reported the face images subjectively unperceived and the face identity objectively unrecognizable, a significant face identity aftereffect was observed under low but not high contrast CFS noise. In addition, the identity of face images under shallow interocular suppression can be decoded from multi-voxel patterns in the right fusiform face area (FFA) obtained with high-resolution 7T fMRI. Thus the comined evidence from visual adaptation and 7T fMRI suggest that face identity can be represented in the human brain without explicit perceptual recognition. The processing of interocularly suppressed faces could occur at different levels depending on how "deep" the information is suppressed.

Expanding the discussion: Revision of the fundamental assumptions framing the study of the neural correlates of consciousness

The way one asks a question is shaped by a-priori assumptions and constrains the range of possible answers. We identify and test the assumptions underlying contemporary debates, models, and methodology in the study of the neural correlates of consciousness, which was framed by Crick and Koch's seminal paper (1990). These premises create a sequential and passive conception of conscious perception: it is considered the product of resolved information processing by unconscious mechanisms, produced by a singular event in time and place representing the moment of entry. The conscious percept produced is then automatically retained to be utilized by post-conscious mechanisms. Major debates in the field, such as concern the moment of entry, the all-or-none vs graded nature, and report vs no-report paradigms, are driven by the consensus on these assumptions. We show how removing these assumptions can resolve some of the debates and challenges and prompt additional questions. The potential non-sequential nature of perception suggests new ways of thinking about consciousness as a dynamic and dispersed process, and in turn about the relationship between conscious and unconscious perception. Moreover, it allows us to present a parsimonious account for conscious perception while addressing more aspects of the phenomenon.

Is Developmental Dyslexia Due to a Visual and Not a Phonological Impairment?

It is a widely held belief that developmental dyslexia (DD) is a phonological disorder in which readers have difficulty associating graphemes with their corresponding phonemes. In contrast, the magnocellular theory of dyslexia assumes that DD is a visual disorder caused by dysfunctional magnocellular neural pathways. The review explores arguments for and against these theories. Recent results have shown that DD is caused by (1) a reduced ability to simultaneously recognize sequences of letters that make up words, (2) longer fixation times required to simultaneously recognize strings of letters, and (3) amplitudes of saccades that do not match the number of simultaneously recognized letters. It was shown that pseudowords that could not be recognized simultaneously were recognized almost without errors when the fixation time was extended. However, there is an individual maximum number of letters that each reader with DD can recognize simultaneously. Findings on the neurobiological basis of temporal summation have shown that a necessary prolongation of fixation times is due to impaired processing mechanisms of the visual system, presumably involving magnocells and parvocells. An area in the mid-fusiform gyrus also appears to play a significant role in the ability to simultaneously recognize words and pseudowords. The results also contradict the assumption that DD is due to a lack of eye movement control. The present research does not support the assumption that DD is caused by a phonological disorder but shows that DD is due to a visual processing dysfunction.

Hippocampal-Cortical Encoding Activity Predicts the Precision of Episodic Memory

Our recollections of past experiences can vary in both the number of specific event details accessible from memory and the precision with which such details are reconstructed. Prior neuroimaging evidence suggests the success and precision of episodic recollection to rely on distinct neural substrates during memory retrieval. In contrast, the specific encoding mechanisms supporting later memory precision, and whether they differ from those underlying successful memory formation in general, are currently unknown. Here, we combined continuous measures of memory retrieval with model-based analyses of behavioral and neuroimaging data to tease apart the encoding correlates of successful memory formation and mnemonic precision. In the MRI scanner, participants encoded object-scene displays and later reconstructed features of studied objects using a continuous scale. We observed overlapping encoding activity in inferior prefrontal and posterior perceptual regions to predict both which object features were later remembered versus forgotten and the precision with which they were reconstructed from memory. In contrast, hippocampal encoding activity significantly predicted the precision, but not overall success, of subsequent memory retrieval. The current results align with theoretical accounts proposing the hippocampus to be critical for representation of high-fidelity associative information and suggest a contribution of shared cortical encoding mechanisms to the formation of both accessible and precise memory representations.

Investigating the validity of the Perceptual Awareness Scale - The effect of task-related difficulty on subjective rating

The Perceptual Awareness Scale (PAS) is often used to probe conscious experience, but the assumptions behind the scale and its validity are rarely tested. Using a continuous colour estimation task to assess perceptual quality, we focus on how well PAS follows perceptual quality and how the presence of the estimation task affects PAS ratings. We varied the number and presentation time of stimuli in a simultaneous presentation and target position in a sequential presentation. In all experiments, PAS rating closely followed colour precision. However, it was affected by task-induced response bias, even when the possible task difficulty was judged, without performing the task itself. Still, this bias was only observed on the absolute rating level rather than the scale's ability to capture changes in perceptual quality. Reported studies shed light on factors influencing scales outside of the scale formulation and construction.

No Evidence for Neural Overlap between Unconsciously Processed and Imagined Stimuli

Visual representations can be generated via feedforward or feedback processes. The extent to which these processes result in overlapping representations remains unclear. Previous work has shown that imagined stimuli elicit similar representations as perceived stimuli throughout the visual cortex. However, while representations during imagery are indeed only caused by feedback processing, neural processing during perception is an interplay of both feedforward and feedback processing. This means that any representational overlap could be because of overlap in feedback processes. In the current study, we aimed to investigate this issue by characterizing the overlap between feedforward- and feedback-initiated category representations during imagined stimuli, conscious perception, and unconscious processing using fMRI in humans of either sex. While all three conditions elicited stimulus representations in left lateral occipital cortex (LOC), significant similarities were observed only between imagery and conscious perception in this area. Furthermore, connectivity analyses revealed stronger connectivity between frontal areas and left LOC during conscious perception and in imagery compared with unconscious processing. Together, these findings can be explained by the idea that long-range feedback modifies visual representations, thereby reducing representational overlap between purely feedforward- and feedback-initiated stimulus representations measured by fMRI. Neural representations influenced by feedback, either stimulus driven (perception) or purely internally driven (imagery), are, however, relatively similar.

Behavioural Adaptation to Hereditary Macular Dystrophy: A Systematic Review on the Effect of Early Onset Central Field Loss on Peripheral Visual Abilities

Purpose:

Hereditary macular dystrophies (HMD) result in early onset central field loss. Evidence for cortical plasticity has been found in HMD, which may enhance peripheral visual abilities to meet the increased demands and reliance on the peripheral field, as has been found in congenitally deaf adults and habitual action video-game players. This is a qualitative synthesis of the literature on the effect of early onset central field loss on peripheral visual abilities. The knowledge gained may help in developing rehabilitative strategies that enable optimisation of remaining peripheral vision.

Methods:

A systematic search performed on the Web of Science and PubMED databases yielded 728 records published between 1809 to 2020, of which seven case-control studies were eligible for qualitative synthesis.

Results:

The search highlighted an overall paucity of literature, which lacked validity due to small heterogeneous samples and deficiencies in reporting of methods and population characteristics. A range of peripheral visual abilities at different eccentricities were studied. Superior performance of HMD observers in the peripheral field or similarities between the preferred retinal loci (PRL) and normal fovea were observed in four of seven studies. Findings were often based on studies including a single observer. Further larger rigorous studies are required in this area.

Conclusions:

Spontaneous perceptual learning through reliance on and repeated use of the peripheral field and PRL may result in some specific superior peripheral visual abilities. However, worse performance in some tasks could reflect unexpected rod disease, lack of intensive training, or persistent limitations due to the need for cones for specific tasks. Perceptual learning through training regimes could enable patients to optimise use of the PRL and remaining peripheral vision. However, further studies are needed to design optimal training regimes.

Cortical and subcortical signatures of conscious object recognition

The neural mechanisms underlying conscious recognition remain unclear, particularly the roles played by the prefrontal cortex, deactivated brain areas and subcortical regions. We investigated neural activity during conscious object recognition using 7 Tesla fMRI while human participants viewed object images presented at liminal contrasts. Here, we show both recognized and unrecognized images recruit widely distributed cortical and subcortical regions; however, recognized images elicit enhanced activation of visual, frontoparietal, and subcortical networks and stronger deactivation of the default-mode network. For recognized images, object category information can be decoded from all of the involved cortical networks but not from subcortical regions. Phase-scrambled images trigger strong involvement of inferior frontal junction, anterior cingulate cortex and default-mode network, implicating these regions in inferential processing under increased uncertainty. Our results indicate that content-specific activity in both activated and deactivated cortical networks and non-content-specific subcortical activity support conscious recognition.

Cortical and subcortical neural activity supporting conscious object recognition has not yet been well defined. Here, the authors describe these networks and show recognition-related category information can be decoded from widespread cortical activity but not subcortical activity.

From Objects to Unified Minds

The involvement of top-down processes in perception and cognition is widely acknowledged by now. In fields of research from predictions to inhibition, and from attentional guidance to affect, a great deal has already been charted. Integrating this newer understanding with accumulated findings from the past has made it clear that human experience is determined by a combination of both bottom-up and top-down processes. It has been proposed that the ongoing balance between their relative contribution affects a person’s entire state of mind, an overarching framework that encompasses the breadth of mental activity. According to this proposal, state of mind, in which multiple facets of mind are clumped together functionally and dynamically, orients us to the optimal state for the given circumstances. These ideas are examined here by connecting a broad array of domains in which the balance between top-down and bottom-up processes is apparent. These domains range from object recognition to contextual associations, from pattern of thought to tolerance for uncertainty, and from the default-mode network to mood. From this synthesis emerge numerous hypotheses, implications, and directions for future research in cognitive psychology, psychiatry, and neuroscience.

Meta-Analyses Support a Taxonomic Model for Representations of Different Categories of Audio-Visual Interaction Events in the Human Brain

Our ability to perceive meaningful action events involving objects, people, and other animate agents is characterized in part by an interplay of visual and auditory sensory processing and their cross-modal interactions. However, this multisensory ability can be altered or dysfunctional in some hearing and sighted individuals, and in some clinical populations. The present meta-analysis sought to test current hypotheses regarding neurobiological architectures that may mediate audio-visual multisensory processing. Reported coordinates from 82 neuroimaging studies (137 experiments) that revealed some form of audio-visual interaction in discrete brain regions were compiled, converted to a common coordinate space, and then organized along specific categorical dimensions to generate activation likelihood estimate (ALE) brain maps and various contrasts of those derived maps. The results revealed brain regions (cortical "hubs") preferentially involved in multisensory processing along different stimulus category dimensions, including 1) living versus nonliving audio-visual events, 2) audio-visual events involving vocalizations versus actions by living sources, 3) emotionally valent events, and 4) dynamic-visual versus static-visual audio-visual stimuli. These meta-analysis results are discussed in the context of neurocomputational theories of semantic knowledge representations and perception, and the brain volumes of interest are available for download to facilitate data interpretation for future neuroimaging studies.

Mapping the Scene and Object Processing Networks by Intracranial EEG

Human perception and cognition are based predominantly on visual information processing. Much of the information regarding neuronal correlates of visual processing has been derived from functional imaging studies, which have identified a variety of brain areas contributing to visual analysis, recognition, and processing of objects and scenes. However, only two of these areas, namely the parahippocampal place area (PPA) and the lateral occipital complex (LOC), were verified and further characterized by intracranial electroencephalogram (iEEG). iEEG is a unique measurement technique that samples a local neuronal population with high temporal and anatomical resolution. In the present study, we aimed to expand on previous reports and examine brain activity for selectivity of scenes and objects in the broadband high-gamma frequency range (50–150 Hz). We collected iEEG data from 27 epileptic patients while they watched a series of images, containing objects and scenes, and we identified 375 bipolar channels responding to at least one of these two categories. Using K-means clustering, we delineated their brain localization. In addition to the two areas described previously, we detected significant responses in two other scene-selective areas, not yet reported by any electrophysiological studies; namely the occipital place area (OPA) and the retrosplenial complex. Moreover, using iEEG we revealed a much broader network underlying visual processing than that described to date, using specialized functional imaging experimental designs. Here, we report the selective brain areas for scene processing include the posterior collateral sulcus and the anterior temporal region, which were already shown to be related to scene novelty and landmark naming. The object-selective responses appeared in the parietal, frontal, and temporal regions connected with tool use and object recognition. The temporal analyses specified the time course of the category selectivity through the dorsal and ventral visual streams. The receiver operating characteristic analyses identified the PPA and the fusiform portion of the LOC as being the most selective for scenes and objects, respectively. Our findings represent a valuable overview of visual processing selectivity for scenes and objects based on iEEG analyses and thus, contribute to a better understanding of visual processing in the human brain.

Vision: A Product of a Society of Independent Experts

A lesion of primary visual cortex, V1, can result in the perceived size of objects varying with the size of their retinal image. A new study shows that the pregrasp span of the hand of an individual with such a lesion remains tuned to the object's true size, providing evidence for separate representations mediating perceptual appearance and motor interactions.

All-or-none face categorization in the human brain

Visual categorization is integral for our interaction with the natural environment. In this process, similar selective responses are produced to a class of variable visual inputs. Whether categorization is supported by partial (graded) or absolute (all-or-none) neural responses in high-level human brain regions is largely unknown. We address this issue with a novel frequency-sweep paradigm probing the evolution of face categorization responses between the minimal and optimal stimulus presentation times. In a first experiment, natural images of variable non-face objects were progressively swept from 120 to 3 ​Hz (8.33-333 ​ms duration) in rapid serial visual presentation sequences. Widely variable face exemplars appeared every 1 ​s, enabling an implicit frequency-tagged face-categorization electroencephalographic (EEG) response at 1 ​Hz. Face-categorization activity emerged with stimulus durations as brief as 17 ​ms (17-83 ​ms across individual participants) but was significant with 33 ​ms durations at the group level. The face categorization response amplitude increased until 83 ​ms stimulus duration (12 ​Hz), implying graded categorization responses. In a second EEG experiment, faces appeared non-periodically throughout such sequences at fixed presentation rates, while participants explicitly categorized faces. A strong correlation between response amplitude and behavioral accuracy across frequency rates suggested that dilution from missed categorizations, rather than a decreased response to each face stimulus, accounted for the graded categorization responses as found in Experiment 1. This was supported by (1) the absence of neural responses to faces that participants failed to categorize explicitly in Experiment 2 and (2) equivalent amplitudes and spatio-temporal signatures of neural responses to behaviorally categorized faces across presentation rates. Overall, these observations provide original evidence that high-level visual categorization of faces, starting at about 100 ​ms following stimulus onset in the human brain, is variable across observers tested under tight temporal constraints, but occurs in an all-or-none fashion.

Differential neural processing of spontaneous blinking under visual and auditory sensory environments: An EEG investigation of blink-related oscillations

Blink-related oscillations (BROs) are a recently discovered neurophysiological response associated with spontaneous blinking, distinct from the well-known oculomotor and visual suppression effects. BROs strongly activate the bilateral precuneus along with other cortical regions involved in visuospatial processing and associative episodic memory, and are believed to represent environmental monitoring processes that occur following blink-induced visual interruptions. Although these responses have been reported across multiple imaging modalities under both resting and cognitive loading conditions, it is yet unknown whether these responses also exist under external sensory stimulation conditions. To address this, we investigated BRO responses in healthy adults using 64-channel electroencephalography (EEG), while participants underwent passive external auditory and visual stimulation. Our results showed that BRO responses are present under both auditory and visual stimulation conditions (p ​< ​0.05), with similar temporal and spectral features compared to rest. However, visual stimulation did result in decreased BRO amplitude compared to auditory and resting conditions (p ​< ​0.05), suggesting decreased neuronal resources for processing blink-related information in the visual but not auditory environment. There were also additional pre-blink spectral changes in the visual condition compared to rest (p ​< ​0.05), which suggest that passive visual stimulation induces neural preparatory processes occurring in anticipation of the upcoming blink event. Together, these findings provide new and compelling evidence that blink-related neural processes are modulated not only by the internal cognitive loading due to simultaneous task demands, but also by competing external sensory requirements. This highlights the link between blinking and cognition, and further demonstrates the importance of BROs as a new window into brain function.

Guessing right: Preconscious processing in inattentional blindness

Much research has been conducted on the determinants of inattentional blindness-the failure to miss an unexpected but salient stimulus in plain view. Far less research has been concerned with the fate of those objects that go unnoticed in such a setting. The available evidence suggests that objects that are not consciously noticed due to inattentional blindness are still processed to a certain degree. The present study substantiated and generalised this limited evidence by reanalysing 16 datasets in regard to participants' guessing accuracy in multiple-choice questions concerning the unexpected object: Participants who did not notice the critical object showed guessing accuracy that lay significantly above chance. Thus, stimuli that are not consciously noticed (i.e., cannot be reported) can nevertheless exert an influence on seemingly random choices. Modality of the primary task as well as performance in the primary task and in a divided-attention trial were evaluated as potential moderators. Methodological limitations such as the design and implementation of the multiple-choice questions and the generalisability of our findings are discussed, and promises of the present approach for future studies are presented.

Spectral Encoding of Seen and Attended Object Categories in the Human Brain

Local field potentials (LFPs) encode visual information via variations in power at many frequencies. These variations are complex and depend on stimulus and cognitive state in ways that have yet to be fully characterized. Specifically, the frequencies (or combinations of frequencies) that most robustly encode specific types of visual information are not fully known. To address this knowledge gap, we used intracranial EEG to record LFPs at 858 widely distributed recording sites as human subjects (six males, five females) indicated whether briefly presented natural scenes depicted one of three attended object categories. Principal component analysis applied to power spectra of the LFPs near stimulus onset revealed a broadband component (1-100 Hz) and two narrowband components (1-8 and 8-30 Hz, respectively) that encoded information about both seen and attended categories. Interestingly, we found that seen and attended categories were not encoded with the same fidelity by these distinct spectral components. Model-based tuning and decoding analyses revealed that power variations along the broadband component were most sharply tuned and offered more accurate decoding for seen than for attended categories. Power along the narrowband delta-theta (1-8 Hz) component robustly decoded information about both seen and attended categories, while the alpha-beta (8-30 Hz) component was specialized for attention. We conclude that, when viewing natural scenes, information about the seen category is encoded via broadband and sub-gamma (<30 Hz) power variations, while the attended category is most robustly encoded in the sub-gamma range. More generally, these results suggest that power variation along different spectral components can encode qualitatively different kinds of visual information.SIGNIFICANCE STATEMENT In this article, we characterize how changes in visual stimuli depicting specific objects (cars, faces, and buildings) and changes in attention to those objects affect the frequency content of local field potentials in the human brain. In contrast to many previous studies that have investigated encoding by variations in power at high (>30 Hz) frequencies, we find that the most important variation patterns are broadband (i.e., distributed across multiple frequencies) and narrowband, but in lower frequencies (<30 Hz). Interestingly, we find that seen and attended categories are not encoded with the same fidelity by these distinct spectral encoding patterns, suggesting that power at different frequencies can encode qualitatively different kinds of information.

Multimodal Computational Modeling of Visual Object Recognition Deficits but Intact Repetition Priming in Schizophrenia

The term perceptual closure refers to the neural processes responsible for "filling-in" missing information in the visual image under highly adverse viewing conditions such as fog or camouflage. Here we used a closure task that required the participants to identify barely recognizable fragmented line-drawings of common objects. Patients with schizophrenia have been shown to perform poorly on this task. Following priming, controls and importantly patients can complete the line-drawings at greater levels of fragmentation behaviorally, suggesting an improvement in their ability to perform the task. Closure phenomena have been shown to involve a distributed network of cortical regions, notably the lateral occipital complex (LOC) of the ventral visual stream, dorsal visual stream (DS), hippocampal formation (HIPP) and the prefrontal cortex (PFC). We have previously demonstrated the failure of closure processes in schizophrenia and shown that the dysregulation in the sensory information transmitted to the prefrontal cortex plays a critical role in this failure. Here, using a multimodal imaging approach in patients, combining event related electrophysiological recordings (ERP) and functional magnetic resonance imaging (fMRI), we characterize the spatiotemporal dynamics of priming in perceptual closure. Using directed functional connectivity measures we demonstrate that priming modifies the network-level interactions between the nodes of closure processing in a manner that is functionally advantageous to patients resulting in the mitigation of their deficit in perceptual closure.

Neuronal correlates of full and partial visual conscious perception

Stimuli may induce only partial consciousness-an intermediate between null and full consciousness-where the presence but not identity of an object can be reported. The differences in the neuronal basis of full and partial consciousness are poorly understood. We investigated if evoked and oscillatory activity could dissociate full from partial conscious perception. We recorded human cortical activity with magnetoencephalography (MEG) during a visual perception task in which stimulus could be either partially or fully perceived. Partial consciousness was associated with an early increase in evoked activity and theta/low-alpha-band oscillations while full consciousness was also associated with late evoked activity and beta-band oscillations. Full from partial consciousness was dissociated by stronger evoked activity and late increase in theta oscillations that were localized to higher-order visual regions and posterior parietal and prefrontal cortices. Our results reveal both evoked activity and theta oscillations dissociate partial and full consciousness.

ERP correlates of cognitive control and food-related processing in normal weight and severely obese candidates for bariatric surgery: Data gathered using a newly designed Simon task

Although there have been suggestions that altered cognitive control and food reward sensitivity contribute to overeating in obese individuals, neurophysiological correlates of these mechanisms have been poorly investigated. The current study investigated event-related potentials (ERP) in 24 severely obese and 26 normal weight individuals in fasting condition, using a novel Simon task with food and object distractors. The study showed that conflict in the Simon task for the food distractor increased with hunger in both groups but was larger with respect to a neutral condition only in the obese individuals. ERP showed higher N1amplitudes in both groups for food distractor, reflecting early food processing. The P2 latency was delayed and the effect of distractors on N2 amplitude was smaller in the obese subjects, reflecting altered neural mechanisms associated with selective attention and cognitive control, all contributing hypothetically to delay response selection of these individuals faced with food distractor.

A dual role of prestimulus spontaneous neural activity in visual object recognition

Vision relies on both specific knowledge of visual attributes, such as object categories, and general brain states, such as those reflecting arousal. We hypothesized that these phenomena independently influence recognition of forthcoming stimuli through distinct processes reflected in spontaneous neural activity. Here, we recorded magnetoencephalographic (MEG) activity in participants (N = 24) who viewed images of objects presented at recognition threshold. Using multivariate analysis applied to sensor-level activity patterns recorded before stimulus presentation, we identified two neural processes influencing subsequent subjective recognition: a general process, which disregards stimulus category and correlates with pupil size, and a specific process, which facilitates category-specific recognition. The two processes are doubly-dissociable: the general process correlates with changes in criterion but not in sensitivity, whereas the specific process correlates with changes in sensitivity but not in criterion. Our findings reveal distinct mechanisms of how spontaneous neural activity influences perception and provide a framework to integrate previous findings.

The effect of spontaneous variations in prestimulus neural activity on subsequent perception is incompletely understood. Here, using MEG, the authors identify two distinct neural processes that can influence object recognition in different ways.

Decreased static and increased dynamic global signal topography in major depressive disorder

Major depressive disorder (MDD) has been linked to imbalanced communication among large-scale brain networks. However, the details of altered large-scale coordination of MDD remains unknown. To explore the altered large-scale functional organization in MDD. We used static and dynamic global signal (GS) topography, which are data-driven methods to explore altered relationship between global and local neuronal activities in MDD. Sixty three MDD patients and matched 63 healthy controls (HCs) were recruited in current study. Patients with MDD presented decreased static GS topography in bilateral parahippocampal gyrus and hippocampus gyrus. Meanwhile, patients with MDD presented increased variability of dynamic GS topography in the right ventromedial prefrontal cortex. This result may reflect the decreased and unstable whole brain functional coherence in MDD. The decreased static GS topography in the right parahippocampal gyrus was correlated with psychomotor retardation in patients with MDD. Our results presented that the altered static and dynamic GS topography can provide distinct evidence on the physiological mechanisms of MDD.

Access to consciousness of briefly presented visual events is modulated by transcranial direct current stimulation of left dorsolateral prefrontal cortex

Adaptive behaviour requires the ability to process goal-relevant events at the expense of irrelevant ones. However, perception of a relevant visual event can transiently preclude access to consciousness of subsequent events — a phenomenon called attentional blink (AB). Here we investigated involvement of the left dorsolateral prefrontal cortex (DLPFC) in conscious access, by using transcranial direct current stimulation (tDCS) to potentiate or reduce neural excitability in the context of an AB task. In a sham-controlled experimental design, we applied between groups anodal or cathodal tDCS over the left DLPFC, and examined whether this stimulation modulated the proportion of stimuli that were consciously reported during the AB period. We found that tDCS over the left DLPFC affected the proportion of consciously perceived target stimuli. Moreover, anodal and cathodal tDCS had opposing effects, and exhibited different temporal patterns. Anodal stimulation attenuated the AB, enhancing conscious report earlier in the AB period. Cathodal stimulation accentuated the AB, reducing conscious report later in the AB period. These findings support the notion that the DLPFC plays a role in facilitating information transition from the unconscious to the conscious stage of processing.

Altered Global Signal Topography and Its Different Regional Localization in Motor Cortex and Hippocampus in Mania and Depression

Bipolar disorder (BD) is a complex psychiatric disorder characterized by dominant symptom swings across different phases (manic, depressive, and euthymic). Different symptoms in BD such as abnormal episodic memory recall and psychomotor activity have been related to alterations in different regions, ie, hippocampus and motor cortex. How the abnormal regional distribution of neuronal activity relates to specific symptoms remains unclear, however. One possible neuronal mechanism of the relationship is the alteration of the global distribution of neuronal activity manifested in specific local regions; this can be measured as the correlation between the global signal (GS) and local regions. To understand the GS and its relationship to psychopathological symptoms, we here investigated the alteration of both GS variance and its regional topography in healthy controls and 3 phases of BD. We found that the variance of GS showed no significant difference between the 4 groups. In contrast, the GS topography was significantly altered in the different phases of BD, ie, the regions showing abnormally strong topographical GS contribution changed from hippocampus (and parahippocampus/fusiform gyrus) in depression to motor cortex in mania. Importantly, topographical GS changes in these regions correlated with psychopathological measures in both depression and mania. Taken together, our findings demonstrate the central importance of GS topography for psychopathological symptoms. This sheds lights on the neuronal mechanisms of specific psychopathological symptoms in BD, and its relevance in the relationship between global and local neuronal activities for behavior in general.

Dysfunction of Magnocellular/dorsal Processing Stream in Schizophrenia

Background:

Patients with schizophrenia show not only cognitive, but also perceptual deficits. Perceptual deficits may affect different sensory modalities. Among these, the impairment of visual information processing is of particular relevance as demonstrated by the high incidence of visual disturbances. In recent years, the study of neurophysiological mechanisms that underlie visuo-perceptual, -spatial and -motor disorders in schizophrenia has increasingly attracted the interest of researchers.

Objective:

The study aims to review the existent literature on magnocellular/dorsal (occipitoparietal) visual processing stream impairment in schizophrenia. The impairment of relatively early stages of visual information processing was examined using experimental paradigms such as backward masking, contrast sensitivity, contour detection, and perceptual closure. The deficits of late processing stages were detected by examining visuo-spatial and -motor abilities.

Results:

Neurophysiological and behavioral studies support the existence of deficits in the processing of visual information along the magnocellular/dorsal pathway. These deficits appear to affect both early and late stages of visual information processing.

Conclusion:

The existence of disturbances in the early processing of visual information along the magnocellular/dorsal pathway is strongly supported by neurophysiological and behavioral observations. Early magnocellular dysfunction may provide a substrate for late dorsal processing impairment as well as higher-level cognition deficits.

Cognitive loading via mental arithmetic modulates effects of blink-related oscillations on precuneus and ventral attention network regions

Blink-related oscillations (BROs) have been linked with environmental monitoring processes associated with blinking, with cortical activations in the bilateral precuneus. Although BROs have been described under resting and passive fixation conditions, little is known about their characteristics under cognitive loading. To address this, we investigated BRO effects during both mental arithmetic (MA) and passive fixation (PF) tasks using magnetoencephalography (n =20), while maintaining the same sensory environment in both tasks. Our results confirmed the presence of BRO effects in both MA and PF tasks, with similar characteristics including blink-related increase in global field power and blink-related activation of the bilateral precuneus. In addition, cognitive loading due to MA also modulated BRO effects by decreasing BRO-induced cortical activations in key brain regions including the bilateral anterior precuneus. Interestingly, blinking during MA-but not PF-activated regions of the ventral attention network (i.e., right supramarginal gyrus and inferior frontal gyrus), suggesting possible recruitment of these areas for blink processing under cognitive loading conditions. Time-frequency analysis revealed a consistent pattern of BRO-related effects in the precuneus in both tasks, but with task-related functional segregation within the anterior and posterior subregions. Based on these findings, we postulate a potential neurocognitive mechanism for blink processing in the precuneus. This study is the first investigation of BRO effects under cognitive loading, and our results provide compelling new evidence for the important cognitive implications of blink-related processing in the human brain.

Differential Roles of the Salience Network During Prediction Error Encoding and Facial Emotion Processing Among Female Adolescent Assault Victims

BACKGROUND

Early-life assaultive violence exposure is a potent risk factor for posttraumatic stress disorder (PTSD) and other mood and anxiety disorders. Neurocircuitry models posit that increased risk is mediated by heightened emotion processing in a salience network including the dorsal anterior cingulate cortex, anterior insula, and amygdala. However, the processes of reinforcement learning (RL) also engage the salience network and are implicated in responses to early-life trauma and PTSD. To define their relative roles in response to early-life trauma and PTSD symptoms, the current study compared engagement of the salience network during emotion processing and RL as a function of early-life assault exposure.

METHODS

Adolescent girls (n = 30 girls who had previously been physically or sexually assaulted; n = 30 healthy girls for comparison) 11 to 17 years of age completed two types of tasks during functional magnetic resonance imaging: a facial emotion processing task and an RL task using either social or nonsocial stimuli. Independent component analysis was used to identify a salience network and characterize its engagement in response to emotion processing and prediction error encoding during the RL tasks.

RESULTS

Assault was related to greater reactivity of the salience network during emotion processing. By contrast, we found lesser encoding of negative prediction errors in the salience network, particularly during the social RL task, in girls who had been assaulted. The dysfunction of salience network activity during emotion processing and prediction error encoding was not associated with PTSD symptoms.

CONCLUSIONS

These results suggest that hyper- versus hypoactivity of the salience network among trauma-exposed youths depends on the cognitive-affective domain.

Three-stage processing of category and variation information by entangled interactive mechanisms of peri-occipital and peri-frontal cortices

Object recognition has been a central question in human vision research. The general consensus is that the ventral and dorsal visual streams are the major processing pathways undertaking objects' category and variation processing. This overlooks mounting evidence supporting the role of peri-frontal areas in category processing. Yet, many aspects of visual processing in peri-frontal areas have remained unattended including whether these areas play role only during active recognition and whether they interact with lower visual areas or process information independently. To address these questions, subjects were presented with a set of variation-controlled object images while their EEG were recorded. Considerable amounts of category and variation information were decodable from occipital, parietal, temporal and prefrontal electrodes. Using information-selectivity indices, phase and Granger causality analyses, three processing stages were identified showing distinct directions of information transaction between peri-frontal and peri-occipital areas suggesting their parallel yet interactive role in visual processing. A brain-plausible model supported the possibility of interactive mechanisms in peri-occipital and peri-frontal areas. These findings, while promoting the role of prefrontal areas in object recognition, extend their contributions from active recognition, in which peri-frontal to peri-occipital pathways are activated by higher cognitive processes, to the general sensory-driven object and variation processing.

The Relationship Between General Intelligence and Cortical Structure in Healthy Individuals

Considerable work in recent years has examined the relationship between cortical thickness (CT) and general intelligence (IQ) in healthy individuals. It is not known whether specific IQ variables (i.e., perceptual reasoning [PIQ], verbal comprehension IQ [VIQ], and full-scale IQ [FSIQ]) are associated with multiple cortical measures (i.e., CT, cortical volume (CV), cortical surface area (CSA) and cortical gyrification (CG)) within the same individuals. Here we examined the association between these neuroimaging metrics and IQ in 56 healthy adults. At a cluster-forming threshold (CFT) of p < 0.05, we observed significant positive relationships between CT and all three IQ variables in regions within the posterior frontal and superior parietal lobes. Regions within the temporal and posterior frontal lobes exhibited positive relationships between CV and two IQ variables (PIQ and FSIQ) and regions within the inferior parietal lobe exhibited positive relationships between CV and PIQ. Additionally, CV was positively associated with VIQ in the left insula and with FSIQ within the inferior frontal gyrus. At a more stringent CFT (p < 0.01), the CT-PIQ, CT-VIQ, CT-FSIQ, and CV-PIQ relationships remained significant within the posterior frontal lobe, as did the CV-PIQ relationship within the temporal and inferior parietal lobes. We did not observe statistically significant relationships between IQ and either CSA or CG. Our findings suggest that the neural basis of IQ extends beyond previously observed relationships with fronto-parietal regions. We also conclude that CT and CV may be more useful metrics than CSA or CG in the study of intellectual abilities.

Cortical Circuit for Binding Object Identity and Location During Multiple-Object Tracking

Sustained multifocal attention for moving targets requires binding object identities with their locations. The brain mechanisms of identity-location binding during attentive tracking have remained unresolved. In 2 functional magnetic resonance imaging experiments, we measured participants’ hemodynamic activity during attentive tracking of multiple objects with equivalent (multiple-object tracking) versus distinct (multiple identity tracking, MIT) identities. Task load was manipulated parametrically. Both tasks activated large frontoparietal circuits. MIT led to significantly increased activity in frontoparietal and temporal systems subserving object recognition and working memory. These effects were replicated when eye movements were prohibited. MIT was associated with significantly increased functional connectivity between lateral temporal and frontal and parietal regions. We propose that coordinated activity of this network subserves identity-location binding during attentive tracking.

Functional Preference for Object Sounds and Voices in the Brain of Early Blind and Sighted Individuals

Sounds activate occipital regions in early blind individuals. However, how different sound categories map onto specific regions of the occipital cortex remains a matter of debate. We used fMRI to characterize brain responses of early blind and sighted individuals to familiar object sounds, human voices, and their respective low-level control sounds. In addition, sighted participants were tested while viewing pictures of faces, objects, and phase-scrambled control pictures. In both early blind and sighted, a double dissociation was evidenced in bilateral auditory cortices between responses to voices and object sounds: Voices elicited categorical responses in bilateral superior temporal sulci, whereas object sounds elicited categorical responses along the lateral fissure bilaterally, including the primary auditory cortex and planum temporale. Outside the auditory regions, object sounds also elicited categorical responses in the left lateral and in the ventral occipitotemporal regions in both groups. These regions also showed response preference for images of objects in the sighted group, thus suggesting a functional specialization that is independent of sensory input and visual experience. Between-group comparisons revealed that, only in the blind group, categorical responses to object sounds extended more posteriorly into the occipital cortex. Functional connectivity analyses evidenced a selective increase in the functional coupling between these reorganized regions and regions of the ventral occipitotemporal cortex in the blind group. In contrast, vocal sounds did not elicit preferential responses in the occipital cortex in either group. Nevertheless, enhanced voice-selective connectivity between the left temporal voice area and the right fusiform gyrus were found in the blind group. Altogether, these findings suggest that, in the absence of developmental vision, separate auditory categories are not equipotent in driving selective auditory recruitment of occipitotemporal regions and highlight the presence of domain-selective constraints on the expression of cross-modal plasticity.

Desirability, availability, credit assignment, category learning, and attention: Cognitive-emotional and working memory dynamics of orbitofrontal, ventrolateral, and dorsolateral prefrontal cortices

BACKGROUND

The prefrontal cortices play an essential role in cognitive-emotional and working memory processes through interactions with multiple brain regions.

METHODS

This article further develops a unified neural architecture that explains many recent and classical data about prefrontal function and makes testable predictions.

RESULTS

Prefrontal properties of desirability, availability, credit assignment, category learning, and feature-based attention are explained. These properties arise through interactions of orbitofrontal, ventrolateral prefrontal, and dorsolateral prefrontal cortices with the inferotemporal cortex, perirhinal cortex, parahippocampal cortices; ventral bank of the principal sulcus, ventral prearcuate gyrus, frontal eye fields, hippocampus, amygdala, basal ganglia, hypothalamus, and visual cortical areas V1, V2, V3A, V4, middle temporal cortex, medial superior temporal area, lateral intraparietal cortex, and posterior parietal cortex. Model explanations also include how the value of visual objects and events is computed, which objects and events cause desired consequences and which may be ignored as predictively irrelevant, and how to plan and act to realise these consequences, including how to selectively filter expected versus unexpected events, leading to movements towards, and conscious perception of, expected events. Modelled processes include reinforcement learning and incentive motivational learning; object and spatial working memory dynamics; and category learning, including the learning of object categories, value categories, object-value categories, and sequence categories, or list chunks.

CONCLUSION

This article hereby proposes a unified neural theory of prefrontal cortex and its functions.

Making sense of objects lying around: How contextual objects shape brain activity during action observation

Action recognition involves not only the readout of body movements and involved objects but also the integration of contextual information, e.g. the environment in which an action takes place. Notably, inferring superordinate goals and generating predictions about forthcoming action steps should benefit from screening the actor's immediate environment, in particular objects located in the actor's peripersonal space and thus potentially used in following action steps. Critically, if such contextual objects (COs) afford actions that are semantically related to the observed action, they may trigger or facilitate the inference of goals and the prediction of following actions. This fMRI study investigated the neural mechanisms underlying the integration of COs in semantic and spatial relation to observed actions. Specifically, we tested the hypothesis that the inferior frontal gyrus (IFG) subserves this integration. Participants observed action videos in which COs and observed actions had common overarching goals or not (goal affinity) and varied in their location relative to the actor. High goal affinity increased bilateral activity in action observation network nodes, i.e. the occipitotemporal cortex and the intraparietal sulcus, but also in the precuneus and middle frontal gyri. This finding suggests that the semantic relation between COs and actions is considered during action observation and triggers (rather than facilitates) processes beyond those usually involved in action observation. Moreover, COs with high goal affinity located close to the actor's dominant hand additionally engaged bilateral IFG, corroborating the view that IFG is critically involved in the integration of action steps under a common overarching goal.

Auditory object perception: A neurobiological model and prospective review

Interaction with the world is a multisensory experience, but most of what is known about the neural correlates of perception comes from studying vision. Auditory inputs enter cortex with its own set of unique qualities, and leads to use in oral communication, speech, music, and the understanding of emotional and intentional states of others, all of which are central to the human experience. To better understand how the auditory system develops, recovers after injury, and how it may have transitioned in its functions over the course of hominin evolution, advances are needed in models of how the human brain is organized to process real-world natural sounds and "auditory objects". This review presents a simple fundamental neurobiological model of hearing perception at a category level that incorporates principles of bottom-up signal processing together with top-down constraints of grounded cognition theories of knowledge representation. Though mostly derived from human neuroimaging literature, this theoretical framework highlights rudimentary principles of real-world sound processing that may apply to most if not all mammalian species with hearing and acoustic communication abilities. The model encompasses three basic categories of sound-source: (1) action sounds (non-vocalizations) produced by 'living things', with human (conspecific) and non-human animal sources representing two subcategories; (2) action sounds produced by 'non-living things', including environmental sources and human-made machinery; and (3) vocalizations ('living things'), with human versus non-human animals as two subcategories therein. The model is presented in the context of cognitive architectures relating to multisensory, sensory-motor, and spoken language organizations. The models' predictive values are further discussed in the context of anthropological theories of oral communication evolution and the neurodevelopment of spoken language proto-networks in infants/toddlers. These phylogenetic and ontogenetic frameworks both entail cortical network maturations that are proposed to at least in part be organized around a number of universal acoustic-semantic signal attributes of natural sounds, which are addressed herein.

The priming of basic combinatory responses in MEG

Priming has been a powerful tool for the study of human memory and especially the memory representations relevant for language. However, although it is well established that lexical access can be primed, we do not know exactly what types of computations can be primed above the word level. This work took a neurobiological approach and assessed the ways in which the complex representation of a minimal combinatory phrase, such as red boat, can be primed, as evidenced by the spatiotemporal profiles of magnetoencephalography (MEG) signals. Specifically, we built upon recent progress on the neural signatures of phrasal composition and tested whether the brain activities implicated for the basic combination of two words could be primed. In two experiments, MEG was recorded during a picture naming task where the prime trials were designed to replicate previously reported combinatory effects and the target trials to test whether those combinatory effects could be primed. The manipulation of the primes was successful in eliciting larger activity for adjective-noun combinations than single nouns in left anterior temporal and ventromedial prefrontal cortices, replicating prior MEG studies on parallel contrasts. Priming of similarly timed activity was observed during target trials in anterior temporal cortex, but only when the prime and target shared an adjective. No priming in temporal cortex was observed for single word repetition and two control tasks showed that the priming effect was not elicited if the prime pictures were simply viewed but not named. In sum, this work provides evidence that very basic combinatory operations can be primed, with the necessity for some lexical overlap between prime and target suggesting combinatory conceptual, as opposed to syntactic processing. Both our combinatory and priming effects were early, onsetting between 100 and 150ms after picture onset and thus are likely to reflect the very earliest planning stages of a combinatory message. Thus our findings suggest that at the earliest stages of combinatory planning in production, a combinatory memory representation is formed that affects the planning of a relevantly similar combination on a subsequent trial.

Semantic incongruity attracts attention at a pre-conscious level: Evidence from a TMS study

Unpredicted objects, i.e., those that do not fit in a specific context, have been shown to quickly attract attention as a mean of extracting more information about potentially relevant items. Whether the required semantic processing triggering the attraction of attention can occur independently of participants' awareness of the object is still a highly debated topic. In the present study we make use of a change detection task in which we manipulate the semantic congruity between the to-be-detected object and the background scene. We applied inhibitory repetitive transcranial magnetic stimulation (rTMS) over the right temporo-parietal junction (right TPJ) and a control location (vertex) to test the causal role of the former in the processing of objects at a pre-conscious level. Our results clearly show that semantic congruity can impact detection and identification processes in opposite ways, even when low-level features are controlled for. Incongruent objects are quickly detected but poorly identified. rTMS over the right TPJ effectively diminishes semantic effects on object detection. These results suggest that at least some high order category processing takes place before conscious detection to direct attention towards the most informative regions of space. Moreover, rTMS over right TPJ also impacts object identification, which calls for a re-evaluation of right TPJ's role on object processing.