Object representations in ventral and dorsal visual streams: fMRI repetition effects depend on attention and part-whole configuration

Dynamic changes in neural representations underlie the repetition effect on false memory

Restudying word lists (e.g., dream, awake, and bed) strengthens true memory of the studied words and reduces false memory for unstudied but semantically related lures (e.g., sleep). Yet, the neural mechanisms involved in this repetition effect on false memory remain unclear. Possible mechanisms involve item-specific and semantic neural representations at encoding, and the memory strength between encoding and retrieval. This study first replicated the behavioral results (Exp. 1) and then investigated various neural mechanisms by using slow event-related functional magnetic resonance imaging (fMRI) and representational similarity analysis (Exp. 2). Behavioral results confirmed that restudy improved true memory and reduced false memory. The fMRI results showed that restudy induced item-specific neural representations at encoding in the left occipital pole, but reduced neural overlap between semantic representations at encoding in the left temporal pole. Individual differences in these two encoding neural mechanisms were correlated with the behavioral measure of false memory, with greater restudy-induced representational changes at encoding (item-specific neural representations and reduced neural overlap between semantic representations) being associated with lower false memory. Moreover, restudy enhanced the memory strength between encoding and retrieval in the visuoparietal cortex but reduced it in the frontal cortex. These findings suggest that dynamic changes in neural representations underlie the repetition effect on false memory, supporting a dual-coding neural framework.

Intermediate, Wholistic Shape Representation in Object Recognition: A Pre-Attentive Stage of Processing?

Evidence is presented for intermediate, wholistic visual representations of objects and non-objects that are computed online and independent of visual attention. Short-term visual priming was examined between visually similar shapes, with targets either falling at the (valid) location cued by primes or at another (invalid) location. Object decision latencies were facilitated when the overall shapes of the stimuli were similar irrespective of whether the location of the prime was valid or invalid, with the effects being equally large for object and non-object targets. In addition, the effects were based on the overall outlines of the stimuli and low spatial frequency components, not on local parts. In conclusion, wholistic shape representations based on outline form, are rapidly computed online during object recognition. Moreover, activation of common wholistic shape representations prime the processing of subsequent objects and non-objects irrespective of whether they appear at attended or unattended locations. Rapid derivation of wholistic form provides a key intermediate stage of object recognition.

Intracranial recording in patients with aphasia using nanomaterial-based flexible electronics: promises and challenges

In recent years, researchers have studied how nanotechnology could enhance neuroimaging techniques. The application of nanomaterial-based flexible electronics has the potential to advance conventional intracranial electroencephalography (iEEG) by utilising brain-compatible soft nanomaterials. The resultant technique has significantly high spatial and temporal resolution, both of which enhance the localisation of brain functions and the mapping of dynamic language processing. This review presents findings on aphasia, an impairment in language and communication, and discusses how different brain imaging techniques, including positron emission tomography, magnetic resonance imaging, and iEEG, have advanced our understanding of the neural networks underlying language and reading processing. We then outline the strengths and weaknesses of iEEG in studying human cognition and the development of intracranial recordings that use brain-compatible flexible electrodes. We close by discussing the potential advantages and challenges of future investigations adopting nanomaterial-based flexible electronics for intracranial recording in patients with aphasia.

Left Amygdala Regulates the Cerebral Reading Network During Fast Emotion Word Processing

Emotion words constitute a special class of verbal stimuli which can quickly activate the limbic system outside the left-hemisphere language network. Such fast response to emotion words may arise independently of the left occipitotemporal area involved in visual word-form analysis and rely on a distinct amygdala-dependent emotion circuit involved in fearful face processing. Using a hemifield priming paradigm with fMRI, we explored how the left and right amygdala systems interact with the reading network during emotion word processing. On each trial, participants viewed a centrally presented target which was preceded by a masked prime flashed either to the left or right visual field. Primes and targets, each denoting negative or positive nouns, could be either affectively congruent or incongruent with each other. We observed that affective congruency produced parallel changes in neural priming between the left frontal and parietotemporal regions and the bilateral amygdala. However, we also found that the left, but not right, amygdala exhibited significant change in functional connectivity with the neural components of reading as a function of affective congruency. Collectively, these results suggest that emotion words activate the bilateral amygdala during early stages of emotion word processing, whereas only the left amygdala exerts a long-distance regulatory influence over the reading network via its strong within-hemisphere connectivity.

Functional connectivity underlying hedonic response to food in female adolescents with atypical AN: the role of somatosensory and salience networks

Atypical anorexia nervosa (AN) usually occurs during adolescence. Patients are often in the normal-weight range at diagnosis; however, they often present with signs of medical complications and severe restraint over eating, body dissatisfaction, and low self-esteem. We investigated functional circuitry underlying the hedonic response in 28 female adolescent patients diagnosed with atypical AN and 33 healthy controls. Participants were shown images of food with high (HC) or low (LC) caloric content in alternating blocks during functional MRI. The HC > LC contrast was calculated. Based on the previous literature on full-threshold AN, we hypothesized that patients would exhibit increased connectivity in areas involved in sensory processing and bottom-up responses, coupled to increased connectivity from areas related to top-down inhibitory control, compared with controls. Patients showed increased connectivity in pathways related to multimodal somatosensory processing and memory retrieval. The connectivity was on the other hand decreased in patients in salience and attentional networks, and in a wide cerebello-occipital network. Our study was the first investigation of food-related neural response in atypical AN. Our findings support higher somatosensory processing in patients in response to HC food images compared with controls, however HC food was less efficient than LC food in engaging patients' bottom-up salient responses, and was not associated with connectivity increases in inhibitory control regions. These findings suggest that the psychopathological mechanisms underlying food restriction in atypical AN differ from full-threshold AN. Elucidating the mechanisms underlying the development and maintenance of eating behavior in atypical AN might help designing specific treatment strategies.

Object Category Understanding via Eye Fixations on Freehand Sketches

The study of eye gaze fixations on photographic images is an active research area. In contrast, the image sub-category of freehand sketches has not received as much attention for such studies. In this paper, we analyze the results of a free-viewing gaze fixation study conducted on 3904 freehand sketches distributed across 160 object categories. Our analysis shows that fixation sequences exhibit marked consistency within a sketch, across sketches of a category and even across suitably grouped sets of categories. This multi-level consistency is remarkable given the variability in depiction and extreme image content sparsity that characterizes hand-drawn object sketches. In this paper, we show that the multi-level consistency in the fixation data can be exploited to 1) predict a test sketch's category given only its fixation sequence and 2) build a computational model which predicts part-labels underlying fixations on objects. We hope that our findings motivate the community to deem sketch-like representations worthy of gaze-based studies vis-a-vis photographic images.

Brain and cognitive reserve: Translation via network control theory

Traditional approaches to understanding the brain's resilience to neuropathology have identified neurophysiological variables, often described as brain or cognitive "reserve," associated with better outcomes. However, mechanisms of function and resilience in large-scale brain networks remain poorly understood. Dynamic network theory may provide a basis for substantive advances in understanding functional resilience in the human brain. In this perspective, we describe recent theoretical approaches from network control theory as a framework for investigating network level mechanisms underlying cognitive function and the dynamics of neuroplasticity in the human brain. We describe the theoretical opportunities offered by the application of network control theory at the level of the human connectome to understand cognitive resilience and inform translational intervention.

Event-Related Potential Effects of Object Repetition Depend on Attention and Part-Whole Configuration

The effects of spatial attention and part-whole configuration on recognition of repeated objects were investigated with behavioral and event-related potential (ERP) measures. Short-term repetition effects were measured for probe objects as a function of whether a preceding prime object was shown as an intact image or coarsely scrambled (split into two halves) and whether or not it had been attended during the prime display. In line with previous behavioral experiments, priming effects were observed from both intact and split primes for attended objects, but only from intact (repeated same-view) objects when they were unattended. These behavioral results were reflected in ERP waveforms at occipital–temporal locations as more negative-going deflections for repeated items in the time window between 220 and 300 ms after probe onset (N250r). Attended intact images showed generally more enhanced repetition effects than split ones. Unattended images showed repetition effects only when presented in an intact configuration, and this finding was limited to the right-hemisphere electrodes. Repetition effects in earlier (before 200 ms) time windows were limited to attended conditions at occipito-temporal sites during the N1, a component linked to the encoding of object structure, while repetition effects at central locations during the same time window (P150) were found for attended and unattended probes but only when repeated in the same intact configuration. The data indicate that view-generalization is mediated by a combination of analytic (part-based) representations and automatic view-dependent representations.

Steady-state visually evoked potential correlates of human body perception

In cognitive neuroscience, interest in the neuronal basis underlying the processing of human bodies is steadily increasing. Based on functional magnetic resonance imaging studies, it is assumed that the processing of pictures of human bodies is anchored in a network of specialized brain areas comprising the extrastriate and the fusiform body area (EBA, FBA). An alternative to examine the dynamics within these networks is electroencephalography, more specifically so-called steady-state visually evoked potentials (SSVEPs). In SSVEP tasks, a visual stimulus is presented repetitively at a predefined flickering rate and typically elicits a continuous oscillatory brain response at this frequency. This brain response is characterized by an excellent signal-to-noise ratio-a major advantage for source reconstructions. The main goal of present study was to demonstrate the feasibility of this method to study human body perception. To that end, we presented pictures of bodies and contrasted the resulting SSVEPs to two control conditions, i.e., non-objects and pictures of everyday objects (chairs). We found specific SSVEPs amplitude differences between bodies and both control conditions. Source reconstructions localized the SSVEP generators to a network of temporal, occipital and parietal areas. Interestingly, only body perception resulted in activity differences in middle temporal and lateral occipitotemporal areas, most likely reflecting the EBA/FBA.

Developmental Commonalities between Object and Face Recognition in Adolescence

In the visual perception literature, the recognition of faces has often been contrasted with that of non-face objects, in terms of differences with regard to the role of parts, part relations and holistic processing. However, recent evidence from developmental studies has begun to blur this sharp distinction. We review evidence for a protracted development of object recognition that is reminiscent of the well-documented slow maturation observed for faces. The prolonged development manifests itself in a retarded processing of metric part relations as opposed to that of individual parts and offers surprising parallels to developmental accounts of face recognition, even though the interpretation of the data is less clear with regard to holistic processing. We conclude that such results might indicate functional commonalities between the mechanisms underlying the recognition of faces and non-face objects, which are modulated by different task requirements in the two stimulus domains.

Functional neuroimaging of visuospatial working memory tasks enables accurate detection of attention deficit and hyperactivity disorder

Finding neurobiological markers for neurodevelopmental disorders, such as attention deficit and hyperactivity disorder (ADHD), is a major objective of clinicians and neuroscientists. We examined if functional Magnetic Resonance Imaging (fMRI) data from a few distinct visuospatial working memory (VSWM) tasks enables accurately detecting cases with ADHD. We tested 20 boys with ADHD combined type and 20 typically developed (TD) boys in four VSWM tasks that differed in feedback availability (feedback, no-feedback) and reward size (large, small). We used a multimodal analysis based on brain activity in 16 regions of interest, significantly activated or deactivated in the four VSWM tasks (based on the entire participants' sample). Dimensionality of the data was reduced into 10 principal components that were used as the input variables to a logistic regression classifier. fMRI data from the four VSWM tasks enabled a classification accuracy of 92.5%, with high predicted ADHD probability values for most clinical cases, and low predicted ADHD probabilities for most TDs. This accuracy level was higher than those achieved by using the fMRI data of any single task, or the respective behavioral data. This indicates that task-based fMRI data acquired while participants perform a few distinct VSWM tasks enables improved detection of clinical cases.

Feedback associated with expectation for larger-reward improves visuospatial working memory performances in children with ADHD

•

Children with ADHD and normal controls were tested in working memory tasks.

•

Availability of feedback and expectation for monetary reward were manipulated.

•

ADHDs showed improved working memory when feedback was associated with larger-reward.

•

Performance improvement in ADHD was associated with brain activity normalization.

We tested the interactive effect of feedback and reward on visuospatial working memory in children with ADHD. Seventeen boys with ADHD and 17 Normal Control (NC) boys underwent functional magnetic resonance imaging (fMRI) while performing four visuospatial 2-back tasks that required monitoring the spatial location of letters presented on a display. Tasks varied in reward size (large; small) and feedback availability (no-feedback; feedback). While the performance of NC boys was high in all conditions, boys with ADHD exhibited higher performance (similar to those of NC boys) only when they received feedback associated with large-reward. Performance pattern in both groups was mirrored by neural activity in an executive function neural network comprised of few distinct frontal brain regions. Specifically, neural activity in the left and right middle frontal gyri of boys with ADHD became normal-like only when feedback was available, mainly when feedback was associated with large-reward. When feedback was associated with small-reward, or when large-reward was expected but feedback was not available, boys with ADHD exhibited altered neural activity in the medial orbitofrontal cortex and anterior insula. This suggests that contextual support normalizes activity in executive brain regions in children with ADHD, which results in improved working memory.

Good thinking or gut feeling? Cognitive reflection and intuition in traders, bankers and financial non-experts

The current study investigated differences in decision-making style and risk-taking between financial traders, non-trading bank employees, and people not working in finance. Traders scored significantly higher than participants in the other two groups on the cognitive reflection test (CRT) which measures the tendency to inhibit automatic but frequently false responses in reasoning tasks. Scores for traders compared to people outside the banking sector were also higher on a self-rated scale for reflective thinking in decision-making, but there were no differences in self-rated intuitive thinking between groups. Financial risk-taking correlated with cognitive reflection scores and was significantly lower in the non-expert group compared to the other groups working in financial services. Traders in the current study showed no elevated preference to use ‘intuition’ in their decision-making compared to other groups. Overall, these results indicate that compared to non-expert participants financial traders have a higher self-rated tendency for reflective thinking and a greater propensity to inhibit the use of mental shortcuts (heuristics) in decision-making.

Non-holistic coding of objects in lateral occipital complex with and without attention

A fundamental issue in visual cognition is whether high-level visual areas code objects in a part-based or a view-based (holistic) format. Previous behavioral and neuroimaging studies that examined the viewpoint invariance of object recognition have yielded ambiguous results, providing evidence for either type of representational format. A critical factor distinguishing the two formats could be the availability of attentional resources, as a number of priming studies have found greater viewpoint invariance for attended compared to unattended objects. It has therefore been suggested that the activation of part-based representations requires attention, whereas the activation of holistic representations occurs automatically irrespective of attention. Using functional magnetic resonance imaging in combination with a novel multivariate pattern analysis approach, the present study probed the format of object representations in human lateral occipital complex and its dependence on attention. We presented human participants with intact and half-split versions of objects that were either attended or unattended. Cross-classifying between intact and split objects, we found that the object-related information coded in activation patterns of intact objects is fully preserved in the patterns of split objects and vice versa. Importantly, the generalization between intact and split objects did not depend on attention. We conclude that lateral occipital complex codes objects in a non-holistic format, both in the presence and absence of attention.

Prism adaptation does not alter configural processing of faces

Patients with hemispatial neglect (‘neglect’) following a brain lesion show difficulty responding or orienting to objects and events on the left side of space. Substantial evidence supports the use of a sensorimotor training technique called prism adaptation as a treatment for neglect. Reaching for visual targets viewed through prismatic lenses that induce a rightward shift in the visual image results in a leftward recalibration of reaching movements that is accompanied by a reduction of symptoms in patients with neglect. The understanding of prism adaptation has also been advanced through studies of healthy participants, in whom adaptation to leftward prismatic shifts results in temporary neglect-like performance. Interestingly, prism adaptation can also alter aspects of non-lateralised spatial attention. We previously demonstrated that prism adaptation alters the extent to which neglect patients and healthy participants process local features versus global configurations of visual stimuli. Since deficits in non-lateralised spatial attention are thought to contribute to the severity of neglect symptoms, it is possible that the effect of prism adaptation on these deficits contributes to its efficacy. This study examines the pervasiveness of the effects of prism adaptation on perception by examining the effect of prism adaptation on configural face processing using a composite face task. The composite face task is a persuasive demonstration of the automatic global-level processing of faces: the top and bottom halves of two familiar faces form a seemingly new, unknown face when viewed together. Participants identified the top or bottom halves of composite faces before and after prism adaptation. Sensorimotor adaptation was confirmed by significant pointing aftereffect, however there was no significant change in the extent to which the irrelevant face half interfered with processing. The results support the proposal that the therapeutic effects of prism adaptation are limited to dorsal stream processing.

Earlier development of analytical than holistic object recognition in adolescence

BACKGROUND

Previous research has shown that object recognition may develop well into late childhood and adolescence. The present study extends that research and reveals novel differences in holistic and analytic recognition performance in 7-12 year olds compared to that seen in adults. We interpret our data within a hybrid model of object recognition that proposes two parallel routes for recognition (analytic vs. holistic) modulated by attention.

METHODOLOGY/PRINCIPAL FINDINGS

Using a repetition-priming paradigm, we found in Experiment 1 that children showed no holistic priming, but only analytic priming. Given that holistic priming might be thought to be more 'primitive', we confirmed in Experiment 2 that our surprising finding was not because children's analytic recognition was merely a result of name repetition.

CONCLUSIONS/SIGNIFICANCE

Our results suggest a developmental primacy of analytic object recognition. By contrast, holistic object recognition skills appear to emerge with a much more protracted trajectory extending into late adolescence.

The effect of imagination on stimulation: the functional specificity of efference copies in speech processing

The computational role of efference copies is widely appreciated in action and perception research, but their properties for speech processing remain murky. We tested the functional specificity of auditory efference copies using magnetoencephalography recordings in an unconventional pairing: We used a classical cognitive manipulation (mental imagery--to elicit internal simulation and estimation) with a well-established experimental paradigm (one shot repetition--to assess neuronal specificity). Participants performed tasks that differentially implicated internal prediction of sensory consequences (overt speaking, imagined speaking, and imagined hearing) and their modulatory effects on the perception of an auditory (syllable) probe were assessed. Remarkably, the neural responses to overt syllable probes vary systematically, both in terms of directionality (suppression, enhancement) and temporal dynamics (early, late), as a function of the preceding covert mental imagery adaptor. We show, in the context of a dual-pathway model, that internal simulation shapes perception in a context-dependent manner.

Evidence of change in brain activity among childhood cancer survivors participating in a cognitive remediation program

Increased understanding of the underlying mechanisms of cognitive remediation is needed to facilitate development of intervention strategies for childhood cancer survivors experiencing cognitive late effects. Accordingly, a pilot functional magnetic resonance imaging (fMRI) study was conducted with 14 cancer survivors (12.02 ± 0.09 years old), who participated in a cognitive remediation clinical trial, and 28 healthy children (12.7 ± 0.6 years old). The ventral visual areas, cerebellum, supplementary motor area, and left inferior frontal cortex were significantly activated in the healthy participants during a continuous performance task. In survivors, brain activation in these regions was diminished at baseline, and increased upon completion of remediation and at a 6-month follow-up. The fMRI activation index for each region of interest was inversely associated with the Conners' Clinical Competence Index (p<.01). The pilot study suggests that fMRI is useful in evaluating neural responses to cognitive remediation.

Hemispheric asymmetry of visual scene processing in the human brain: evidence from repetition priming and intrinsic activity

Asymmetrical specialization of cognitive processes across the cerebral hemispheres is a hallmark of healthy brain development and an important evolutionary trait underlying higher cognition in humans. While previous research, including studies of priming, divided visual field presentation, and split-brain patients, demonstrates a general pattern of right/left asymmetry of form-specific versus form-abstract visual processing, little is known about brain organization underlying this dissociation. Here, using repetition priming of complex visual scenes and high-resolution functional magnetic resonance imaging (MRI), we demonstrate asymmetrical form specificity of visual processing between the right and left hemispheres within a region known to be critical for processing of visual spatial scenes (parahippocampal place area [PPA]). Next, we use resting-state functional connectivity MRI analyses to demonstrate that this functional asymmetry is associated with differential intrinsic activity correlations of the right versus left PPA with regions critically involved in perceptual versus conceptual processing, respectively. Our results demonstrate that the PPA comprises lateralized subregions across the cerebral hemispheres that are engaged in functionally dissociable yet complementary components of visual scene analysis. Furthermore, this functional asymmetry is associated with differential intrinsic functional connectivity of the PPA with distinct brain areas known to mediate dissociable cognitive processes.