Neural correlates of implicit object identification

From scanner to court: A neuroscientifically informed "reasonable person" test of trademark infringement

Many legal decisions center on the thoughts or perceptions of some idealized group of individuals, referred to variously as the "average person," "the typical consumer," or the "reasonable person." Substantial concerns exist, however, regarding the subjectivity and vulnerability to biases inherent in conventional means of assessing such responses, particularly the use of self-report evidence. Here, we addressed these concerns by complementing self-report evidence with neural data to inform the mental representations in question. Using an example from intellectual property law, we demonstrate that it is possible to construct a parsimonious neural index of visual similarity that can inform the reasonable person test of trademark infringement. Moreover, when aggregated across multiple participants, this index was able to detect experimenter-induced biases in self-report surveys in a sensitive and replicable fashion. Together, these findings potentially broaden the possibilities for neuroscientific data to inform legal decision-making across a range of settings.

How do cannabis users mentally travel in time? Evidence from an fMRI study of episodic future thinking

RATIONALE

Episodic future thinking (EFT) is a cognitive function that allows individuals to imagine novel experiences that may happen in the future. Prior studies show that EFT is impaired in different groups of substance users. However, there is no evidence regarding the neurobiological mechanisms of EFT in cannabis users.

OBJECTIVES

We aimed to compare brain activations of regular cannabis users and non-using controls during an EFT fMRI task. Exploratory analyses were also conducted to investigate the association between EFT and cannabis use variables (e.g., duration of use, age onset, frequency of use).

METHODS

Twenty current cannabis users and 22 drug-naïve controls underwent an fMRI scanning session while completing a task involving envisioning future-related events and retrieval of past memories as a control condition. The EFT fMRI task was adapted from the autobiographical interview and composed of 20 auditory cue sentences (10 cues for past and 10 cues for future events). Participants were asked to recall a past or generate a future event, in response to the cues, and then rate their vividness after each response.

RESULTS

We found that cannabis users compared to non-user controls had lower activation within the cerebellum, medial and superior temporal gyrus, lateral occipital cortex, and occipital fusiform gyrus while envisioning future events. Cannabis users rated the vividness of past events significantly lower than non-users (P < 0.005). There were marginal group differences for rating the vividness of future events (P = 0.052). Significant correlations were also found between the medial and superior temporal gyrus activities and behavioral measures of EFT and episodic memory.

CONCLUSIONS

Cannabis users, compared to drug-naïve controls, have lower brain activation in EFT relevant regions. Thus, any attempts to improve aberrant EFT performance in cannabis users may benefit from EFT training.

Global Visual Motion Sensitivity: Associations with Parietal Area and Children's Mathematical Cognition

Sensitivity to global visual motion has been proposed as a signature of brain development, related to the dorsal rather than ventral cortical stream. Thresholds for global motion have been found to be elevated more than for global static form in many developmental disorders, leading to the idea of "dorsal stream vulnerability." Here we explore the association of global motion thresholds with individual differences in children's brain development, in a group of typically developing 5- to 12-year-olds. Good performance was associated with a relative increase in parietal lobe surface area, most strongly around the intraparietal sulcus and decrease in occipital area. In line with the involvement of intraparietal sulcus, areas in visuospatial and numerical cognition, we also found that global motion performance was correlated with tests of visuomotor integration and numerical skills. Individual differences in global form detection showed none of these anatomical or cognitive correlations. This suggests that the correlations with motion sensitivity are unlikely to reflect general perceptual or attentional abilities required for both form and motion. We conclude that individual developmental variations in global motion processing are not linked to greater area in the extrastriate visual areas, which initially process such motion, but in the parietal systems that make decisions based on this information. The overlap with visuospatial and numerical abilities may indicate the anatomical substrate of the "dorsal stream vulnerability" proposed as characterizing neurodevelopmental disorders.

Top-down modulation of visual processing and knowledge after 250 ms supports object constancy of category decisions

People categorize objects more slowly when visual input is highly impoverished instead of optimal. While bottom-up models may explain a decision with optimal input, perceptual hypothesis testing (PHT) theories implicate top-down processes with impoverished input. Brain mechanisms and the time course of PHT are largely unknown. This event-related potential study used a neuroimaging paradigm that implicated prefrontal cortex in top-down modulation of occipitotemporal cortex. Subjects categorized more impoverished and less impoverished real and pseudo objects. PHT theories predict larger impoverishment effects for real than pseudo objects because top-down processes modulate knowledge only for real objects, but different PHT variants predict different timing. Consistent with parietal-prefrontal PHT variants, around 250 ms, the earliest impoverished real object interaction started on an N3 complex, which reflects interactive cortical activity for object cognition. N3 impoverishment effects localized to both prefrontal and occipitotemporal cortex for real objects only. The N3 also showed knowledge effects by 230 ms that localized to occipitotemporal cortex. Later effects reflected (a) word meaning in temporal cortex during the N400, (b) internal evaluation of prior decision and memory processes and secondary higher-order memory involving anterotemporal parts of a default mode network during posterior positivity (P600), and (c) response related activity in posterior cingulate during an anterior slow wave (SW) after 700 ms. Finally, response activity in supplementary motor area during a posterior SW after 900 ms showed impoverishment effects that correlated with RTs. Convergent evidence from studies of vision, memory, and mental imagery which reflects purely top-down inputs, indicates that the N3 reflects the critical top-down processes of PHT. A hybrid multiple-state interactive, PHT and decision theory best explains the visual constancy of object cognition.

Neuronal substrates characterizing two stages in visual object recognition

Visual object recognition is classically believed to involve two stages: a perception stage in which perceptual information is integrated, and a memory stage in which perceptual information is matched with an object's representation. The transition from the perception to the memory stage can be slowed to allow for neuroanatomical segregation using a degraded visual stimuli (DVS) task in which images are first presented at low spatial resolution and then gradually sharpened. In this functional magnetic resonance imaging study, we characterized these two stages using a DVS task based on the classic model. To separate periods that are assumed to dominate the perception, memory, and post-recognition stages, subjects responded once when they could guess the identity of the object in the image and a second time when they were certain of the identity. Activation of the right medial occipitotemporal region and the posterior part of the rostral medial frontal cortex was found to be characteristic of the perception and memory stages, respectively. Although the known role of the former region in perceptual integration was consistent with the classic model, a likely role of the latter region in monitoring for confirmation of recognition suggests the advantage of recently proposed interactive models.

Electrophysiological correlates of object-repetition effects: sLORETA imaging with 64-channel EEG and individual MRI

BACKGROUND

We investigated the electrophysiological correlates of object-repetition effects using an object categorization task, standardized low-resolution electromagnetic tomography (sLORETA), and individual magnetic resonance imaging. Sixteen healthy adults participated, and a total of 396 line drawings of living and non-living objects were used as stimuli. Of these stimuli, 274 were presented only once, and 122 were repeated after one to five intervening pictures. Participants were asked to categorize the objects as living or non-living things by pressing one of two buttons.

RESULTS

The old/new effect (i.e., a faster response time and more positive potentials in response to repeated stimuli than to stimuli initially presented) was observed at 350-550 ms post-stimulus. The distributions of cortical sources for the old and new stimuli were very similar at 250-650 ms after stimulus-onset. Activation in the right middle occipital gyrus/cuneus, right fusiform gyrus, left superior temporal gyrus, and right inferior frontal gyrus was significantly reduced in response to old compared with new stimuli at 250-350, 350-450, 450-550, and 550-650 ms after stimulus-onset, respectively. Priming in response time was correlated with the electrophysiological priming at left parietal area and repetition suppression at left superior temporal gyrus in 450-550 ms.

CONCLUSIONS

These results suggest processing of repeated objects is facilitated by sharpening perceptual representation and by efficient detection or attentional control of repeated objects.

The importance of being relevant

This review aims at an understanding of the binding process by synthesizing the extant perspectives regarding binding. It begins with a consideration of the biological explanations of binding, viz., conjunctive coding, synchrony, and reentrant mechanisms. Thereafter binding is reviewed as a psychological process guided by top-down signals. The stages and types of binding proposed by various researchers are discussed in this section. The next section introduces Working Memory (WM) as the executive directing the top-down signals. After that it is described how WM works by selecting relevant sensory input, followed by a detailed consideration of the debate regarding objects vs. features with the conclusion that relevance is the key factor determining what is processed. The next section considers other factors affecting the selection of relevant input. Then, we shift focus to describe what happens to irrelevant input - whether it is discarded at the outset or is gradually inhibited, and whether inhibition is a perceptual or post-perceptual process. The concluding section describes the process of binding as currently understood on the basis of the literature included in the review. To summarize, it appears that initially the "object" is conceptualized as an instantaneous bundle of all features. However, only relevant features of stimuli are gradually integrated to form a stable representation of the object. Concomitantly, irrelevant features are removed from the object representations. Empirical evidence suggests that the inhibition of irrelevant features occurs over time and is presumably a process within WM.

Accessing newly learned names and meanings in the native language

Ten healthy adults encountered pictures of unfamiliar archaic tools and successfully learned either their name, verbal definition of their usage, or both. Neural representation of the newly acquired information was probed with magnetoencephalography in an overt picture-naming task before and after learning, and in two categorization tasks after learning. Within 400 ms, activation proceeded from occipital through parietal to left temporal cortex, inferior frontal cortex (naming) and right temporal cortex (categorization). Comparison of naming of newly learned versus familiar pictures indicated that acquisition and maintenance of word forms are supported by the same neural network. Explicit access to newly learned phonology when such information was known strongly enhanced left temporal activation. By contrast, access to newly learned semantics had no comparable, direct neural effects. Both the behavioral learning pattern and neurophysiological results point to fundamentally different implementation of and access to phonological versus semantic features in processing pictured objects.

Developmental changes in cerebral white matter microstructure in a disorder of lysosomal storage

The goal of this work was to study white matter (WM) integrity in children with cystinosis, a rare lysosomal storage disorder resulting in cystine accumulation in peripheral and central nervous system tissue. Based on previous reports of cystine crystal formation in myelin precursors as well as evidence for specific cognitive deficits in visuospatial functioning, diffusion tensor imaging (DTI) was applied to 24 children with cystinosis (age 3-7 years) and to 24 typically developing age-matched controls. Scalar diffusion indices, fractional anisotropy (FA) and mean diffusivity (MD), were examined in manually defined regions of interest within the parietal and inferior temporal lobes. Diffusion indices were correlated with performance on measures of visuospatial cognition and with white blood cell cystine levels. Bilaterally decreased FA and increased MD were evident in the inferior and superior parietal lobules in children with cystinosis, with comparable FA and MD to controls in inferior temporal WM, and implicate a dissociation of the dorsal and ventral visual pathways. In older cystinosis children (age>5), diminutions in visuospatial performance were associated with reduced FA in the right inferior parietal lobule. In addition, increased MD was found in the presence of high cystine levels in all children with cystinosis. This study provides new information that the average diffusion properties in children with cystinosis deviate from typically developing children. Findings suggest the presence of early microstructural WM changes in addition to a secondary effect of cystine accumulation. These alterations may impact the development of efficient fiber networks important for visuospatial cognition.

Common cortical loci are activated during visuospatial interpolation and orientation discrimination judgements

There is a wealth of literature on the role of short-range interactions between low-level orientation-tuned filters in the perception of discontinuous contours. However, little is known about how spatial information is integrated across more distant regions of the visual field in the absence of explicit local orientation cues, a process referred to here as visuospatial interpolation (VSI). To examine the neural correlates of VSI high field functional magnetic resonance imaging was used to study brain activity while observers either judged the alignment of three Gabor patches by a process of interpolation or discriminated the local orientation of the individual patches. Relative to a fixation baseline the two tasks activated a largely over-lapping network of regions within the occipito-temporal, occipito-parietal and frontal cortices. Activated clusters specific to the orientation task (orientation>interpolation) included the caudal intraparietal sulcus, an area whose role in orientation encoding per se has been hotly disputed. Surprisingly, there were few task-specific activations associated with visuospatial interpolation (VSI>orientation) suggesting that largely common cortical loci were activated by the two experimental tasks. These data are consistent with previous studies that suggest higher level grouping processes -putatively involved in VSI- are automatically engaged when the spatial properties of a stimulus (e.g. size, orientation or relative position) are used to make a judgement.

Induced Gamma-band Activity Elicited by Visual Representation of Unattended Objects

Object recognition is achieved through neural mechanisms reliant on the activity of distributed neural assemblies that are thought to be coordinated by synchronous firing in the gamma-band range (&gt;20 Hz). An outstanding question focuses on the extent to which the role of gamma oscillations in object recognition is dependent on attention. Attentional mechanisms determine the allocation of perceptual resources to objects in complex scenes biasing the outcome of their mutual competitive interactions. Would object-related enhancements in gamma activity also occur for unattended objects when perceptual resources are traded off to the processing of concurrent visual material? The present electroencephalogram study investigated event-related potentials and evoked (time- and phase-locked) and induced (non-time- and phase-locked to stimulus onset) gamma-band activity (GBA) using a visual discrimination task of low or high perceptual load at fixation. The task was performed while task-irrelevant familiar or unfamiliar objects coappeared in the surrounding central area. Attentional focus was kept at fixation by varying perceptual load between trials; in such conditions, only holistic object processing or low-level perceptual processing, requiring little or no attention, are thought to occur. Although evoked GBA remained unmodulated, induced GBA enhancements, specific to familiar object presentations, were observed, thus providing evidence for cortical visual representation of unattended objects. In addition, the effect was mostly driven by object-specific activity under low load, implying that, in cluttered or complex scenes, attentional selection likely plays a more significant role in object representation.

Mid-fusiform activation during object discrimination reflects the process of differentiating structural descriptions

The present study explored constraints on mid-fusiform activation during object discrimination. In three experiments, participants performed a matching task on simple line configurations, nameable objects, three dimensional (3-D) shapes, and colors. Significant bilateral mid-fusiform activation emerged when participants matched objects and 3-D shapes, as compared to when they matched two-dimensional (2-D) line configurations and colors, indicating that the mid-fusiform is engaged more strongly for processing structural descriptions (e.g., comparing 3-D volumetric shape) than perceptual descriptions (e.g., comparing 2-D or color information). In two of the experiments, the same mid-fusiform regions were also modulated by the degree of structural similarity between stimuli, implicating a role for the mid-fusiform in fine differentiation of similar visual object representations. Importantly, however, this process of fine differentiation occurred at the level of structural, but not perceptual, descriptions. Moreover, mid-fusiform activity was more robust when participants matched shape compared to color information using the identical stimuli, indicating that activity in the mid-fusiform gyrus is not driven by specific stimulus properties, but rather by the process of distinguishing stimuli based on shape information. Taken together, these findings further clarify the nature of object processing in the mid-fusiform gyrus. This region is engaged specifically in structural differentiation, a critical component process of object recognition and categorization.

Relationship of temporal lobe volumes to neuropsychological test performance in healthy children

Ecological validity of neuropsychological assessment includes the ability of tests to predict real-world functioning and/or covary with brain structures. Studies have examined the relationship between adaptive skills and test performance, with less focus on the association between regional brain volumes and neurobehavioral function in healthy children. The present study examined the relationship between temporal lobe gray matter volumes and performance on two neuropsychological tests hypothesized to measure temporal lobe functioning (visual perception-VP; peabody picture vocabulary test, third edition-PPVT-III) in 48 healthy children ages 5-18 years. After controlling for age and gender, left and right temporal and left occipital volumes were significant predictors of VP. Left and right frontal and temporal volumes were significant predictors of PPVT-III. Temporal volume emerged as the strongest lobar correlate with both tests. These results provide convergent and discriminant validity supporting VP as a measure of the "what" system; but suggest the PPVT-III as a complex measure of receptive vocabulary, potentially involving executive function demands.

Object memory and change detection: dissociation as a function of visual and conceptual similarity

People often fail to detect a change between two visual scenes, a phenomenon referred to as change blindness. This study investigates how a post-change object's similarity to the pre-change object influences memory of the pre-change object and affects change detection. The results of Experiment 1 showed that similarity lowered detection sensitivity but did not affect the speed of identifying the pre-change object, suggesting that similarity between the pre- and post-change objects does not degrade the pre-change representation. Identification speed for the pre-change object was faster than naming the new object regardless of detection accuracy. Similarity also decreased detection sensitivity in Experiment 2 but improved the recognition of the pre-change object under both correct detection and detection failure. The similarity effect on recognition was greatly reduced when 20% of each pre-change stimulus was masked by random dots in Experiment 3. Together the results suggest that the level of pre-change representation under detection failure is equivalent to the level under correct detection and that the pre-change representation is almost complete. Similarity lowers detection sensitivity but improves explicit access in recognition. Dissociation arises between recognition and change detection as the two judgments rely on the match-to-mismatch signal and mismatch-to-match signal, respectively.

The Different Neural Correlates of Action and Functional Knowledge in Semantic Memory: An fMRI Study

Previous reports suggest that the internal organization of semantic memory is in terms of different "types of knowledge," including "sensory" (information about perceptual features), "action" (motor-based knowledge of object utilization), and "functional" (abstract properties, as function and context of use). Consistent with this view, a specific loss of action knowledge, with preserved functional knowledge, has been recently observed in patients with left frontoparietal lesions. The opposite pattern (impaired functional knowledge with preserved action knowledge) was reported in association with anterior inferotemporal lesions. In the present study, the cerebral representation of action and functional knowledge was investigated using event-related analysis of functional magnetic resonance imaging data. Fifteen subjects were presented with pictures showing pairs of manipulable objects and asked whether the objects within each pair were used with the same manipulation pattern ("action knowledge" condition) or in the same context ("functional knowledge" condition). Direct comparisons showed action knowledge, relative to functional knowledge, to activate a left frontoparietal network, comprising the intraparietal sulcus, the inferior parietal lobule, and the dorsal premotor cortex. The reverse comparison yielded activations in the retrosplenial and the lateral anterior inferotemporal cortex. These results confirm and extend previous neuropsychological data and support the hypothesis of the existence of different types of information processing in the internal organization of semantic memory.

Traces of vocabulary acquisition in the brain: Evidence from covert object naming

One of the strongest predictors of the speed with which adults can name a pictured object is the age at which the object and its name are first learned. Age of acquisition also predicts the retention or loss of individual words following brain damage in conditions like aphasia and Alzheimer's disease. Functional Magnetic Resonance Imaging (fMRI) was used to reveal brain areas differentially involved in naming objects with early or late acquired names. A baseline task involved passive viewing of non-objects. The comparison between the silent object naming conditions (early and late) with baseline showed significant activation in frontal, parietal and mediotemporal regions bilaterally and in the lingual and fusiform gyri on the left. Direct comparison of early and late items identified clusters with significantly greater activation for early acquired items at the occipital poles (in the posterior parts of the middle occipital gyri) and at the left temporal pole. In contrast, the left middle occipital and fusiform gyri showed significantly greater activation for late than early acquired items. We propose that greater activation to early than late objects at the occipital poles and at the left temporal pole reflects the more detailed visual and semantic representations of early than late acquired items. We propose that greater activation to late than early objects in the left middle occipital and fusiform gyri occurs because those areas are involved in mapping visual onto semantic representations, which is more difficult, and demands more resource, for late than for early items.

Cortical dynamics of visual/semantic vs. phonological analysis in picture confrontation

Picture naming covers the main stages of word production from concept retrieval to articulation. Cortical correlates of picture naming have been characterized with both haemodynamic and neurophysiological methods but the association of specific activation patterns with the hypothesized processing stages remains elusive. Here we used categorization tasks to selectively highlight different components of picture confrontation, from visual analysis (VIS) to semantic (SEM) and phonological access (PHON), and compared these time courses of activation with that obtained during picture naming (NAM). Brain activity was recorded with whole-head magnetoencephalography (MEG). Following the initially similar activation patterns in occipital and parietal areas, task effects (stronger activation in NAM/PHON than in SEM/VIS) emerged after 300 ms, in the sustained activation of the left posterior temporal and bilateral inferior frontal cortex, apparently reflecting enhancement of phonological and phonetic/articulatory processing.

Neural correlates of differential retrieval orientation: Sustained and item-related components

Retrieval orientation refers to a cognitive state that biases processing of retrieval cues in service of a specific goal. The present study used a mixed fMRI design to investigate whether adoption of different retrieval orientations - as indexed by differences in the activity elicited by retrieval cues corresponding to unstudied items - is associated with differences in the state-related activity sustained across a block of test trials sharing a common retrieval goal. Subjects studied mixed lists comprising visually presented words and pictures. They then undertook a series of short test blocks in which all test items were visually presented words. The blocks varied according to whether the test items were used to cue retrieval of studied words or studied pictures. In several regions, neural activity elicited by correctly classified new items differed according to whether words or pictures were the targeted material. The loci of these effects suggest that one factor driving differential cue processing is modulation of the degree of overlap between cue and targeted memory representations. In addition to these item-related effects, neural activity sustained throughout the test blocks also differed according to the nature of the targeted material. These findings indicate that the adoption of different retrieval orientations is associated with distinct neural states. The loci of these sustained effects were distinct from those where new item activity varied, suggesting that the effects may play a role in biasing retrieval cue processing in favor of the current retrieval goal.

Implicit identification of irrelevant local objects interacts with global/local processing of hierarchical stimuli

This work aimed at studying interactions between automatic object identification and global/local perceptual processing. We designed a paradigm in which participants were presented with pairs of hierarchically organized items, composed of global forms made up of local forms. Both global and local forms could represent either objects or non-objects. Subjects were instructed to detect whether the two hierarchical items composing a pair were identical or different. In a dissimilar pair, items differed at one level (target level), the other level, made of similar forms on both sides, was irrelevant to perform the task. We hypothesized that the automatic identification of object could affect the global precedence principle defined by Navon. In agreement with our hypothesis, we found that when the irrelevant level was made of objects, the global precedence effect was reversed. In contrast, the irrelevant level had no effect when the target level included only objects, or when the irrelevant level was made of non-object, the global precedence principle was being preserved in these cases. This interaction is compatible with the existence of two distinct processes working in parallel, namely automatic identification and structural analysis, that could either interfere or act together for the detection of differences.

Sex Differences in Neural Mechanisms Underlying Implicit Symmetry Processing

Some species, including humans, prefer symmetrical to asymmetrical patterns. Preferences for symmetrical stimuli could have arisen in both sexes because specialized systems developed to detect and identify symmetrical stimuli, which are more likely to be figure than background. Females, it has been suggested, prefer symmetry because it may provide a cue to biological fitness when choosing a mate. Using functional magnetic resonance imaging, we found sex differences in neural activity when subjects distinguished figure from ground in abstract patterns whose component shapes differed in colour, brightness, and symmetry/asymmetry. Although no participant explicitly reported using symmetry as a decision criterion, women showed more neural activity than men in visual processing areas when the display contained a symmetrical shape. This enhanced activity in occipital cortex (middle and superior occipital gyrus) occurred bilaterally in women irrespective of whether they chose the symmetrical element in the display as the figure. Contrariwise, men showed a significant neural response in right temporal (superior temporal gyrus) and left parietal cortex (inferior parietal cortex/temporo-parietal junction) only when they chose a symmetrical element as the figure. The female brain thus appears to register symmetry automatically as a stimulus attribute, while the differential neurophysiological response of the male brain is dependent upon an explicit behavioural response to symmetry (choosing the symmetrical part of the display as figure), even if the criterion for choice (symmetry) is not reported verbally.

Similar cortical correlates underlie visual object identification and orientation judgment

Visual object perception has been suggested to follow two different routes in the human brain: a ventral, view-invariant occipital-temporal route processes object identity, whereas a dorsal, view-dependent occipital-parietal route processes spatial properties of an object. Using fMRI, we addressed the question whether these routes are exclusively involved in either object recognition or spatial representation. We presented subjects with images of natural objects and involved them either in object identification or object orientation judgment task. For both tasks, we observed activation in ventro-temporal as well as parietal areas bilaterally, with significantly stronger responses for the orientation judgment in both ventro-temporal as well as parietal areas. Our findings suggest that object identification and orientation judgment do not follow strictly separable cortical pathways, but rather involve both the dorsal and the ventral stream.