Segregation and persistence of form in the lateral occipital complex

HD-tDCS to the lateral occipital complex improves haptic object recognition

High-definition transcranial direct current stimulation (HD-tDCS) is a non-invasive brain stimulation technique that has been shown to be safe and effective in modulating neuronal activity. The present study investigates the effect of anodal HD-tDCS on haptic object perception and memory through stimulation of the lateral occipital complex (LOC), a structure that has been shown to be involved in both visual and haptic object recognition. In this single-blind, sham-controlled, between-subjects study, blindfolded healthy, sighted participants used their right (dominant) hand to perform haptic discrimination and recognition tasks with 3D-printed, novel objects called "Greebles" while receiving 20 min of 2 milliamp (mA) anodal stimulation (or sham) to the left or right LOC. Compared to sham, those who received left LOC stimulation (contralateral to the hand used) showed an improvement in haptic object recognition but not discrimination-a finding that was evident from the start of the behavioral tasks. A second experiment showed that this effect was not observed with right LOC stimulation (ipsilateral to the hand used). These results suggest that HD-tDCS to the left LOC can improve recognition of objects perceived via touch. Overall, this work sheds light on the LOC as a multimodal structure that plays a key role in object recognition in both the visual and haptic modalities.

A focus on the multiple interfaces between action and perception and their neural correlates

Successful behaviour relies on the appropriate interplay between action and perception. The well-established dorsal and ventral stream theories depicted two distinct functional pathways for the processes of action and perception, respectively. In physiological conditions, the two pathways closely cooperate in order to produce successful adaptive behaviour. As the coupling between perception and action exists, this requires an interface that is responsible for a common reading of the two functions. Several studies have proposed different types of perception and action interfaces, suggesting their role in the creation of the shared interaction channel. In the present review, we describe three possible perception and action interfaces: i) the motor code, including common coding approaches, ii) attention, and iii) object affordance; we highlight their potential neural correlates. From this overview, a recurrent neural substrate that underlies all these interface functions appears to be crucial: the parieto-frontal circuit. This network is involved in the mirror mechanism which underlies the perception and action interfaces identified as common coding and motor code theories. The same network is also involved in the spotlight of attention and in the encoding of potential action towards objects; these are manifested in the perception and action interfaces for common attention and object affordance, respectively. Within this framework, most studies were dedicated to the description of the role of the inferior parietal lobule; growing evidence, however, suggests that the superior parietal lobule also plays a crucial role in the interplay between action and perception. The present review proposes a novel model that is inclusive of the superior parietal regions and their relative contribution to the different action and perception interfaces.

High-definition transcranial direct current stimulation of the lateral occipital cortex influences figure-ground perception

Prior work has shown that the lateral occipital cortex (LO) is involved in recognition of objects and their parts, as well as segregation of that object (or "figure") from its background. No studies, though, have examined how LO's functioning is influenced by non-invasive brain stimulation, particularly during a figure-ground perception task. The present study tested whether high-definition transcranial direct current stimulation (HD-tDCS) to right LO influences the effects of familiarity on figure-ground perception. Following 20 min of offline anodal stimulation (or sham), participants viewed masked stimuli consisting of two regions separated by a vertical border and were asked to report which region they perceived as figure. One region was the "critical" region, which either depicted a portion of a familiar object ("Familiar" stimuli), or a familiar object with its parts rearranged into a novel configuration ("Part-rearranged" stimuli). Previous research using these stimuli has found higher reports of the critical region as figure for Familiar vs. Part-rearranged displays, demonstrating the effect of familiarity on figure assignment. The results of the current study showed that HD-tDCS to right LO significantly influenced this typical behavioral pattern. Specifically, stimulation (vs. sham) increased reports of the critical region as figure for Part-rearranged stimuli, bringing perception of these displays up to the level of the Familiar stimuli. We interpret this finding as evidence that stimulation of right LO increased participants' reliance on the familiarity of the parts in their figure-ground judgements-a finding consistent with and extending previous research showing that LO is indeed sensitive to object parts. This is the first study showing that HD-tDCS to LO can influence the effects of familiarity on figure-ground perception.

Probing the Characteristics of Colour-Motion Binding and Its Dependence on Persistent Surface Segregation

Identifying the spatial and temporal characteristics of visual feature binding is a remaining challenge in the science of perception. Within the feature-binding literature, disparate findings have suggested the existence of more than one feature-binding mechanism with differing temporal resolutions. For example, one surprising result is that temporal alternations between two different feature pairings of colour and motion (e.g., orange dots moving left with blue dots moving right) support accurate conjunction discrimination at alternation frequencies of around 10 Hz and greater. However, at lower alternation frequencies around 5 Hz, conjunction discrimination falls to chance. To further investigate this effect, we present two experiments that probe the stimulus characteristics that facilitate or impede feature binding. Using novel manipulations of random dot kinematograms, we identify that facilitating surface representations through temporal integration can enable accurate conjunction discrimination at both intermediate and high alternation frequencies. We also offer a neurally plausible evidence accumulator model to describe these results, removing the need to suggest multiple binding mechanisms acting at different timescales. In effect, we propose a single, flexible binding process, whereby the relatively low temporal resolution for binding features can be circumvented by extracting them from rapidly formed and persistent surface representations.

Allocentric coding in ventral and dorsal routes during real-time reaching: Evidence from imaging-guided multi-site brain stimulation

Recent evidence has revealed an advantage for movements to last target positions in a structured visual display, suggesting a mediating role of allocentric, in addition to egocentric, information in goal-directed reaching. This notion is accommodated by the recently updated perception-action model (Milner and Goodale, 2008), which postulates functional roles of ventral and dorsal neural areas in allocentric coding. In the present study, we used imaging-guided multi-site continuous theta burst stimulation (cTBS) over regions of the ventral and dorsal processing streams to unravel their functional contribution on visually guided reaching in two display conditions: the "egocentric" condition where the target appeared in an empty display and the "allocentric" condition where the target appeared in a structured display with placeholders marking possible target locations. Cortical sites for cTBS were identified individually for each participant via coregistration with magnetic resonance scans. Results indicated that cTBS in the egocentric condition did not affect movement time, but cTBS in the allocentric condition modulated movement time contingent on stimulation site and target position. In particular, cTBS over the lateral occipital cortex (part of the ventral stream) and over the angular gyrus (part of the dorsal stream) eliminated the last-target advantage by slowing down reaching to the salient last target position. cTBS over the superior parietal occipital cortex did not affect the last-target advantage. These outcomes provide the first causal evidence for allocentric coding in ventral and dorsal routes during real-time reaching, thereby supporting the updated perception-action model.

Visible Persistence of Single-Transient Random Dot Patterns: Spatial Parameters Affect the Duration of Fading Percepts

Visible persistence refers to the continuation of visual perception after the physical termination of a stimulus. We studied an extreme case of visible persistence by presenting two matrices of randomly distributed black and white pixels in succession. On the transition from one matrix to the second, the luminance polarity of all pixels within a disk- or annulus-shaped area reversed, physically creating a single second-order transient signal. This transient signal produces the percept of a disk or an annulus with an abrupt onset and a gradual offset. To study the nature of this fading percept we varied spatial parameters, such as the inner and the outer diameter of annuli (Experiment I) and the radius and eccentricity of disks (Experiment III), and measured the duration of visible persistence by having subjects adjust the synchrony of the onset of a reference stimulus with the onset or the offset of the fading percept. We validated this method by comparing two modalities of the reference stimuli (Experiment I) and by comparing the judgments of fading percepts with the judgments of stimuli that actually fade in luminance contrast (Experiment II). The results show that (i) irrespective of the reference modality, participants are able to precisely judge the on- and the offsets of the fading percepts, (ii) auditory reference stimuli lead to higher visible persistence durations than visual ones, (iii) visible persistence duration increases with the thickness of annuli and the diameter of disks, but decreases with the diameter of annuli, irrespective of stimulus eccentricity. These effects cannot be explained by stimulus energy, which suggests that more complex processing mechanisms are involved. Seemingly contradictory effects of disk and annulus diameter can be unified by assuming an abstract filling-in mechanism that speeds up with the strength of the edge signal and takes more time the larger the stimulus area is.

Spatiotemporal Form Integration: sequentially presented inducers can lead to representations of stationary and rigidly rotating objects

Objects in the world often are occluded and in motion. The visible fragments of such objects are revealed at different times and locations in space. To form coherent representations of the surfaces of these objects, the visual system must integrate local form information over space and time. We introduce a new illusion in which a rigidly rotating square is perceived on the basis of sequentially presented Pacman inducers. The illusion highlights two fundamental processes that allow us to perceive objects whose form features are revealed over time: Spatiotemporal Form Integration (STFI) and Position Updating. STFI refers to the spatial integration of persistent representations of local form features across time. Position updating of these persistent form representations allows them to be integrated into a rigid global motion percept. We describe three psychophysical experiments designed to identify spatial and temporal constraints that underlie these two processes and a fourth experiment that extends these findings to more ecologically valid stimuli. Our results indicate that although STFI can occur across relatively long delays between successive inducers (i.e., greater than 500 ms), position updating is limited to a more restricted temporal window (i.e., ~300 ms or less), and to a confined range of spatial (mis)alignment. These findings lend insight into the limits of mechanisms underlying the visual system's capacity to integrate transient, piecemeal form information, and support coherent object representations in the ever-changing environment.

The role of the lateral occipital cortex in aesthetic appreciation of representational and abstract paintings: a TMS study

Neuroimaging studies of aesthetic appreciation have shown that activity in the lateral occipital area (LO)-a key node in the object recognition pathway-is modulated by the extent to which visual artworks are liked or found beautiful. However, the available evidence is only correlational. Here we used transcranial magnetic stimulation (TMS) to investigate the putative causal role of LO in the aesthetic appreciation of paintings. In our first experiment, we found that interfering with LO activity during aesthetic appreciation selectively reduced evaluation of representational paintings, leaving appreciation of abstract paintings unaffected. A second experiment demonstrated that, although the perceived clearness of the images overall positively correlated with liking, the detrimental effect of LO TMS on aesthetic appreciation does not owe to TMS reducing perceived clearness. Taken together, our findings suggest that object-recognition mechanisms mediated by LO play a causal role in aesthetic appreciation of representational art.

Memory for shape reactivates the lateral occipital complex

Memory is thought to be a constructive process in which the cortical regions associated with processing event features are reactivated during retrieval. Although there is evidence for non-detailed cortical reactivation during retrieval (e.g., memory for visual or auditory information reactivates the visual or auditory processing regions, respectively), there is limited evidence that memory can reactivate cortical regions associated with processing detailed, feature-specific information. Such evidence is critical to our understanding of the mechanisms of episodic retrieval. The present functional magnetic resonance imaging (fMRI) study assessed whether the lateral occipital complex (LOC), a region that preferentially processes shape, is associated with retrieval of shape information. During encoding, participants were presented with colored abstract shapes that were either intact or scrambled. During retrieval, colored disks were presented and participants indicated whether the corresponding shape was previously "intact" or "scrambled". To assess whether conscious retrieval of intact shapes reactivated LOC, we conducted a conjunction of shape perception/encoding and accurate versus inaccurate retrieval of intact shapes, which produced many activations in LOC. To determine whether activity in LOC was specific to intact shapes, we conducted a conjunction of shape perception/encoding and intact versus scrambled shapes, which also produced many activations in LOC. Furthermore, memory for intact shapes in each hemifield produced contralateral activity in LOC (e.g., memory for left visual field intact shapes activated right LOC), which reflects the specific reinstatement of perception/encoding activity. The present results extend previous feature-specific memory reactivation evidence and support the view that memory is a constructive process.

Inter-element orientation and distance influence the duration of persistent contour integration

Contour integration is a fundamental form of perceptual organization. We introduce a new method of studying the mechanisms responsible for contour integration. This method capitalizes on the perceptual persistence of contours under conditions of impending camouflage. Observers viewed arrays of randomly arranged line segments upon which circular contours comprised of similar line segments were superimposed via abrupt onset. Crucially, these contours remained visible for up to a few seconds following onset, but eventually disappeared due to the camouflaging effects of surrounding background line segments. Our main finding was that the duration of contour visibility depended on the distance and degree of co-alignment between adjacent contour segments such that relatively dense smooth contours persisted longest. The stimulus-related effects reported here parallel similar results from contour detection studies, and complement previous reported top–down influences on contour persistence (Strother et al., 2011). We propose that persistent contour visibility reflects the sustained activity of recurrent processing loops within and between visual cortical areas involved in contour integration and other important stages of visual object recognition.

Cortical responses to optic flow and motion contrast across patterns and speeds

Motion provides animals with fast and robust cues for navigation and object detection. In the first case, stereotyped patterns of optic flow inform a moving observer about the direction and speed of its own movement. In the case of object detection, regional differences in motion allow for the segmentation of figures from their background, even in the absence of color or shading cues. Previous research has investigated human electrophysiological responses to global motion across speeds, but only focused upon one type of optic flow pattern. Here, we compared steady-state visual evoked potential (SSVEP) responses across patterns and speeds, both for optic flow and for motion-defined figure patterns, to assess the extent to which the processes are pattern-general or pattern-specific. For optic flow, pattern and speed effects on response amplitudes varied substantially across channels, suggesting pattern-specific processing at slow speeds and pattern-general activity at fast speeds. Responses for coherence- and direction-defined figures were comparatively more uniform, with similar response profiles and spatial distributions. Self- and object-motion patterns activate some of the same circuits, but these data suggest differential sensitivity: not only across the two classes of motion, but also across the patterns within each class, and across speeds. Thus, the results demonstrate that cortical processing of global motion is complex and activates a distributed network.

The causal role of the lateral occipital complex in visual mirror symmetry detection and grouping: an fMRI-guided TMS study

Despite the fact that bilateral mirror symmetry is an important characteristic of the visual world, few studies have investigated its neural basis. Here we addressed this issue by investigating whether the object-selective lateral occipital (LO) cortex, a key brain region in object and shape processing, is causally involved in bilateral symmetry detection. Participants were asked to discriminate between symmetric and asymmetric dot patterns, while fMRI-guided repetitive TMS was delivered online over either the left LO, the right LO or two control sites in the occipital cortex. We found that the application of TMS over both right and left LO impaired symmetry judgments, with disruption being greater following right LO than left LO TMS, indicative of right hemisphere lateralization in symmetry processing. TMS over LO bilaterally also affected a visual contour detection task, with no evidence for hemispheric difference in this task. Overall, our results demonstrates that LO bilaterally plays a causal role in symmetry detection possibly due to symmetry acting as a strong cue in Gestalt processes mediating object recognition.

Linking brain to behavior for the visual perception of figures and objects

The dissociation of a figure from its background is an essential feat of visual perception, as it allows us to detect, recognize, and interact with shapes and objects in our environment. In order to understand how the human brain gives rise to the perception of figures, we here review experiments that explore the links between activity in visual cortex and performance of perceptual tasks related to figure perception. We organize our review according to a proposed model that attempts to contextualize figure processing within the more general framework of object processing in the brain. Overall, the current literature provides us with individual linking hypotheses as to cortical regions that are necessary for particular tasks related to figure perception. Attempts to reach a more complete understanding of how the brain instantiates figure and object perception, however, will have to consider the temporal interaction between the many regions involved, the details of which may vary widely across different tasks.

Early spatial frequency processing of natural images: an ERP study

The present study examined the role of spatial stimulus frequencies in the early visual processing of natural scenes. The content of initially degraded (low- or high-pass filtered) pictures was progressively revealed in a sequence of steps by adding high or low spatial frequencies. Event Related Potentials (ERPs) were used to track the early stages of visual processing. Picture degradation modulated the topography of the P1, with an occipital midline distribution for the most degraded pictures, which became progressively more laterally distributed as pictures became more complete. Picture degradation also modulated the amplitude of the P2. For both low-passed and high-passed scenes, a linear relationship between the spectral power and the amplitude of the P1 and P2 was observed. These results are likely to reflect the progressive engagement of the lateral occipital complex as the amount of information in both the low and high portions of the frequency spectrum increased.

Disruption of visuospatial and somatosensory functional connectivity in anorexia nervosa

BACKGROUND

Although body image disturbance is considered one of the core characteristics of anorexia nervosa (AN), the exact nature of this complex feature is poorly understood. Task-related functional magnetic resonance imaging studies can only partially explore the multimodal complexity of body consciousness, which is a complex cognition underpinned by aspects of visual perception, proprioception, and touch. The aim of the present study was to explore the functional connectivity of networks involved in visuospatial and somatosensory processing in AN.

METHODS

Twenty-nine subjects with AN, 16 women who had recovered from it, and 26 healthy women underwent a resting-state functional magnetic resonance imaging scan and neuropsychological assessment of their visuospatial abilities using the Rey-Osterrieth Complex Figure Test.

RESULTS

Both AN groups showed areas of decreased connectivity in the ventral visual network, a network involved in the "what?" pathway of visual perception. Even more interestingly, the AN group, but not the recovered AN group, displayed increased coactivation in the left parietal cortex, encompassing the somatosensory cortex, in an area implicated in long-term multimodal spatial memory and representation, even in the absence of visual information. A neuropsychological assessment of visuospatial abilities revealed that aspects of detail processing and global integration (central coherence) showed correlations with connectivity of this brain area in the AN group.

CONCLUSIONS

Our findings show that AN is associated with double disruption of brain connectivity, which shows a specific association with visuospatial difficulties and may explain the failure of the integration process between visual and somatosensory perceptual information that might sustain body image disturbance.

Figure–Ground Representation and Its Decay in Primary Visual Cortex

We used fMRI to study figure–ground representation and its decay in primary visual cortex (V1). Human observers viewed a motion-defined figure that gradually became camouflaged by a cluttered background after it stopped moving. V1 showed positive fMRI responses corresponding to the moving figure and negative fMRI responses corresponding to the static background. This positive–negative delineation of V1 “figure” and “background” fMRI responses defined a retinotopically organized figure–ground representation that persisted after the figure stopped moving but eventually decayed. The temporal dynamics of V1 “figure” and “background” fMRI responses differed substantially. Positive “figure” responses continued to increase for several seconds after the figure stopped moving and remained elevated after the figure had disappeared. We propose that the sustained positive V1 “figure” fMRI responses reflected both persistent figure–ground representation and sustained attention to the location of the figure after its disappearance, as did subjects' reports of persistence. The decreasing “background” fMRI responses were relatively shorter-lived and less biased by spatial attention. Our results show that the transition from a vivid figure–ground percept to its disappearance corresponds to the concurrent decay of figure enhancement and background suppression in V1, both of which play a role in form-based perceptual memory.

The path to memory is guided by strategy: distinct networks are engaged in associative encoding under visual and verbal strategy and influence memory performance in healthy and impaired individuals

Given the diversity of stimuli encountered in daily life, a variety of strategies must be used for learning new information. Relating and encoding visual and verbal stimuli into memory has been probed using various tasks and stimulus types. Engagement of specific subsequent memory and cortical processing regions depends on the stimulus modality of studied material; however, it remains unclear whether different encoding strategies similarly influence regional activity when stimulus type is held constant. In this study, participants encoded object pairs using a visual or verbal associative strategy during fMRI, and subsequent memory was assessed for pairs encoded under each strategy. Each strategy elicited distinct regional processing and subsequent memory effects: middle/superior frontal, lateral parietal, and lateral occipital for visually associated pairs and inferior frontal, medial frontal, and medial occipital for verbally associated pairs. This regional selectivity mimics the effects of stimulus modality, suggesting that cortical involvement in associative encoding is driven by strategy and not simply by stimulus type. The clinical relevance of these findings, probed in a patient with a recent aphasic stroke, suggest that training with strategies utilizing unaffected cortical regions might improve memory ability in patients with brain damage.

Face inversion reduces the persistence of global form and its neural correlates

Face inversion produces a detrimental effect on face recognition. The extent to which the inversion of faces and other kinds of objects influences the perceptual binding of visual information into global forms is not known. We used a behavioral method and functional MRI (fMRI) to measure the effect of face inversion on visual persistence, a type of perceptual memory that reflects sustained awareness of global form. We found that upright faces persisted longer than inverted versions of the same images; we observed a similar effect of inversion on the persistence of animal stimuli. This effect of inversion on persistence was evident in sustained fMRI activity throughout the ventral visual hierarchy, including the lateral occipital area (LO), two face-selective visual areas--the fusiform face area (FFA) and the occipital face area (OFA)--and several early visual areas. V1 showed the same initial fMRI activation to upright and inverted forms but this activation lasted longer for upright stimuli. The inversion effect on persistence-related fMRI activity in V1 and other retinotopic visual areas demonstrates that higher-tier visual areas influence early visual processing via feedback. This feedback effect on figure-ground processing is sensitive to the orientation of the figure.

The role of apparent size in building- and object-specific regions of ventral visual cortex

Images of buildings and manipulable objects have been found to activate distinct regions in the ventral visual pathway. Yet, many non-categorical properties distinguish buildings from common everyday objects, and perhaps the most salient of these is size. In this fMRI study, we investigated whether or not changes in perceived scale can account for some of the differences in category-specific responses, independent of the influence of semantic or retinotopic image properties. We used independent scans to localize object-specific ROIs in lateral occipital cortex (LO) and scene-specific ROIs in the parahippocampal place area (PPA) and posterior collateral sulcus. We then contrasted the effects of stimulus category and perceived size/distance in these regions in a factorial design. Participants performed an oddball detection task while viewing images of objects, buildings, and planar rectangles both with and without a background that indicated stimulus size/distance via simple pictorial cues. The analyses of fMRI responses showed effects of perceived size/distance in addition to effects of category in LO and the PPA. Interestingly, when simple rectangles were presented in a control condition against the background that indicated size/distance, LO in the right hemisphere responded significantly more to the small/close rectangles than to the large/far ones, in spite of the fact that the rectangles themselves were identical. These findings suggest that ventral stream regions that show category specificity are modulated by the perceived size and distance of visual stimuli.

The timing of associative memory formation: frontal lobe and anterior medial temporal lobe activity at associative binding predicts memory

The process of associating items encountered over time and across variable time delays is fundamental for creating memories in daily life, such as for stories and episodes. Forming associative memory for temporally discontiguous items involves medial temporal lobe structures and additional neocortical processing regions, including prefrontal cortex, parietal lobe, and lateral occipital regions. However, most prior memory studies, using concurrently presented stimuli, have failed to examine the temporal aspect of successful associative memory formation to identify when activity in these brain regions is predictive of associative memory formation. In the current study, functional MRI data were acquired while subjects were shown pairs of sequentially presented visual images with a fixed interitem delay within pairs. This design allowed the entire time course of the trial to be analyzed, starting from onset of the first item, across the 5.5-s delay period, and through offset of the second item. Subjects then completed a postscan recognition test for the items and associations they encoded during the scan and their confidence for each. After controlling for item-memory strength, we isolated brain regions selectively involved in associative encoding. Consistent with prior findings, increased regional activity predicting subsequent associative memory success was found in anterior medial temporal lobe regions of left perirhinal and entorhinal cortices and in left prefrontal cortex and lateral occipital regions. The temporal separation within each pair, however, allowed extension of these findings by isolating the timing of regional involvement, showing that increased response in these regions occurs during binding but not during maintenance.

Early stages of figure-ground segregation during perception of the face-vase

The temporal sequence of neural processes supporting figure-ground perception was investigated by recording ERPs associated with subjects' perceptions of the face-vase figure. In Experiment 1, subjects continuously reported whether they perceived the face or the vase as the foreground figure by pressing one of two buttons. Each button press triggered a probe flash to the face region, the vase region, or the borders between the two. The N170/vertex positive potential (VPP) component of the ERP elicited by probes to the face region was larger when subjects perceived the faces as figure. Preceding the N170/VPP, two additional components were identified. First, when the borders were probed, ERPs differed in amplitude as early as 110 msec after probe onset depending on subjects' figure-ground perceptions. Second, when the face or vase regions were probed, ERPs were more positive (at ∼ 150-200 msec) when that region was perceived as figure versus background. These components likely reflect an early "border ownership" stage, and a subsequent "figure-ground segregation" stage of processing. To explore the influence of attention on these stages of processing, two additional experiments were conducted. In Experiment 2, subjects selectively attended to the face or vase region, and the same early ERP components were again produced. In Experiment 3, subjects performed an identical selective attention task, but on a display lacking distinctive figure-ground borders, and neither of the early components were produced. Results from these experiments suggest sequential stages of processing underlying figure-ground perception, each which are subject to modifications by selective attention.

Contralateral delay activity provides a neural measure of the number of representations in visual working memory

Visual working memory (VWM) helps to temporarily represent information from the visual environment and is severely limited in capacity. Recent work has linked various forms of neural activity to the ongoing representations in VWM. One piece of evidence comes from human event-related potential studies, which find a sustained contralateral negativity during the retention period of VWM tasks. This contralateral delay activity (CDA) has previously been shown to increase in amplitude as the number of memory items increases, up to the individual's working memory capacity limit. However, significant alternative hypotheses remain regarding the true nature of this activity. Here we test whether the CDA is modulated by the perceptual requirements of the memory items as well as whether it is determined by the number of locations that are being attended within the display. Our results provide evidence against these two alternative accounts and instead strongly support the interpretation that this activity reflects the current number of objects that are being represented in VWM.

Remembering perceptual features unequally bound in object and episodic tokens: Neural mechanisms and their electrophysiological correlates

We present a neurocognitive model of long-term object memory. We propose that perceptual priming and episodic recognition are phenomena based on three distinct kinds of representations. We label these representations types and tokens. Types are prototypical representations needed for object identification. The network of non-arbitrary features necessary for object categorization is sharpened in the course of repeated identification, an effect that we call type trace and which causes perceptual priming. Tokens, on the other hand, support episodic recognition. Perirhinal structures are proposed to bind intrinsic within-object features into an object token that can be thought of as a consolidated perceptual object file. Hippocampal structures integrate object- with contextual information in an episodic token. The reinstatement of an object token is assumed to generate a feeling of familiarity, whereas recollection occurs when the reinstatement of an episodic token occurs. Retrieval mode and retrieval orientation dynamically modulate access to these representations. In this review, we apply the model to recent empirical research (behavioral, fMRI, and ERP data) including a series of studies from our own lab. We put specific emphasis on the effects that sensory features and their study-test match have on familiarity. The type-token approach fits the data and additionally provides a framework for the analysis of concepts like unitization and associative reinstatement.

Pre-exposure to moving form enhances static form sensitivity

Background

Motion-defined form can seem to persist briefly after motion ceases, before seeming to gradually disappear into the background. Here we investigate if this subjective persistence reflects a signal capable of improving objective measures of sensitivity to static form.

Methodology/Principal Findings

We presented a sinusoidal modulation of luminance, masked by a background noise pattern. The sinusoidal luminance modulation was usually subjectively invisible when static, but visible when moving. We found that drifting then stopping the waveform resulted in a transient subjective persistence of the waveform in the static display. Observers' objective sensitivity to the position of the static waveform was also improved after viewing moving waveforms, compared to viewing static waveforms for a matched duration. This facilitation did not occur simply because movement provided more perspectives of the waveform, since performance following pre-exposure to scrambled animations did not match that following pre-exposure to smooth motion. Observers did not simply remember waveform positions at motion offset, since removing the waveform before testing reduced performance.

Conclusions/Significance

Motion processing therefore interacts with subsequent static visual inputs in a way that can improve performance in objective sensitivity measures. We suggest that the brief subjective persistence of motion-defined forms that can occur after motion offsets is a consequence of the decay of a static form signal that has been transiently enhanced by motion processing.

The Role of Temporal Synchrony as a Binding Cue for Visual Persistence in Early Visual Areas: An fMRI Study

We examined the role of temporal synchrony—the simultaneous appearance of visual features—in the perceptual and neural processes underlying object persistence. When a binding cue (such as color or motion) momentarily exposes an object from a background of similar elements, viewers remain aware of the object for several seconds before it perceptually fades into the background, a phenomenon known as object persistence. We showed that persistence from temporal stimulus synchrony, like that arising from motion and color, is associated with activation in the lateral occipital (LO) area, as measured by functional magnetic resonance imaging. We also compared the distribution of occipital cortex activity related to persistence to that of iconic visual memory. Although activation related to iconic memory was largely confined to LO, activation related to object persistence was present across V1 to LO, peaking in V3 and V4, regardless of the binding cue (temporal synchrony, motion, or color). Although persistence from motion cues was not associated with higher activation in the MT+ motion complex, persistence from color cues was associated with increased activation in V4. Taken together, these results demonstrate that although persistence is a form of visual memory, it relies on neural mechanisms different from those of iconic memory. That is, persistence not only activates LO in a cue-independent manner, it also recruits visual areas that may be necessary to maintain binding between object elements.

The influence of orientation jitter and motion on contour saliency and object identification

One of the ultimate goals of vision research is to understand how some elements are grouped together and differentiated from others to form object representations in a complex visual scene. There exists an extensive literature on this grouping/segmentation problem, but most of the studies have used un-recognizable stimuli that have little to do with object recognition per se. We used Gabor-rendered outlines of real-world objects to study some relationships between bottom-up and top-down processes in both spatial- and motion form perception. We manipulated low-level properties, such as element orientation and local motion, while incorporating higher-level properties, such as object complexity and identity, and found that adding local motion improved overall performance in both object detection and object identification tasks. Adding orientation jitter effectively decreased object detection performance in both static and motion conditions, and increased reaction time for identification in the static condition. Orientation jitter had much less effect on reaction times for identification in the local motion condition than in the static condition. Both contour properties ("good continuation") and object properties (identifiability) had a positive effect on detection and reaction time for identification.

Differential and co-involvement of areas of the temporal and parietal streams in visual tasks

Transcranial magnetic stimulation (TMS) is particularly useful in teasing apart the contrasting contributions of different anatomical and functional systems in particular aspects of behaviour, for example the involvement of the dorsal and ventral visual streams in tasks involving the perception of distance, shape and colour. In order to investigate the dual involvement of two areas, namely right posterior parietal cortex (PPC) and lateral occipital cortex (LO), in a distance discrimination task, neural processing in both areas was concurrently disrupted using dual site TMS. Although there was no change in error rates, reaction time was significantly lengthened over that seen with TMS over either site alone. This additive effect indicates that both PPC and LO are concurrently active and essential for efficient processing of this task. The second experiment investigated the specificity of function within the ventral stream. Performance was assessed for distance and shape discrimination when TMS was applied to our original LO site and an area rostral to V5 but still part of the lateral occipital complex (rostral LOC) that is activated in form and colour discrimination. Performance deficits were restricted to TMS over LO; no significant impairment for either task followed TMS at the rostral LOC site.

The role of elaboration in the persistence of awareness for degraded objects

When a fragmented line-drawing of an object moves relative to a background of randomly oriented lines, the previously hidden object can be segregated from the background and consequently enters awareness. In this shape-from-motion paradigm, the percept of the object briefly persists after the motion stops, demonstrating the maintenance of a bound percept in awareness. This study investigated how the manipulation of object features that are crucial to recognition influences both the binding process and the maintenance of objects in awareness. Overall, we found that objects that took longer to recognize (i.e., objects missing their vertices) were nonetheless maintained in awareness for longer. We argue that this effect is mediated by additional elaborative processing that is required to bind these less recognizable forms, which generates stronger and more robust representations. These representations are then more easily maintained in awareness, suggesting an important role of elaborative mechanisms for conscious representations.

The role of temporally coarse form processing during binocular rivalry

Presenting the eyes with spatially mismatched images causes a phenomenon known as binocular rivalry—a fluctuation of awareness whereby each eye's image alternately determines perception. Binocular rivalry is used to study interocular conflict resolution and the formation of conscious awareness from retinal images. Although the spatial determinants of rivalry have been well-characterized, the temporal determinants are still largely unstudied. We confirm a previous observation that conflicting images do not need to be presented continuously or simultaneously to elicit binocular rivalry. This process has a temporal limit of about 350 ms, which is an order of magnitude larger than the visual system's temporal resolution. We characterize this temporal limit of binocular rivalry by showing that it is independent of low-level information such as interocular timing differences, contrast-reversals, stimulus energy, and eye-of-origin information. This suggests the temporal factors maintaining rivalry relate more to higher-level form information, than to low-level visual information. Systematically comparing the role of form and motion—the processing of which may be assigned to ventral and dorsal visual pathways, respectively—reveals that this temporal limit is determined by form conflict rather than motion conflict. Together, our findings demonstrate that binocular conflict resolution depends on temporally coarse form-based processing, possibly originating in the ventral visual pathway.

Readout from iconic memory and selective spatial attention involve similar neural processes

Iconic memory and spatial attention are often considered separately, but they may have functional similarities. Here we provide functional magnetic resonance imaging evidence for some common underlying neural effects. Subjects judged three visual stimuli in one hemifield of a bilateral array comprising six stimuli. The relevant hemifield for partial report was indicated by an auditory cue, administered either before the visual array (precue, spatial attention) or shortly after the array (postcue, iconic memory). Pre- and postcues led to similar activity modulations in lateral occipital cortex contralateral to the cued side. This finding indicates that readout from iconic memory can have some neural effects similar to those of spatial attention. We also found common bilateral activation of a fronto-parietal network for postcue and precue trials. These neuroimaging data suggest that some common neural mechanisms underlie selective spatial attention and readout from iconic memory. Some differences were also found; compared with precues, postcues led to higher activity in the right middle frontal gyrus.

Object recognition by artificial cortical maps

Object recognition is one of the most important functions of the human visual system, yet one of the least understood, this despite the fact that vision is certainly the most studied function of the brain. We understand relatively well how several processes in the cortical visual areas that support recognition capabilities take place, such as orientation discrimination and color constancy. This paper proposes a model of the development of object recognition capability, based on two main theoretical principles. The first is that recognition does not imply any sort of geometrical reconstruction, it is instead fully driven by the two dimensional view captured by the retina. The second assumption is that all the processing functions involved in recognition are not genetically determined or hardwired in neural circuits, but are the result of interactions between epigenetic influences and basic neural plasticity mechanisms. The model is organized in modules roughly related to the main visual biological areas, and is implemented mainly using the LISSOM architecture, a recent neural self-organizing map model that simulates the effects of intercortical lateral connections. This paper shows how recognition capabilities, similar to those found in brain ventral visual areas, can develop spontaneously by exposure to natural images in an artificial cortical model.

Neurophysiological evidence for the time course of activation of global shape, part, and local contour representations during visual object categorization and memory

Categorization of visual objects entails matching a percept to long-term representations of structural knowledge. This object model selection is central to theories of human visual cognition, but the representational format(s) is largely unknown. To characterize these neural representations, event-related brain potentials (ERPs) to fragmented objects during an indirect memory test were compared when only local contour features, but not global shapes of the object and its parts, differed between encoding and retrieval experiences. The ERP effects revealed that the format of object representations varies across time according to the particular neural processing and memory system currently engaged. An occipito-temporal P2(00) showed implicit memory modulation to items that repeatedly engaged similar perceptual grouping processes but not items that merely reinstantiated visual features. After 500 msec, memory modulation of a late positive complex, indexing secondary categorization and/or explicit recollection processes, was sensitive to local contour changes. In between, a frontocentral N350, indexing the model selection and an implicit perceptual memory system, showed reactivation of object representations whenever the same global shapes were reactivated, despite local feature differences. These and prior N350 findings provide direct neurophysiological evidence that the neural representations supporting object categorization include knowledge beyond local contours and about higher-order perceptual structures, such as the global shapes of the object and its parts, that can differ between object views. The N350 is proposed to index a second state of interactive, recurrent, and feedback processing in occipital and ventral temporal neocortex supporting higher-order cognitive abilities and phenomenological awareness with objects.

Cue-invariant networks for figure and background processing in human visual cortex

Lateral occipital cortical areas are involved in the perception of objects, but it is not clear how these areas interact with first tier visual areas. Using synthetic images portraying a simple texture-defined figure and an electrophysiological paradigm that allows us to monitor cortical responses to figure and background regions separately, we found distinct neuronal networks responsible for the processing of each region. The figure region of our displays was tagged with one temporal frequency (3.0 Hz) and the background region with another (3.6 Hz). Spectral analysis was used to separate the responses to the two regions during their simultaneous presentation. Distributed source reconstructions were made by using the minimum norm method, and cortical current density was measured in a set of visual areas defined on retinotopic and functional criteria with the use of functional magnetic resonance imaging. The results of the main experiments, combined with a set of control experiments, indicate that the figure region, but not the background, was routed preferentially to lateral cortex. A separate network extending from first tier through more dorsal areas responded preferentially to the background region. The figure-related responses were mostly invariant with respect to the texture types used to define the figure, did not depend on its spatial location or size, and mostly were unaffected by attentional instructions. Because of the emergent nature of a segmented figure in our displays, feedback from higher cortical areas is a likely candidate for the selection mechanism by which the figure region is routed to lateral occipital cortex.

Concurrent visuomotor behaviour improves form discrimination in a patient with visual form agnosia

It is now well established that the visual brain is divided into two visual streams, the ventral and the dorsal stream. Milner and Goodale have suggested that the ventral stream is dedicated for processing vision for perception and the dorsal stream vision for action [A.D. Milner & M.A. Goodale (1995) The Visual Brain in Action, Oxford University Press, Oxford]. However, it is possible that ongoing processes in the visuomotor stream will nevertheless have an effect on perceptual processes. This possibility was examined in the present study. We have examined the visual form-discrimination performance of the form-agnosic patient D.F. with and without a concurrent visuomotor task, and found that her performance was significantly improved in the former condition. This suggests that the visuomotor behaviour provides cues that enhance her ability to recognize the form of the target object. In control experiments we have ruled out proprioceptive and efferent cues, and therefore propose that D.F. can, to a significant degree, access the object's visuomotor representation in the dorsal stream. Moreover, we show that the grasping-induced perceptual improvement disappears if the target objects only differ with respect to their shape but not their width. This suggests that shape information per se is not used for this grasping task.

Early development of visual recognition

The most important ability of the human vision is object recognition, yet it is exactly the less understood aspect of the vision system. Computational models have been helpful in progressing towards an explanation of this obscure cognitive ability, and today it is possible to conceive more refined models, thanks to the new availability of neuroscientific data about the human visual cortex. This work proposes a model of the development of the object recognition capability, under a different perspective with respect to the most common approaches, with a precise theoretical epistemology. It is assumed that the main processing functions involved in recognition are not genetically determined and hardwired in the neural circuits, but are the result of interactions between epigenetic influences and the basic neural plasticity mechanisms. The model is organized in modules related with the main visual biological areas, and is implemented mainly using the LISSOM architecture, a recent self-organizing algorithm closely reflecting the essential behavior of cortical circuits.

Temporal characteristics of neural activity related to target detection during visual search

A previous MEG study on neural activities during the orientation singleton search showed that both efficient and inefficient searches shared a common neural network and the search efficiency was determined by a neural process executed in the temporal and parietal areas. The target segmentation stage, however, remains to be elucidated. In the present study, MEG and fMRI experiments were conducted, and moment-magnitudes of equivalent current dipoles were estimated with an fMRI-constrained MEG multi-dipole method to obtain differences between target-present and -absent conditions in each brain region for the whole time course. The dipole moments around the calcarine sulcus (CaS) and posterior fusiform gyrus (pFuG) increased at latencies around 70-350 ms. Activity around the CaS consisted of a prominent and a subsequent smaller but still obvious peak (117, 215 ms); the first peak showed no difference between conditions, while the second peak was significantly larger in the target-present condition. Activity around the pFuG had a prominent peak (125 ms) and subsequent small activity (237 ms), whereas the target's presence or not had no influence on either activity. The activity of the right intraparietal sulcus (IPS) was significantly larger than that for the left IPS at latencies around 196 ms irrespective of the target's presence or not. The activity of the other brain regions such as the posterior superior temporal sulcus, cingulate sulcus and central sulcus showed no difference between target conditions. The results demonstrate that neural activities of multiple regions had different temporal characteristics, and the later activity around the CaS was related to the target segregation from its surroundings during the orientation contrast search.

TMS can reveal contrasting functions of the dorsal and ventral visual processing streams

In order to investigate the functional specificity of the dorsal and ventral visual processing steams we used transcranial magnetic stimulation (TMS) to briefly disrupt one or the other while subjects performed three tasks, involving discrimination of colour or shape or relative position. TMS was delivered over right posterior parietal cortex (PPC) or right lateral occipital (LO) cortex, regions known to have visuo-spatial and object processing properties respectively. LO but not PPC stimulation had a significant effect on reaction time when subjects were asked to make a discrimination of relative shape. PPC stimulation had a significant effect when subjects were asked to discriminate relative position of the same shapes. Stimulation of LO also lengthened reaction times on the position task. There were no effects of stimulation at either site on colour discrimination. Results are discussed within the framework of how the dorsal stream and ventral stream are dissociated following their damage in neurological patients and possible ways in which they may interact in the normal brain.

The ties that keep us bound: Top-down influences on the persistence of shape-from-motion

The phenomenon of perceptual persistence after the motion stops in shape-from-motion displays (SFM) was used to study the influence of prior knowledge on the maintenance of a percept in awareness. In SFM displays an object composed of discontinuous line segments are embedded in a background of randomly oriented lines. The object only becomes perceptible when the line segments that compose the object and the lines that compose the background move in counterphase. Critically, once the movement of the line segments stops, the percept of the object persists for a short period of time. In the present study, perceptual persistence for digits exceeded that reported for nonsense shapes composed of the same line segments. This result is taken as evidence that the processes involved in the persistence of SFM, and therefore sustained perception, are sensitive to top-down influences.

Perceptual continuity and the emergence of perceptual persistence in the ventral visual pathway

Perceptual continuity is an important aspect of our experience of the visual world. In this study, we focus on an example of perceptual continuity involving the maintenance of figure-ground segregation despite the removal of binding cues that initiated the segregation. Fragmented line drawings of objects were superimposed on a background of randomly oriented lines. Global forms could be discriminated from the background based on differences in motion or differences in color/brightness. Furthermore, perception of a global form persisted after the binding cue had been removed. A comparison between the persistence of forms constructed from motion or color demonstrated that both forms produced persistence after the object defining cues were removed. Functional imaging showed a gradual increase in the persistence of brain activity in the lower visual areas (V1, V2, VP), which reached significance in V4v and peaked in the lateral occipital area. There was no difference in the location of persistence for color- or motion-defined forms. These results suggest that the retention of a global percept is an emerging property of the ventral visual processing stream and the maintenance of grouped visual elements is independent of cue type. We postulated that perceptual persistence depends on a system of perceptual memory reflecting the state of perceptual organization.