Integrating electrophysiology and neuroimaging in the study of human cognition

Sensorimotor brain dynamics reflect architectural affordances

Anticipating meaningful actions in the environment is an essential function of the brain. Such predictive mechanisms originate from the motor system and allow for inferring actions from environmental affordances, and the potential to act within a specific environment. Using architecture, we provide a unique perspective on the ongoing debate in cognitive neuroscience and philosophy on whether cognition depends on movement or is decoupled from our physical structure. To investigate cognitive processes associated with architectural affordances, we used a mobile brain/body imaging approach recording brain activity synchronized to head-mounted displays. Participants perceived and acted on virtual transitions ranging from nonpassable to easily passable. We found that early sensory brain activity, on revealing the environment and before actual movement, differed as a function of affordances. In addition, movement through transitions was preceded by a motor-related negative component that also depended on affordances. Our results suggest that potential actions afforded by an environment influence perception.

Early attentive processing on forged and genuine exemplars by imitators: An ERP study

Important questions have arisen about the capacity of traditional questioned document methodology to differentiate between genuine and forged exemplars of an author's handwriting. This paper does not address that dispute. The paper describes the first part of a research project investigating whether imitators (forgers) can reliably differentiate between genuine samples and forgeries. This paper takes a different, cognitive neuroscience approach and investigates the overlooked topic of the mental processing of forgeries by forgers. The paper tried to examine the neural mechanisms of imitators' (forgers') attentive processing of forged and genuine exemplars. The data in this initial phase of the study showed imitators experienced more difficulty evaluating their own forgeries perhaps because the forgeries included both the features they had consciously copied and some of their own handwriting characteristics that they could not completely suppress. A subsequent phase of the study will use self-reporting and eye movement tracking studies, in this phase we shall attempt to identify the specific types of features the imitators relied on in correctly classifying the exhibit as a forgery. We shall then enlist the services of experienced questioned document examiners endeavor to determine whether those characteristics appear in genuine exemplars of the forgers' handwriting. The identification of those categories of features may hold the potential for improving both the detection of forgeries and the identification of the forger.

Neural substrates of species-dependent visual processing of faces: use of morphed faces

Face identification and categorization are essential for social communication. The N170 event-related potential (ERP) is considered to be a biomarker of face perception. To elucidate the neural basis of species-dependent face processing, we recorded 128-ch high-density ERPs in 14 healthy adults while they viewed the images of morphed faces. The morphed stimuli contained different proportions of human and monkey faces, and the species boundary was shifted away from the center of the morph continuum. Three experiments were performed to determine how task requirement, facial orientation, and spatial frequency (SF) of visual stimuli affected ERPs. In an equal SF condition, the latency, and amplitude of the occipital P100 for upright faces were modulated in a monotonic-like fashion by the level of morphing. In contrast, the N170 latency for upright faces was modulated in a step-like fashion, showing a flexion point that may reflect species discrimination. Although N170 amplitudes for upright faces were not modulated by morph level, they were modulated in a monotonic-like fashion by inverted faces. The late positive (LP) component (350–550 msec) in the parietal region was modulated in a U-shaped function by morph level during a categorization task, but not in a simple reaction task. These results suggest that P100 reflects changes in the physical properties of faces and that N170 is involved in own-species selectivity. The LP component seems to represent species categorization that occurs 350 msec after stimulus onset.

Mighty metaphors: behavioral and ERP evidence that power shifts attention on a vertical dimension

Thinking about the abstract concept power may automatically activate the spatial up-down image schema (powerful up; powerless down) and consequently direct spatial attention to the image schema-congruent location. Participants indicated whether a word represented a powerful or powerless person (e.g. 'king' or 'servant'). Following each decision, they identified a target at the top or bottom of the visual field. In Experiment 1 participants identified the target faster when their spatial position was congruent with the perceived power of the preceding word than when it was incongruent. In Experiment 2 ERPs showed a higher N1 amplitude for congruent spatial positions. These results support the view that attention is driven to the image schema congruent location of a power word. Thus, power is partially understood in terms of vertical space, which demonstrates that abstract concepts are grounded in sensory-motor processing.

Electrophysiological evidence of attentional biases in social anxiety disorder

BACKGROUND

Previous studies investigating attentional biases in social anxiety disorder (SAD) have yielded mixed results. Recent event-related potential (ERP) studies using the dot-probe paradigm in non-anxious participants have shown that the P1 component is sensitive to visuospatial attention towards emotional faces. We used a dot-probe task in conjunction with high-density ERPs and source localization to investigate attentional biases in SAD.

METHOD

Twelve SAD and 15 control participants performed a modified dot-probe task using angry-neutral and happy-neutral face pairs. The P1 component elicited by face pairs was analyzed to test the hypothesis that SAD participants would display early hypervigilance to threat-related cues. The P1 component to probes replacing angry, happy or neutral faces was used to evaluate whether SAD participants show either sustained hypervigilance or decreased visual processing of threat-related cues at later processing stages.

RESULTS

Compared to controls, SAD participants showed relatively (a) potentiated P1 amplitudes and fusiform gyrus (FG) activation to angry-neutral versus happy-neutral face pairs; (b) decreased P1 amplitudes to probes replacing emotional (angry and happy) versus neutral faces; and (c) higher sensitivity (d') to probes following angry-neutral versus happy-neutral face pairs. SAD participants also showed significantly shorter reaction times (RTs) to probes replacing angry versus happy faces, but no group differences emerged for RT.

CONCLUSIONS

The results provide electrophysiological support for early hypervigilance to angry faces in SAD with involvement of the FG, and reduced visual processing of emotionally salient locations at later stages of information processing, which might be a manifestation of attentional avoidance.

Neural correlates of person recognition

Rapidly identifying known individuals is an essential skill in human society. To elucidate the neural basis of this skill, we monitored brain activity while experimental participants demonstrated their ability to recognize people on the basis of viewing their faces. Each participant first memorized the faces of 20 individuals who were not known to the participants in advance. Each face was presented along with a voice simulating the individual speaking their name and a biographical fact. Following this learning procedure, the associated verbal information could be recalled accurately in response to each face. These learned faces were subsequently viewed together with new faces in a memory task. Subjects made a yes-no recognition decision in response to each face while also covertly retrieving the person-specific information associated with each learned face. Brain activity that accompanied this retrieval of person-specific information was contrasted to that when new faces were processed. Functional magnetic resonance imaging in 10 participants showed that several brain regions were activated during blocks of learned faces, including left hippocampus, left middle temporal gyrus, left insula, and bilateral cerebellum. Recordings of event-related brain potentials in 10 other participants tracked the time course of face processing and showed that learned faces engaged neural activity responsible for person recognition 300-600 msec after face onset. Collectively, these results suggest that the visual input of a recently learned face can rapidly trigger retrieval of associated person-specific information through reactivation of distributed cortical networks linked via hippocampal connections.

Spatiotemporal activation of the two visual pathways in form discrimination and spatial location: a brain mapping study

To address the question of the relationship between the two visual pathways, a ventral stream for object and form vision and a dorsal stream for spatial and motion vision, we measured the spatiotemporal activation patterns in the two pathways responding to an integrated visuospatial task to which form discrimination and spatial location were assigned simultaneously. The two cognitive components of form discrimination and spatial location were interwoven in the task; however, the fMRI data demonstrated that such a task still activated both ventral GTi/GF (the inferior temporal gyrus/the fusiform gyrus) and dorsal Ga/PCu (the angular gyrus/Precuneus), which are supposed to mediate form discrimination and spatial location, respectively. In addition, the source waveforms of the fMRI foci based on the source analysis of the fMRI-seeded dipole modeling and the moving dipole modeling indicated that in responding to the task combining simultaneously form perception and spatial location, the activity in Ga/PCu begins earlier than that in GTi/GF, but it peaks later and lasts longer.

Dissociating top-down attentional control from selective perception and action

Research into the neural mechanisms of attention has revealed a complex network of brain regions that are involved in the execution of attention-demanding tasks. Recent advances in human neuroimaging now permit investigation of the elementary processes of attention being subserved by specific components of the brain's attention system. Here we describe recent studies of spatial selective attention that made use of positron emission tomography (PET), functional magnetic resonance imaging (fMRI), and event-related brain potentials (ERPs) to investigate the spatio-temporal dynamics of the attention-related neural activity. We first review the results from an event-related fMRI study that examined the neural mechanisms underlying top-down attentional control versus selective sensory perception. These results defined a fronto-temporal-parietal network involved in the control of spatial attention. Activity in these areas biased the neural activity in sensory brain structures coding the spatial locations of upcoming target stimuli, preceding a modulation of subsequent target processing in visual cortex. We then present preliminary evidence from a fast-rate event-related fMRI study of spatial attention that demonstrates how to disentangle the potentially overlapping hemodynamic responses elicited by temporally adjacent stimuli in studies of attentional control. Finally, we present new analyses from combined neuroimaging (PET) and event-related brain potential (ERP) studies that together reveal the timecourse of activation of brain regions implicated in attentional control and selective perception.

Electrophysiological estimate of human cortical magnification

OBJECTIVE

The cortical magnification factor characterizes the area of human primary visual cortex activated by a stimulus as a function of angular distance from an observer's line of sight. This study estimates human cortical magnification using an electrophysiological method with excellent temporal resolution: visual evoked potential (VEP) dipole source localization.

METHODS

For each of 60 independently modulated checkerboard patches within the central 18 deg of the visual field, location, orientation, magnitude, and time-course of the dipole current source that best described the VEP distribution across a multi-electrode array was obtained. At numerous eccentricities, cortical magnification was determined using two different techniques: (1) the distance between each pair of adjacent stimulus patches was matched to the corresponding distance between adjacent cortical sources; and (2) the area of each stimulus patch was matched to the magnitude of the corresponding cortical source (which was assumed to be proportional to cortical area).

RESULTS

The estimates of human cortical magnification using our electrophysiological method were similar to previous estimates from psychophysics, cortical stimulation, and functional magnetic resonance imaging.

CONCLUSIONS

The concordance of results provided by these disparate technologies, with differing spatial and temporal limitations, supports their combination in studying the spatio-temporal dynamics of human brain function.

Neural mechanisms of global and local processing. A combined PET and ERP study

The neural mechanisms of hierarchical stimulus processing were investigated using a combined event-related potentials (ERPs) and positron emission tomography (PET) approach. Healthy subjects were tested under two conditions that involved selective or divided attention between local and global levels of hierarchical letter stimuli in order to determine whether and where hemispheric differences might exist in the processing of local versus global information. When attention was divided between global and local levels, the N2 component of the ERPs (260- to 360-msec latency) elicited by the target stimuli showed asymmetries in amplitude over the two hemispheres. The N2 to local targets was larger over the left hemisphere, but the N2 to global targets tended to be slightly larger over the right hemisphere. However, the shorter-latency, sensory-evoked P1 component (90- to 150-msec latency) was not different for global versus local targets under conditions of divided attention. In contrast, during selective attention to either global or local targets, asymmetries in the N2 component were not observed. But under selective attention conditions, the sensory-evoked P1 components in the extrastriate cortex were enlarged for global versus local attention. Increased regional cerebral blood flow in the posterior fusiform gyrus bilaterally was observed in the PET data during selective attention to either global or local targets, but neither these nor the P1 component showed any tendency toward hemispheric difference for global versus local attention. Neither were there any activations observed in the parietal lobe during selective attention to global versus local targets. Together these data indicate that early sensory inputs are not modulated to gate global versus local information differentially into the two hemispheres. Rather, later stages of processing that may be asymmetrically organized in the left and right hemispheres operate in parallel to process global and local aspects of complex stimuli (i.e., the N2 effect of the ERPs). This pattern of results supports models proposing that spatial frequency analysis is only asymmetric at higher stages of perceptual processing and not at the earliest stages of visual cortical analysis.

Effects of spatial selective attention on the steady-state visual evoked potential in the 20-28 Hz range

Steady-state visual evoked potentials (SSVEPs) were recorded from the scalp of subjects who attended to a flickering LED display in one visual field while ignoring a similar display (flickering at a different frequency) in the opposite visual field. The flicker frequencies were 20.8 Hz in the left-field display and 27.8 Hz in the right-field display. The SSVEP to the flicker in either field was enhanced in amplitude when attention was directed to its location. The scalp distribution of this SSVEP enhancement was narrowly focused over the posterior scalp contralateral to the visual field of stimulation. A source analysis using Variable Resolution Electromagnetic Tomography (VARETA) indicated that the source current densities for the SSVEP attention effect had a focal origin in the contralateral parieto-occipital cortex.