People can reliably detect action changes and goal changes during naturalistic perception

As a part of ongoing perception, the human cognitive system segments others' activities into discrete episodes (event segmentation). Although prior research has shown that this process is likely related to changes in an actor's actions and goals, it has not yet been determined whether untrained observers can reliably identify action and goal changes as naturalistic activities unfold, or whether the changes they identify are tied to visual features of the activity (e.g., the beginnings and ends of object interactions). This study addressed these questions by examining untrained participants' identification of action changes, goal changes, and event boundaries while watching videos of everyday activities that were presented in both first-person and third-person perspectives. We found that untrained observers can identify goal changes and action changes consistently, and these changes are not explained by visual change and the onsets or offsets of contact with objects. Moreover, the action and goal changes identified by untrained observers were associated with event boundaries, even after accounting for objective visual features of the videos. These findings suggest that people can identify action and goal changes consistently and with high agreement, that they do so by using sensory information flexibly, and that the action and goal changes they identify may contribute to event segmentation.

Nonlinear changes in pupillary attentional orienting responses across the lifespan

The cognitive aging process is not necessarily linear. Central task-evoked pupillary responses, representing a brainstem-pupil relationship, may vary across the lifespan. Thus we examined, in 75 adults ranging in age from 19 to 86, whether task-evoked pupillary responses to an attention task may serve in as an index of cognitive aging. This is because the locus coeruleus (LC), located in the brainstem, is not only among the earliest sites of degeneration in pathological aging, but also supports both attentional and pupillary behaviors. We assessed brief, task-evoked phasic attentional orienting to behaviorally relevant and irrelevant auditory tones, stimuli known specifically to recruit the LC in the brainstem and evoke pupillary responses. Due to potential nonlinear changes across the lifespan, we used a novel data-driven analysis on 6 dynamic pupillary behaviors on 10% of the data to reveal cut off points that best characterized the three age bands: young (19-41 years old), middle aged (42-68 years old), and older adults (69 + years old). Follow-up analyses on independent data, the remaining 90%, revealed age-related changes such as monotonic decreases in tonic pupillary diameter and dynamic range, along with curvilinear phasic pupillary responses to the behaviorally relevant target events, increasing in the middle-aged group and then decreasing in the older group. Additionally, the older group showed decreased differentiation of pupillary responses between target and distractor events. This pattern is consistent with potential compensatory LC activity in midlife that is diminished in old age, resulting in decreased adaptive gain. Beyond regulating responses to light, pupillary dynamics reveal a nonlinear capacity for neurally mediated gain across the lifespan, thus providing evidence in support of the LC adaptive gain hypothesis.

Attention-dependent coupling with forebrain and brainstem neuromodulatory nuclei changes across the lifespan

Attentional states continuously reflect the predictability and uncertainty in one's environment having important consequences for learning and memory. Beyond well known cortical contributions, rapid shifts in attention are hypothesized to also originate from deep nuclei, such as the basal forebrain (BF) and locus coeruleus (LC) neuromodulatory systems. These systems are also the first to change with aging. Here we characterized the interplay between these systems and their regulation of afferent targets - the hippocampus (HPC) and posterior cingulate cortex (PCC) - across the lifespan. To examine the role of attentional salience on task-dependent functional connectivity, we used a target-distractor go/no go task presented during functional MRI. In younger adults, BF coupling with the HPC, and LC coupling with the PCC, increased with behavioral relevance (targets vs distractors). Although the strength and presence of significant regional coupling changed in middle age, the most striking change in network connectivity was in old age, such that in older adults BF and LC coupling with their cortical afferents was largely absent and replaced by stronger interconnectivity between LC-BF nuclei. Overall rapid changes in attention related to behavioral relevance revealed distinct roles of subcortical neuromodulatory systems. The pronounced changes in functional network architecture across the lifespan suggest a decrease in these distinct roles, with deafferentation of cholinergic and noradrenergic systems associated with a shift towards mutual support during attention guided to external stimuli.

Measuring event segmentation: An investigation into the stability of event boundary agreement across groups

People spontaneously divide everyday experience into smaller units (event segmentation). To measure event segmentation, studies typically ask participants to explicitly mark the boundaries between events as they watch a movie (segmentation task). Their data may then be used to infer how others are likely to segment the same movie. However, significant variability in performance across individuals could undermine the ability to generalize across groups, especially as more research moves online. To address this concern, we used several widely employed and novel measures to quantify segmentation agreement across different sized groups (n = 2-32) using data collected on different platforms and movie types (in-lab & commercial film vs. online & everyday activities). All measures captured nonrandom and video-specific boundaries, but with notable between-sample variability. Samples of 6-18 participants were required to reliably detect video-driven segmentation behavior within a single sample. As sample size increased, agreement values improved and eventually stabilized at comparable sample sizes for in-lab & commercial film data and online & everyday activities data. Stabilization occurred at smaller sample sizes when measures reflected (1) agreement between two groups versus agreement between an individual and group, and (2) boundary identification between small (fine-grained) rather than large (coarse-grained) events. These analyses inform the tailoring of sample sizes based on the comparison of interest, materials, and data collection platform. In addition to demonstrating the reliability of online and in-lab segmentation performance at moderate sample sizes, this study supports the use of segmentation data to infer when events are likely to be segmented.

Grounding the Attentional Boost Effect in Events and the Efficient Brain

Attention and memory for everyday experiences vary over time, wherein some moments are better attended and subsequently better remembered than others. These effects have been demonstrated in naturalistic viewing tasks with complex and relatively uncontrolled stimuli, as well as in more controlled laboratory tasks with simpler stimuli. For example, in the attentional boost effect (ABE), participants perform two tasks at once: memorizing a series of briefly presented stimuli (e.g., pictures of outdoor scenes) for a later memory test, and responding to other concurrently presented cues that meet pre-defined criteria (e.g., participants press a button for a blue target square and do nothing for a red distractor square). However, rather than increasing dual-task interference, attending to a target cue boosts, rather than impairs, subsequent memory for concurrently presented information. In this review we describe current data on the extent and limitations of the attentional boost effect and whether it may be related to activity in the locus coeruleus neuromodulatory system. We suggest that insight into the mechanisms that produce the attentional boost effect may be found in recent advances in the locus coeruleus literature and from understanding of how the neurocognitive system handles stability and change in everyday events. We consequently propose updates to an early account of the attentional boost effect, the dual-task interaction model, to better ground it in what is currently known about event cognition and the role that the LC plays in regulating brain states.

"Guidance of spatial attention by incidental learning and endogenous cuing": Retraction

Reports the retraction of "Guidance of spatial attention by incidental learning and endogenous cuing" by Yuhong V. Jiang, Khena M. Swallow and Gail M. Rosenbaum (Journal of Experimental Psychology: Human Perception and Performance, 2013[Feb], Vol 39[1], 285-297). The retraction is at the request of the authors. There was an unintentional error in the MATLAB experimental script used for Experiment 5 that caused one experimental condition to be incorrectly recorded in the data files. The authors confirmed that the MATLAB scripts used for Experiments 1 and 2 did not contain any errors and the findings and conclusions remain valid. However, for Experiments 3 and 4, the programming error led to two issues: (a) one variable was incorrectly written to the data files, and (b) the actual number of trials per condition during the training phase was unbalanced. To ensure that the scientific record is adequately corrected, the authors have uploaded additional information, including the MATLAB scripts for all experiments, the reanalysis of the data from Experiments 3, 4, and 5, and the validation of Experiments 1 and 2, to this OSF repository: https://osf.io/k79j4/?view_only=2220d62d0bb643f9b4ca53 e7a6da872f. The first author of the paper, who programmed the MATLAB scripts, takes full responsibility for the error. The authors sincerely regret this error and apologize for its effects on the editors, reviewers, and the broader scientific community. All authors of the original article joined in the request for the retraction. (The following abstract of the original article appeared in record 2012-09470-001). Our visual system is highly sensitive to regularities in the environment. Locations that were important in one's previous experience are often prioritized during search, even though observers may not be aware of the learning. In this study we characterized the guidance of spatial attention by incidental learning of a target's spatial probability, and examined the interaction between endogenous cuing and probability cuing. Participants searched for a target (T) among distractors (Ls). The target was more often located in one region of the screen than in others. We found that search reaction time (RT) was faster when the target appeared in the high-frequency region rather than the low-frequency regions. This difference increased when there were more items on the display, suggesting that probability cuing guides spatial attention. Additional data indicated that on their own, probability cuing and endogenous cuing (e.g., a central arrow that predicted a target's location) were similarly effective at guiding attention. However, when both cues were presented at once, probability cuing was largely eliminated. Thus, although both incidental learning and endogenous cuing can effectively guide attention, endogenous cuing takes precedence over incidental learning. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Auditory Target Detection Enhances Visual Processing and Hippocampal Functional Connectivity

Though dividing one's attention between two input streams typically impairs performance, detecting a behaviorally relevant stimulus can sometimes enhance the encoding of unrelated information presented at the same time. Previous research has shown that selection of this kind boosts visual cortical activity and memory for concurrent items. An important unanswered question is whether such effects are reflected in processing quality and functional connectivity in visual regions and in the hippocampus. In this fMRI study, participants were asked to memorize a stream of naturalistic images and press a button only when they heard a predefined target tone (400 or 1,200 Hz, counterbalanced). Images could be presented with a target tone, with a distractor tone, or without a tone. Auditory target detection increased activity throughout the ventral visual cortex but lowered it in the hippocampus. Enhancements in functional connectivity between the ventral visual cortex and the hippocampus were also observed following auditory targets. Multi-voxel pattern classification of image category was more accurate on target tone trials than on distractor and no tone trials in the fusiform gyrus and parahippocampal gyrus. This effect was stronger in visual cortical clusters whose activity was more correlated with the hippocampus on target tone than on distractor tone trials. In agreement with accounts suggesting that subcortical noradrenergic influences play a role in the attentional boost effect, auditory target detection also caused an increase in locus coeruleus activity and phasic pupil responses. These findings outline a network of cortical and subcortical regions that are involved in the selection and processing of information presented at behaviorally relevant moments.

Estimates of locus coeruleus function with functional magnetic resonance imaging are influenced by localization approaches and the use of multi-echo data

The locus coeruleus (LC) plays a central role in regulating human cognition, arousal, and autonomic states. Efforts to characterize the LC’s function in humans using functional magnetic resonance imaging have been hampered by its small size and location near a large source of noise, the fourth ventricle. We tested whether the ability to characterize LC function is improved by employing neuromelanin-T1 weighted images (nmT1) for LC localization and multi-echo functional magnetic resonance imaging (ME-fMRI) for estimating intrinsic functional connectivity (iFC). Analyses indicated that, relative to a probabilistic atlas, utilizing nmT1 images to individually localize the LC increases the specificity of seed time series and clusters in the iFC maps. When combined with independent components analysis (ME-ICA), ME-fMRI data provided significant improvements in the temporal signal to noise ratio and DVARS relative to denoised single echo data (1E-fMRI). The effects of acquiring nmT1 images and ME-fMRI data did not appear to only reflect increases in power: iFC maps for each approach overlapped only moderately. This is consistent with findings that ME-fMRI offers substantial advantages over 1E-fMRI acquisition and denoising. It also suggests that individually identifying LC with nmT1 scans is likely to reduce the influence of other nearby brainstem regions on estimates of LC function.

Culture influences how people divide continuous sensory experience into events

Everyday experience is divided into meaningful events as a part of human perception. Current accounts of this process, known as event segmentation, focus on how characteristics of the experience (e.g., situation changes) influence segmentation. However, characteristics of the viewers themselves have been largely neglected. We test whether one such viewer characteristic, their cultural background, impacts online event segmentation. Culture could impact event segmentation (1) by emphasizing different aspects of experiences as being important for comprehension, memory, and communication, and (2) by providing different exemplars of how everyday activities are performed, which objects are likely to be used, and how scenes are laid out. Indian and US viewers (N = 152) identified events in everyday activities (e.g., making coffee) recorded in Indian and US settings. Consistent with their cultural preference for analytical processing, US viewers segmented the activities into more events than did Indian viewers. Furthermore, event boundaries identified by US viewers were more strongly associated with visual changes, whereas boundaries identified by Indian viewers were more strongly associated with goal changes. There was no evidence that familiarity with an activity impacted segmentation. Thus, culture impacts event perception by altering the types of information people prioritize when dividing experience into meaningful events.

Attention and cardiac phase boost judgments of trust

Fluctuations in mental and bodily states have both been shown to be associated with negative affective experience. Here we examined how momentary fluctuations in attentional and cardiac states combine to regulate the perception of positive social value. Faces varying in trustworthiness were presented during a go/no-go letter target discrimination task synchronized with systolic or diastolic cardiac phase. Go trials lead to an attentional boosting of perceived trust on high trust and ambiguous neutral faces, suggesting attention both boosted existing and generated positive social value. Cardiac phase during face presentation interacted with attentional boosting of trust, enhancing high trust faces specifically during relaxed diastolic cardiac states. Confidence judgments revealed that attentional trust boosting, and its cardiac modulation, did not reflect altered perceptual or response fluency. These results provide evidence for how moment-to moment fluctuations in top-down mental and bottom-up bodily inputs combine to enhance a priori and generate de novo positive social value.

Target detection increases pupil diameter and enhances memory for background scenes during multi-tasking

Attending to targets in a detection task can facilitate memory for concurrently presented information, a phenomenon known as the attentional boost effect. One account of the attentional boost suggests that it reflects the temporal selection of behaviorally relevant moments, broadly facilitating the processing of information encountered at these times. Because pupil diameter increases when orienting to behaviorally relevant events and is positively correlated with increases in gain and activity in the locus coeruleus (a purported neurophysiological mechanism for temporal selection), we tested whether the attentional boost effect is accompanied by an increase in pupil diameter. Participants memorized a series of individually presented scenes. Whenever a scene appeared, a high or low pitched tone was played, and participants counted (and later reported) the number of tones in the pre-specified, target pitch. Target detection enhanced later memory for concurrently presented scenes. It was accompanied by a larger pupil response than was distractor rejection, and this effect was more pronounced for subsequently remembered rather than forgotten scenes. Thus, conditions that produce the attentional boost effect may also elicit phasic changes in neural gain and locus coeruleus activity.

The role of perspective in event segmentation

People divide their ongoing experience into meaningful events. This process, event segmentation, is strongly associated with visual input: when visual features change, people are more likely to segment. However, the nature of this relationship is unclear. Segmentation could be bound to specific visual features, such as actor posture. Or, it could be based on changes in the activity that are correlated with visual features. This study distinguished between these two possibilities by examining whether segmentation varies across first- and third-person perspectives. In two experiments, observers identified meaningful events in videos of actors performing everyday activities, such as eating breakfast or doing laundry. Each activity was simultaneously recorded from a first-person perspective and a third-person perspective. These videos presented identical activities but differed in their visual features. If segmentation is tightly bound to visual features then observers should identify different events in first- and third-person videos. In addition, the relationship between segmentation and visual features should remain unchanged. Neither prediction was supported. Though participants sometimes identified more events in first-person videos, the events they identified were mostly indistinguishable from those identified for third-person videos. In addition, the relationship between the video's visual features and segmentation changed across perspectives, further demonstrating a partial dissociation between segmentation and visual input. Event segmentation appears to be robust to large variations in sensory information as long as the content remains the same. Segmentation mechanisms appear to flexibly use sensory information to identify the structure of the underlying activity.

The role of value in the attentional boost effect

Focusing attention on one item typically interferes with the ability to process other information. Yet, target detection can both facilitate memory for items paired with the target (the attentional boost effect) and increase the perceived value of those items (cued approach). Because long-term memory is better for valuable items than for neutral items, we asked whether the attentional boost effect is due to changes in the perceived value of items that are paired with targets. In three experiments, participants memorised a series of briefly presented images that depicted valuable (e.g., food) or neutral (e.g., children's toys) items. Whenever an item appeared, a square flashed in its centre. Participants pressed a button if the square was a target colour but not if it was a distractor colour. Consistent with previous research, target-paired items were remembered better than distractor-paired items and were rated as more valuable. Importantly, if memory for target-paired items is enhanced because they increased in perceived value, then valuable items should have been better remembered than neutral items. However, we found no evidence that value enhanced memory for the items in this task. Thus, it is unlikely that the attentional boost effect is due to changes in perceived value.

How memory is tested influences what is measured: Reply to Wyble and Chen (2017)

In this response to Wyble and Chen's (2017) commentary on attribute amnesia, we hope to achieve several goals. First, we clarify how our view diverges from that described by Wyble and Chen. We argue that because the surprise memory test is disruptive, it is an insensitive tool for measuring the persistence of recently attended target attributes in memory. Second, we identify points of agreement between our view and that of Wyble and Chen. Like them, we believe that the strength of a mental representation is a critical factor in determining whether the representation persists long enough to be used in a surprise recognition task. We also agree that consolidation is one means of strengthening this representation. Finally, we suggest questions that should be addressed to clarify the factors that determine whether attended information can be reported in a surprise memory test. (PsycINFO Database Record

EVENT SEGMENTATION

One way to understand something is to break it up into parts. New research indicates that segmenting ongoing activity into meaningful events is a core component of ongoing perception, with consequences for memory and learning. Behavioral and neuroimaging data suggest that event segmentation is automatic and that people spontaneously segment activity into hierarchically organized parts and sub-parts. This segmentation depends on the bottom-up processing of sensory features such as movement, and on the top-down processing of conceptual features such as actors' goals. How people segment activity affects what they remember later; as a result, those who identify appropriate event boundaries during perception tend to remember more and learn more proficiently.

Memory for recently accessed visual attributes

Recent reports have suggested that the attended features of an item may be rapidly forgotten once they are no longer relevant for an ongoing task (attribute amnesia). This finding relies on a surprise memory procedure that places high demands on declarative memory. We used intertrial priming to examine whether the representation of an item's identity is lost completely once it becomes task irrelevant. If so, then the identity of a target on one trial should not influence performance on the next trial. In 3 experiments, we replicated the finding that a target's identity is poorly recognized in a surprise memory test. However, we also observed location and identity repetition priming across consecutive trials. These data suggest that, although explicit recognition on a surprise memory test may be impaired, some information about a particular target's identity can be retained after it is no longer needed for a task. (PsycINFO Database Record

Temporal yoking in continuous multitasking

Continuous tasks such as baggage screening often involve selective gating of sensory information when "targets" are detected. Previous research has shown that temporal selection of behaviorally relevant information triggers changes in perception, learning, and memory. However, it is unclear whether temporal selection has broad effects on concurrent tasks. To address this question, we asked participants to view a stream of faces and encoded faces of a particular gender for a later memory test. At the same time, they listened to a sequence of tones, pressing a button for specific pitched tones. We manipulated the timing of temporal selection such that target faces and target tones could be unrelated, perfectly correlated, or anticorrelated. Temporal selection was successful when the temporally coinciding stimuli were congruent (e.g., both were targets), but not when they were incongruent (i.e., only 1 was a target). This pattern suggests that attentional selection for separate tasks is yoked in time-when the attentional gate opens for 1 task it also opens for the other. Temporal yoking is a unique form of dual-task interaction.

Changing viewer perspectives reveals constraints to implicit visual statistical learning

Statistical learning-learning environmental regularities to guide behavior-likely plays an important role in natural human behavior. One potential use is in search for valuable items. Because visual statistical learning can be acquired quickly and without intention or awareness, it could optimize search and thereby conserve energy. For this to be true, however, visual statistical learning needs to be viewpoint invariant, facilitating search even when people walk around. To test whether implicit visual statistical learning of spatial information is viewpoint independent, we asked participants to perform a visual search task from variable locations around a monitor placed flat on a stand. Unbeknownst to participants, the target was more often in some locations than others. In contrast to previous research on stationary observers, visual statistical learning failed to produce a search advantage for targets in high-probable regions that were stable within the environment but variable relative to the viewer. This failure was observed even when conditions for spatial updating were optimized. However, learning was successful when the rich locations were referenced relative to the viewer. We conclude that changing viewer perspective disrupts implicit learning of the target's location probability. This form of learning shows limited integration with spatial updating or spatiotopic representations.

Spatial reference frame of attention in a large outdoor environment

A central question about spatial attention is whether it is referenced relative to the external environment or to the viewer. This question has received great interest in recent psychological and neuroscience research, with many but not all, finding evidence for a viewer-centered representation. However, these previous findings were confined to computer-based tasks that involved stationary viewers. Because natural search behaviors differ from computer-based tasks in viewer mobility and spatial scale, it is important to understand how spatial attention is coded in the natural environment. To this end, we created an outdoor visual search task in which participants searched a large (690 square ft), concrete, outdoor space to report which side of a coin on the ground faced up. They began search in the middle of the space and were free to move around. Attentional cuing by statistical learning was examined by placing the coin in 1 quadrant of the search space on 50% of the trials. As in computer-based tasks, participants learned and used these regularities to guide search. However, cuing could be referenced to either the environment or the viewer. The spatial reference frame of attention shows greater flexibility in the natural environment than previously found in the lab.

First saccadic eye movement reveals persistent attentional guidance by implicit learning

Implicit learning about where a visual search target is likely to appear often speeds up search. However, whether implicit learning guides spatial attention or affects postsearch decisional processes remains controversial. Using eye tracking, this study provides compelling evidence that implicit learning guides attention. In a training phase, participants often found the target in a high-frequency, "rich" quadrant of the display. When subsequently tested in a phase during which the target was randomly located, participants were twice as likely to direct the first saccadic eye movement to the previously rich quadrant than to any of the sparse quadrants. The attentional bias persisted for nearly 200 trials after training and was unabated by explicit instructions to distribute attention evenly. We propose that implicit learning guides spatial attention but in a qualitatively different manner than goal-driven attention.

Perceptual load and attentional boost: a study of their interaction

Increasing attention to an item typically interferes with the ability to process other concurrent information. The attentional boost effect, however, appears to contradict the ubiquity of dual-task interference. Rather, detecting a target item for one task boosts memory for a currently presented, but unrelated background scene. To account for the apparent discrepancy between dual-task interference and attentional boost, we present and test the dual-task interaction model. This model states that dual-task interference occurs at multiple stages of processing, but the decision that an item is a target triggers a cross-task enhancement to perceptual processing. Consistent with this model, this study shows that targets, but not perceptually similar distractors, trigger the attentional boost effect. In addition, the attentional boost effect is unperturbed when the perceptual load of target detection increases. The effect can also occur for task-irrelevant background images. Consistent with the dual-task interaction model these data clearly tie the attentional boost effect to the decision that an item is a target. They also suggest that this decision can rapidly boost the availability of perceptual resources.

Body and head tilt reveals multiple frames of reference for spatial attention

Most modern theories of spatial attention suggest that it is based on a maplike representation that prioritizes information in some spatial locations over others. However, movement through space changes the relationship between what is "out there" and a person's viewpoint. Does spatial attention move with the viewer, or does it stay in environmental locations? Several recent psychophysical and neuroscience studies have attempted to address this question by probing attention following saccadic eye movements. The alignment of the head and body to the external environment in these studies, however, makes it impossible to determine whether attention is based on the viewer's location in space or on the external environment. The current study therefore introduces a head and/or body tilt through the vertical plane to dissociate viewer-centered from environment-centered representations. Participants first acquired a long-lasting attentional bias to a region of the search display that was likely to contain a target. They then tilted their head or body, and the location of the spatial bias was evaluated. The results suggest that attention has both a viewer-centered component that rotates with the viewer's head and an environment-centered component that is tied to environmental locations.

Attentional load and attentional boost: a review of data and theory

Both perceptual and cognitive processes are limited in capacity. As a result, attention is selective, prioritizing items and tasks that are important for adaptive behavior. However, a number of recent behavioral and neuroimaging studies suggest that, at least under some circumstances, increasing attention to one task can enhance performance in a second task (e.g., the attentional boost effect). Here we review these findings and suggest a new theoretical framework, the dual-task interaction model, that integrates these findings with current views of attentional selection. To reconcile the attentional boost effect with the effects of attentional load, we suggest that temporal selection results in a temporally specific enhancement across modalities, tasks, and spatial locations. Moreover, the effects of temporal selection may be best observed when the attentional system is optimally tuned to the temporal dynamics of incoming stimuli. Several avenues of research motivated by the dual-task interaction model are then discussed.

Selection of events in time enhances activity throughout early visual cortex

Temporal selection poses unique challenges to the perceptual system. Selection is needed to protect goal-relevant stimuli from interference from new sensory input. In addition, contextual information that occurs at the same time as goal-relevant stimuli may be critical for learning. Using fMRI, we characterized how visual cortical regions respond to the temporal selection of auditory and visual stimuli. Critically, we focused on brain regions that are not involved in processing the target itself. Participants pressed a button when they heard a prespecified target tone and did not respond to other tones. Although more attention was directed to auditory input when the target tone was selected, activity in primary visual cortex increased more after target tones than after distractor tones. In contrast to spatial attention, this effect was larger in V1 than in V2 and V3. It was present in regions not typically involved in representing the target stimulus. Additional experiments demonstrated that these effects were not due to multimodal processing, rare targets, or motor responses to the targets. Thus temporal selection of behaviorally relevant stimuli enhances, rather than reduces, activity in perceptual regions involved in processing other information.

Guidance of spatial attention by incidental learning and endogenous cuing

Our visual system is highly sensitive to regularities in the environment. Locations that were important in one's previous experience are often prioritized during search, even though observers may not be aware of the learning. In this study we characterized the guidance of spatial attention by incidental learning of a target's spatial probability, and examined the interaction between endogenous cuing and probability cuing. Participants searched for a target (T) among distractors (Ls). The target was more often located in one region of the screen than in others. We found that search reaction time (RT) was faster when the target appeared in the high-frequency region rather than the low-frequency regions. This difference increased when there were more items on the display, suggesting that probability cuing guides spatial attention. Additional data indicated that on their own, probability cuing and endogenous cuing (e.g., a central arrow that predicted a target's location) were similarly effective at guiding attention. However, when both cues were presented at once, probability cuing was largely eliminated. Thus, although both incidental learning and endogenous cuing can effectively guide attention, endogenous cuing takes precedence over incidental learning.

Rapid acquisition but slow extinction of an attentional bias in space

Substantial research has focused on the allocation of spatial attention based on goals or perceptual salience. In everyday life, however, people also direct attention using their previous experience. Here we investigate the pace at which people incidentally learn to prioritize specific locations. Participants searched for a T among Ls in a visual search task. Unbeknownst to them, the target was more often located in one region of the screen than in other regions. An attentional bias toward the rich region developed over dozens of trials. However, the bias did not rapidly readjust to new contexts. It persisted for at least a week and for hundreds of trials after the target's position became evenly distributed. The persistence of the bias did not reflect a long window over which visual statistics were calculated. Long-term persistence differentiates incidentally learned attentional biases from the more flexible goal-driven attention.

Changes in events alter how people remember recent information

Observers spontaneously segment larger activities into smaller events. For example, "washing a car" might be segmented into "scrubbing," "rinsing," and "drying" the car. This process, called event segmentation, separates "what is happening now? from "what just happened." In this study, we show that event segmentation predicts activity in the hippocampus when people access recent information. Participants watched narrative film and occasionally attempted to retrieve from memory objects that recently appeared in the film. The delay between object presentation and test was always 5 sec. Critically, for some of the objects, the event changed during the delay whereas for others the event continued. Using fMRI, we examined whether retrieval-related brain activity differed when the event changed during the delay. Brain regions involved in remembering past experiences over long periods, including the hippocampus, were more active during retrieval when the event changed during the delay. Thus, the way an object encountered just 5 sec ago is retrieved from memory appears to depend in part on what happened in those 5 sec. These data strongly suggest that the segmentation of ongoing activity into events is a control process that regulates when memory for events is updated.

Attending to unrelated targets boosts short-term memory for color arrays

Detecting a target typically impairs performance in a second, unrelated task. It has been recently reported however, that detecting a target in a stream of distractors can enhance long-term memory of faces and scenes that were presented concurrently with the target (the attentional boost effect). In this study we ask whether target detection also enhances performance in a visual short-term memory task, where capacity limits are severe. Participants performed two tasks at once: a one shot, color change detection task and a letter-detection task. In Experiment 1, a central letter appeared at the same time as 3 or 5 color patches (memory display). Participants encoded the colors and pressed the spacebar if the letter was a T (target). After a short retention interval, a probe display of color patches appeared. Performance on the change detection task was enhanced when a target, rather than a distractor, appeared with the memory display. This effect was not modulated by memory load or the frequency of trials in which a target appeared. However, there was no enhancement when the target appeared at the same time as the probe display (Experiment 2a) or during the memory retention interval (Experiment 2b). Together these results suggest that detecting a target facilitates the encoding of unrelated information into visual short-term memory.

The Brain's Cutting-Room Floor: Segmentation of Narrative Cinema

Observers segment ongoing activity into meaningful events. Segmentation is a core component of perception that helps determine memory and guide planning. The current study tested the hypotheses that event segmentation is an automatic component of the perception of extended naturalistic activity, and that the identification of event boundaries in such activities results in part from processing changes in the perceived situation. Observers may identify boundaries between events as a result of processing changes in the observed situation. To test this hypothesis and study this potential mechanism, we measured brain activity while participants viewed an extended narrative film. Large transient responses were observed when the activity was segmented, and these responses were mediated by changes in the observed activity, including characters and their interactions, interactions with objects, spatial location, goals, and causes. These results support accounts that propose event segmentation is automatic and depends on processing meaningful changes in the perceived situation; they are the first to show such effects for extended naturalistic human activity.

The Attentional Boost Effect: Transient increases in attention to one task enhance performance in a second task

Recent work on event perception suggests that perceptual processing increases when events change. An important question is how such changes influence the way other information is processed, particularly during dual-task performance. In this study, participants monitored a long series of distractor items for an occasional target as they simultaneously encoded unrelated background scenes. The appearance of an occasional target could have two opposite effects on the secondary task: It could draw attention away from the second task, or, as a change in the ongoing event, it could improve secondary task performance. Results were consistent with the second possibility. Memory for scenes presented simultaneously with the targets was better than memory for scenes that preceded or followed the targets. This effect was observed when the primary detection task involved visual feature oddball detection, auditory oddball detection, and visual color-shape conjunction detection. It was eliminated when the detection task was omitted, and when it required an arbitrary response mapping. The appearance of occasional, task-relevant events appears to trigger a temporal orienting response that facilitates processing of concurrently attended information (Attentional Boost Effect).

The visual attractor illusion

In many visual illusions, the perceived features of an object such as its size or orientation are influenced by nearby objects. In contrast, the presence of nearby, static objects often enhances the perceived spatial location of another object. Here we present a type of visual illusion in which the presence of a static object alters another object's perceived location. Participants localized the edge of a briefly presented and masked target object. Localization was accurate when the masked target was presented in isolation. However, when another nearby object was presented at the same time as the target, localization deviated toward the nearby object (the "attractor"). This "visual attractor illusion" was stronger when the attractor object was task-relevant rather than irrelevant and diminished as the experiment progressed, suggesting that it was modulated by attention. Visual transients also play an important role in the illusion, which depends on the sudden onset of the attractor object and backward masking of the target. We suggest that the brief appearance of an object (the attractor) distorts perceptual space and draws in the perceived location of a neighboring object. Alternatively, localization of a masked target may be weighted toward the position of a concurrently presented visual transient.

Reading stories activates neural representations of visual and motor experiences

To understand and remember stories, readers integrate their knowledge of the world with information in the text. Here we present functional neuroimaging evidence that neural systems track changes in the situation described by a story. Different brain regions track different aspects of a story, such as a character's physical location or current goals. Some of these regions mirror those involved when people perform, imagine, or observe similar real-world activities. These results support the view that readers understand a story by simulating the events in the story world and updating their simulation when features of that world change.

Reading stories activates neural representations of visual and motor experiences

To understand and remember stories, readers integrate their knowledge of the world with information in the text. Here we present functional neuroimaging evidence that neural systems track changes in the situation described by a story. Different brain regions track different aspects of a story, such as a character's physical location or current goals. Some of these regions mirror those involved when people perform, imagine, or observe similar real-world activities. These results support the view that readers understand a story by simulating the events in the story world and updating their simulation when features of that world change.

Event boundaries in perception affect memory encoding and updating

Memory for naturalistic events over short delays is important for visual scene processing, reading comprehension, and social interaction. The research presented here examined relations between how an ongoing activity is perceptually segmented into events and how those events are remembered a few seconds later. In several studies, participants watched movie clips that presented objects in the context of goal-directed activities. Five seconds after an object was presented, the clip paused for a recognition test. Performance on the recognition test depended on the occurrence of perceptual event boundaries. Objects that were present when an event boundary occurred were better recognized than other objects, suggesting that event boundaries structure the contents of memory. This effect was strongest when an object's type was tested but was also observed for objects' perceptual features. Memory also depended on whether an event boundary occurred between presentation and test; this variable produced complex interactive effects that suggested that the contents of memory are updated at event boundaries. These data indicate that perceptual event boundaries have immediate consequences for what, when, and how easily information can be remembered.

Event perception: a mind-brain perspective

People perceive and conceive of activity in terms of discrete events. Here the authors propose a theory according to which the perception of boundaries between events arises from ongoing perceptual processing and regulates attention and memory. Perceptual systems continuously make predictions about what will happen next. When transient errors in predictions arise, an event boundary is perceived. According to the theory, the perception of events depends on both sensory cues and knowledge structures that represent previously learned information about event parts and inferences about actors' goals and plans. Neurological and neurophysiological data suggest that representations of events may be implemented by structures in the lateral prefrontal cortex and that perceptual prediction error is calculated and evaluated by a processing pathway, including the anterior cingulate cortex and subcortical neuromodulatory systems.

Event perception: a mind-brain perspective

People perceive and conceive of activity in terms of discrete events. Here the authors propose a theory according to which the perception of boundaries between events arises from ongoing perceptual processing and regulates attention and memory. Perceptual systems continuously make predictions about what will happen next. When transient errors in predictions arise, an event boundary is perceived. According to the theory, the perception of events depends on both sensory cues and knowledge structures that represent previously learned information about event parts and inferences about actors' goals and plans. Neurological and neurophysiological data suggest that representations of events may be implemented by structures in the lateral prefrontal cortex and that perceptual prediction error is calculated and evaluated by a processing pathway, including the anterior cingulate cortex and subcortical neuromodulatory systems.

Visual motion and the neural correlates of event perception

People perceive ongoing activity in terms of discrete temporal events. Distinctive changes in the movement of objects or actors may contribute to the perception that one event has ended and another has begun. However, little is known about the quantitative contribution of movement information to the processing of events. This study investigated how movement features are related to the neural processing of events by performing functional magnetic resonance imaging while participants viewed simple animations of moving objects. After the imaging session, participants watched the animations again and segmented them into meaningful events. Movement features were systematically related to viewers' perceptual segmentation and to cortical activity throughout visual processing areas. Activity in the MT complex, which is known to be specialized for processing motion, increased with increases in the objects' speed. The perception of an event boundary was associated with transient changes in the MT complex and in a nearby region in the superior temporal sulcus associated with processing biological motion. Other movement features were associated with changes in activity in occipital, parietal, and frontal cortex. These results indicate a role for movement features in the perceptual processing of meaningful events, and in the neural basis of that processing.

Activation of human motion processing areas during event perception

Observers are able to segment continuous everyday activity into meaningful parts. This ability may be related to processing low-level visual cues, such as changes in motion. To address this issue, the present study combined measurement of evoked responses to event boundaries with functional identification of the extrastriate motion complex (MT+) and the frontal eye field (FEF), two regions related to motion perception and eye movements. The results provided strong evidence that MT+ is activated by event boundaries: Individuals' MT+ regions showed strong responses to event boundaries, and MT+ was collocated with a lateral posterior region that responded at event boundaries. The evidence regarding the FEF was less conclusive: The FEF showed reliable but relatively reduced responses to event boundaries, but the FEF was medial and superior to a frontal area that responded at event boundaries. These results suggest that motion cues, and possibly eye movements, may play key roles in event structure perception.

Reliability of functional localization using fMRI

Neuroimaging researchers increasingly take advantage of the known functional properties of brain regions to localize them and probe changes in their activity under different conditions. The utility of this approach depends in part on the reliability of the methods used to define these regions of interest. Two operations may affect the reliability of functionally identified regions: spatially normalizing data to a stereotactic atlas and statistically combining data across participants to form a composite region (as opposed to identifying individual regions for each participant). The effect of these two operations on reliability was evaluated for two functionally identifiable regions: the MT complex and the frontal eye fields. Spatial normalization had almost no effect on within-subject reliability, while grouping across participants negatively affected retest measures of the activation and location of regions defined on separate occasions. We conclude that, for typical sample sizes and numbers of observations per subject, functional localization is most reliable when performed for each individual using data in atlas space.