Unexpected changes in direction of motion attract attention

Two masked prime arrows simultaneously affect a response to a target: Revealing of an additive unconscious priming effect

Since there are many sources of unconscious information in our minds, there is a possibility that multiple channels of unconscious information can affect a response at the same time. However, this question has been largely ignored by researchers. In the present study, we presented two opposite pointing arrows as the masked primes followed by a target arrow. The results suggested that the two directions in which the two prime arrows are pointing influenced the response to the target simultaneously and additively, that is, the overall priming effect caused by the two opposite pointing prime arrows was equal to the net effect of the individual congruent effect elicited by the same pointing prime arrow and the individual incongruent priming effect induced by the prime arrow poitning in the opposite direction. In addition, in Experiment 1, a biased delayed response to the target was observed when the target arrow and the opposite pointing prime arrow were closely positioned in space due to Gestalt continuity and closure grouping. According to these results, the "independent unconscious influence" and "reverse unconscious selection" hypotheses are proposed.

Time-varying similarity of neural responses to musical tension is shaped by physical features and musical themes

The similarity of understanding is important for music experience and communication, but little is understood about the sources of this common knowledge. Although neural responses to the same piece of music are known to be similar across listeners, it remains unclear whether this neural response similarity is linked to musical understanding and the role of dynamic musical attributes in shaping it. Our study addresses this gap by investigating the relationship between neural response similarity, musical tension, and dynamic musical attributes. Using electroencephalography-based inter-subject correlation (EEG-ISC), we examined how the neural response similarity among listeners varies throughout the evaluation of musical tension in the first movement of Beethoven's Piano Sonata No. 8. Participants continuously rated the degree of alignment between musical events and their expectations, while neural activity was recorded using electroencephalography (EEG). The results showed that neural response similarity fluctuated in tandem with musical tension, with increased similarity observed during moments of heightened tension. This time-varying neural response similarity was influenced by two dynamic attributes contributing to musical tension: physical features and musical themes. Specifically, its fluctuation was driven by physical features, and the patterns of its variation were modulated by musical themes, with similar time-varying patterns observed across similar thematic materials. These findings offer valuable insight into the role of dynamic musical attributes in shaping neural response similarity, and reveal an important source and mechanism of shared musical understandings.

The benefits of socioemotional learning strategies and video formats for older digital immigrants learning a novel smartphone application

The need to continually learn and adjust to new technology can be an arduous demand, particularly for older adults who did not grow up with digital technology ("older digital immigrants" or ODIs). This study tests the efficacy of socioemotional learning strategies (i.e., encoding information in a socially- or emotionally-meaningful way) for ODIs learning a new software application from an instructional video (Experiment 1) or a written manual (Experiment 2). An experiment-by-condition effect was identified, where memory was greatest for participants engaging socioemotional learning strategies while learning from a video, suggesting a synergistic effect of these manipulations. These findings serve as a first step toward identifying and implementing an optimal learning context for ODIs to learn new technologies in everyday life.

The role of attention control in complex real-world tasks

Working memory capacity is an important psychological construct, and many real-world phenomena are strongly associated with individual differences in working memory functioning. Although working memory and attention are intertwined, several studies have recently shown that individual differences in the general ability to control attention is more strongly predictive of human behavior than working memory capacity. In this review, we argue that researchers would therefore generally be better suited to studying the role of attention control rather than memory-based abilities in explaining real-world behavior and performance in humans. The review begins with a discussion of relevant literature on the nature and measurement of both working memory capacity and attention control, including recent developments in the study of individual differences of attention control. We then selectively review existing literature on the role of both working memory and attention in various applied settings and explain, in each case, why a switch in emphasis to attention control is warranted. Topics covered include psychological testing, cognitive training, education, sports, police decision-making, human factors, and disorders within clinical psychology. The review concludes with general recommendations and best practices for researchers interested in conducting studies of individual differences in attention control.

Tracking multiple fish

Although the Multiple Object Tracking (MOT) task is a widely used experimental method for studying divided attention, tracking objects in the real world usually looks different. For example, in the real world, objects are usually clearly distinguishable from each other and also possess different movement patterns. One such case is tracking groups of creatures, such as tracking fish in an aquarium. We used movies of fish in an aquarium and measured general tracking performance in this task (Experiment 1). In Experiment 2, we compared tracking accuracy within-subjects in fish tracking, tracking typical MOT stimuli, and in a third condition using standard MOT uniform objects which possessed movement patterns similar to the real fish. This third condition was added to further examine the impact of different motion characteristics on tracking performance. Results within a Bayesian framework showed that tracking real fish shares similarities with tracking simple objects in a typical laboratory MOT task. Furthermore, we observed a close relationship between performance in both laboratory MOT tasks (typical and fish-like) and real fish tracking, suggesting that the commonly used laboratory MOT task possesses a good level of ecological validity.

Pupil responses to implied motion in figurative and abstract paintings

Motion can be perceived in static images, such as photos and figurative paintings, representing realistic subjects in motion, with or without directional information (e.g., motion blur or speed lines). Motion impression can be achieved even in non-realistic static images such as motion illusions and abstract paintings. It has been shown that visual motion processing affects the diameter of the pupil, responding differently to real, illusory, and implied motion in photographs (IM). It has been suggested that these different effects might be due to top-down modulations from different cortical areas underlying their processing. It is worthwhile to investigate pupillary response to figurative paintings, since they require an even higher level of interpretation than photos representing the same kind of subjects, given the complexity of cognitive processes involved in the aesthetic experience. Also, pupil responses to abstract paintings allows to study the effect of IM perception in representations devoid of real-life motion cues. We measured pupil responses to IM in figurative and abstract artworks depicting static and dynamic scenes, as rated by a large group of individuals not participating in the following experiment. Since the pupillary response is modulated by the subjective image interpretation, a motion rating test has been used to correct individual pupil data according to whether participants actually perceived the presence of motion in the paintings. Pupil responses to movies showing figurative and abstract subjects, and to motion illusions were also measured, to compare real and illusory motion with painted IM. Movies, both figurative and abstract, elicit the largest pupillary dilation of all static stimuli, whereas motion illusions cause the smallest pupil size, as previously shown. Interestingly, pupil responses to IM depend on the paintings' style. Figurative paintings depicting moving subjects cause more dilation than those representing static figures, and pupil size increases with the strength of IM, as already found with realistic photos. The opposite effect is obtained with abstract artworks. Abstract paintings depicting motion produce less dilation than those depicting stillness. In any case, these results reflect the individual subjective perception of dynamism, as the very same paintings can induce opposite responses in observer which interpreted it as static or dynamic. Overall, our data show that pupil size depends on high-level interpretation of motion in paintings, even when they do not represent real-world scenes. Our findings further suggest that the pupil is modulated by multiple top-down cortical mechanisms, involving the processing of motion, attention, memory, imagination, and other cognitive functions necessary for enjoying a complete aesthetic experience.

Pupillary response to real, illusory, and implied motion

The perception of moving objects (real motion) is a critical function for interacting with a dynamic environment. Motion perception can be also induced by particular structural features of static images (illusory motion) or by photographic images of subjects in motion (implied motion, IM). Many cortical areas are involved in motion processing, particularly the medial temporal cortical area (MT), dedicated to the processing of real, illusory, and implied motion. Recently, there has been a growing interest in the influence of high-level visual processes on pupillary responses. However, just a few studies have measured the effect of motion processing on the pupil, and not always with consistent results. Here we systematically investigate the effects of real, illusory, and implied motion on the pupil diameter for the first time, by showing different types of stimuli (movies, illusions, and photos) with the same average luminance to the same observers. We find different pupillary responses depending on the nature of motion. Real motion elicits a larger pupillary dilation than IM, which in turn induces more dilation than control photos representing static subjects (No-IM). The pupil response is sensitive even to the strength of IM, as photos with enhanced IM (blur, motion streaks, speed lines) induce larger dilation than simple freezed IM (subjects captured in the instant they are moving). Also, the subject represented in the stimulus matters: human figures are interpreted as more dynamic and induce larger dilation than objects/animals. Interestingly, illusory motion induces much less dilation than all the other motion categories, despite being seen as moving. Overall, pupil responses depend on the individual perception of dynamicity, confirming that the pupil is modulated by the subjective interpretation of complex stimuli. We argue that the different pupillary responses to real, illusory, and implied motion reflect the top-down modulations of different cortical areas involved in their processing.

Oscillatory signatures of Repetition Suppression and Novelty Detection reveal altered induced visual responses in early deafness

The ability to differentiate between repeated and novel events represents a fundamental property of the visual system. Neural responses are typically reduced upon stimulus repetition, a phenomenon called Repetition Suppression (RS). On the contrary, following a novel visual stimulus, the neural response is generally enhanced, a phenomenon referred to as Novelty Detection (ND). Here, we aimed to investigate the impact of early deafness on the oscillatory signatures of RS and ND brain responses. To this aim, electrophysiological data were acquired in early deaf and hearing control individuals during processing of repeated and novel visual events unattended by participants. By studying evoked and induced oscillatory brain activities, as well as inter-trial phase coherence, we linked response modulations to feedback and/or feedforward processes. Results revealed selective experience-dependent changes on both RS and ND mechanisms. Compared to hearing controls, early deaf individuals displayed: (i) greater attenuation of the response following stimulus repetition, selectively in the induced theta-band (4-7 Hz); (ii) reduced desynchronization following the onset of novel visual stimuli, in the induced alpha and beta bands (8-12 and 13-25 Hz); (iii) comparable modulation of evoked responses and inter-trial phase coherence. The selectivity of the effects in the induced responses parallels findings observed in the auditory cortex of deaf animal models following intracochlear electric stimulation. The present results support the idea that early deafness alters induced oscillatory activity and the functional tuning of basic visual processing.

Event-Based Eccentric Motion Detection Exploiting Time Difference Encoding

Attentional selectivity tends to follow events considered as interesting stimuli. Indeed, the motion of visual stimuli present in the environment attract our attention and allow us to react and interact with our surroundings. Extracting relevant motion information from the environment presents a challenge with regards to the high information content of the visual input. In this work we propose a novel integration between an eccentric down-sampling of the visual field, taking inspiration from the varying size of receptive fields (RFs) in the mammalian retina, and the Spiking Elementary Motion Detector (sEMD) model. We characterize the system functionality with simulated data and real world data collected with bio-inspired event driven cameras, successfully implementing motion detection along the four cardinal directions and diagonally.

Changes (but not differences) in motion direction fail to capture attention

In this study we investigated under what conditions motion direction changes pop out in continuously moving target/distractor environments. Participants were presented with vertically oriented Gabor patches whose carrier components drifted at a constant speed from left to right and then reversed direction. On any given trial, one of these elements was nominated as the target and the remaining elements were distractors. Distractor elements all changed direction simultaneously. The distractors either moved in a homogeneous manner (i.e. all moved in the same direction), or in a heterogeneous manner (i.e. direction was randomized). The target moved with a similar spatio-temporal trajectory as the distractors from left to right (or vice versa), but changed direction asynchronously with respect to the distracting elements. The participants' task was to locate this deviant (target) Gabor patch. We show that a motion direction change pops out (as indicated by the absence of a set size effect) when the surrounding distractors move in a homogeneous direction. When the distractors moved in heterogenous directions, a similar pop out effect was observed when the set size was small (≤5 elements), but not when it was large. This suggests that motion direction changes capture attention only when the change results in a unique direction of motion. Consistent with this finding we also show that a moving target (without direction change) captures attention in cases in which all distractors recently changed direction. This corroborates the idea that, in addition to direction cues, the temporal uniqueness of a change in an object's direction (or absence, thereof) relative to surrounding objects is a cue capable of capturing attention.

What we learned from creating one of the world's most popular MOOCs

Learning How to Learn (LHTL) is currently one of the world's most popular massive open online course (MOOC), with nearly 2.5 million registered learners in its first 4 years. Here, we "reverse engineer" the design of the course's videos to show how creative application of well-known principles of multimedia learning in an MOOC context appear to have fueled the course's popularity. Gaps in knowledge of multimedia learning are also noted. There have been some 50 years of experience researching effective classroom teaching, but less there have been only 5 years since MOOCs became widespread. The success of LHTL may provide further insight into the importance of the principles of multimedia learning, and how those principles might be practically implemented to improve MOOC making and the general design of instructional videos.

Team ball sport participation is associated with performance in two sustained visual attention tasks: Position monitoring and target identification in rapid serial visual presentation streams

We investigated the relationship between participation in team ball sports and performance in two sustained spatiotemporal attention tasks-a position monitoring variant of the multiple object tracking (MOT) task and target identification in the rapid serial visual presentation (RSVP) task. Thirty participants were asked about the frequency of their participation in team ball sports and undertook both the MOT task and RSVP task. In the MOT task, participants viewed an array of eight discs as they moved unpredictably for 3-8s before disappearing. On each trial, a subset of these were marked as targets for tracking, meaning that participants attempted to keep track of their positions on the screen with as much precision as possible. At the end of each trial, participants reported the final perceived position of a queried target. In the RSVP task, a stream of letters was presented at the center of the screen and participants attempted to report either one or both of two target letters embedded in the stream. Participation in team ball sports was associated with superior performance in both tasks: in the MOT task, individuals reporting more time spent playing team ball sports on a weekly basis were able to report the positions of targets with greater precision, and in the RSVP task they reported targets more accurately. The current findings add to the literature of somewhat mixed findings regarding the extent to which participation in sports may be associated with superior visual attention abilities.

Suppressed Sensory Response to Predictable Object Stimuli throughout the Ventral Visual Stream

Prediction plays a crucial role in perception, as prominently suggested by predictive coding theories. However, the exact form and mechanism of predictive modulations of sensory processing remain unclear, with some studies reporting a downregulation of the sensory response for predictable input whereas others observed an enhanced response. In a similar vein, downregulation of the sensory response for predictable input has been linked to either sharpening or dampening of the sensory representation, which are opposite in nature. In the present study, we set out to investigate the neural consequences of perceptual expectation of object stimuli throughout the visual hierarchy, using fMRI in human volunteers. Participants of both sexes were exposed to pairs of sequentially presented object images in a statistical learning paradigm, in which the first object predicted the identity of the second object. Image transitions were not task relevant; thus, all learning of statistical regularities was incidental. We found strong suppression of neural responses to expected compared with unexpected stimuli throughout the ventral visual stream, including primary visual cortex, lateral occipital complex, and anterior ventral visual areas. Expectation suppression in lateral occipital complex scaled positively with image preference and voxel selectivity, lending support to the dampening account of expectation suppression in object perception.SIGNIFICANCE STATEMENT It has been suggested that the brain fundamentally relies on predictions and constructs models of the world to make sense of sensory information. Previous research on the neural basis of prediction has documented suppressed neural responses to expected compared with unexpected stimuli. In the present study, we demonstrate robust expectation suppression throughout the entire ventral visual stream, and underlying this suppression a dampening of the sensory representation in object-selective visual cortex, but not in primary visual cortex. Together, our results provide novel evidence in support of theories conceptualizing perception as an active inference process, which selectively dampens cortical representations of predictable objects. This dampening may support our ability to automatically filter out irrelevant, predictable objects.

Temporal fractals in movies and mind

Fractal patterns are seemingly everywhere. They can be analyzed through Fourier and power analyses, and other methods. Cutting, DeLong, and Nothelfer (2010) analyzed as time-series data the fluctuations of shot durations in 150 popular movies released over 70 years. They found that these patterns had become increasingly fractal-like and concluded that they might be linked to those found in the results of psychological tasks involving attention. To explore this possibility further, we began by analyzing the shot patterns of almost twice as many movies released over a century. The increasing fractal-like nature of shot patterns is affirmed, as determined by both a slope measure and a long-range dependence measure, neither of which is sensitive to the vector lengths of their inputs within the ranges explored here. But the main reason for increased long-range dependence is related to, but not caused by, the increasing vector length of the shot-series samples. It appears that, in generating increasingly fractal-like patterns, filmmakers have systematically explored dimensions that are important for holding our attention-shot durations, scene durations, motion, and sound amplitude-and have crafted fluctuations in them like those of our endogenous attention patterns. Other dimensions-luminance, clutter, and shot scale-are important to film style but their variations seem not to be important to holding viewers' moment-to-moment attention and have not changed in their fractional dimension over time.

Sustained attention to objects' motion sharpens position representations: Attention to changing position and attention to motion are distinct

In tasks where people monitor moving objects, such the multiple object tracking task (MOT), observers attempt to keep track of targets as they move amongst distracters. The literature is mixed as to whether observers make use of motion information to facilitate performance. We sought to address this by two means: first by superimposing arrows on objects which varied in their informativeness about motion direction and second by asking observers to attend to motion direction. Using a position monitoring task, we calculated mean error magnitudes as a measure of the precision with which target positions are represented. We also calculated perceptual lags versus extrapolated reports, which are the times at which positions of targets best match position reports. We find that the presence of motion information in the form of superimposed arrows made no difference to position report precision nor perceptual lag. However, when we explicitly instructed observers to attend to motion, we saw facilitatory effects on position reports and in some cases reports that best matched extrapolated rather than lagging positions for small set sizes. The results indicate that attention to changing positions does not automatically recruit attention to motion, showing a dissociation between sustained attention to changing positions and attention to motion.

Live ECG readings using Google Glass in emergency situations

Most sudden cardiac problems require rapid treatment to preserve life. In this regard, electrocardiograms (ECG) shown on vital parameter monitoring systems help medical staff to detect problems. In some situations, such monitoring systems may display information in a less than convenient way for medical staff. For example, vital parameters are displayed on large screens outside the field of view of a surgeon during cardiac surgery. This may lead to losing time and to mistakes when problems occur during cardiac operations. In this paper we present a novel approach to display vital parameters such as the second derivative of the ECG rhythm and heart rate close to the field of view of a surgeon using Google Glass. As a preliminary assessment, we run an experimental study to verify the possibility for medical staff to identify abnormal ECG rhythms from Google Glass. This study compares 6 ECG rhythms readings from a 13.3 inch laptop screen and from the prism of Google Glass. Seven medical residents in internal medicine participated in the study. The preliminary results show that there is no difference between identifying these 6 ECG rhythms from the laptop screen versus Google Glass. Both allow close to perfect identification of the 6 common ECG rhythms. This shows the potential of connected glasses such as Google Glass to be useful in selected medical applications.

No need for a social cue! A masked magician can also trick the audience in the vanishing ball illusion

In the vanishing ball illusion (VBI), a magician throws a ball up in the air twice, after which he pretends to toss it up again, when in fact it remains secretly concealed in his hand. Observers perceive an imaginary ball disappearing into the air. According to Kuhn and Land (2006), the VBI during the fake throw is mediated by the magician's gaze and/or head direction (also called "social cues") as he looks toward the imaginary ball. The aim of this article is to test an alternative interpretation. According to our hypothesis, the magician's social cues are not essential to the VBI. We compared the numbers of participants experiencing the VBI when the magician's social cues were directed toward the illusory ball and when the magician's social cues were either hidden behind a black mask (Exp. 1) or stationary (Exp. 2). The results showed that the number of observers experiencing the VBI was high (almost two-thirds of the participants), regardless of whether the magician's social cueing was directed toward the illusion, hidden behind a mask, or stationary. In a third experiment (Exp. 3), we replicated Kuhn and Land's initial results and attempted to further explain their "anti-illusion" social-cue effect. This study confirms that social cueing is not required in the VBI: Its presence did not increase the number of participants experiencing the illusion.

Oculomotor examination of the weapon focus effect: does a gun automatically engage visual attention?

Background

A person is less likely to be accurately remembered if they appear in a visual scene with a gun, a result that has been termed the weapon focus effect (WFE). Explanations of the WFE argue that weapons engage attention because they are unusual and/or threatening, which causes encoding deficits for the other items in the visual scene. Previous WFE research has always embedded the weapon and nonweapon objects within a larger context that provides information about an actor's intention to use the object. As such, it is currently unknown whether a gun automatically engages attention to a greater extent than other objects independent of the context in which it is presented.

Method

Reflexive responding to a gun compared to other objects was examined in two experiments. Experiment 1 employed a prosaccade gap-overlap paradigm, whereby participants looked toward a peripheral target, and Experiment 2 employed an antisaccade gap-overlap paradigm, whereby participants looked away from a peripheral target. In both experiments, the peripheral target was a gun or a nonthreatening object (i.e., a tomato or pocket watch). We also controlled how unexpected the targets were and compared saccadic reaction times across types of objects.

Results

A gun was not found to differentially engage attention compared to the unexpected object (i.e., a pocket watch). Some evidence was found (Experiment 2) that both the gun and the unexpected object engaged attention to a greater extent compared the expected object (i.e., a tomato).

Conclusion

An image of a gun did not engage attention to a larger extent than images of other types of objects (i.e., a pocket watch or tomato). The results suggest that context may be an important determinant of WFE. The extent to which an object is threatening may depend on the larger context in which it is presented.

Looking for trouble: a description of oculomotor search strategies during live CCTV operation

Recent research has begun to address how CCTV operators in the modern control room attempt to search for crime (e.g., Howard et al., 2011). However, an often-neglected element of the CCTV task is that the operators have at their disposal a multiplexed wall of scenes, and a single spot-monitor on which they can select any of these feeds for inspection. Here we examined how 2 trained CCTV operators used these sources of information to search from crime during a morning, afternoon, and night-time shift. We found that they spent surprisingly little time viewing the multiplex wall, instead preferentially spending most of their time searching on the single-scene spot-monitor. Such search must require a sophisticated understanding of the surveilled environment, as the operators must make their selection of which screen to view based on their prediction of where crime is likely to occur. This seems to be reflected in the difference in the screens that they selected to view at different times of the day. For example, night-clubs received close monitoring at night, but were seldom viewed in mid-morning. Such narrowing of search based on a contextual understanding of an environment is not a new idea (e.g., Torralba et al., 2006), and appears to contribute to operator's selection strategy. This research prompts new questions regarding the nature of representation that operators have of their environment, and how they might develop expectation-based search strategies to countermand the demands of the large influx of visual information. Future research should ensure not to neglect examination of operator behavior "in the wild" (Hutchins, 1995a), as such insights are difficult to gain from laboratory based paradigms alone.

Changing target trajectories influences tracking performance

People have the ability to attentively select and successfully track several moving objects, a process known as multiple-object tracking (MOT; Pylyshyn & Storm Spatial Vision 3: 179-197, 1988). Various factors have been known to influence MOT performance, such as speed, number of distractors, and proximity, while recent work has suggested that object trajectories may also be a factor (Fencsik, Kleiger, & Horowitz Perception and Psychophysics 69: 567-577, 2007). Meanwhile, unexpected changes in motion information have been demonstrated to be a critical facet for attracting attention Howard & Holcombe Attention, Perception & Psychophysics 72: 2087-2095, (2010). Therefore, we suggest that unexpected changes in target trajectories are an important factor in tracking performance. The research presented here controlled for spatial proximity while manipulating the number of instances in which an object changed trajectory. We found that spatial proximity had no effect on tracking performance but, rather, as the number of trajectory changes increased, tracking performance suffered. Results imply that the ability to track multiple moving objects is limited by unexpected changes in direction.

Statistical learning of visual transitions in monkey inferotemporal cortex

One of the most fundamental functions of the brain is to predict upcoming events on the basis of the recent past. A closely related function is to signal when a prediction has been violated. The identity of the brain regions that mediate these functions is not known. We set out to determine whether they are implemented at the level of single neurons in the visual system. We gave monkeys prolonged exposure to pairs of images presented in fixed sequence so that each leading image became a strong predictor for the corresponding trailing image. We then monitored the responses of neurons in the inferotemporal cortex to image sequences that obeyed or violated the transitional rules imposed during training. Inferotemporal neurons exhibited a transitional surprise effect, responding much more strongly to unpredicted transitions than to predicted transitions. Thus, neurons even in the visual system make experience-based predictions and react when they fail.

Spatially uninformative sounds increase sensitivity for visual motion change

It has recently been shown that spatially uninformative sounds can cause a visual stimulus to pop out from an array of similar distractor stimuli when that sound is presented in temporal proximity to a feature change in the visual stimulus. Until now, this effect has predominantly been demonstrated by using stationary stimuli. Here, we extended these results by showing that auditory stimuli can also improve the sensitivity of visual motion change detection. To accomplish this, we presented moving visual stimuli (small dots) on a computer screen. At a random moment during a trial, one of these stimuli could abruptly move in an orthogonal direction. Participants’ task was to indicate whether such an abrupt motion change occurred or not by making a corresponding button press. If a sound (a short 1,000 Hz tone pip) co-occurred with the abrupt motion change, participants were able to detect this motion change more frequently than when the sound was not present. Using measures derived from signal detection theory, we were able to demonstrate that the effect on accuracy was due to increased sensitivity rather than to changes in response bias.