Scan patterns when viewing natural scenes: emotion, complexity, and repetition

How body postures affect gaze control in scene viewing under specific task conditions

Gaze movements during visual exploration of natural scenes are typically investigated with the static picture viewing paradigm in the laboratory. While this paradigm is attractive for its highly controlled conditions, limitations in the generalizability of the resulting findings to more natural viewing behavior have been raised frequently. Here, we address the combined influences of body posture and viewing task on gaze behavior with the static picture viewing paradigm under free viewing as a baseline condition. We recorded gaze data using mobile eye tracking during postural manipulations in scene viewing. Specifically, in Experiment 1, we compared gaze behavior during head-supported sitting and quiet standing under two task conditions. We found that task affects temporal and spatial gaze parameters, while posture produces no effects on temporal and small effects on spatial parameters. In Experiment 2, we further investigated body posture by introducing four conditions (sitting with chin rest, head-free sitting, quiet standing, standing on an unstable platform). Again, we found no effects on temporal and small effects on spatial gaze parameters. In our experiments, gaze behavior is largely unaffected by body posture, while task conditions readily produce effects. We conclude that results from static picture viewing may allow predictions of gaze statistics under more natural viewing conditions, however, viewing tasks should be chosen carefully because of their potential effects on gaze characteristics.

The effect of emotional arousal on visual attentional performance: a systematic review

Although the arousal elicited by emotional stimuli, similarly to valence, is an integrative part of emotion theories, previous studies and reviews mostly focused on the valence of a stimulus and rarely investigated the role of arousal. Here, I systematically searched for articles that used visual attentional paradigms, manipulated emotional arousal by auditory or visual, task-relevant or task-irrelevant stimuli, measured behavioral responses, ocular behavior, or neural correlates. I found that task-relevant arousing stimuli draw and hold attention regardless of the modality. In contrast, task-irrelevant arousing stimuli impaired task performance. However, when the emotional content precedes the task or it is presented for a longer duration, arousal increased performance. Future directions on how research could address the remaining questions are discussed.

Delayed ocular disengagement from arousing scenes

Visual exploration of the world is supported by eye movements which can be speeded up or delayed depending on bottom-up stimulation, top-down goals, and prior associations. Previous studies observed faster initiation of saccades toward emotional than neutral natural scenes; however, less is known concerning saccades which originate from emotional, compared with neutral, scenes. Here, we addressed this issue by examining a task in which participants continuously moved their gaze from and toward pictures (natural scenes), which could be emotional or neutral, and changed position in every trial. Saccades were initiated later when the starting picture was emotional compared to neutral, and this slowing was associated with the arousal value of the picture, suggesting that ocular disengagement does not vary with stimulus valence but is affected by engaging picture contents such as erotica and threat/injuries.

Gaze Control and Tactical Decision-Making Under Stress in Active-Duty Police Officers During a Live Use-of-Force Response

Police officers during dynamic and stressful encounters are required to make rapid decisions that rely on effective decision-making, experience, and intuition. Tactical decision-making is influenced by the officer's capability to recognize critical visual information and estimation of threat. The purpose of the current study is to investigate how visual search patterns using cluster analysis and factors that differentiate expertise (e.g., years of service, tactical training, related experiences) influence tactical decision-making in active-duty police officers (44 active-duty police officers) during high stress, high threat, realistic use of force scenario following a car accident and to examine the relationships between visual search patterns and physiological response (heart rate). A cluster analysis of visual search variables (fixation duration, fixation location difference score, and number of fixations) produced an Efficient Scan and an Inefficient Scan group. Specifically, the Efficient Scan group demonstrated longer total fixation duration and differences in area of interests (AOI) fixation duration compared to the Inefficient Scan group. Despite both groups exhibiting a rise in physiological stress response (HR) throughout the high-stress scenario, the Efficient Scan group had a history of tactical training, improved return fire performance, had higher sleep time total, and demonstrated increased processing efficiency and effective attentional control, due to having a background of increased tactical training.

Same but different: The influence of context framing on subjective disgust, eye movements and pupillary responses

The adaptive value of disgust has been associated with situations of threat to our survival. This study explored this topic using eye-tracking, which provides an objective measurement of attention, while solving previous methodological issues (e.g., not considering discrete emotions and comparing across perceptually-different stimuli). We used the same stimuli and manipulated the emotional state via contextual framing. Participants' eye movements and pupillary responses were recorded while they explored pictures of objects held by clean or dirty hands; the latter were framed in a disease or a non-disease context. Pictures were then rated for arousal, disgust, and valence. Framing stimuli in a disease (vs non-disease) context induced a more adverse subjective emotional experience. Importantly, our objective measures revealed that such manipulation also led to a higher information-seeking behavior and greater pupil constriction. Overall, our data suggest that the same stimuli can effectively be used to induce different emotional states by manipulating their framing.

Emotional arousal in patients with functional movement disorders: A pupillometry study

OBJECTIVE

Pathophysiology explanations for functional movement disorders often assume a role for emotional hyperarousal. Pupillometry is a validated method for evaluation of emotional arousal by detecting changes in pupil size in response to emotional stimuli. In a case-control study design, we aimed to study objective and subjective emotional arousal using pupillometry and affective ratings. To assess attentional engagement by affective stimuli, we used videooculographic tracking of eye movement patterns (scanpath).

METHODS

Twenty-five female patients with functional movement disorders (mean age: 40.9 [SD 12.7] years) and 23 age matched healthy female controls participated in the study. Using infrared high-resolution eye-tracker, both pupil size and eye movement pattern in response to emotionally charged erotic, adventure, threat, victim, and neutral pictures were recorded along with subjective ratings of emotional valence and arousal of the presented pictures.

RESULTS

A between-group comparison showed significantly smaller pupil dilation to adventure stimuli compared to neutral stimuli in patients compared to controls (P < 0.004, bootstrap, uncorr., adj. η2 = 0.00). No significant difference in pupillary response to other stimuli and scanpath parameters was found between the groups. Patients rated significantly lower emotional arousal to erotic pictures than controls (P < 0.001, bootstrap, uncorr., adj. η2 = 0.09).

CONCLUSION

This study did not find evidence of autonomous or subjective emotional hyperarousal. The mismatch between objective autonomic measures and subjective arousal ratings in patients is of pathophysiological interest and in line with recent findings of impaired interoception in functional movement disorders.

Gaze patterns reveal aesthetic distance while viewing art

For centuries, Western philosophers have argued that aesthetic experiences differ from common, everyday pleasing sensations, and further, that mental states, such as disinterested contemplation and aesthetic distance, underlie these complex experiences. We empirically tested whether basic perceptual processes of information intake reveal evidence for aesthetic distance, specifically toward visual art. We conducted two eye tracking experiments using appropriately matched visual stimuli (environmental scenes and representational paintings) with 59 participants using two different presentation durations (25 and 6 s). Linear mixed-effects models considering individual differences showed that affective content (pleasantness and arousal), but not stimulus composition (complexity), leads to differential effects when viewing representational paintings in comparison to environmental scenes. We demonstrate that an increase in aesthetic pleasantness induced by representational paintings during a free-viewing task leads to a slower and deeper processing mode than when viewing environmental scenes of motivational relevance, for which we observed the opposite effect. In addition, long presentation durations led to an increase in scanning behavior during visual art perception. These empirical findings inform the debate about how aesthetic experiences differ from everyday perceptual processes by showing that the notion of aesthetic distance may be better understood by examining different modes of viewing.

The effects of task-irrelevant threatening stimuli on orienting- and executive attentional processes under cognitive load

Human visual attention is biased to rapidly detect threats in the environment so that our nervous system can initiate quick reactions. The processes underlying threat detection (and how they operate under cognitive load), however, are still poorly understood. Thus, we sought to test the impact of task-irrelevant threatening stimuli on the salience network and executive control of attention during low and high cognitive load. Participants were exposed to neutral or threatening pictures (with moderate and high arousal levels) as task-irrelevant distractors in near (parafoveal) and far (peripheral) positions while searching for numbers in ascending order in a matrix array. We measured reaction times and recorded eye-movements. Our results showed that task-irrelevant distractors primarily influenced behavioural measures during high cognitive load. The distracting effect of threatening images with moderate arousal level slowed reaction times for finding the first number. However, this slowing was offset by high arousal threatening stimuli, leading to overall shorter search times. Eye-tracking measures showed that participants fixated threatening pictures more later and for shorter durations compared to neutral images. Together, our results indicate a complex relationship between threats and attention that results not in a unitary bias but in a sequence of effects that unfold over time.

The influence of stimuli valence, extraversion, and emotion regulation on visual search within real-world scenes

Affective traits, including extraversion and emotion regulation, are important considerations in clinical psychology due to their associations with the occurrence of affective disorders. Previously, emotional real-world scenes have been shown to influence visual search. However, it is currently unknown whether extraversion and emotion regulation can influence visual search towards neutral targets embedded within real-world scenes, or whether these traits can impact the effect of emotional stimuli on visual search. An opportunity sample of healthy individuals had trait levels of extraversion and emotion regulation recorded before completing a visual search task. Participants more accurately identified search targets in neutral images compared to positive images, whilst response times were slower in negative images. Importantly, individuals with higher trait levels of expressive suppression displayed faster identification of search targets regardless of the emotional valence of the stimuli. Extraversion and cognitive reappraisal did not influence visual search. These findings add to our understanding regarding the influence of extraversion, cognitive reappraisal, and expressive suppression on our ability to allocate attention during visual search when viewing real-world scenes.

Forever yuck: Oculomotor avoidance of disgusting stimuli resists habituation

Disgust is an adaptation forged under the selective pressure of pathogens. Yet disgust may cause problems in contemporary societies because of its propensity for "false positives" and resistance to corrective information. Here, we investigate whether disgust, as revealed by oculomotor avoidance, might be reduced through the noncognitive process of habituation. In each of three experiments, we repeatedly exposed participants to the same pair of images, one disgusting and one neutral, and recorded gaze. Experiment 1 (N = 104) found no decline in oculomotor avoidance of the disgusting image after 24 prolonged exposures. Experiment 2 (N = 99) replicated this effect and demonstrated its uniqueness to disgust. In Experiment 3 (N = 93), we provided a gaze-contingent reward to ensure perceptual contact with the disgusting image. Participants looked almost exclusively at the disgusting image for 5 min but resumed baseline levels of oculomotor avoidance once the reward ceased. These findings underscore the challenge of reducing disgust. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Unsupervised foveal vision neural architecture with top-down attention

Deep learning architectures are an extremely powerful tool for recognizing and classifying images. However, they require supervised learning and normally work on vectors of the size of image pixels and produce the best results when trained on millions of object images. To help mitigate these issues, we propose an end-to-end architecture that fuses bottom-up saliency and top-down attention with an object recognition module to focus on relevant data and learn important features that can later be fine-tuned for a specific task, employing only unsupervised learning. In addition, by utilizing a virtual fovea that focuses on relevant portions of the data, the training speed can be greatly improved. We test the performance of the proposed Gamma saliency technique on the Toronto and CAT 2000 databases, and the foveated vision in the large Street View House Numbers (SVHN) database. The results with foveated vision show that Gamma saliency performs at the same level as the best alternative algorithms while being computationally faster. The results in SVHN show that our unsupervised cognitive architecture is comparable to fully supervised methods and that saliency also improves CNN performance if desired. Finally, we develop and test a top-down attention mechanism based on the Gamma saliency applied to the top layer of CNNs to facilitate scene understanding in multi-object cluttered images. We show that the extra information from top-down saliency is capable of speeding up the extraction of digits in the cluttered multidigit MNIST data set, corroborating the important role of top down attention.

Effects of affective content and motivational context on neural gain functions during naturalistic scene perception

Visual scene processing is modulated by semantic, motivational, and emotional factors, in addition to physical scene statistics. An open question is to what extent those factors affect low-level visual processing. One index of low-level visual processing is the contrast response function (CRF), representing the change in neural or psychophysical gain with increasing stimulus contrast. Here we aimed to (a) establish the use of an electrophysiological technique for assessing CRFs with complex emotional scenes and (b) examine the effects of motivational context and emotional content on CRFs elicited by naturalistic stimuli, including faces and complex scenes (humans, animals). Motivational context varied by expectancy of threat (a noxious noise) versus safety. CRFs were measured in 18 participants by means of sweep steady-state visual evoked potentials. Results showed a facilitation in visuocortical sensitivity (contrast gain) under threat, compared with safe conditions, across all stimulus categories. Facial stimuli prompted heightened neural response gain, compared with scenes. Within the scenes, response gain was smaller for scenes high in emotional arousal, compared with low-arousing scenes, consistent with interference effects of emotional content. These findings support the notion that motivational context alters the contrast sensitivity of cortical tissue, differing from changes in response gain (activation) when visual cues themselves carry motivational/affective relevance.

Emotional arousal impairs association memory: roles of prefrontal cortex regions

The brain processes underlying impairing effects of emotional arousal on associative memory were previously attributed to two dissociable routes using high-resolution fMRI of the MTL (Madan et al. 2017). Extrahippocampal MTL regions supporting associative encoding of neutral pairs suggested unitization; conversely, associative encoding of negative pairs involved compensatory hippocampal activity. Here, whole-brain fMRI revealed prefrontal contributions: dmPFC was more involved in hippocampal-dependent negative pair learning and vmPFC in extrahippocampal neutral pair learning. Successful encoding of emotional memory associations may require emotion regulation/conflict resolution (dmPFC), while neutral memory associations may be accomplished by anchoring new information to prior knowledge (vmPFC).

Bodily emotional expressions are a primary source of information for dogs, but not for humans

Dogs have remarkable abilities to synergise their behaviour with that of people, but how dogs read facial and bodily emotional cues in comparison to humans remains unclear. Both species share the same ecological niche, are highly social and expressive, making them an ideal comparative model for intra- and inter-species emotion perception. We compared eye-tracking data from unrestrained humans and dogs when viewing dynamic and naturalistic emotional expressions in humans and dogs. Dogs attended more to the body than the head of human and dog figures, unlike humans who focused more on the head of both species. Dogs and humans also showed a clear age effect that reduced head gaze. Our results indicate a species-specific evolutionary adaptation for emotion perception, which is only partly modified for heterospecific cues. These results have important implications for managing the risk associated with human-dog interactions, where expressive and perceptual differences are crucial.

The spatial distribution of attention predicts familiarity strength during encoding and retrieval

The memories we form are determined by what we attend to, and conversely, what we attend to is influenced by our memory for past experiences. Although we know that shifts of attention via eye movements are related to memory during encoding and retrieval, the role of specific memory processes in this relationship is unclear. There is evidence that attention may be especially important for some forms of memory (i.e., conscious recollection), and less so for others (i.e., familiarity-based recognition and unconscious influences of memory), but results are conflicting with respect to both the memory processes and eye movement patterns involved. To address this, we used a confidence-based method of isolating eye movement indices of spatial attention that are related to different memory processes (i.e., recollection, familiarity strength, and unconscious memory) during encoding and retrieval of real-world scenes. We also developed a new method of measuring the dispersion of eye movements, which proved to be more sensitive to memory processing than previously used measures. Specifically, in 2 studies, we found that familiarity strength-that is, changes in subjective reports of memory confidence-increased with (a) more dispersed patterns of viewing during encoding, (b) less dispersed viewing during retrieval, and (c) greater overlap in regions viewed between encoding and retrieval (i.e., resampling). Recollection was also related to these eye movements in a similar manner, though the associations with recollection were less consistent across experiments. Furthermore, we found no evidence for effects related to unconscious influences of memory. These findings indicate that attentional processes during viewing may not preferentially relate to recollection, and that the spatial distribution of eye movements is directly related to familiarity-based memory during encoding and retrieval. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

From Abstract Symbols to Emotional (In-)Sights: An Eye Tracking Study on the Effects of Emotional Vignettes and Pictures

Reading is known to be a highly complex, emotion-inducing process, usually involving connected and cohesive sequences of sentences and paragraphs. However, most empirical results, especially from studies using eye tracking, are either restricted to simple linguistic materials (e.g., isolated words, single sentences) or disregard valence-driven effects. The present study addressed the need for ecologically valid stimuli by examining the emotion potential of and reading behavior in emotional vignettes, often used in applied psychological contexts and discourse comprehension. To allow for a cross-domain comparison in the area of emotion induction, negatively and positively valenced vignettes were constructed based on pre-selected emotional pictures from the Nencki Affective Picture System (NAPS; Marchewka et al., 2014). We collected ratings of perceived valence and arousal for both material groups and recorded eye movements of 42 participants during reading and picture viewing. Linear mixed-effects models were performed to analyze effects of valence (i.e., valence category, valence rating) and stimulus domain (i.e., textual, pictorial) on ratings of perceived valence and arousal, eye movements in reading, and eye movements in picture viewing. Results supported the success of our experimental manipulation: emotionally positive stimuli (i.e., vignettes, pictures) were perceived more positively and less arousing than emotionally negative ones. The cross-domain comparison indicated that vignettes are able to induce stronger valence effects than their pictorial counterparts, no differences between vignettes and pictures regarding effects on perceived arousal were found. Analyses of eye movements in reading replicated results from experiments using isolated words and sentences: perceived positive text valence attracted shorter reading times than perceived negative valence at both the supralexical and lexical level. In line with previous findings, no emotion effects on eye movements in picture viewing were found. This is the first eye tracking study reporting superior valence effects for vignettes compared to pictures and valence-specific effects on eye movements in reading at the supralexical level.

Been there, seen that, done that: Modification of visual exploration across repeated exposures

The underlying factors that determine gaze position are a central topic in visual cognitive research. Traditionally, studies emphasized the interaction between the low-level properties of an image and gaze position. Later studies examined the influence of the semantic properties of an image. These studies explored gaze behavior during a single presentation, thus ignoring the impact of familiarity. Sparse evidence suggested that across repetitive exposures, gaze exploration attenuates but the correlation between gaze position and the low-level features of the image remains stable. However, these studies neglected two fundamental issues: (a) repeated scenes are displayed later in the testing session, such that exploration attenuation could be a result of lethargy, and (b) even if these effects are related to familiarity, are they based on a verbatim familiarity with the image, or on high-level familiarity with the gist of the scene? We investigated these issues by exposing participants to a sequence of images, some of them repeated across blocks. We found fewer, longer fixations as familiarity increased, along with shorter saccades and decreased gaze allocation towards semantically meaningful regions. These effects could not be ascribed to tonic fatigue, since they did not manifest for images that changed across blocks. Moreover, there was no attenuation of gaze behavior when participants observed a flipped version of the familiar images, suggesting that gist familiarity is not sufficient for eliciting these effects. These findings contribute to the literature on memory-guided gaze behavior and provide novel insights into the mechanism underlying the visual exploration of familiar environments.

Recognizing images: The role of motivational significance, complexity, social content, age, and gender

Memory for affective events plays an important role in determining people's behavior and well-being. Its determinants are far from being completely understood. We investigated how recognition memory for affective pictures depends on pictures' motivational significance (valence and arousal), complexity (figure-ground compositions vs. scenes), and social content (pictures with people vs. without people) and on observers' age and gender. Younger, middle-aged, and older adults viewed 84 pictures depicting real-life situations. After a break, the participants viewed 72 pictures, half of which had been viewed previously and half of which were novel, and were asked to endorse whether each picture was novel or had been presented previously. Hits, false alarms, and overall performance (discrimination accuracy) were our dependent variables. The main findings were that, across participants, recognition memory was better for unpleasant than pleasant pictures and for pictures depicting people than pictures without people. Low-arousal pictures were more accurately recognized than high-arousal pictures, and this effect was significantly larger among middle-aged and older adults than younger adults. Recognition memory worsened across adulthood, and this decline was steeper among men than women. Middle-aged and older women outperformed their male counterparts. This study suggests that how well we are able to successfully discriminate previously seen pictorial stimuli from novel stimuli depends on several pictures' properties related to their motivational significance and content, and on observer's age and gender.

Eye gaze behavior during affective picture viewing: Effects of motivational significance, gender, age, and repeated exposure

How top-down and bottom-up factors combine to determine eye movements during affective picture viewing is far from being completely understood. We investigated how observers' fixation frequency and scanpath length - two indices of information seeking and intake - are related to self-reported valence (pleasantness) and arousal and depend on gender, age, and repeated exposure during affective picture viewing. We tracked the eye movements of 157 younger, middle-aged, and older adults when viewing 14 picture series each consisting of six thematically and affectively similar pictures. Participants' valence and arousal ratings were registered for each series. Fixation frequency and scanpath length increased with self-rated unpleasantness and arousal and decreased across the six pictures within series. This decrease was age- and arousal-dependent. Compared to men, women exhibited a more exploratory scanning behavior. These findings suggest that observers' affective appraisal, gender and age and repeated exposure to affective visual stimuli influence visual information seeking and intake.

Free visual exploration of natural movies in schizophrenia

BACKGROUND

Eye tracking dysfunction (ETD) observed with standard pursuit stimuli represents a well-established biomarker for schizophrenia. How ETD may manifest during free visual exploration of real-life movies is unclear.

METHODS

Eye movements were recorded (EyeLink®1000) while 26 schizophrenia patients and 25 healthy age-matched controls freely explored nine uncut movies and nine pictures of real-life situations for 20 s each. Subsequently, participants were shown still shots of these scenes to decide whether they had explored them as movies or pictures. Participants were additionally assessed on standard eye-tracking tasks.

RESULTS

Patients made smaller saccades (movies (p = 0.003), pictures (p = 0.002)) and had a stronger central bias (movies and pictures (p < 0.001)) than controls. In movies, patients' exploration behavior was less driven by image-defined, bottom-up stimulus saliency than controls (p < 0.05). Proportions of pursuit tracking on movies differed between groups depending on the individual movie (group*movie p = 0.011, movie p < 0.001). Eye velocity on standard pursuit stimuli was reduced in patients (p = 0.029) but did not correlate with pursuit behavior on movies. Additionally, patients obtained lower rates of correctly identified still shots as movies or pictures (p = 0.046).

CONCLUSION

Our results suggest a restricted centrally focused visual exploration behavior in patients not only on pictures, but also on movies of real-life scenes. While ETD observed in the laboratory cannot be directly transferred to natural viewing conditions, these alterations support a model of impairments in motion information processing in patients resulting in a reduced ability to perceive moving objects and less saliency driven exploration behavior presumably contributing to alterations in the perception of the natural environment.

Attentional Patterns to Emotional Faces Versus Scenes in Children with Autism Spectrum Disorders

Previous research has shown attentional biases in children with autism spectrum disorders (ASD) when processing distressing information. This study examined these attentional patterns as a function of the type of stimulus (scenes and faces) and the stimulus valence (happy, sad, threatening, neutral) using a within-subject design. A dot-probe was applied to ASD (n = 24) and typically developing (TD) children (n = 24). Results showed no differences between the groups for happy and sad stimuli. Critically, ASD children showed an attentional bias toward threatening scenes but away from threatening faces. Thus, the type of stimuli modulated the direction of attentional biases to distressing information in ASD children. These results are discussed in the framework of current theories on cognitive and emotional processing in ASD.

Gender-based eye movement differences in passive indoor picture viewing: An eye-tracking study

Male and female brains have different structures, which can make genders produce various eye- movement patterns. This study presents the results of an eye tracking experiment in which we analyzed the eye movements of 25 male and 20 female participants during passive indoor picture viewing. We examined eye-movement parameters, namely fixation duration, scan path length, number of saccades, spatial density, saccade amplitude, and the ratio of total fixation duration to total saccade duration so as to investigate gender differences in eye-movement patterns while indoor picture viewing. We found significant differences in eye-movement patterns between genders. The results of eye-movement analysis also indicated that females showed more explorative gaze behavior, indicated by larger saccade amplitudes, and by longer scan paths. Furthermore, owing to shorter ratio of fixation durations to saccade duration in females as compared to male, we speculate that females inspect the images faster than males. In addition, we classified the genders into two subgroups-males and females-based on their eye-movement parameters by using a support vector machine classifier achieving an accuracy of 70%. We have come to the result males and females - with same culture - see the environment differently. Our findings have profound implications for researches employing gaze-based models.

Visual Complexity and Affect: Ratings Reflect More Than Meets the Eye

Pictorial stimuli can vary on many dimensions, several aspects of which are captured by the term 'visual complexity.' Visual complexity can be described as, "a picture of a few objects, colors, or structures would be less complex than a very colorful picture of many objects that is composed of several components." Prior studies have reported a relationship between affect and visual complexity, where complex pictures are rated as more pleasant and arousing. However, a relationship in the opposite direction, an effect of affect on visual complexity, is also possible; emotional arousal and valence are known to influence selective attention and visual processing. In a series of experiments, we found that ratings of visual complexity correlated with affective ratings, and independently also with computational measures of visual complexity. These computational measures did not correlate with affect, suggesting that complexity ratings are separately related to distinct factors. We investigated the relationship between affect and ratings of visual complexity, finding an 'arousal-complexity bias' to be a robust phenomenon. Moreover, we found this bias could be attenuated when explicitly indicated but did not correlate with inter-individual difference measures of affective processing, and was largely unrelated to cognitive and eyetracking measures. Taken together, the arousal-complexity bias seems to be caused by a relationship between arousal and visual processing as it has been described for the greater vividness of arousing pictures. The described arousal-complexity bias is also of relevance from an experimental perspective because visual complexity is often considered a variable to control for when using pictorial stimuli.

Retrieval Demands Adaptively Change Striatal Old/New Signals and Boost Subsequent Long-Term Memory

The striatum is a central part of the dopaminergic mesolimbic system and contributes both to the encoding and retrieval of long-term memories. In this regard, the co-occurrence of striatal novelty and retrieval success effects in independent studies underlines the structure's double duty and suggests dynamic contextual adaptation. To test this hypothesis and further investigate the underlying mechanisms of encoding and retrieval dynamics, human subjects viewed pre-familiarized scene images intermixed with new scenes and classified them as indoor versus outdoor (encoding task) or old versus new (retrieval task), while fMRI and eye tracking data were recorded. Subsequently, subjects performed a final recognition task. As hypothesized, striatal activity and pupil size reflected task-conditional salience of old and new stimuli, but, unexpectedly, this effect was not reflected in the substantia nigra and ventral tegmental area (SN/VTA), medial temporal lobe, or subsequent memory performance. Instead, subsequent memory generally benefitted from retrieval, an effect possibly driven by task difficulty and activity in a network including different parts of the striatum and SN/VTA. Our findings extend memory models of encoding and retrieval dynamics by pinpointing a specific contextual factor that differentially modulates the functional properties of the mesolimbic system.SIGNIFICANCE STATEMENT The mesolimbic system is involved in the encoding and retrieval of information but it is unclear how these two processes are achieved within the same network of brain regions. In particular, memory retrieval and novelty encoding were considered in independent studies, implying that novelty (new > old) and retrieval success (old > new) effects may co-occur in the striatum. Here, we used a common framework implicating the striatum, but not other parts of the mesolimbic system, in tracking context-dependent salience of old and new information. The current study, therefore, paves the way for a more comprehensive understanding of the functional properties of the mesolimbic system during memory encoding and retrieval.

Consumer Neuroscience-Based Metrics Predict Recall, Liking and Viewing Rates in Online Advertising

The purpose of the present study is to investigate whether the effectiveness of a new ad on digital channels (YouTube) can be predicted by using neural networks and neuroscience-based metrics (brain response, heart rate variability and eye tracking). Neurophysiological records from 35 participants were exposed to 8 relevant TV Super Bowl commercials. Correlations between neurophysiological-based metrics, ad recall, ad liking, the ACE metrix score and the number of views on YouTube during a year were investigated. Our findings suggest a significant correlation between neuroscience metrics and self-reported of ad effectiveness and the direct number of views on the YouTube channel. In addition, and using an artificial neural network based on neuroscience metrics, the model classifies (82.9% of average accuracy) and estimate the number of online views (mean error of 0.199). The results highlight the validity of neuromarketing-based techniques for predicting the success of advertising responses. Practitioners can consider the proposed methodology at the design stages of advertising content, thus enhancing advertising effectiveness. The study pioneers the use of neurophysiological methods in predicting advertising success in a digital context. This is the first article that has examined whether these measures could actually be used for predicting views for advertising on YouTube.

Effects of Scene Properties and Emotional Valence on Brain Activations: A Fixation-Related fMRI Study

Temporal and spatial characteristics of fixations are affected by image properties, including high-level scene characteristics, such as object-background composition, and low-level physical characteristics, such as image clarity. The influence of these factors is modulated by the emotional content of an image. Here, we aimed to establish whether brain correlates of fixations reflect these modulatory effects. To this end, we simultaneously scanned participants and measured their eye movements, while presenting negative and neutral images in various image clarity conditions, with controlled object-background composition. The fMRI data were analyzed using a novel fixation-based event-related (FIBER) method, which allows the tracking of brain activity linked to individual fixations. The results revealed that fixating an emotional object was linked to greater deactivation in the right lingual gyrus than fixating the background of an emotional image, while no difference between object and background was found for neutral images. We suggest that deactivation in the lingual gyrus might be linked to inhibition of saccade execution. This was supported by fixation duration results, which showed that in the negative condition, fixations falling on the object were longer than those falling on the background. Furthermore, increase in the image clarity was correlated with fixation-related activity within the lateral occipital complex, the structure linked to object recognition. This correlation was significantly stronger for negative images, presumably due to greater deployment of attention towards emotional objects. Our eye-tracking results are in line with these observations, showing that the chance of fixating an object rose faster for negative images over neutral ones as the level of noise decreased. Overall, our study demonstrated that emotional value of an image changes the way that low and high-level scene properties affect the characteristics of fixations. The fixation-related brain activity is affected by the low-level scene properties and this impact differs between negative and neutral images. The high-level scene properties also affect brain correlates of fixations, but only in the case of the negative images.

Abnormal Visual Scanning of Emotionally Evocative Natural Scenes in Huntington's Disease

Huntington's disease (HD) is a neurodegenerative movement disorder associated with deficits in the processing of emotional stimuli, including alterations in the self-reported subjective experience of emotion when presented with pictures of emotional scenes. The aim of this study was to determine whether individuals with HD, compared to unaffected controls, display abnormal visual scanning of emotionally evocative natural scenes. Using eye-tracking, we recorded eye-movements of 25 HD participants (advanced pre-symptomatic and early symptomatic) and 25 age-matched unaffected control participants during a picture viewing task. Participants viewed pictures of natural scenes associated with different emotions: anger, fear, disgust, happiness, or neutral, and evaluated those pictures on a valence rating scale. Individuals with HD displayed abnormal visual scanning patterns, but did not differ from controls with respect to their valence ratings. Specifically, compared to controls, HD participants spent less time fixating on the pictures and made longer scan paths. This finding highlights the importance of taking visual scanning behavior into account when investigating emotion processing in HD. The visual scanning patterns displayed by HD participants could reflect a heightened, but possibly unfocussed, search for information, and might be linked to attentional deficits or to altered subjective emotional experiences in HD. Another possibility is that HD participants may have found it more difficult than controls to evaluate the emotional valence of the scenes, and the heightened search for information was employed as a compensatory strategy.

Escaping aversive exposure

This research examined human defensive reactivity when exposure to an aversive event could be escaped but not entirely avoided. Prolonged visual cues indicated whether exposure to an upcoming aversive (i.e., disgusting) picture could be terminated after onset (escaped) or not, or that a neutral go signal would appear. Acoustically elicited startle reflexes were measured during each cue interval, as were cardiac and skin conductance activity. Early in the cuing interval, startle reflexes were potentiated during both escape and inescapable exposure trials, compared to the simple motor context. Later in the interval, reflexes remained potentiated for both escapable and inescapable trials, with potentiation further enhanced when aversive exposure could not be escaped compared to when exposure could be escaped. Heart rate deceleration in the cuing interval indicated increased vigilance when preparing any (escape or neutral) action, whereas skin conductance responding indicated enhanced sympathetic action mobilization particularly in an escape context. These data suggest that startle reflexes engaged in an escape context reflect both motor-related response inhibition and aversive potentiation, and they indicate that defensive motivation is engaged whenever aversive exposure is guaranteed, regardless of whether it can be escaped or not.

The Effect of Illustration on Improving Text Comprehension in Dyslexic Adults

This study analyses the effect of pictures in reading materials on the viewing patterns of dyslexic adults. By analysing viewing patterns using eye-tracking, we captured differences in eye movements between young adults with dyslexia and controls based on the influence of reading skill as a continuous variable of the total sample. Both types of participants were assigned randomly to view either text-only or a text + picture stimuli. The results show that the controls made an early global overview of the material and (when a picture was present) rapid transitions between text and picture. Having text illustrated with a picture decreased scores on questions about the learning material among participants with dyslexia. Controls spent 1.7% and dyslexic participants 1% of their time on the picture. Controls had 24% fewer total fixations; however, 29% more of the control group's fixations than the dyslexic group's fixations were on the picture. We also looked for effects of different types of pictures. Dyslexic subjects exhibited a comparable viewing pattern to controls when scenes were complex, but fewer fixations when scenes were neutral/simple. Individual scan paths are presented as examples of atypical viewing patterns for individuals with dyslexia as compared with controls. © 2016 The Authors. Dyslexia published by John Wiley & Sons Ltd.

Responding to emotional scenes: effects of response outcome and picture repetition on reaction times and the late positive potential

Processing the motivational relevance of a visual scene and reacting accordingly is crucial for survival. Previous work suggests the emotional content of naturalistic scenes affects response speed, such that unpleasant content slows responses whereas pleasant content accelerates responses. It is unclear whether these effects reflect motor-cognitive processes, such as attentional orienting, or vary with the function/outcome of the motor response itself. Four experiments manipulated participants' ability to terminate the picture (offset control) and, thereby, the response's function and motivational value. Attentive orienting was manipulated via picture repetition, which diminishes orienting. A total of N = 81 participants completed versions of a go/no-go task, discriminating between distorted versus intact pictures drawn from six content categories varying in positive, negative, or neutral valence. While all participants responded faster with repetition, only participants without offset control exhibited slower responses to unpleasant and accelerated responses to pleasant content. Emotional engagement, measured by the late positive potential, was not modulated by attentional orienting (repetition), suggesting that the interaction between repetition and offset control is not due to altered emotional engagement. Together, results suggest that response time changes as a function of emotional content and sensitivity to attention orienting depends on the motivational function of the motor response.

Aversive stimuli exacerbate defensive motor behaviour in motor conversion disorder

Conversion disorder or functional neurological symptom disorder (FND) can affect the voluntary motor system, without an organic cause. Functional symptoms are thought to be generated unconsciously, arising from underlying psychological stressors. However, attempts to demonstrate a direct relationship between the limbic system and disrupted motor function in FND are lacking. We tested whether negative affect would exacerbate alterations of motor control and corresponding brain activations in individuals with FND. Ten patients and ten healthy controls produced an isometric precision-grip contraction at 10% of maximum force while either viewing visual feedback of their force output, or unpleasant or pleasant emotional images (without feedback). Force magnitude was continuously recorded together with change in brain activity using fMRI. For controls, force output decayed from the target level while viewing pleasant and unpleasant images. Patients however, maintained force at the target level without decay while viewing unpleasant images, indicating a pronounced effect of negative affect on force output in FND. This emotional modulation of force control was associated with different brain activation patterns between groups. Contrasting the unpleasant with the pleasant condition, controls showed increased activity in the inferior frontal cortex and pre-supplementary motor area, whereas patients had greater activity in the cerebellum (vermis), posterior cingulate cortex, and hippocampus. Engagement of a cerebellar-limbic network in patients is consistent with heightened processing of emotional salience, and supports the role of the cerebellum in freezing responses in the presence of aversive events. These data highlight a possible neural circuit through which psychological stressors elicit defensive behaviour and modulate motor function in FND.

Disgust Proneness and the Perception of Disgust-Evoking Pictures

Abstract. Disgust has been conceptualized as an emotion which promotes disease-avoidance behavior. The present eye-tracking experiment investigated whether disgust-evoking stimuli provoke specific eye movements and pupillary responses. Forty-three women viewed images depicting disgusting, fear-eliciting, neutral items and fractals while their eye movements (fixation duration and frequency, blinking rate, saccade amplitude) and pupil size were recorded. Disgust and fear ratings for the pictures as well as trait disgust and trait anxiety were assessed. The disgust pictures evoked the target emotion specifically and prompted characteristic scanning patterns. The participants made more and shorter fixations when looking at the repulsive pictures compared to all other categories. Moreover, state and trait disgust of the participants correlated negatively with their pupil size during disgust elicitation. Our data point to a disgust-specific visual exploration behavior, which possibly supports the fast identification of health-threatening aspects of a stimulus.

Selective orienting to pleasant versus unpleasant visual scenes

We investigated the relative attentional capture by positive versus simultaneously presented negative images in extrafoveal vision for female observers. Pairs of task-irrelevant pleasant and unpleasant visual scenes were displayed peripherally (⩾5° away from fixation) during a task-relevant letter-discrimination task at fixation. Selective attentional orienting was assessed by the probability of first fixating each scene and the time until first fixation. Results revealed a higher first fixation probability and shorter entry times, followed by longer dwell times, for pleasant relative to unpleasant scenes. The attentional capture advantage by pleasant scenes occurred in the absence of differences in perceptual properties. Processing of affective scene significance automatically occurs through covert attention in peripheral vision early. At least in non-threatening conditions, the attentional system is tuned to initially orient to pleasant images when competing with unpleasant ones.

Effects of presentation duration on measures of complexity in affective environmental scenes and representational paintings

Complexity constitutes an integral part of humans' environment and is inherent to information processing. However, little is known about the dynamics of visual complexity perception of affective environmental scenes (IAPS pictures) and artworks, such as affective representational paintings. In three experiments, we studied the time course of visual complexity perception by varying presentation duration and comparing subjective ratings with objective measures of complexity. In Experiment 1, 60 females rated 96 IAPS pictures, presented either for 1, 5, or 25s, for familiarity, complexity, pleasantness and arousal. In Experiment 2, another 60 females rated 96 representational paintings. Mean ratings of complexity and pleasantness changed according to presentation duration in a similar vein in both experiments, suggesting an inverted U-shape. No common pattern of results was observed for arousal and familiarity ratings across the two picture sets. The correlations between subjective and objective measures of complexity increased with longer exposure durations for IAPS pictures, but results were more ambiguous for paintings. Experiment 3 explored the time course of the multidimensionality of visual complexity perception. Another 109 females rated the number of objects, their disorganization and the differentiation between a figure-ground vs. complex scene composition of pictures presented for 1 and 5s. The multidimensionality of visual complexity only clearly emerged in the 5-s condition. In both picture sets, the strength of the correlations with objective measures depended on the type of subdimension of complexity and was less affected by presentation duration than correlations with general complexity in Experiments 1 and 2. These results have clear implications for perceptual and cognitive theories, especially for those of esthetic experiences, in which the dynamical changes of complexity perception need to be integrated.

The effects of visual context and individual differences on perception and evaluation of modern art and graffiti art

Traditionally, artworks are seen as autonomous objects that stand (or should stand) on their own. However, at least since the emergence of Conceptual Art in the 1920s and Pop Art in the 1960s, art lacks any distinctive perceptual features that define it as such. Art, therefore, cannot be defined without reference to its context. Some studies have shown that context affects the evaluation of artworks, and that specific contexts (street for graffiti art, museum for modern art) elicit specific effects (Gartus & Leder, 2014). However, it is yet unclear how context changes perception and appreciation processes. In our study we measured eye-movements while participants (64 psychology undergraduates, 48% women) perceived and evaluated beauty, interest, emotional valence, as well as perceived style for modern art and graffiti art embedded into either museum or street contexts. For modern art, beauty and interest ratings were higher in a museum than in a street context, but context made no difference for the ratings of graffiti art. Importantly, we also found an interaction of context and individual interest in graffiti for beauty and interest ratings, as well as for number of fixations. Analyses of eye-movements also revealed that viewing times were in general significantly longer in museum than in street contexts. We conclude that context can have an important influence on aesthetic appreciation. However, some effects depend also on the style of the artworks and the individual art interests of the viewers.

Perceptual processing of natural scenes at rapid rates: effects of complexity, content, and emotional arousal

During rapid serial visual presentation (RSVP), the perceptual system is confronted with a rapidly changing array of sensory information demanding resolution. At rapid rates of presentation, previous studies have found an early (e.g., 150-280 ms) negativity over occipital sensors that is enhanced when emotional, as compared with neutral, pictures are viewed, suggesting facilitated perception. In the present study, we explored how picture composition and the presence of people in the image affect perceptual processing of pictures of natural scenes. Using RSVP, pictures that differed in perceptual composition (figure-ground or scenes), content (presence of people or not), and emotional content (emotionally arousing or neutral) were presented in a continuous stream for 330 ms each with no intertrial interval. In both subject and picture analyses, all three variables affected the amplitude of occipital negativity, with the greatest enhancement for figure-ground compositions (as compared with scenes), irrespective of content and emotional arousal, supporting an interpretation that ease of perceptual processing is associated with enhanced occipital negativity. Viewing emotional pictures prompted enhanced negativity only for pictures that depicted people, suggesting that specific features of emotionally arousing images are associated with facilitated perceptual processing, rather than all emotional content.

Regulating the blink: Cognitive reappraisal modulates attention

Our brain is unable to fully process all the sensory signals we encounter. Attention is the process that helps selecting input from all available information for detailed processing and it is largely influenced by the affective value of the stimuli. This study examined if attentional bias toward emotional stimuli can be modulated by cognitively changing their emotional value. Participants were presented with negative and neutral images from four different scene-categories depicting humans (“Reading”, “Working”, “Crying” and “Violence”). Using cognitive reappraisal subjects decreased and increased the negativity of one negative (e.g., “Crying”) and one neutral (e.g., “Reading”) category respectively, whereas they only had to watch the other two categories (e.g., “Working” and “Violence”) without changing their feelings. Subsequently, subjects performed the attentional blink paradigm. Two targets were embedded in a stream of distractors, with the previously seen human pictures serving as the first target (T1) and rotated landmark/landscape images as the second (T2). Subjects then reported T1 visibility and the orientation of T2. We investigated if the detection accuracy of T2 is influenced by the change of the emotional value of T1 due to the reappraisal manipulation. Indeed, T2 detection rate was higher when T2 was preceded by a negative image that was only viewed compared to negative images that were reappraised to be neutral. Thus, more resources were captured by images that have been reappraised before, i.e., their negativity has been reduced. This modulatory effect of reappraisal on attention was not found for neutral images. Possibly upon re-exposure to negative stimuli subjects had to recall the previously performed affective change. In this case resources may be allocated to maintain the reappraised value and therefore hinder the detection of a temporally close target. Complimentary self-reported ratings support the reappraisal manipulation of negative images.

More intense experiences, less intense forecasts: why people overweight probability specifications in affective forecasts

We propose that affective forecasters overestimate the extent to which experienced hedonic responses to an outcome are influenced by the probability of its occurrence. The experience of an outcome (e.g., winning a gamble) is typically more affectively intense than the simulation of that outcome (e.g., imagining winning a gamble) upon which the affective forecast for it is based. We suggest that, as a result, experiencers allocate a larger share of their attention toward the outcome (e.g., winning the gamble) and less to its probability specifications than do affective forecasters. Consequently, hedonic responses to an outcome are less sensitive to its probability specifications than are affective forecasts for that outcome. The results of 6 experiments provide support for our theory. Affective forecasters overestimated how sensitive experiencers would be to the probability of positive and negative outcomes (Experiments 1 and 2). Consistent with our attentional account, differences in sensitivity to probability specifications disappeared when the attention of forecasters was diverted from probability specifications (Experiment 3) or when the attention of experiencers was drawn toward probability specifications (Experiment 4). Finally, differences in sensitivity to probability specifications between forecasters and experiencers were diminished when the forecasted outcome was more affectively intense (Experiments 5 and 6).

Advanced analysis of free visual exploration patterns in schizophrenia

Background: Visual scanpath analyses provide important information about attention allocation and attention shifting during visual exploration of social situations. This study investigated whether patients with schizophrenia simply show restricted free visual exploration behavior reflected by reduced saccade frequency and increased fixation duration or whether patients use qualitatively different exploration strategies than healthy controls.

Methods: Scanpaths of 32 patients with schizophrenia and age-matched 33 healthy controls were assessed while participants freely explored six photos of daily life situations (20 s/photo) evaluated for cognitive complexity and emotional strain. Using fixation and saccade parameters, we compared temporal changes in exploration behavior, cluster analyses, attentional landscapes, and analyses of scanpath similarities between both groups.

Results: We found fewer fixation clusters, longer fixation durations within a cluster, fewer changes between clusters, and a greater increase of fixation duration over time in patients compared to controls. Scanpath patterns and attentional landscapes in patients also differed significantly from those of controls. Generally, cognitive complexity and emotional strain had significant effects on visual exploration behavior. This effect was similar in both groups as were physical properties of fixation locations.

Conclusions: Longer attention allocation to a given feature in a scene and less attention shifts in patients suggest a more focal processing mode compared to a more ambient exploration strategy in controls. These visual exploration alterations were present in patients independently of cognitive complexity, emotional strain or physical properties of visual cues implying that they represent a rather general deficit. Despite this impairment, patients were able to adapt their scanning behavior to changes in cognitive complexity and emotional strain similar to controls.

Examining complexity across domains: relating subjective and objective measures of affective environmental scenes, paintings and music

Subjective complexity has been found to be related to hedonic measures of preference, pleasantness and beauty, but there is no consensus about the nature of this relationship in the visual and musical domains. Moreover, the affective content of stimuli has been largely neglected so far in the study of complexity but is crucial in many everyday contexts and in aesthetic experiences. We thus propose a cross-domain approach that acknowledges the multidimensional nature of complexity and that uses a wide range of objective complexity measures combined with subjective ratings. In four experiments, we employed pictures of affective environmental scenes, representational paintings, and Romantic solo and chamber music excerpts. Stimuli were pre-selected to vary in emotional content (pleasantness and arousal) and complexity (low versus high number of elements). For each set of stimuli, in a between-subjects design, ratings of familiarity, complexity, pleasantness and arousal were obtained for a presentation time of 25 s from 152 participants. In line with Berlyne's collative-motivation model, statistical analyses controlling for familiarity revealed a positive relationship between subjective complexity and arousal, and the highest correlations were observed for musical stimuli. Evidence for a mediating role of arousal in the complexity-pleasantness relationship was demonstrated in all experiments, but was only significant for females with regard to music. The direction and strength of the linear relationship between complexity and pleasantness depended on the stimulus type and gender. For environmental scenes, the root mean square contrast measures and measures of compressed file size correlated best with subjective complexity, whereas only edge detection based on phase congruency yielded equivalent results for representational paintings. Measures of compressed file size and event density also showed positive correlations with complexity and arousal in music, which is relevant for the discussion on which aspects of complexity are domain-specific and which are domain-general.

Orienting and emotional perception: facilitation, attenuation, and interference

Human emotions are considered here to be founded on motivational circuits in the brain that evolved to protect (defensive) and sustain (appetitive) the life of individuals and species. These circuits are phylogenetically old, shared among mammals, and involve the activation of both subcortical and cortical structures that mediate attention, perception, and action. Circuit activation begins with a feature-match between a cue and an existing representation in memory that has motivational significance. Subsequent processes include rapid cue-directed orienting, information gathering, and action selection - What is it? Where is it? What to do? In our studies of emotional perception, we have found that measures that index orienting to emotional cues generally show enhanced circuit activation and response facilitation, relative to orienting indicators occasioned by affectively neutral cues, whether presented concurrently or independently. Here, we discuss these findings, considering both physiological reflex and brain measures as they are modulated during orienting and emotional perception.

Emotion and ocular responses in Parkinson's disease

Parkinson's disease (PD) is a neurodegenerative disease that affects motor, cognitive, and emotional functioning. Previous studies reported reduced skin conductance responses in PD patients, compared to healthy older adults when viewing emotionally arousing pictures. Attenuated skin conductance changes in PD may reflect peripheral autonomic dysfunction (e.g., reduced nerve endings at the sweat gland) or, alternatively, a more central emotional deficit. The aim of the current study was to investigate a second measure of sympathetic arousal-change in pupil dilation. Eye movements, a motor-based correlate of emotional processing, were also assessed. Results indicated that pupil dilation was significantly greater when viewing emotional, compared to neutral pictures for both PD patients and controls. On the other hand, PD patients made fewer fixations with shorter scan paths, particularly when viewing pleasant pictures. These results suggest that PD patients show normal sympathetic arousal to affective stimuli (indexed by pupil diameter), but differences in motor correlates of emotion (eye movements).