Positive and negative hysteresis effects for the perception of geometric and emotional ambiguities

Visual imagination can influence visual perception - towards an experimental paradigm to measure imagination

During visual imagination, a perceptual representation is activated in the absence of sensory input. This is sometimes described as seeing with the mind's eye. A number of physiological studies indicate that the brain uses more or less the same neural resources for visual perception of sensory information and visual imagination. The intensity of visual imagination is typically assessed with questionnaires, while more objective measures are missing. Aim of the present study was, to test a new experimental paradigm that may allow to objectively quantify imagination. For this, we used priming and adaptation effects during observation of ambiguous figures. Our perception of an ambiguous stimulus is unstable and alternates spontaneously between two possible interpretations. If we first observe an unambiguous stimulus variant (the conditioning stimulus), the subsequently presented ambiguous stimulus can either be perceived in the same way as the test stimulus (priming effect) or in the opposite way (adaptation effect) as a function of the conditioning time. We tested for these conditioning effects (priming and adaptation) using an ambiguous Necker Cube and an ambiguous Letter /Number stimulus as test stimuli and unambiguous variants thereof as conditioning stimuli. In a second experimental condition, we tested whether the previous imagination of an unambiguous conditioning stimulus variant - instead of its observation - can have similar conditioning effects on the subsequent test stimulus. We found no systematic conditioning effect on the group level, neither for the two stimulus types (Necker Cube stimuli and Letter /Number stimuli) nor for the two conditions (Real and Imaginary). However, significant correlations between effects of Real and Imaginary Condition were observed for both stimulus types. The absence of conditioning effects at the group level may be explained by using only one conditioning time, which may fit with individual priming and adaptation constants of some of our participants but not of others. Our strong correlation results indicate that observers with clear conditioning effects have about the same type (priming or adaptation) and intensity of imaginary conditioning effects. As a consequence, not only past perceptual experiences but also past imaginations can influence our current percepts. This is further confirmation that the mechanisms underlying perception and imagination are similar. Our post-hoc qualitative observations from three self-defined aphantasic observers indicate that our paradigm may be a promising objective measure to identify aphantasia.

Hysteresis reveals a happiness bias effect in dynamic emotion recognition from ambiguous biological motion

Considering the nonlinear dynamic nature of emotion recognition, it is believed to be strongly dependent on temporal context. This can be investigated by resorting to the phenomenon of hysteresis, which features a form of serial dependence, entailed by continuous temporal stimulus trajectories. Under positive hysteresis, the percept remains stable in visual memory (persistence) while in negative hysteresis, it shifts earlier (adaptation) to the opposite interpretation. Here, we asked whether positive or negative hysteresis occurs in emotion recognition of inherently ambiguous biological motion, while testing for the controversial debate of a negative versus positive emotional bias. Participants (n = 22) performed a psychophysical experiment in which they were asked to judge stimulus transitions between two emotions, happiness and sadness, from an actor database, and report perceived emotion across time, from one emotion to the opposite as physical cues were continuously changing. Our results reveal perceptual hysteresis in ambiguous emotion recognition, with positive hysteresis (visual persistence) predominating. However, negative hysteresis (adaptation/fatigue) was also observed in particular in the direction from sadness to happiness. This demonstrates a positive (happiness) bias in emotion recognition in ambiguous biological motion recognition. Finally, the interplay between positive and negative hysteresis suggests an underlying competition between visual persistence and adaptation mechanisms during ambiguous emotion recognition.

Continuous dynamics in behavior reveal interactions between perceptual warping in categorization and speech-in-noise perception

Introduction

Spoken language comprehension requires listeners map continuous features of the speech signal to discrete category labels. Categories are however malleable to surrounding context and stimulus precedence; listeners' percept can dynamically shift depending on the sequencing of adjacent stimuli resulting in a warping of the heard phonetic category. Here, we investigated whether such perceptual warping-which amplify categorical hearing-might alter speech processing in noise-degraded listening scenarios.

Methods

We measured continuous dynamics in perception and category judgments of an acoustic-phonetic vowel gradient via mouse tracking. Tokens were presented in serial vs. random orders to induce more/less perceptual warping while listeners categorized continua in clean and noise conditions.

Results

Listeners' responses were faster and their mouse trajectories closer to the ultimate behavioral selection (marked visually on the screen) in serial vs. random order, suggesting increased perceptual attraction to category exemplars. Interestingly, order effects emerged earlier and persisted later in the trial time course when categorizing speech in noise.

Discussion

These data describe interactions between perceptual warping in categorization and speech-in-noise perception: warping strengthens the behavioral attraction to relevant speech categories, making listeners more decisive (though not necessarily more accurate) in their decisions of both clean and noise-degraded speech.

Presenting rose odor during learning, sleep and retrieval helps to improve memory consolidation: a real-life study

Improving our learning abilities is important for numerous aspects of our life. Several studies found beneficial effects of presenting cues (odor or sounds) during learning and during sleep for memory performance. A recent study applying a real-life paradigm indicated that additional odor cueing during a Final Test can further increase this cueing effect. The present online study builds on these findings with the following questions: (1) Can we replicate beneficial memory effects of additional odor cueing during tests? (2) How many odor cueing learning sessions and odor cueing nights of sleep maximize the learning success? (3) Can odor cueing also reduce the amount of forgetting over time? 160 Participants learned 40 German Japanese word pairs in four groups with separate experimental conditions over three days. Group N received no odor during the whole study. Group LS received odor cueing during learning and sleep, group LT during learning and testing and group LST during learning, sleep and testing. Participants performed intermediate tests after each learning session plus three final tests 1, 7 and 28 days after the last learning session. Results: (1) Group LST learned 8.5% more vocabulary words than the other groups overall. (2) This odor cueing effect increased across the three days of cued learning. (3) We found no clear evidence for effects of odor cueing on the forgetting dynamics. Our findings support the notion of a beneficial effect of odor cueing. They further suggest to use at least 3 days and nights of odor cueing. Overall, this study indicates that there is an easy, efficient and economical way to enhance memory performance in daily life.

Positive hysteresis in emotion recognition: Face processing visual regions are involved in perceptual persistence, which mediates interactions between anterior insula and medial prefrontal cortex

Facial emotion perception can be studied from the point of view of dynamic systems whose output may depend not only on current input but also on prior history - a phenomenon known as hysteresis. In cognitive neuroscience, hysteresis has been described as positive (perceptual persistence) or negative (fatigue of current percept) depending on whether perceptual switching occurs later or earlier than actual physical stimulus changes. However, its neural correlates remain elusive. We used dynamic transitions between emotional expressions and combined behavioral assessment with functional magnetic resonance imaging (fMRI) to investigate the underlying circuitry of perceptual hysteresis in facial emotion recognition. Our findings revealed the involvement of face-selective visual areas - fusiform face area (FFA) and superior temporal sulcus (STS) - in perceptual persistence as well as the right anterior insula. Moreover, functional connectivity analyses revealed an interplay between the right anterior insula and medial prefrontal cortex, which showed to be dependent on the presence of positive hysteresis. Our results support the hypothesis that high-order regions are involved in perceptual stabilization and decision during perceptual persistence (positive hysteresis) and add evidence to the role of the anterior insula as a hub of sensory information in perceptual decision-making.

Hysteresis and return point memory in the random-field Blume-Capel model

We study the zero-temperature steady-state of the random-field Blume-Capel model with spin-flip Glauber dynamics on a random regular graph. The magnetization m as a function of the external field H is observed to have double hysteresis loops with a return point memory. We also solve the model on a Bethe lattice in the approximation that the spin relaxation dynamics is abelian and find good agreement between simulations on random regular graphs and Bethe lattice calculations for negative values of H.

Recurrent processing improves occluded object recognition and gives rise to perceptual hysteresis

Over the past decades, object recognition has been predominantly studied and modelled as a feedforward process. This notion was supported by the fast response times in psychophysical and neurophysiological experiments and the recent success of deep feedforward neural networks for object recognition. Recently, however, this prevalent view has shifted and recurrent connectivity in the brain is now believed to contribute significantly to object recognition — especially under challenging conditions, including the recognition of partially occluded objects. Moreover, recurrent dynamics might be the key to understanding perceptual phenomena such as perceptual hysteresis. In this work we investigate if and how artificial neural networks can benefit from recurrent connections. We systematically compare architectures comprised of bottom-up, lateral, and top-down connections. To evaluate the impact of recurrent connections for occluded object recognition, we introduce three stereoscopic occluded object datasets, which span the range from classifying partially occluded hand-written digits to recognizing three-dimensional objects. We find that recurrent architectures perform significantly better than parameter-matched feedforward models. An analysis of the hidden representation of the models suggests that occluders are progressively discounted in later time steps of processing. We demonstrate that feedback can correct the initial misclassifications over time and that the recurrent dynamics lead to perceptual hysteresis. Overall, our results emphasize the importance of recurrent feedback for object recognition in difficult situations.

Top-down resolution of visual ambiguity - knowledge from the future or footprints from the past?

Current theories about visual perception assume that our perceptual system weights the a priori incomplete, noisy and ambiguous sensory information with previous, memorized perceptual experiences in order to construct stable and reliable percepts. These theories are supported by numerous experimental findings. Theories about precognition have an opposite point of view. They assume that information from the future can have influence on perception, thoughts, and behavior. Several experimental studies provide evidence for precognition effects, other studies found no such effects. One problem may be that the vast majority of precognition paradigms did not systematically control for potential effects from the perceptual history. In the present study, we presented ambiguous Necker cube stimuli and disambiguated cube variants and systematically tested in two separate experiments whether perception of a currently observed ambiguous Necker cube stimulus can be influenced by a disambiguated cube variant, presented in the immediate perceptual past (perceptual history effects) and/or in the immediate perceptual future (precognition effects). We found perceptual history effects, which partly depended on the length of the perceptual history trace but were independent of the perceptual future. Results from some individual participants suggest on the first glance a precognition pattern, but results from our second experiment make a perceptual history explanation more probable. On the group level, no precognition effects were statistically indicated. The perceptual history effects found in the present study are in confirmation with related studies from the literature. The precognition analysis revealed some interesting individual patterns, which however did not allow for general conclusions. Overall, the present study demonstrates that any future experiment about sensory or extrasensory perception urgently needs to control for potential perceptual history effects and that temporal aspects of stimulus presentation are of high relevance.

Divergent Thinking Influences the Perception of Ambiguous Visual Illusions

This study investigated the relationships between personality and creativity in the perception of two different ambiguous visual illusions. Previous research has suggested that Industriousness and Openness/Intellect (as measured by the Big Five Aspects Scale) are both associated with individual differences in perceptual switching rates for binocular rivalry stimuli. Here, we examined whether these relationships generalise to the Necker Cube and the Spinning Dancer illusions. In the experimental phase of this study, participants viewed these ambiguous figures under both static and dynamic, as well as free-view and fixation, conditions. As predicted, perceptual switching rates were higher: (a) for the static Necker Cube than the Spinning Dancer, and (b) in free-view compared with fixation conditions. In the second phase of the study, personality type and divergent thinking were measured using the Big Five Aspects Scale and the Alternate Uses Task, respectively. Higher creativity/divergent thinking (as measured by the Alternate Uses Task) was found to predict greater switching rates for the static Necker Cube (but not the Spinning Dancer) under both free-view and fixation conditions. These findings suggest that there are differences in the perceptual processing of creative individuals.

Identification of competing neural mechanisms underlying positive and negative perceptual hysteresis in the human visual system

Hysteresis is a well-known phenomenon in physics that relates changes in a system with its prior history. It is also part of human visual experience (perceptual hysteresis), and two different neural mechanisms might explain it: persistence (a cause of positive hysteresis), which forces to keep a current percept for longer, and adaptation (a cause of negative hysteresis), which in turn favors the switch to a competing percept early on. In this study, we explore the neural correlates underlying these mechanisms and the hypothesis of their competitive balance, by combining behavioral assessment with fMRI. We used machine learning on the behavioral data to distinguish between positive and negative hysteresis, and discovered a neural correlate of persistence at a core region of the ventral attention network, the anterior insula. Our results add to the understanding of perceptual multistability and reveal a possible mechanistic explanation for the regulation of different forms of perceptual hysteresis.

Using the perceptual past to predict the perceptual future influences the perceived present - A novel ERP paradigm

The information available through our senses is noisy, incomplete, and to varying degrees ambiguous. The perceptual system must create stable and reliable percepts out of this restricted information. It solves this perceptual inference problem by integrating memories of previous percepts and making predictions about the perceptual future.

Using ambiguous figures and a new experimental approach, we studied whether generating predictions based on regularities in the past affects processing of the present and how this is done. Event-related potentials (ERPs) were measured to investigate whether a highly regular temporal context of either ambiguous or unambiguous stimulus variants differently affects processing of a current stimulus and/or task execution. Further, we tested whether symbolic announcements about the immediate perceptual future can replace the past experience of regularities as a source for making predictions. Both ERP and reaction time varied as a function of stimulus ambiguity in the temporal context of a present stimulus. No such effects were found with symbolic announcements.

Our results indicate that predictions about the future automatically alter processing of the present, even if the predictions are irrelevant for the present percept and task. However, direct experiences of past regularities are necessary for predicting the future whereas symbolic information about the future is not sufficient.

How positive emotional content overrules perceptual history effects: Hysteresis in emotion recognition

The human visual system is constantly processing multiple and often conflicting sensory cues to make perceptual decisions. Given the nonlinear nature of emotion recognition, this often leads to different percepts of the same physical facial expression. Moreover, the state of the emotion recognition system might depend on the trajectory of temporal context, potentially leading to a phenomenon known as perceptual hysteresis. Here, we aimed to explore temporal context-related mechanisms underlying perceptual hysteresis during emotion recognition. We hypothesized that dependence on recent perceptual experience might reveal important clues about the role of short-term memory on the perception of emotional stimuli. Behavioral data were acquired using reality-based, changing emotion expressions morphed from a source to a target emotion with different valences, always passing through a neutral expression. Participants identified the onset and offset of what they perceived as the neutral expression interval. Our results showed that current perception of emotional expression is affected by recent temporal context, thus revealing perceptual hysteresis. We also found a relation between recent perceptual history effects and stimulus emotional Content: The positive valence of the stimulus emotional content appeared to abolish perceptual history effects, whereas negatively loaded stimuli induced clear short-term memory effects and positive hysteresis. Our findings show direct competition between recent perceptual experience and stimulus emotional content during decision making, which affects the formation of current percepts in emotion recognition.

Large EEG amplitude effects are highly similar across Necker cube, smiley, and abstract stimuli

The information available through our senses is noisy, incomplete, and ambiguous. Our perceptual systems have to resolve this ambiguity to construct stable and reliable percepts. Previous EEG studies found large amplitude differences in two event-related potential (ERP) components 200 and 400 ms after stimulus onset when comparing ambiguous with disambiguated visual information ("ERP Ambiguity Effects"). These effects so far generalized across classical ambiguous figures from different visual categories at lower (geometry, motion) and intermediate (Gestalt perception) levels. The present study aimed to examine whether these ERP Effects are restricted to ambiguous figures or whether they also occur for different degrees of visibility. Smiley faces with low and high visibility of emotional expressions, as well as abstract figures with low and high visibility of a target curvature were presented. We thus compared ambiguity effects in geometric cube stimuli with visibility in emotional faces, and with visibility in abstract figures. ERP Effects were replicated for the geometric stimuli and very similar ERP Effects were found for stimuli with emotional face expressions but also for abstract figures. Conclusively, the ERP amplitude effects generalize across fundamentally different stimulus categories and show highly similar effects for different degrees of stimulus ambiguity and stimulus visibility. We postulate the existence of a high-level/meta-perceptual evaluation instance, beyond sensory details, that estimates the certainty of a perceptual decision. The ERP Effects may reflect differences in evaluation results.

How odor cues help to optimize learning during sleep in a real life-setting

Effortless learning during sleep is everybody’s dream. Several studies found that presenting odor cues during learning and selectively during slow wave sleep increases learning success. The current study extends previous research in three aspects to test for optimization and practical applicability of this cueing effect: We (1) performed a field study of vocabulary-learning in a regular school setting, (2) stimulated with odor cues during the whole night without sleep monitoring, and (3) applied the odor additionally as retrieval cue in a subsequent test. We found an odor cueing effect with comparable effect sizes (d between 0.6 and 1.2) as studies with sleep monitoring and selective cueing. Further, we observed some (non-significant) indication for a further performance benefit with additional cueing during the recall test. Our results replicate previous findings and provide important extensions: First, the odor effect also works outside the lab. Second, continuous cueing at night produces similar effect sizes as a study with selective cueing in specific sleep stages. Whether odor cueing during memory recall further increases memory performance hast to be shown in future studies. Overall, our results extend the knowledge on odor cueing effects and provide a realistic practical perspective on it.