A computational model of perceptual expectation effect based on neural coding principles

How predictability affects habituation to novelty

One becomes accustomed to repeated exposures, even for a novel event. In the present study, we investigated how predictability affects habituation to novelty by applying a mathematical model of arousal that we previously developed, and through the use of psychophysiological experiments to test the model's prediction. We formalized habituation to novelty as a decrement in Kullback-Leibler divergence from Bayesian prior to posterior (i.e., information gain) representing arousal evoked from a novel event through Bayesian update. The model predicted an interaction effect between initial uncertainty and initial prediction error (i.e., predictability) on habituation to novelty: the greater the initial uncertainty, the faster the decrease in information gain (i.e., the sooner habituation occurs). This prediction was supported by experimental results using subjective reports of surprise and event-related potential (P300) evoked by visual-auditory incongruity. Our findings suggest that in highly uncertain situations, repeated exposure to stimuli can enhance habituation to novel stimuli.

Intrinsic motivation in virtual assistant interaction for fostering spontaneous interactions

With the growing utility of today’s conversational virtual assistants, the importance of user motivation in human–artificial intelligence interactions is becoming more obvious. However, previous studies in this and related fields, such as human–computer interaction, scarcely discussed intrinsic motivation (the motivation to interact with the assistants for fun). Previous studies either treated motivation as an inseparable concept or focused on non-intrinsic motivation (the motivation to interact with the assistant for utilitarian purposes). The current study aims to cover intrinsic motivation by taking an affective engineering approach. A novel motivation model is proposed, in which intrinsic motivation is affected by two factors that derive from user interactions with virtual assistants: expectation of capability and uncertainty. Experiments in which these two factors are manipulated by making participants believe they are interacting with the smart speaker “Amazon Echo” are conducted. Intrinsic motivation is measured both by using questionnaires and by covertly monitoring a five-minute free-choice period in the experimenter’s absence, during which the participants could decide for themselves whether to interact with the virtual assistants. Results of the first experiment showed that high expectation engenders more intrinsically motivated interaction compared with low expectation. However, the results did not support our hypothesis that expectation and uncertainty have an interaction effect on intrinsic motivation. We then revised our hypothetical model of action selection accordingly and conducted a verification experiment of the effects of uncertainty. Results of the verification experiment showed that reducing uncertainty encourages more interactions and causes the motivation behind these interactions to shift from non-intrinsic to intrinsic.

Modeling Emotions Associated With Novelty at Variable Uncertainty Levels: A Bayesian Approach

Acceptance of novelty depends on the receiver's emotional state. This paper proposes a novel mathematical model for predicting emotions elicited by the novelty of an event under different conditions. It models two emotion dimensions, arousal and valence, and considers different uncertainty levels. A state transition from before experiencing an event to afterwards is assumed, and a Bayesian model estimates a posterior distribution as being proportional to the product of a prior distribution and a likelihood function. Our model uses Kullback-Leibler divergence of the posterior from the prior, which we termed information gain, to represent arousal levels because it corresponds to surprise, a high-arousal emotion, upon experiencing a novel event. Based on Berlyne's hedonic function, we formalized valence as a summation of reward and aversion systems that are modeled as sigmoid functions of information gain. We derived information gain as a function of prediction errors (i.e., differences between the mean of the posterior and the peak likelihood), uncertainty (i.e., variance of the prior that is proportional to prior entropy), and noise (i.e., variance of the likelihood function). This functional model predicted an interaction effect of prediction errors and uncertainty on information gain, which we termed the arousal crossover effect. This effect means that the greater the uncertainty, the greater the information gain for a small prediction error. However, for large prediction errors, greater uncertainty means a smaller information gain. To verify this effect, we conducted an experiment with participants who watched short videos in which different percussion instruments were played. We varied uncertainty levels by using familiar and unfamiliar instruments, and we varied prediction error magnitudes by including congruent or incongruent percussive sounds in the videos. Event-related potential P300 amplitudes and subjective reports of surprise in response to the percussive sounds were used as measures of arousal levels, and the findings supported the hypothesized arousal crossover effect. The concordance between our model's predictions and our experimental results suggests that Bayesian information gain can be decomposed into uncertainty and prediction errors and is a valid measure of emotional arousal. Our model's predictions of arousal may help identify positively accepted novelty.

The Influence of Color on the Consumer's Experience of Beer

Visual appearance (e.g., color) cues set expectations regarding the likely taste and flavor properties of food and drink. These expectations may, in turn, anchor the subsequent tasting experience. In the present study, we examined the influence of the color of a beer on the consumer's experience. Dark and pale beers were evaluated both before and after tasting. Importantly, these beers were indistinguishable in terms of their taste/flavor when tasted without any visual cues. The results indicate that the differing visual appearance of the beers led to clear differences in expected taste/flavor. However, after tasting, no differences in flavor ratings were observed, indicating that the expectations based on visual cues did not influence the actual tasting experience. The participants also expected the dark beer to be more expensive than the pale one. These outcomes suggest that changes in the visual appearance of a beer lead to significant changes in the way in which consumers expect the beer to taste. At the same time, however, our findings also suggest the need for more evidence to be collected in order to determine the boundary conditions on when such crossmodal expectations may vs. may not affect the tasting experience. Highlights: The expected flavor of a beer is affected by its visual appearance. No differences in flavor ratings were observed on tasting. Consumers expect dark beers to be more expensive than pale/amber beers.