Serial Dependence of Emotion Within and Between Stimulus Sensory Modalities

Visual continuum in non-human animals: serial dependence revealed in dogs

Serial dependence is a recently described phenomenon by which the perceptual evaluation of a stimulus is biased by a previously attended one. By integrating stimuli over time, serial dependence is believed to ensure a stable conscious experience. Despite increasing studies in humans, it is unknown if the process occurs also in other species. Here, we assessed whether serial dependence occurs in dogs. To this aim, dogs were trained on a quantity discrimination task before being presented with a discrimination where one of the discriminanda was preceded by a task-irrelevant stimulus. If dogs are susceptible to serial dependence, the task-irrelevant stimulus was hypothesized to influence the perception of the subsequently presented quantity. Our results revealed that dogs perceived the currently presented quantity to be closer to the one presented briefly before, in accordance with serial dependence. The direction and strength of the effect were comparable to those observed in humans. Data regarding dogs' attention during the task suggest that dogs used two different quantity estimation mechanisms, an indication of a higher cognitive mechanism involved in the process. The present results are the first empirical evidence that serial dependence extends beyond humans, suggesting that the mechanism is shared by phylogenetically distant mammals.

Attention influences the effects of the previous form orientation on the current motion direction estimation

Recent studies have found that the estimates of motion directions are biased toward the previous form orientations, showing serial dependence, and the serial dependence does not involve cognitive abilities. In the current study, we conducted two experiments to investigate whether and how attention-a cognitive ability-affected the serial dependence. The results showed that serial dependence was present in the current study, reproducing the previous findings. Importantly, when the attentional load reduced the reliability (i.e., estimation accuracy and precision) of previous form orientations (Experiment 1), the serial dependence decreased, meaning that the biases of motion direction estimates toward previous form orientations were reduced; in contrast, when the attentional load reduced the reliability of current motion directions (Experiment 2), the serial dependence increased, meaning that the biases of motion direction estimates toward previous form orientations were increased. These trends were well consistent with the prediction of the Bayesian inference theory. Therefore, the current study revealed the involvement of attention in the serial dependence of current motion direction estimation on the previous form orientation, demonstrating that the serial dependence was cognitive and the attentional effect can be a Bayesian inference process, initially revealing its computational mechanism.

Serial dependencies between form orientation and motion direction are asymmetric

Much work has been done to uncover the mechanisms underlying form and motion information integration. However, no study examined the symmetry of the integration of form and motion across the temporal domain (i.e., serial dependence). In Experiment 1, we presented form and motion displays sequentially. In the form displays, dot pairs were oriented toward one screen position, indicating the form orientation; in the motion displays, dots moved radially outward. Their motion trajectories were oriented toward one screen position, indicating the motion direction. In each trial, participants reported their perceived form orientation after the form display or their perceived motion direction after the motion display. We found that the current trial's perceived motion direction was biased toward the previous trial's form orientation and vice versa, indicating serial dependencies between form orientation and motion direction. In Experiment 2, we changed the form and motion displays' reliability by varying the two displays' dot densities. The results showed that the serial dependence of form orientation on motion direction perception decreased only with increasing the current motion display's reliability; neither the reliability of the previous motion display nor that of the current form display significantly affected the serial dependence of motion direction on form orientation perception. Hence, serial dependencies between form orientation and motion direction were asymmetric. Our across-temporal integrations between form and motion, together with the simultaneous integration of form and motion revealed in the previous studies, depict a comprehensive mechanism underlying the integration of the two pieces of information.

Serial Dependence in Dermatological Judgments

Serial Dependence is a ubiquitous visual phenomenon in which sequentially viewed images appear more similar than they actually are, thus facilitating an efficient and stable perceptual experience in human observers. Although serial dependence is adaptive and beneficial in the naturally autocorrelated visual world, a smoothing perceptual experience, it might turn maladaptive in artificial circumstances, such as medical image perception tasks, where visual stimuli are randomly sequenced. Here, we analyzed 758,139 skin cancer diagnostic records from an online app, and we quantified the semantic similarity between sequential dermatology images using a computer vision model as well as human raters. We then tested whether serial dependence in perception occurs in dermatological judgments as a function of image similarity. We found significant serial dependence in perceptual discrimination judgments of lesion malignancy. Moreover, the serial dependence was tuned to the similarity in the images, and it decayed over time. The results indicate that relatively realistic store-and-forward dermatology judgments may be biased by serial dependence. These findings help in understanding one potential source of systematic bias and errors in medical image perception tasks and hint at useful approaches that could alleviate the errors due to serial dependence.

Influence of Multimodal Emotional Stimulations on Brain Activity: An Electroencephalographic Study

This study aimed to reveal the influence of emotional valence and sensory modality on neural activity in response to multimodal emotional stimuli using scalp EEG. In this study, 20 healthy participants completed the emotional multimodal stimulation experiment for three stimulus modalities (audio, visual, and audio-visual), all of which are from the same video source with two emotional components (pleasure or unpleasure), and EEG data were collected using six experimental conditions and one resting state. We analyzed power spectral density (PSD) and event-related potential (ERP) components in response to multimodal emotional stimuli, for spectral and temporal analysis. PSD results showed that the single modality (audio only/visual only) emotional stimulation PSD differed from multi-modality (audio-visual) in a wide brain and band range due to the changes in modality and not from the changes in emotional degree. The most pronounced N200-to-P300 potential shifts occurred in monomodal rather than multimodal emotional stimulations. This study suggests that emotional saliency and sensory processing efficiency perform a significant role in shaping neural activity during multimodal emotional stimulation, with the sensory modality being more influential in PSD. These findings contribute to our understanding of the neural mechanisms involved in multimodal emotional stimulation.