Sound-Symbolism Effects in the Absence of Awareness: A Replication Study

Audiovisual interactions outside of visual awareness during motion adaptation

Motion aftereffects (MAEs), illusory motion experienced in a direction opposed to real motion experienced during prior adaptation, have been used to assess audiovisual interactions. In a previous study from our laboratory, we demonstrated that a congruent direction of auditory motion presented concurrently with visual motion during adaptation strengthened the consequent visual MAE, compared to when auditory motion was incongruent in direction. Those judgments of MAE strength, however, could have been influenced by expectations or response bias from mere knowledge of the state of audiovisual congruity during adaptation. To prevent such knowledge, we now employed continuous flash suppression to render visual motion perceptually invisible during adaptation, ensuring that observers were completely unaware of visual adapting motion and only aware of the motion direction of the sound they were hearing. We found a small but statistically significant congruence effect of sound on adaptation strength produced by invisible adaptation motion. After considering alternative explanations for this finding, we conclude that auditory motion can impact the strength of visual processing produced by translational visual motion even when that motion transpires outside of awareness.

The importance of awareness in face processing: A critical review of interocular suppression studies

Human faces convey essential information for understanding others' mental states and intentions. The importance of faces in social interaction has prompted suggestions that some relevant facial features such as configural information, emotional expression, and gaze direction may promote preferential access to awareness. This evidence has predominantly come from interocular suppression studies, with the most common method being the Breaking Continuous Flash Suppression (bCFS) procedure, which measures the time it takes different stimuli to overcome interocular suppression. However, the procedures employed in such studies suffer from multiple methodological limitations. For example, they are unable to disentangle detection from identification processes, their results may be confounded by participants' response bias and decision criteria, they typically use small stimulus sets, and some of their results attributed to detecting high-level facial features (e.g., emotional expression) may be confounded by differences in low-level visual features (e.g., contrast, spatial frequency). In this article, we review the evidence from the bCFS procedure on whether relevant facial features promote access to awareness, discuss the main limitations of this very popular method, and propose strategies to address these issues.

Affective Arousal Links Sound to Meaning

Prior investigations have demonstrated that people tend to link pseudowords such as bouba to rounded shapes and kiki to spiky shapes, but the cognitive processes underlying this matching bias have remained controversial. Here, we present three experiments underscoring the fundamental role of emotional mediation in this sound–shape mapping. Using stimuli from key previous studies, we found that kiki-like pseudowords and spiky shapes, compared with bouba-like pseudowords and rounded shapes, consistently elicit higher levels of affective arousal, which we assessed through both subjective ratings (Experiment 1, N = 52) and acoustic models implemented on the basis of pseudoword material (Experiment 2, N = 70). Crucially, the mediating effect of arousal generalizes to novel pseudowords (Experiment 3, N = 64, which was preregistered). These findings highlight the role that human emotion may play in language development and evolution by grounding associations between abstract concepts (e.g., shapes) and linguistic signs (e.g., words) in the affective system.

A round Bouba is easier to remember than a curved Kiki: Sound-symbolism can support associative memory

Past research has shown that prior knowledge can support our episodic memory for recently encountered associations. According to the model proposed by Cox and Criss (Proceedings of the 40th Annual Conference of the Cognitive Science Society, pp. 250-255, Madison, MI: Cognitive Science Society, 2018) and Cox and Shiffrin (Cognitive Psychology, 97, 31-61, 2017), any features shared by associated items should facilitate encoding and retrieval. We implemented a strict test of this prediction by taking advantage of sound-symbolism associations; here, the latter refer to relationships between phonemes and object characteristics - relationships that participants readily find natural - even if they have never encountered the items before. For instance, the non-word "maluma" is much more readily seen to refer to a random shape with rounded contours than to a shape that has sharp angles. In our study, 70 participants completed paired-associate memory tests after studying lists of three pairs, each composed of a random shape and a non-word. As predicted, there was better associative memory performance for sound-shape pairs that could rely on sound-symbolism links.