Audio-Visual-Olfactory Resource Allocation for Tri-modal Virtual Environments

Studying the Effects of Congruence of Auditory and Visual Stimuli on Virtual Reality Experiences

Studies in virtual reality (VR) have introduced numerous multisensory simulation techniques for more immersive VR experiences. However, although they primarily focus on expanding sensory types or increasing individual sensory quality, they lack consensus in designing appropriate interactions between different sensory stimuli. This paper explores how the congruence between auditory and visual (AV) stimuli, which are the sensory stimuli typically provided by VR devices, affects the cognition and experience of VR users as a critical interaction factor in promoting multisensory integration. We defined the types of (in)congruence between AV stimuli, and then designed 12 virtual spaces with different types or degrees of congruence between AV stimuli. We then evaluated the presence, immersion, motion sickness, and cognition changes in each space. We observed the following key findings: 1) there is a limit to the degree of temporal or spatial incongruence that can be tolerated, with few negative effects on user experience until that point is exceeded; 2) users are tolerant of semantic incongruence; 3) a simulation that considers synesthetic congruence contributes to the user's sense of immersion and presence. Based on these insights, we identified the essential considerations for designing sensory simulations in VR and proposed future research directions.

Recent Advances in Smellscape Research for the Built Environment

The interrelationships between humans, smells and the built environment have been the focus of increasing numbers of research studies in the past ten years. This paper reviews these trends and identifies the challenges in smellscape research from three aspects: methodological approaches, artistic design interventions and museum practices, and odour policy making. In response to the gaps and challenges identified, three areas of future research have also been identified for this field: smell archives and databases, social justice within odour control and management, and research into advanced building materials.