May I Smell Your Attention: Exploration of Smell and Sound for Visuospatial Attention in Virtual Reality

Using olfactory cues in text materials benefits delayed retention and schemata construction

Olfactory cues are considered a new sensory medium that can enhance learning, but the lack of empirical data has hampered their widespread use in educational practice. This requires empirical research to explore the effects of olfactory cues on learning. To address this research need, an experimental research study was conducted among 87 fourth graders from a Chinese elementary school. It explored the innovative design of adding olfactory cues to text materials by examining their effects on retention and schemata construction as learning outcomes, as well as their influence on learners' cognitive load and learning experience. In this between-subjects design experiment, the experimental group (n = 44) learned text materials with the introduction of olfactory cues, while the control group (n = 43) only learned text materials. After the learning activity, participants were asked to complete the questionnaires, immediate test, and delayed test. The results revealed that the usage of olfactory cues synchronized with text materials can enhance delayed retention, facilitate schemata construction, and improve learner experience without increasing cognitive load. This study confirms the potential of well-designed olfactory cues in educational practice and provides insights for designing and presenting multimedia learning resources.

Marketing sonified fragrance: Designing soundscapes for scent

Auditory branding is undoubtedly becoming more important across a range of sectors. One area, in particular, that has recently seen significant growth concerns the introduction of music and soundscapes that have been specifically designed to match a particular scent (what one might think of as "audio scents" or "sonic scents"). This represents an exciting new approach to the sensory marketing of fragrance and for industries with strategic sensory goals, such as cosmetics. Crucially, techniques such as the semantic differential technique, as well as the emerging literature on crossmodal correspondences, offer both a mechanistic understanding of, and a practical framework for, those wishing to rigorously align the connotative meaning and conceptual/emotional/sensory associations of sound and scent. These developments have enabled those working in the creative industries to start moving beyond previously popular approaches to matching, or translating between the senses, that were traditionally often based on the idiosyncratic phenomenon of synaesthesia, toward a more scientific approach while nevertheless still enabling/requiring a healthy dose of artistic inspiration. In this narrative historical review, we highlight the various approaches to the systematic matching of sound with scent and review the various marketing activations that have appeared in this space recently.

Modulating Driver Alertness via Ambient Olfactory Stimulation: A Wearable Electroencephalography Study

Poor alertness levels and related changes in cognitive efficiency are common when performing monotonous tasks such as extended driving. Recent studies have investigated driver alertness decrement and possible strategies for modulating alertness with the goal of improving reaction times to safety critical events. However, most studies rely on subjective measures in assessing alertness changes, while the use of olfactory stimuli, which are known to be strong modulators of cognitive states, has not been commensurately explored in driving alertness settings. To address this gap, in the present study we investigated the effectiveness of olfactory stimuli in modulating the alertness state of drivers and explored the utility of electroencephalography (EEG) in developing objective brain-based tools for assessing the resulting changes in cortical activity. Olfactory stimulation induced a significant differential effect on braking reaction time. The corresponding effect to the cortical activity was characterized using EEG-derived metrics and the devised machine learning framework yielded a high discriminating accuracy (92.1%). Furthermore, neural activity in the alpha frequency band was found to be significantly associated with the observed drivers' behavioral changes. Overall, our results demonstrate the potential of olfactory stimuli to modulate the alertness state and the efficiency of EEG in objectively assessing the resulting cognitive changes.

Improved Spatial Knowledge Acquisition through Sensory Augmentation

Sensory augmentation provides novel opportunities to broaden our knowledge of human perception through external sensors that record and transmit information beyond natural perception. To assess whether such augmented senses affect the acquisition of spatial knowledge during navigation, we trained a group of 27 participants for six weeks with an augmented sense for cardinal directions called the feelSpace belt. Then, we recruited a control group that did not receive the augmented sense and the corresponding training. All 53 participants first explored the Westbrook virtual reality environment for two and a half hours spread over five sessions before assessing their spatial knowledge in four immersive virtual reality tasks measuring cardinal, route, and survey knowledge. We found that the belt group acquired significantly more accurate cardinal and survey knowledge, which was measured in pointing accuracy, distance, and rotation estimates. Interestingly, the augmented sense also positively affected route knowledge, although to a lesser degree. Finally, the belt group reported a significant increase in the use of spatial strategies after training, while the groups' ratings were comparable at baseline. The results suggest that six weeks of training with the feelSpace belt led to improved survey and route knowledge acquisition. Moreover, the findings of our study could inform the development of assistive technologies for individuals with visual or navigational impairments, which may lead to enhanced navigation skills and quality of life.

Validation of "Neurit.Space": Three Digital Tests for the Neuropsychological Evaluation of Unilateral Spatial Neglect

Patients suffering from Unilateral Spatial Neglect (USN) fail to pay attention to, respond to, and report sensory events occurring in the contralesional side of space. The traditional neuropsychological assessment of USN is based on paper-and-pencil tests, whose data recording and scoring may be subjected to human error. The utilization of technological devices can be expected to improve the assessment of USN. Therefore, we built Neurit.Space, a modified digital version of three paper-and-pencil tests, widely used to detect signs of USN, namely: Bells Cancellation, Line Bisection and Five Elements Drawing Test. Administration and data processing is fully automatic. Twelve right brain-damaged patients (six with and six without USN) and 12 age- and education-balanced healthy participants were enrolled in the study. All participants were administered both the computerized and the paper-and-pencil versions of the tests. The results of this preliminary study showed good sensitivity, specificity, and usability of Neurit.Space, suggesting that these digital tests are a promising tool for the evaluation of USN, both in clinical and in research settings.

Eating, Smelling, and Seeing: Investigating Multisensory Integration and (In)congruent Stimuli while Eating in VR

Integrating taste in AR/VR applications has various promising use cases - from social eating to the treatment of disorders. Despite many successful AR/VR applications that alter the taste of beverages and food, the relationship between olfaction, gustation, and vision during the process of multisensory integration (MSI) has not been fully explored yet. Thus, we present the results of a study in which participants were confronted with congruent and incongruent visual and olfactory stimuli while eating a tasteless food product in VR. We were interested (1) if participants integrate bi-modal congruent stimuli and (2) if vision guides MSI during congruent/incongruent conditions. Our results contain three main findings: First, and surprisingly, participants were not always able to detect congruent visual-olfactory stimuli when eating a portion of tasteless food. Second, when confronted with tri-modal incongruent cues, a majority of participants did not rely on any of the presented cues when forced to identify what they eat; this includes vision which has previously been shown to dominate MSI. Third, although research has shown that basic taste qualities like sweetness, saltiness, or sourness can be influenced by congruent cues, doing so with more complex flavors (e.g., zucchini or carrot) proved to be harder to achieve. We discuss our results in the context of multimodal integration, and within the domain of multisensory AR/VR. Our results are a necessary building block for future human-food interaction in XR that relies on smell, taste, and vision and are foundational for applied applications such as affective AR/VR.

An Overview of Olfactory Displays in Education and Training

This paper describes an overview of olfactory displays (human–computer interfaces that generate and diffuse an odor to a user to stimulate their sense of smell) that have been proposed and researched for supporting education and training. Past research has shown that olfaction (the sense of smell) can support memorization of information, stimulate information recall, and help immerse learners and trainees into educational virtual environments, as well as complement and/or supplement other human sensory channels for learning. This paper begins with an introduction to olfaction and olfactory displays, and a review of techniques for storing, generating and diffusing odors at the computer interface. The paper proceeds with a discussion on educational theories that support olfactory displays for education and training, and a literature review on olfactory displays that support learning and training. Finally, the paper summarizes the advantages and challenges regarding the development and application of olfactory displays for education and training.

Building Embodied Spaces for Spatial Memory Neurorehabilitation with Virtual Reality in Normal and Pathological Aging

Along with deficits in spatial cognition, a decline in body-related information is observed in aging and is thought to contribute to impairments in navigation, memory, and space perception. According to the embodied cognition theories, bodily and environmental information play a crucial role in defining cognitive representations. Thanks to the possibility to involve body-related information, manipulate environmental stimuli, and add multisensory cues, virtual reality is one of the best candidates for spatial memory rehabilitation in aging for its embodied potential. However, current virtual neurorehabilitation solutions for aging and neurodegenerative diseases are in their infancy. Here, we discuss three concepts that could be used to improve embodied representations of the space with virtual reality. The virtual bodily representation is the combination of idiothetic information involved during virtual navigation thanks to input/output devices; the spatial affordances are environmental or symbolic elements used by the individual to act in the virtual environment; finally, the virtual enactment effect is the enhancement on spatial memory provided by actively (cognitively and/or bodily) interacting with the virtual space and its elements. Theoretical and empirical findings will be presented to propose innovative rehabilitative solutions in aging for spatial memory and navigation.