Multisensory Integration as per Technological Advances: A Review

Synchrony perception across senses: A systematic review of temporal binding window changes from infancy to adolescence in typical and atypical development

Sensory integration is increasingly acknowledged as being crucial for the development of cognitive and social abilities. However, its developmental trajectory is still little understood. This systematic review delves into the topic by investigating the literature about the developmental changes from infancy through adolescence of the Temporal Binding Window (TBW) - the epoch of time within which sensory inputs are perceived as simultaneous and therefore integrated. Following comprehensive searches across PubMed, Elsevier, and PsycInfo databases, only experimental, behavioral, English-language, peer-reviewed studies on multisensory temporal processing in 0-17-year-olds have been included. Non-behavioral, non-multisensory, and non-human studies have been excluded as those that did not directly focus on the TBW. The selection process was independently performed by two Authors. The 39 selected studies involved 2859 participants in total. Findings indicate a predisposition towards cross-modal asynchrony sensitivity and a composite, still unclear, developmental trajectory, with atypical development associated to increased asynchrony tolerance. These results highlight the need for consistent and thorough research into TBW development to inform potential interventions.

A behavioral economics approach to enhancing HIV preexposure and postexposure prophylaxis implementation

PURPOSE OF REVIEW

The 'PrEP cliff' phenomenon poses a critical challenge in global HIV PrEP implementation, marked by significant dropouts across the entire PrEP care continuum. This article reviews new strategies to address 'PrEP cliff'.

RECENT FINDINGS

Canadian clinicians have developed a service delivery model that offers presumptive PEP to patients in need and transits eligible PEP users to PrEP. Early findings are promising. This service model not only establishes a safety net for those who were not protected by PrEP, but it also leverages the immediate salience and perceived benefits of PEP as a natural nudge towards PrEP use. Aligning with Behavioral Economics, specifically the Salience Theory, this strategy holds potential in tackling PrEP implementation challenges.

SUMMARY

A natural pathway between PEP and PrEP has been widely observed. The Canadian service model exemplifies an innovative strategy that leverages this organic pathway and enhances the utility of both PEP and PrEP services. We offer theoretical insights into the reasons behind these PEP-PrEP transitions and evolve the Canadian model into a cohesive framework for implementation.

Multimodal processing of noisy cues in bumblebees

Multimodal cues can improve behavioral responses by enhancing the detection and localization of sensory cues and reducing response times. Across species, studies have shown that multisensory integration of visual and olfactory cues can improve response accuracy. However, in real-world settings, sensory cues are often noisy; visual and olfactory cues can be deteriorated, masked, or mixed, making the target cue less clear to the receiver. In this study, we use an associative learning paradigm (Free Moving Proboscis Extension Reflex, FMPER) to show that having multimodal cues may improve the accuracy of bees' responses to noisy cues. Adding a noisy visual cue improves the accuracy of response to a noisy olfactory cue, despite neither the clear nor noisy visual cue being sufficient when paired with a novel olfactory cue. This may provide insight into the neural mechanisms underlying multimodal processing and the effects of environmental change on pollination services.

Alterations of Audiovisual Integration in Alzheimer's Disease

Audiovisual integration is a vital information process involved in cognition and is closely correlated with aging and Alzheimer's disease (AD). In this review, we evaluated the altered audiovisual integrative behavioral symptoms in AD. We further analyzed the relationships between AD pathologies and audiovisual integration alterations bidirectionally and suggested the possible mechanisms of audiovisual integration alterations underlying AD, including the imbalance between energy demand and supply, activity-dependent degeneration, disrupted brain networks, and cognitive resource overloading. Then, based on the clinical characteristics including electrophysiological and imaging data related to audiovisual integration, we emphasized the value of audiovisual integration alterations as potential biomarkers for the early diagnosis and progression of AD. We also highlighted that treatments targeted audiovisual integration contributed to widespread pathological improvements in AD animal models and cognitive improvements in AD patients. Moreover, investigation into audiovisual integration alterations in AD also provided new insights and comprehension about sensory information processes.

Olfactory-auditory sensory integration in the lateral entorhinal cortex

Multisensory integration plays an important role in animal cognition. Although many studies have focused on visual-auditory integration, studies on olfactory-auditory integration are rare. Here, we investigated neural activity patterns and odor decoding in the lateral entorhinal cortex (LEC) under uni-sensory and multisensory stimuli in awake, head-fixed mice. Using specific retrograde tracing, we verified that the LEC receives direct inputs from the primary auditory cortex (AC) and the medial geniculate body (MGB). Strikingly, we found that mitral/tufted cells (M/Ts) in the olfactory bulb (OB) and neurons in the LEC respond to both olfactory and auditory stimuli. Sound decreased the neural responses evoked by odors in both the OB and LEC, for both excitatory and inhibitory responses. Interestingly, significant changes in odor decoding performance and modulation of odor-evoked local field potentials (LFPs) were observed only in the LEC. These data indicate that the LEC is a critical center for olfactory-auditory multisensory integration, with direct projections from both olfactory and auditory centers.

Scent-delivery devices as a digital healthcare tool for olfactory training: A pilot focus group study in Parkinson's disease patients

Parkinson's disease (PD) patients display a combination of motor and non-motor symptoms. The most common non-motor symptom is scent (olfactory) impairment, occurring at least four years prior to motor symptom onset. Recent and growing interest in digital healthcare technology used in PD has resulted in more technologies developed for motor rather than non-motor symptoms. Human-computer interaction (HCI), which uses computer technology to explore human activity and work, could be combined with digital healthcare technologies to better understand and support olfaction via scent training - leading to the development of a scent-delivery device (SDD). In this pilot study, three PD patients were invited to an online focus group to explore the association between PD and olfaction, understand HCI and sensory technologies and were demonstrated a new multichannel SDD with an associated mobile app. Participants had a preconceived link, a result of personal experience, between olfactory impairment and PD. Participants felt that healthcare professionals did not take olfactory dysfunction concerns seriously prior to PD diagnosis. Two were not comfortable with sharing scent loss experiences with others. Participants expected the multichannel SDD to be small, portable and easy-to-use, with customisable cartridges to deliver chosen scents and the mobile app to create a sense of community. None of the participants regularly performed scent training but would consider doing so if some scent function could be regained. Standardised digital SDDs for regular healthcare check-ups may facilitate improvement in olfactory senses in PD patients and potential earlier PD diagnosis, allowing earlier therapeutic and symptomatic PD management.

Central vestibular dysfunction: don't forget vestibular rehabilitation

INTRODUCTION

Vestibular rehabilitation (VR) is now a subject of active studies and has been shown to be effective for multiple vestibular disorders, peripheral or central. VR is a physical therapy that helps train the central nervous system to compensate for vestibular dysfunction. There is moderate to strong evidence that VR is safe and effective for the management of peripheral vestibular dysfunction. Nonetheless, the studies on how VR works on central vestibular dysfunction remains scanty.

AREAS COVERED

This article addressed the rehabilitation strategies and possible mechanisms, including how central vestibular function might improve upon rehabilitation. In addition, it provides some examples concerning the effect of VR on central vestibular dysfunction.

EXPERT OPINION

VR works on the vestibular system through repetition of specific physical exercises that activate central neuroplastic mechanisms to achieve adaptive compensation of the impaired functions. VR has become a mainstay in the management of patients with dizziness and balance dysfunction. Individualized VR programs are a safe and effective treatment option for a large percentage of patients with central vestibular disease reporting imbalance and dizziness. Exploration of various treatment strategies and possible mechanisms will help develop the best and personalized VR treatment for patients with central vestibular dysfunction.

Consumer Consciousness in Multisensory Extended Reality

The reality-virtuality continuum encompasses a multitude of objects, events and environments ranging from real-world multisensory inputs to interactive multisensory virtual simulators, in which sensory integration can involve very different combinations of both physical and digital inputs. These different ways of stimulating the senses can affect the consumer's consciousness, potentially altering their judgements and behaviours. In this perspective paper, we explore how technologies such as Augmented Reality (AR) and Virtual Reality (VR) can, by generating and modifying the human sensorium, act on consumer consciousness. We discuss the potential impact of this altered consciousness for consumer behaviour while, at the same time, considering how it may pave the way for further research.

OpenSync: An opensource platform for synchronizing multiple measures in neuroscience experiments

BACKGROUND

The human mind is multimodal. Yet most behavioral studies rely on century-old measures such as task accuracy and latency. To create a better understanding of human behavior and brain functionality, we should introduce other measures and analyze behavior from various aspects. However, it is technically complex and costly to design and implement the experiments that record multiple measures. To address this issue, a platform that allows synchronizing multiple measures from human behavior is needed.

METHOD

This paper introduces an opensource platform named OpenSync, which can be used to synchronize multiple measures in neuroscience experiments. This platform helps to automatically integrate, synchronize and record physiological measures (e.g., electroencephalogram (EEG), galvanic skin response (GSR), eye-tracking, body motion, etc.), user input response (e.g., from mouse, keyboard, joystick, etc.), and task-related information (stimulus markers). In this paper, we explain the structure and details of OpenSync, provide two case studies in PsychoPy and Unity. Comparison with existing tools: Unlike proprietary systems (e.g., iMotions), OpenSync is free and it can be used inside any opensource experiment design software (e.g., PsychoPy, OpenSesame, Unity, etc., https://pypi.org/project/OpenSync/ and https://github.com/moeinrazavi/OpenSync_Unity).

RESULTS

Our experimental results show that the OpenSync platform is able to synchronize multiple measures with microsecond resolution.

A Reflection on the State of Multisensory Human–Food Interaction Research

We present a perspective article on the state of multisensory human–food interaction (MHFI) research and lay out some reflections for research and development in this area of inquiry, based on a revision of the different spaces that we have co-created with researchers in this space. We begin by conceptualizing and defining MHFI, before moving onto presenting some of its major themes, as well as possible ways in which such themes can guide future research in the area. This article provides key definitions and foundations for the area of MHFI, as well as a first point of contact for those interested in it.

Impossible (Food) Experiences in Extended Reality

We introduce a model to think about impossible experiences in mixed and virtual reality, while emphasizing the role of said experiences in the context of food. This reality-impossibility model includes two continua, namely, the reality-fantasy character of objects and environments, and the extent to which they follow the laws of physics-other laws. We present a series of examples in each of the quadrants of the model and discuss both the research possibilities and implications of impossible experiences.

Getting started with virtual reality for sensory and consumer science: Current practices and future perspectives

While virtual reality (VR) has become increasingly popular in food-related research, there has been a lack of clarity, precision, and guidelines regarding what exactly constitutes a virtual reality study, as well as the options available to the researcher for designing and implementing it. This review provides a practical guide for sensory and consumer scientists interested in exploring the emerging opportunities offered by VR. We take a deep dive into the components that make up a VR study, including hardware, software, and response measurement methods, all the while being grounded in immersion and presence theory. We then review how these building blocks are put together to create two major categories of research scenarios: product selection, which can be entirely created in VR, and food evaluation, which involve tasting products in real life. For each category, we review current literature with a focus on experimental design, then highlight future avenues and technical development opportunities within sensory and consumer research. Finally, we evaluate limitations and ethical issues in VR food research, and offer future perspectives which go above and beyond ensuring ecological validity in product testing.