Optoelectronic Synapses Based on MXene/Violet Phosphorus van der Waals Heterojunctions for Visual-Olfactory Crossmodal Perception

The crossmodal interaction of different senses, which is an important basis for learning and memory in the human brain, is highly desired to be mimicked at the device level for developing neuromorphic crossmodal perception, but related researches are scarce. Here, we demonstrate an optoelectronic synapse for vision-olfactory crossmodal perception based on MXene/violet phosphorus (VP) van der Waals heterojunctions. Benefiting from the efficient separation and transport of photogenerated carriers facilitated by conductive MXene, the photoelectric responsivity of VP is dramatically enhanced by 7 orders of magnitude, reaching up to 7.7 A W-1. Excited by ultraviolet light, multiple synaptic functions, including excitatory postsynaptic currents, paired-pulse facilitation, short/long-term plasticity and "learning-experience" behavior, were demonstrated with a low power consumption. Furthermore, the proposed optoelectronic synapse exhibits distinct synaptic behaviors in different gas environments, enabling it to simulate the interaction of visual and olfactory information for crossmodal perception. This work demonstrates the great potential of VP in optoelectronics and provides a promising platform for applications such as virtual reality and neurorobotics.

Representational momentum in vision and touch: Visual motion information biases tactile spatial localization

After an object disappears, the vanishing point is shifted in the direction of motion, a phenomenon known as representational momentum. The present study focused on the relationship between motion information and spatial location in a crossmodal setting. In two visuotactile experiments, we studied how motion information in one sensory modality affects the perceived final location of a motion signal (congruent vs. incongruent left-right motion direction) in another modality. The results revealed a unidirectional crossmodal influence of motion information on spatial localization performance. While visual motion information influenced the perceived final location of the tactile stimulus, tactile motion information had no influence on visual localization. These results therefore extend the existing literature on crossmodal influences on spatial location and are discussed in relation to current theories of multisensory perception.