1
|
James LS, Baier AL, Page RA, Clements P, Hunter KL, Taylor RC, Ryan MJ. Cross-modal facilitation of auditory discrimination in a frog. Biol Lett 2022; 18:20220098. [PMID: 35765810 PMCID: PMC9240679 DOI: 10.1098/rsbl.2022.0098] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Accepted: 06/06/2022] [Indexed: 11/12/2022] Open
Abstract
Stimulation in one sensory modality can affect perception in a separate modality, resulting in diverse effects including illusions in humans. This can also result in cross-modal facilitation, a process where sensory performance in one modality is improved by stimulation in another modality. For instance, a simple sound can improve performance in a visual task in both humans and cats. However, the range of contexts and underlying mechanisms that evoke such facilitation effects remain poorly understood. Here, we demonstrated cross-modal stimulation in wild-caught túngara frogs, a species with well-studied acoustic preferences in females. We first identified that a combined visual and seismic cue (vocal sac movement and water ripple) was behaviourally relevant for females choosing between two courtship calls in a phonotaxis assay. We then found that this combined cross-modal stimulus rescued a species-typical acoustic preference in the presence of background noise that otherwise abolished the preference. These results highlight how cross-modal stimulation can prime attention in receivers to improve performance during decision-making. With this, we provide the foundation for future work uncovering the processes and conditions that promote cross-modal facilitation effects.
Collapse
Affiliation(s)
- Logan S. James
- Department of Integrative Biology, University of Texas, Austin, TX 78712, USA
- Smithsonian Tropical Research Institute, Apartado 0843-03092, Balboa, Ancón, Republic of Panama
| | - A. Leonie Baier
- Department of Integrative Biology, University of Texas, Austin, TX 78712, USA
- Smithsonian Tropical Research Institute, Apartado 0843-03092, Balboa, Ancón, Republic of Panama
| | - Rachel A. Page
- Smithsonian Tropical Research Institute, Apartado 0843-03092, Balboa, Ancón, Republic of Panama
| | - Paul Clements
- Henson School of Technology, Salisbury University, 1101 Camden Ave, Salisbury, MD 21801, USA
| | - Kimberly L. Hunter
- Department of Biological Sciences, Salisbury University, 1101 Camden Ave, Salisbury, MD 21801, USA
| | - Ryan C. Taylor
- Smithsonian Tropical Research Institute, Apartado 0843-03092, Balboa, Ancón, Republic of Panama
- Department of Biological Sciences, Salisbury University, 1101 Camden Ave, Salisbury, MD 21801, USA
| | - Michael J. Ryan
- Department of Integrative Biology, University of Texas, Austin, TX 78712, USA
- Smithsonian Tropical Research Institute, Apartado 0843-03092, Balboa, Ancón, Republic of Panama
| |
Collapse
|
2
|
Masutomi K, Kashino M. Frequency-change aftereffect produced by adaptation to real and illusory unidirectional frequency sweeps. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2013; 134:EL14-EL18. [PMID: 23862900 DOI: 10.1121/1.4807304] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
It was examined whether illusory and real continuities induce the frequency-change aftereffect, in which repeated exposure to a frequency sweep results in a shift in the perceived frequency change direction of a subsequent test sound. The magnitude of the aftereffect for different types of adaptors ("real sweep," "illusory sweep," and "sweep with gap") was compared. Listeners judged the direction of a frequency change of the test sound and showed a significant aftereffect only for the "real sweep" adaptors. The results suggest that the illusory sweeps are processed after the stage of frequency-change detection.
Collapse
Affiliation(s)
- Keiko Masutomi
- Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, 4259, Yokohama, Kanagawa 226-8503 Japan.
| | | |
Collapse
|
3
|
Kobayashi M, Kashino M. Effect of flanking sounds on the auditory continuity illusion. PLoS One 2012; 7:e51969. [PMID: 23251666 PMCID: PMC3522616 DOI: 10.1371/journal.pone.0051969] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2011] [Accepted: 11/14/2012] [Indexed: 11/23/2022] Open
Abstract
Background The auditory continuity illusion or the perceptual restoration of a target sound briefly interrupted by an extraneous sound has been shown to depend on masking. However, little is known about factors other than masking. Methodology/Principal Findings We examined whether a sequence of flanking transient sounds affects the apparent continuity of a target tone alternated with a bandpass noise at regular intervals. The flanking sounds significantly increased the limit of perceiving apparent continuity in terms of the maximum target level at a fixed noise level, irrespective of the frequency separation between the target and flanking sounds: the flanking sounds enhanced the continuity illusion. This effect was dependent on the temporal relationship between the flanking sounds and noise bursts. Conclusions/Significance The spectrotemporal characteristics of the enhancement effect suggest that a mechanism to compensate for exogenous attentional distraction may contribute to the continuity illusion.
Collapse
Affiliation(s)
- Maori Kobayashi
- Department of Science and Technology, Meiji University, Kawasaki, Kanagawa, Japan.
| | | |
Collapse
|
4
|
Shahin AJ, Miller LM. Multisensory integration enhances phonemic restoration. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2009; 125:1744-50. [PMID: 19275331 PMCID: PMC2663900 DOI: 10.1121/1.3075576] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2023]
Abstract
Phonemic restoration occurs when speech is perceived to be continuous through noisy interruptions, even when the speech signal is artificially removed from the interrupted epochs. This temporal filling-in illusion helps maintain robust comprehension in adverse environments and illustrates how contextual knowledge through the auditory modality (e.g., lexical) can improve perception. This study investigated how one important form of context, visual speech, affects phonemic restoration. The hypothesis was that audio-visual integration of speech should improve phonemic restoration, allowing the perceived continuity to span longer temporal gaps. Subjects listened to tri-syllabic words with a portion of each word replaced by white noise while watching lip-movement that was either congruent, temporally reversed (incongruent), or static. For each word, subjects judged whether the utterance sounded continuous or interrupted, where a "continuous" response indicated an illusory percept. Results showed that illusory filling-in of longer white noise durations (longer missing segments) occurred when the mouth movement was congruent with the spoken word compared to the other conditions, with no differences occurring between the static and incongruent conditions. Thus, phonemic restoration is enhanced when applying contextual knowledge through multisensory integration.
Collapse
Affiliation(s)
- Antoine J Shahin
- Center for Mind & Brain, University of California, Davis, California 95618, USA.
| | | |
Collapse
|