1
|
Okayasu T, Nishimura T, Yamashita A, Nagatani Y, Inoue T, Uratani Y, Yamanaka T, Hosoi H, Kitahara T. Word Categorization of Vowel Durational Changes in Speech-Modulated Bone-Conducted Ultrasound. Audiol Res 2021; 11:357-364. [PMID: 34287242 PMCID: PMC8293211 DOI: 10.3390/audiolres11030033] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Revised: 07/03/2021] [Accepted: 07/12/2021] [Indexed: 11/16/2022] Open
Abstract
Ultrasound can deliver speech information when it is amplitude-modulated with speech and presented via bone conduction. This speech-modulated bone-conducted ultrasound (SM-BCU) can also transmit prosodic information. However, there is insufficient research on the recognition of vowel duration in SM-BCU. The aim of this study was to investigate the categorization of vowel durational changes in SM-BCU using a behavioral test. Eight Japanese-speaking participants with normal hearing participated in a forced-choice behavioral task to discriminate between "hato" (pigeon) and "haato" (heart). Speech signal stimuli were presented in seven duration grades from 220 ms to 340 ms. The threshold at which 50% of responses were "haato" was calculated and compared for air-conducted audible sound (ACAS) and SM-BCU. The boundary width was also evaluated. Although the SM-BCU threshold (mean: 274.6 ms) was significantly longer than the ACAS threshold (mean: 269.6 ms), there were no differences in boundary width. These results suggest that SM-BCU can deliver prosodic information about vowel duration with a similar difference limen to that of ACAS in normal hearing.
Collapse
Affiliation(s)
- Tadao Okayasu
- Department of Otolaryngology-Head and Neck Surgery, Nara Medical University, 840 Shijo-cho, Kashihara 634-8522, Japan; (T.N.); (A.Y.); (Y.U.); (T.Y.); (T.K.)
- Correspondence: ; Tel.: +81-744223051
| | - Tadashi Nishimura
- Department of Otolaryngology-Head and Neck Surgery, Nara Medical University, 840 Shijo-cho, Kashihara 634-8522, Japan; (T.N.); (A.Y.); (Y.U.); (T.Y.); (T.K.)
| | - Akinori Yamashita
- Department of Otolaryngology-Head and Neck Surgery, Nara Medical University, 840 Shijo-cho, Kashihara 634-8522, Japan; (T.N.); (A.Y.); (Y.U.); (T.Y.); (T.K.)
| | - Yoshiki Nagatani
- Pixie Dust Technologies, 3F, 4F, Sumitomo Fudosan Suidobashi Nisiguchi Bldg, 2-20-5, Kanda-Misakicho, Chiyoda-ku, Tokyo 101-0061, Japan;
| | - Takashi Inoue
- Institute for Clinical and Translational Science, Nara Medical Univesity, 840 Shijo-cho, Kashihara 634-8522, Japan;
| | - Yuka Uratani
- Department of Otolaryngology-Head and Neck Surgery, Nara Medical University, 840 Shijo-cho, Kashihara 634-8522, Japan; (T.N.); (A.Y.); (Y.U.); (T.Y.); (T.K.)
| | - Toshiaki Yamanaka
- Department of Otolaryngology-Head and Neck Surgery, Nara Medical University, 840 Shijo-cho, Kashihara 634-8522, Japan; (T.N.); (A.Y.); (Y.U.); (T.Y.); (T.K.)
| | - Hiroshi Hosoi
- MBT (Medicine-Based Town) Institute, Nara Medical University, 840 Shijo-cho, Kashihara 634-8522, Japan;
| | - Tadashi Kitahara
- Department of Otolaryngology-Head and Neck Surgery, Nara Medical University, 840 Shijo-cho, Kashihara 634-8522, Japan; (T.N.); (A.Y.); (Y.U.); (T.Y.); (T.K.)
| |
Collapse
|
2
|
Nishimura T, Okayasu T, Yamashita A, Hosoi H, Kitahara T. Perception Mechanism of Bone-Conducted Ultrasound and Its Clinical Use. Audiol Res 2021; 11:244-253. [PMID: 34070877 PMCID: PMC8261637 DOI: 10.3390/audiolres11020022] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Revised: 05/15/2021] [Accepted: 05/28/2021] [Indexed: 12/13/2022] Open
Abstract
It is generally believed that ultrasound cannot be heard. However, ultrasound is audible when it is presented through bone conduction. Bone-conducted ultrasound (BCU) has unique characteristics; the most interesting is its perception in patients with profound deafness. Some patients can perceive it and discriminate speech-modulated BCU. Previous reports have suggested that BCU can be used for a hearing aid or tinnitus sound therapy. In this review, the perception of BCU at both the peripheral and central levels was investigated based on previous studies, although some of them remain controversial. We also investigated the clinical use of BCU. To develop hearing aids utilizing BCU, the encoding of speech signals into BCU has to be established. The outcomes of the reported speech modulations were evaluated. Furthermore, the suppression of tinnitus by BCU was reviewed, and the feasibility of the application of BCU to tinnitus treatment was investigated.
Collapse
Affiliation(s)
- Tadashi Nishimura
- Department of Otolaryngology-Head and Neck Surgery, Nara Medical University, 840 Shijo-cho, Kashihara, Nara 634-8522, Japan; (T.O.); (A.Y.); (T.K.)
- Correspondence: ; Tel.: +81-744-22-3051
| | - Tadao Okayasu
- Department of Otolaryngology-Head and Neck Surgery, Nara Medical University, 840 Shijo-cho, Kashihara, Nara 634-8522, Japan; (T.O.); (A.Y.); (T.K.)
| | - Akinori Yamashita
- Department of Otolaryngology-Head and Neck Surgery, Nara Medical University, 840 Shijo-cho, Kashihara, Nara 634-8522, Japan; (T.O.); (A.Y.); (T.K.)
| | - Hiroshi Hosoi
- MBT (Medicine-Based Town) Institute, Nara Medical University, 840 Shijo-cho, Kashihara, Nara 634-8522, Japan;
| | - Tadashi Kitahara
- Department of Otolaryngology-Head and Neck Surgery, Nara Medical University, 840 Shijo-cho, Kashihara, Nara 634-8522, Japan; (T.O.); (A.Y.); (T.K.)
| |
Collapse
|
3
|
Okayasu T, Nishimura T, Uratani Y, Yamashita A, Nakagawa S, Yamanaka T, Hosoi H, Kitahara T. Temporal window of integration estimated by omission in bone-conducted ultrasound. Neurosci Lett 2018; 696:1-6. [PMID: 30476566 DOI: 10.1016/j.neulet.2018.11.035] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2018] [Revised: 11/20/2018] [Accepted: 11/22/2018] [Indexed: 10/27/2022]
Abstract
Bone-conducted ultrasound (BCU) can be heard for both normal-hearing and some profoundly deaf individuals. Moreover, amplitude-modulated BCU can transmit the speech signal. These characteristics of BCU provide the possibility of the developing a bone-conducted ultrasonic hearing aid. Previous studies on the perception mechanism of speech-modulated BCU have pointed to the importance of temporal rather than frequency information. In order to elucidate the perception of speech-modulated BCU, further investigation is need concerning the processing of temporal information. The temporal processing of air-conducted audible sounds (ACASs) involves the integration of closely presented sounds into a single information unit. The long-temporal window of integration was estimated approximately 150-200 ms, which contribute to the discrimination of speech sound. The present study investigated the long-temporal integration system for BCU evaluated by stimulus omission using magnetoencephalography. Eight participants with normal hearing took part in this study. Ultrasonic tone burst with the duration of 50 ms and frequency of 30 kHz was used as the standard stimulus and presented with steady onset-to-onset times or stimulus-onset asynchronies (SOAs). In each sequence, the duration of the SOAs were set to 100, 125, 150, 175, 200, or 350 ms. For deviant, tones were randomly omitted from the stimulus train. Definite mismatch fields were elicited by sound omission in the stimulus train with an SOA of 100-150 ms, but weren't with an SOA of 200 and 350 ms for all participants. We found that stimulus train for BCUs can be integrated within a temporal window of integration with an SOA of 100-150 ms, but are regarded as a separate event when the SOA is 200 or 350 ms in duration. Therefore, we demonstrated that the long-temporal window of integration for BCUs estimated by omission was 150-200 ms, which was similar to that for ACAS (Yabe et al. NeuroReport 8 (1997) 1971-1974 and Psychophysiology. 35 (1998) 615-619). These findings contribute to the elucidation and improvement of the perception of speech-modulated BCU.
Collapse
Affiliation(s)
- Tadao Okayasu
- Department of Otolaryngology-Head and Neck Surgery, Nara Medical University, 840 Shijo-cho, Kashihara, Nara 634-8522, Japan.
| | - Tadashi Nishimura
- Department of Otolaryngology-Head and Neck Surgery, Nara Medical University, 840 Shijo-cho, Kashihara, Nara 634-8522, Japan.
| | - Yuka Uratani
- Department of Otolaryngology-Head and Neck Surgery, Nara Medical University, 840 Shijo-cho, Kashihara, Nara 634-8522, Japan.
| | - Akinori Yamashita
- Department of Otolaryngology-Head and Neck Surgery, Nara Medical University, 840 Shijo-cho, Kashihara, Nara 634-8522, Japan.
| | - Seiji Nakagawa
- Center for Frontier Medical Engineering, Chiba University, 1-33 Yayoi-cho, Inage-ku, Chiba 263-8522, Japan; Department of Medical Engineering, Graduate School of Engineering, Chiba University, 1-33 Yayoi-cho, Inage-ku, Chiba 263-8522, Japan; University Hospital Med-Tech Link Center, Chiba University, 1-33 Yayoi-cho, Inage-ku, Chiba 263-8522, Japan; Biomedical Research Institute, National Institute of Advanced Industrial Science and Technology (AIST), 1-8-31 Midorigaoka, Ikeda, Osaka 563-8577, Japan.
| | - Toshiaki Yamanaka
- Department of Otolaryngology-Head and Neck Surgery, Nara Medical University, 840 Shijo-cho, Kashihara, Nara 634-8522, Japan.
| | - Hiroshi Hosoi
- President's Office, Nara Medical University, 840 Shijo-cho, Kashihara, Nara 634-8522, Japan.
| | - Tadashi Kitahara
- Department of Otolaryngology-Head and Neck Surgery, Nara Medical University, 840 Shijo-cho, Kashihara, Nara 634-8522, Japan.
| |
Collapse
|
4
|
Nishimura T, Uratani Y, Okayasu T, Nakagawa S, Hosoi H. Magnetoencephalographic study on forward suppression by ipsilateral, contralateral, and binaural maskers. PLoS One 2013; 8:e66225. [PMID: 23762482 PMCID: PMC3675151 DOI: 10.1371/journal.pone.0066225] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2013] [Accepted: 05/02/2013] [Indexed: 11/19/2022] Open
Abstract
When two tones are presented in a short time interval, the response to the second tone is suppressed. This phenomenon is referred to as forward suppression. To address the effect of the masker laterality on forward suppression, magnetoencephalographic responses were investigated for eight subjects with normal hearing when the preceding maskers were presented ipsilaterally, contralaterally, and binaurally. We employed three masker intensity conditions: the ipsilateral-strong, left-right-balanced, and contralateral-strong conditions. Regarding the responses to the maskers without signal, the N1m amplitude evoked by the left and binaural maskers was significantly larger than that evoked by the right masker for the left-strong and left-right-balanced conditions. No significant difference was observed for the right-strong condition. Regarding the subsequent N1m amplitudes, they were attenuated by the presence of the left, binaural, and right maskers for all conditions. For the left- and right-strong conditions, the subsequent N1m amplitude in the presence of the left masker was smaller than those of the binaural and right maskers. No difference was observed between the binaural and right masker presentation. For left-right-balanced condition, the subsequent N1m amplitude decreased in the presence of the right, binaural, and left maskers in that order. If the preceding activity reflected the ability to suppress the subsequent activity, the forward suppression by the left masker would be superior to that by the right masker for the left-strong and left-right-balanced conditions. Furthermore, the forward suppression by the binaural masker would be expected to be superior to that by the left masker owing to additional afferent activity from the right ear. Thus, the current results suggest that the forward suppression by ipsilateral maskers is superior to that by contralateral maskers although both maskers evoked the N1m amplitudes to the same degree. Additional masker at the contralateral ear can attenuate the forward suppression by the ipsilateral masker.
Collapse
Affiliation(s)
- Tadashi Nishimura
- Department of Otolaryngology-Head and Neck surgery, Nara Medical University, Nara, Japan.
| | | | | | | | | |
Collapse
|
5
|
Okayasu T, Nishimura T, Yamashita A, Nakagawa S, Nagatani Y, Yanai S, Uratani Y, Hosoi H. Duration-dependent growth of N1m for speech-modulated bone-conducted ultrasound. Neurosci Lett 2011; 495:72-6. [PMID: 21439350 DOI: 10.1016/j.neulet.2011.03.044] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2011] [Revised: 03/14/2011] [Accepted: 03/16/2011] [Indexed: 10/18/2022]
Abstract
Bone-conducted ultrasound (BCU) modulated by speech sound is recognized as speech sound and activates the auditory cortex similar to audible sound. To investigate the mechanisms of perception, the effects of stimulus duration on N1m were compared among air-conducted audible speech sound (AC speech), AC speech with carrier BCU and speech-modulated BCU in eight native Japanese with normal hearing. The Japanese vowel sound /a/ was used as a stimulus with durations of 10, 15, 20, 30, 40 and 60 ms. Comparison between AC speech with and without carrier showed that the presentation of carrier had no effect on N1m evoked by AC speech. Comparison among the three conditions showed that N1m amplitude for speech-modulated BCU differed from that for the two AC speeches. Moreover, N1m amplitude growth saturated at 40 ms for speech-modulated BCU, and at 20 ms for two AC speeches. These results suggest a difference in temporal integration of N1m between speech-modulated BCU and AC speech. Considering these results, it is reasonable to conclude that N1m evoked by speech-modulated BCU is influenced mainly by the ultrasonic component rather than demodulated audible sound. Given this finding, the notion needs to be considered that the mechanisms underlying perception and recognition of speech-modulated BCU depend on the ultrasonic component to some extent.
Collapse
Affiliation(s)
- Tadao Okayasu
- Department of Otolaryngology, Nara Medical University, 840 Shijo-cho, Kashihara Nara 634-8522, Japan.
| | | | | | | | | | | | | | | |
Collapse
|
6
|
Nishimura T, Okayasu T, Uratani Y, Fukuda F, Saito O, Hosoi H. Peripheral perception mechanism of ultrasonic hearing. Hear Res 2011; 277:176-83. [PMID: 21238563 DOI: 10.1016/j.heares.2011.01.004] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/07/2010] [Revised: 01/04/2011] [Accepted: 01/06/2011] [Indexed: 10/18/2022]
Abstract
Ultrasound can be perceived by bone conduction, and its characteristics differ from those of air-conducted audible sound (ACAS) in some respects. Despite many studies on ultrasonic hearing, the details have not yet been clarified. In this study, to elucidate the perception mechanism, the masking of bone-conducted ultrasound (BCU) produced by ACAS and the sensitivity of BCU in hearing impaired subjects were evaluated. We found that BCU was masked by high frequency ACAS, especially in the frequency range of 10-14 kHz. The most effective masker frequency depended on masker intensity. For hearing impaired subjects, the pure tone thresholds at 1-8 kHz and the maximum audible frequencies at cut-off intensities of 70-100 dB HL were significantly associated with the BCU threshold (p < 0.01 or p < 0.05). No subjects with estimated total loss of the inner hair cell system in the cochlear basal turn could hear BCU. These results suggest the peripheral perceptual region to be located in the cochlea. The results of masking show the faster excitation spread to the lower frequency range, depending on the intensity. This faster excitation spread may be due to nonlinearity in cochlear mechanics, which may work even without cochlear amplifier, and induce unique characteristics of BCU.
Collapse
Affiliation(s)
- Tadashi Nishimura
- Department of Otolaryngology and Head & Neck surgery, Nara Medical University, 840 shijo-cho Kashihara, Nara 634-8522, Japan.
| | | | | | | | | | | |
Collapse
|
7
|
Fujimoto K, Nakagawa S, Tonoike M. Nonlinear explanation for bone-conducted ultrasonic hearing. Hear Res 2006; 204:210-5. [PMID: 15925206 DOI: 10.1016/j.heares.2005.02.004] [Citation(s) in RCA: 30] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/09/2004] [Accepted: 02/08/2005] [Indexed: 11/15/2022]
Abstract
Human listeners can perceive speech from a voice-modulated ultrasonic carrier presented via a bone-conduction stimulator. This study explored the psychoacoustic characteristics and underlying mechanisms of ultrasonic hearing by measuring difference limens for frequency (DLF) for pure tones modulated onto ultrasonic carriers. Human subjects were presented with two pulsed tones and asked to judge whether the first or the second had the higher pitch. When amplitude modulation was based on a double side-band transmitted carrier, the DLFs were as small as those from the air-conducted pure tones at 0.25-4 kHz. Ultrasounds yielded larger DLFs for tones with low (0.125 kHz) and high (6-8 kHz) frequencies. Results were essentially identical between the two types of carriers, sine wave (30 kHz) and bandpass noise (30+/-4 kHz), despite the different bandwidths in the ultrasonic range. When amplitude modulation was based on a double side-band suppressed carrier, DLFs corresponded to those from tones with double frequencies. These results suggest nonlinear conduction that demodulates audible signals from ultrasounds and provides inputs to the cochlea.
Collapse
Affiliation(s)
- Kiyoshi Fujimoto
- Institute for Human Science and Biomedical Engineering, National Institute of Advanced Industrial Science and Technology (AIST), 1-8-31 Midorigaoka, Ikeda, Osaka 563-8577, Japan.
| | | | | |
Collapse
|
8
|
Nishimura T, Nakagawa S, Sakaguchi T, Hosoi H, Tonoike M. Effect of a forward masker on the N1m amplitude: varying the signal delay. Neuroreport 2003; 14:891-3. [PMID: 12858055 DOI: 10.1097/00001756-200305060-00024] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
Auditory sensation is affected by a forward masker, and this phenomenon has been demonstrated in a neural adaptation model and a temporal window (integration) model. To study forward masking in the central auditory system, the growth of the N1m amplitude was measured by varying the signal delay. In the adaptation model, the masking increases as the signal delay decreases. However, in our results, the minimum N1m amplitude was observed at a signal delay of 40 ms. As the signal delay decreased from 40 ms, the N1m amplitude increased although the masking increased. Our results suggest that the growth of the N1m amplitude largely depends on temporal integration at signal delays below 40 ms.
Collapse
Affiliation(s)
- Tadashi Nishimura
- Department of Otolaryngology, Nara Medical University, 840 shijo-cho, Kashihara, Nara 634-8522, Japan.
| | | | | | | | | |
Collapse
|