1
|
Wang Z, Zhang Y, Zhao D, He R, Zhang Y, Wang D. Perceptually Inspired C 0-Continuity Haptic Shape Display with Trichamber Soft Actuators. Soft Robot 2024. [PMID: 38696661 DOI: 10.1089/soro.2023.0148] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/04/2024] Open
Abstract
Shape display devices composed of actuation pixels enable dynamic rendering of surface morphological features, which have important roles in virtual reality and metaverse applications. The traditional pin-array solution produces sidestep-like structures between neighboring pins and normally relies on high-density pins to obtain curved surfaces. It remains a challenge to achieve continuous curved surfaces using a small number of actuated units. To address the challenge, we resort to the concept of surface continuity in computational geometry and develop a C0-continuity shape display device with trichamber fiber-reinforced soft actuators. Each trichamber unit produces three-dimensional (3D) deformation consisting of elongation, pitch, and yaw rotation, thus ensuring rendered surface continuity using low-resolution actuation units. Inspired by human tactile discrimination threshold on height and angle gradients between adjacent units, we proposed the mathematical criteria of C0-continuity shape display and compared the maximal number of distinguishable shapes using the proposed device in comparison with typical pin-array. We then established a shape control model considering the nonlinearity of soft materials to characterize and control the soft device to display C0-continuity shapes. Experimental results showed that the proposed device with nine trichamber units could render typical sets of distinguishable C0-continuity shape sequence changes. We envision that the concept of C0-continuity shape display with 3D deformation capability could improve the fidelity of the rendered shapes in many metaverse scenarios such as touching human organs in medical palpation simulations.
Collapse
Affiliation(s)
- Zemin Wang
- State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China
| | - Yan Zhang
- State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China
| | - Dongjie Zhao
- State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China
| | - Ruibo He
- State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China
| | - Yuru Zhang
- State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China
| | - Dangxiao Wang
- State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China
- Robotics Institute, School of Mechanical Engineering and Automation, Beihang University, Beijing, China
- Peng Cheng Laboratory, Shenzhen, China
| |
Collapse
|
2
|
McMurray B. The myth of categorical perception. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2022; 152:3819. [PMID: 36586868 PMCID: PMC9803395 DOI: 10.1121/10.0016614] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Revised: 11/26/2022] [Accepted: 12/06/2022] [Indexed: 05/29/2023]
Abstract
Categorical perception (CP) is likely the single finding from speech perception with the biggest impact on cognitive science. However, within speech perception, it is widely known to be an artifact of task demands. CP is empirically defined as a relationship between phoneme identification and discrimination. As discrimination tasks do not appear to require categorization, this was thought to support the claim that listeners perceive speech solely in terms of linguistic categories. However, 50 years of work using discrimination tasks, priming, the visual world paradigm, and event related potentials has rejected the strongest forms of CP and provided little strong evidence for any form of it. This paper reviews the origins and impact of this scientific meme and the work challenging it. It discusses work showing that the encoding of auditory input is largely continuous, not categorical, and describes the modern theoretical synthesis in which listeners preserve fine-grained detail to enable more flexible processing. This synthesis is fundamentally inconsistent with CP. This leads to a different understanding of how to use and interpret the most basic paradigms in speech perception-phoneme identification along a continuum-and has implications for understanding language and hearing disorders, development, and multilingualism.
Collapse
Affiliation(s)
- Bob McMurray
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, Iowa 52242, USA
| |
Collapse
|
3
|
Leo F, Gori M, Sciutti A. Early blindness modulates haptic object recognition. Front Hum Neurosci 2022; 16:941593. [PMID: 36158621 PMCID: PMC9498977 DOI: 10.3389/fnhum.2022.941593] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2022] [Accepted: 08/16/2022] [Indexed: 11/13/2022] Open
Abstract
Haptic object recognition is usually an efficient process although slower and less accurate than its visual counterpart. The early loss of vision imposes a greater reliance on haptic perception for recognition compared to the sighted. Therefore, we may expect that congenitally blind persons could recognize objects through touch more quickly and accurately than late blind or sighted people. However, the literature provided mixed results. Furthermore, most of the studies on haptic object recognition focused on performance, devoting little attention to the exploration procedures that conducted to that performance. In this study, we used iCube, an instrumented cube recording its orientation in space as well as the location of the points of contact on its faces. Three groups of congenitally blind, late blind and age and gender-matched blindfolded sighted participants were asked to explore the cube faces where little pins were positioned in varying number. Participants were required to explore the cube twice, reporting whether the cube was the same or it differed in pins disposition. Results showed that recognition accuracy was not modulated by the level of visual ability. However, congenitally blind touched more cells simultaneously while exploring the faces and changed more the pattern of touched cells from one recording sample to the next than late blind and sighted. Furthermore, the number of simultaneously touched cells negatively correlated with exploration duration. These findings indicate that early blindness shapes haptic exploration of objects that can be held in hands.
Collapse
Affiliation(s)
- Fabrizio Leo
- Cognitive Architecture for Collaborative Technologies Unit, Istituto Italiano di Tecnologia, Genova, Italy
- *Correspondence: Fabrizio Leo,
| | - Monica Gori
- Unit for Visually Impaired People, Istituto Italiano di Tecnologia, Genova, Italy
| | - Alessandra Sciutti
- Cognitive Architecture for Collaborative Technologies Unit, Istituto Italiano di Tecnologia, Genova, Italy
| |
Collapse
|
4
|
A Narrative Review of Auditory Categorisation and Its Potential Role in Tinnitus Perception. JOURNAL OF OTORHINOLARYNGOLOGY, HEARING AND BALANCE MEDICINE 2022. [DOI: 10.3390/ohbm3030006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Auditory categorisation is a phenomenon reflecting the non-linear nature of human perceptual spaces which govern sound perception. Categorisation training paradigms may reduce sensitivity toward training stimuli, decreasing the representation of these stimuli in auditory perceptual maps. Reduced cortical representation may have clinical implications for conditions that arise from disturbances in cortical activation, such as tinnitus. This review explores the categorisation of sound, with a particular focus on tinnitus. The potential of categorisation training as a sound-based tinnitus therapy is discussed. A narrative review methodological framework was followed. Four databases (PubMed, Google Scholar, Scopus, and ScienceDirect) were extensively searched for the following key words: categorisation, categorical perception, perceptual magnet effect, generalisation, and categorisation OR categorical perception OR perceptual magnet effect OR generalisation AND sound. Given the exploratory nature of the review and the fact that early works on categorisation are crucial to the understanding and development of auditory categorisation, all study types were selected for the period 1950–2022. Reference lists of articles were reviewed to identify any further relevant studies. The results of the review were catalogued and organised into themes. In total, 112 articles were reviewed in full, from which 59 were found to contain relevant information and were included in the review. Key themes identified included categorical perception of speech stimuli, warping of the auditory perceptual space, categorisation versus discrimination, the presence of categorisation across several modalities, and categorisation as an innate versus learned feature. Although a substantial amount of work focused on evaluating the effects of categorisation training on sound perception, only two studies investigated the effects of categorisation training on tinnitus. Implementation of a categorisation-based perceptual training paradigm could serve as a promising means of tinnitus management by reversing the changes in cortical plasticity that are seen in tinnitus, in turn altering the representation of sound within the auditory cortex itself. In the instance that the categorisation training is successful, this would likely mean a decrease in the level of activity within the auditory cortex (and other associated cortical areas found to be hyperactive in tinnitus) as well as a reduction in tinnitus salience.
Collapse
|
5
|
Parker AN, Wallis GM, Obergrussberger R, Siebeck UE. Categorical face perception in fish: How a fish brain warps reality to dissociate "same" from "different". J Comp Neurol 2020; 528:2919-2928. [PMID: 32406088 DOI: 10.1002/cne.24947] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2019] [Revised: 04/14/2020] [Accepted: 04/28/2020] [Indexed: 11/07/2022]
Abstract
Categorical perception (CP) is the phenomenon by which a smoothly varying stimulus property undergoes a nonlinear transformation during processing in the brain. Consequently, the stimuli are perceived as belonging to distinct categories separated by a sharp boundary. Originally thought to be largely innate, the discovery of CP in tasks such as novel image discrimination has piqued the interest of cognitive scientists because it provides compelling evidence that learning can shape a category's perceptual boundaries. CP has been particularly closely studied in human face perception. In nonprimates, there is evidence for CP for sound and color discrimination, but not for image or face discrimination. Here, we investigate the potential for learned CP in a lower vertebrate, the damselfish Pomacentrus amboinensis. Specifically, we tested whether the ability of these fish to discriminate complex facial patterns tracked categorical rather than metric differences in the stimuli. We first trained the fish to discriminate sets of two facial patterns. Next, we morphed between these patterns and determined the just noticeable difference (JND) between a morph and original image. Finally, we tested for CP by analyzing the discrimination ability of the fish for pairs of JND stimuli along the spectrum of morphs between two original images. Discrimination performance was significant for the image pair straddling the boundary between categories, and chance for equivalent stimulus pairs on either side, thus producing the classic "category boundary" effect. Our results reveal how perception can be influenced in a top-down manner even in the absence of a visual cortex.
Collapse
Affiliation(s)
- Amira N Parker
- School of Biomedical Sciences, The University of Queensland, Brisbane, Queensland, Australia
| | - Guy M Wallis
- School of Human Movement and Nutrition Sciences, The University of Queensland, Brisbane, Queensland, Australia
| | - Rainer Obergrussberger
- School of Biomedical Sciences, The University of Queensland, Brisbane, Queensland, Australia
| | - Ulrike E Siebeck
- School of Biomedical Sciences, The University of Queensland, Brisbane, Queensland, Australia
| |
Collapse
|
6
|
Li Y, Seger C, Chen Q, Mo L. Left Inferior Frontal Gyrus Integrates Multisensory Information in Category Learning. Cereb Cortex 2020; 30:4410-4423. [DOI: 10.1093/cercor/bhaa029] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2019] [Revised: 12/31/2019] [Accepted: 01/22/2020] [Indexed: 12/12/2022] Open
Abstract
Abstract
Humans are able to categorize things they encounter in the world (e.g., a cat) by integrating multisensory information from the auditory and visual modalities with ease and speed. However, how the brain learns multisensory categories remains elusive. The present study used functional magnetic resonance imaging to investigate, for the first time, the neural mechanisms underpinning multisensory information-integration (II) category learning. A sensory-modality-general network, including the left insula, right inferior frontal gyrus (IFG), supplementary motor area, left precentral gyrus, bilateral parietal cortex, and right caudate and globus pallidus, was recruited for II categorization, regardless of whether the information came from a single modality or from multiple modalities. Putamen activity was higher in correct categorization than incorrect categorization. Critically, the left IFG and left body and tail of the caudate were activated in multisensory II categorization but not in unisensory II categorization, which suggests this network plays a specific role in integrating multisensory information during category learning. The present results extend our understanding of the role of the left IFG in multisensory processing from the linguistic domain to a broader role in audiovisual learning.
Collapse
Affiliation(s)
- You Li
- School of Psychology and Center for Studies of Psychological Application, South China Normal University, Guangzhou 510631, Guangdong, China
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, Guangdong, China
| | - Carol Seger
- School of Psychology and Center for Studies of Psychological Application, South China Normal University, Guangzhou 510631, Guangdong, China
- Department of Psychology, Colorado State University, Fort Collins, CO 80521 USA
| | - Qi Chen
- School of Psychology and Center for Studies of Psychological Application, South China Normal University, Guangzhou 510631, Guangdong, China
| | - Lei Mo
- School of Psychology and Center for Studies of Psychological Application, South China Normal University, Guangzhou 510631, Guangdong, China
| |
Collapse
|
7
|
|
8
|
Prause N, Park J, Leung S, Miller G. Women's Preferences for Penis Size: A New Research Method Using Selection among 3D Models. PLoS One 2015; 10:e0133079. [PMID: 26332467 PMCID: PMC4558040 DOI: 10.1371/journal.pone.0133079] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2015] [Accepted: 06/22/2015] [Indexed: 11/18/2022] Open
Abstract
Women's preferences for penis size may affect men's comfort with their own bodies and may have implications for sexual health. Studies of women's penis size preferences typically have relied on their abstract ratings or selecting amongst 2D, flaccid images. This study used haptic stimuli to allow assessment of women's size recall accuracy for the first time, as well as examine their preferences for erect penis sizes in different relationship contexts. Women (N = 75) selected amongst 33, 3D models. Women recalled model size accurately using this method, although they made more errors with respect to penis length than circumference. Women preferred a penis of slightly larger circumference and length for one-time (length = 6.4 inches/16.3 cm, circumference = 5.0 inches/12.7 cm) versus long-term (length = 6.3 inches/16.0 cm, circumference = 4.8 inches/12.2 cm) sexual partners. These first estimates of erect penis size preferences using 3D models suggest women accurately recall size and prefer penises only slightly larger than average.
Collapse
Affiliation(s)
- Nicole Prause
- Department of Psychiatry, University of California Los Angeles, Los Angeles, California, United States of America
- * E-mail:
| | - Jaymie Park
- Department of Psychiatry, University of California Los Angeles, Los Angeles, California, United States of America
| | - Shannon Leung
- Department of Psychiatry, University of California Los Angeles, Los Angeles, California, United States of America
| | - Geoffrey Miller
- Department of Psychology, University of New Mexico; Albuquerque, New Mexico, United States of America
| |
Collapse
|
9
|
Feldmann-Wüstefeld T, Schubö A. Action Planning Mediates Guidance of Visual Attention from Working Memory. J Ophthalmol 2015; 2015:387378. [PMID: 26171241 PMCID: PMC4485979 DOI: 10.1155/2015/387378] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2015] [Revised: 04/22/2015] [Accepted: 04/27/2015] [Indexed: 11/18/2022] Open
Abstract
Visual search is impaired when a salient task-irrelevant stimulus is presented together with the target. Recent research has shown that this attentional capture effect is enhanced when the salient stimulus matches working memory (WM) content, arguing in favor of attention guidance from WM. Visual attention was also shown to be closely coupled with action planning. Preparing a movement renders action-relevant perceptual dimensions more salient and thus increases search efficiency for stimuli sharing that dimension. The present study aimed at revealing common underlying mechanisms for selective attention, WM, and action planning. Participants both prepared a specific movement (grasping or pointing) and memorized a color hue. Before the movement was executed towards an object of the memorized color, a visual search task (additional singleton) was performed. Results showed that distraction from target was more pronounced when the additional singleton had a memorized color. This WM-guided attention deployment was more pronounced when participants prepared a grasping movement. We argue that preparing a grasping movement mediates attention guidance from WM content by enhancing representations of memory content that matches the distractor shape (i.e., circles), thus encouraging attentional capture by circle distractors of the memorized color. We conclude that templates for visual search, action planning, and WM compete for resources and thus cause interferences.
Collapse
Affiliation(s)
| | - Anna Schubö
- Philipps-University Marburg, 35037 Marburg, Germany
| |
Collapse
|
10
|
Lacey S, Sathian K. Visuo-haptic multisensory object recognition, categorization, and representation. Front Psychol 2014; 5:730. [PMID: 25101014 PMCID: PMC4102085 DOI: 10.3389/fpsyg.2014.00730] [Citation(s) in RCA: 60] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2014] [Accepted: 06/23/2014] [Indexed: 12/15/2022] Open
Abstract
Visual and haptic unisensory object processing show many similarities in terms of categorization, recognition, and representation. In this review, we discuss how these similarities contribute to multisensory object processing. In particular, we show that similar unisensory visual and haptic representations lead to a shared multisensory representation underlying both cross-modal object recognition and view-independence. This shared representation suggests a common neural substrate and we review several candidate brain regions, previously thought to be specialized for aspects of visual processing, that are now known also to be involved in analogous haptic tasks. Finally, we lay out the evidence for a model of multisensory object recognition in which top-down and bottom-up pathways to the object-selective lateral occipital complex are modulated by object familiarity and individual differences in object and spatial imagery.
Collapse
Affiliation(s)
- Simon Lacey
- Department of Neurology, Emory University School of Medicine Atlanta, GA, USA
| | - K Sathian
- Department of Neurology, Emory University School of Medicine Atlanta, GA, USA ; Department of Rehabilitation Medicine, Emory University School of Medicine Atlanta, GA, USA ; Department of Psychology, Emory University School of Medicine Atlanta, GA, USA ; Rehabilitation Research and Development Center of Excellence, Atlanta Veterans Affairs Medical Center Decatur, GA, USA
| |
Collapse
|