1
|
Cao S, Kelly J, Nyugen C, Chow HM, Leonardo B, Sabov A, Ciaramitaro VM. Prior visual experience increases children's use of effective haptic exploration strategies in audio-tactile sound-shape correspondences. J Exp Child Psychol 2024; 241:105856. [PMID: 38306737 DOI: 10.1016/j.jecp.2023.105856] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Revised: 12/21/2023] [Accepted: 12/23/2023] [Indexed: 02/04/2024]
Abstract
Sound-shape correspondence refers to the preferential mapping of information across the senses, such as associating a nonsense word like bouba with rounded abstract shapes and kiki with spiky abstract shapes. Here we focused on audio-tactile (AT) sound-shape correspondences between nonsense words and abstract shapes that are felt but not seen. Despite previous research indicating a role for visual experience in establishing AT associations, it remains unclear how visual experience facilitates AT correspondences. Here we investigated one hypothesis: seeing the abstract shapes improve haptic exploration by (a) increasing effective haptic strategies and/or (b) decreasing ineffective haptic strategies. We analyzed five haptic strategies in video-recordings of 6- to 8-year-old children obtained in a previous study. We found the dominant strategy used to explore shapes differed based on visual experience. Effective strategies, which provide information about shape, were dominant in participants with prior visual experience, whereas ineffective strategies, which do not provide information about shape, were dominant in participants without prior visual experience. With prior visual experience, poking-an effective and efficient strategy-was dominant, whereas without prior visual experience, uncategorizable and ineffective strategies were dominant. These findings suggest that prior visual experience of abstract shapes in 6- to 8-year-olds can increase the effectiveness and efficiency of haptic exploration, potentially explaining why prior visual experience can increase the strength of AT sound-shape correspondences.
Collapse
Affiliation(s)
- Shibo Cao
- Department of Psychology, University of Massachusetts Boston, Boston, MA 02125, USA
| | - Julia Kelly
- Department of Psychology, University of Massachusetts Boston, Boston, MA 02125, USA
| | - Cuong Nyugen
- Department of Psychology, University of Massachusetts Boston, Boston, MA 02125, USA
| | - Hiu Mei Chow
- Department of Psychology, University of Massachusetts Boston, Boston, MA 02125, USA; Department of Psychology, St. Thomas University, Fredericton, New Brunswick E3B 5G3, Canada
| | - Brianna Leonardo
- Department of Psychology, University of Massachusetts Boston, Boston, MA 02125, USA
| | - Aleksandra Sabov
- Department of Psychology, University of Massachusetts Boston, Boston, MA 02125, USA
| | - Vivian M Ciaramitaro
- Department of Psychology, University of Massachusetts Boston, Boston, MA 02125, USA.
| |
Collapse
|
2
|
Gönül G, Takmaz E, Hohenberger A. Preschool children's use of perceptual-motor knowledge and hierarchical representational skills for tool making. Acta Psychol (Amst) 2021; 220:103415. [PMID: 34517261 DOI: 10.1016/j.actpsy.2021.103415] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2021] [Revised: 08/27/2021] [Accepted: 09/03/2021] [Indexed: 10/20/2022] Open
Abstract
Although other animals can make simple tools, the expanded and complex material culture of humans is unprecedented in the animal kingdom. Tool making is a slow and late-developing ability in humans, and preschool children find making tools to solve problems very challenging. This difficulty in tool making might be related to the lack of familiarity with the tools and may be overcome by children's long term perceptual-motor knowledge. Thus, in this study, the effect of tool familiarity on tool making was investigated with a task in which 5-to-6-year-old children (n = 75) were asked to remove a small bucket from a vertical tube. The results show that children are better at tool making if the tool and its relation to the task are familiar to them (e.g., soda straw). Moreover, we also replicated the finding that hierarchical complexity and tool making were significantly related. Results are discussed in light of the ideomotor approach.
Collapse
|
3
|
Puyo LMB, Capel HM, Phelan SK, Wiebe SA, Adams KD. Using a robotic teleoperation system for haptic exploration. J Rehabil Assist Technol Eng 2021; 8:2055668320969308. [PMID: 33912352 PMCID: PMC8050756 DOI: 10.1177/2055668320969308] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2020] [Accepted: 10/08/2020] [Indexed: 11/15/2022] Open
Abstract
Introduction When children with physical impairments cannot perform hand movements for
haptic exploration, they miss opportunities to learn about object
properties. Robotics systems with haptic feedback may better enable object
exploration. Methods Twenty-four adults and ten children without physical impairments, and one
adult with physical impairments, explored tools to mix substances or
transport different sized objects. All participants completed the tasks with
both a robotic system and manual exploration. Exploratory procedures used to
determine object properties were also observed. Results Adults and children accurately identified appropriate tools for each task
using manual exploration, but they were less accurate using the robotic
system. The adult with physical impairment identified appropriate tools for
transport in both conditions, however had difficulty identifying tools used
for mixing substances. A new exploratory procedure was observed, Tapping,
when using the robotic system. Conclusions Adults and children could make judgements on tool utility for tasks using
both manual exploration and the robotic system, however they experienced
limitations in the robotics system that require more study. The adult with
disabilities required less assistance to explore tools when using the
robotic system. The robotic system may be a feasible way for individuals
with physical disabilities to perform haptic exploration.
Collapse
Affiliation(s)
- Lina M Becerra Puyo
- Faculty of Rehabilitation Medicine, University of Alberta, Edmonton, AB, Canada
| | - Heather M Capel
- Faculty of Rehabilitation Medicine, University of Alberta, Edmonton, AB, Canada
| | - Shanon K Phelan
- School of Occupational Therapy, Faculty of Health, Dalhousie University, Halifax, NS, Canada
| | - Sandra A Wiebe
- Faculty of Arts, University of Alberta, Edmonton, AB, Canada
| | - Kim D Adams
- Faculty of Rehabilitation Medicine, University of Alberta, Edmonton, AB, Canada
| |
Collapse
|
4
|
Becerra L, Pedrozo Campos Antunes T, Capel HM, Wiebe SA, Adams KD. Testing of an assistive robot system for haptic exploration of objects. Assist Technol 2020; 32:144-152. [PMID: 30148684 DOI: 10.1080/10400435.2018.1508094] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022] Open
Abstract
INTRODUCTION When children with physical impairments cannot perform hand movements for haptic exploration, they may miss opportunities to learn the properties of objects. Assistive robots may enable them to make manipulation actions. OBJECTIVE To examine the differences between using a robotic teleoperation system with haptic feedback and manual exploration when making perceptual comparisons about object properties. Accuracy and exploratory procedures (EP) using the system were compared to those in manual exploration. METHOD Twenty adults without physical disabilities and ten typically developing children manipulated four pairs of objects and chose one based on size, roughness, hardness and shape. All participants completed the task with the robotic system (Tech) and manual exploration (No Tech), with the order counterbalanced. RESULTS AND CONCLUSION Participants performed a previously unidentified EP, "tapping", in the Tech condition. Enclosure was not possible with the robot end effector, but tapping afforded the required perceptual information. Adults' perceptual comparisons were always accurate and they predominantly performed the optimum EP in both conditions. Even when children performed the optimum EP with the system, their answers were less accurate than with manual exploration. Most gave the correct answer, except for hardness, which was likely due to mechanical flexibility in the robotic system.
Collapse
Affiliation(s)
- Lina Becerra
- Faculty of Rehabilitation Medicine,University of Alberta, Edmonton, AB, Canada
| | - Thaiany Pedrozo Campos Antunes
- Faculty of Rehabilitation Medicine,University of Alberta, Edmonton, AB, Canada.,Department of Health Sciences, Faculty of Medicine of ABC, Santo André, SP, Brazil
| | - Heather M Capel
- Faculty of Rehabilitation Medicine,University of Alberta, Edmonton, AB, Canada
| | - Sandra A Wiebe
- Department of Psychology, University of Alberta, Edmonton, AB, Canada
| | - Kim D Adams
- Faculty of Rehabilitation Medicine,University of Alberta, Edmonton, AB, Canada
| |
Collapse
|
5
|
Gönül G, Hohenberger A, Corballis M, Henderson AME. Joint and individual tool making in preschoolers: From social to cognitive processes. SOCIAL DEVELOPMENT 2019. [DOI: 10.1111/sode.12373] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Affiliation(s)
- Gökhan Gönül
- Department of Cognitive Science, Graduate School of Informatics Middle East Technical University Ankara Turkey
| | - Annette Hohenberger
- Department of Cognitive Science, Graduate School of Informatics Middle East Technical University Ankara Turkey
| | | | | |
Collapse
|
6
|
Taylor S, Girdler S, McCutcheon S, McLean B, Parsons R, Falkmer T, Jacoby P, Carey L, Elliott C. Haptic Exploratory Procedures of Children and Youth with and without Cerebral Palsy. Phys Occup Ther Pediatr 2019; 39:337-351. [PMID: 29944033 DOI: 10.1080/01942638.2018.1477228] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Abstract
Aims: Compare haptic exploratory procedures (EPs) and exploratory movements (EMs) of children. This study also tested the interrater reliability of a novel digital recording method. Methods: Participants were 31 children with typical development (TD) (aged 6 years 1 month to 15 years 9 months; 14 male) and 23 children with spastic unilateral cerebral palsy (CP) (aged 6 years to 15 years 5 months; 13 males; right hemiplegia, n = 12). Results: There were no statistically significant differences between groups for expected EP (p = .15), additional EPs (p = .78), or EMs (p = .69) but there was for mean duration of exploration (p < .001) and accuracy (p < .001). This suggests that although children with CP performed similar haptic EPs for each object as children with TD, they took more time and were less accurate in their identification. There was substantial agreement between the two raters' observations of expected EP, κ = .64, p < .0005. Conclusion: Children with CP performed similar haptic EPs as their TD peers. However, despite similarities, the results indicate that for children with CP manual ability was not the primary determinant of accuracy or speed of identification. This study provides evidence for a reliable method of recording haptic EPs.
Collapse
Affiliation(s)
- Susan Taylor
- a School of Occupational Therapy and Social Work , Curtin University , Perth , Australia.,c Paediatric Rehabilitation Department , Princess Margaret Hospital for Children , Perth , Australia
| | - Sonya Girdler
- a School of Occupational Therapy and Social Work , Curtin University , Perth , Australia.,f Population Sciences , Telethon Kids Institute , Perth , Australia
| | - Sara McCutcheon
- a School of Occupational Therapy and Social Work , Curtin University , Perth , Australia
| | - Belinda McLean
- b School of Paediatrics and Child Health , University of Western Australia , Perth , Australia.,c Paediatric Rehabilitation Department , Princess Margaret Hospital for Children , Perth , Australia
| | - Richard Parsons
- a School of Occupational Therapy and Social Work , Curtin University , Perth , Australia
| | - Torbjorn Falkmer
- a School of Occupational Therapy and Social Work , Curtin University , Perth , Australia
| | - Peter Jacoby
- f Population Sciences , Telethon Kids Institute , Perth , Australia
| | - Leeanne Carey
- d School of Allied Health , La Trobe University , Melbourne , Australia.,e Neurorehabilitation and Recovery , The Florey Institute of Neuroscience and Mental Health , Melbourne , Australia
| | - Catherine Elliott
- a School of Occupational Therapy and Social Work , Curtin University , Perth , Australia.,c Paediatric Rehabilitation Department , Princess Margaret Hospital for Children , Perth , Australia
| |
Collapse
|