1
|
Scheller M, Nardini M. Correctly establishing evidence for cue combination via gains in sensory precision: Why the choice of comparator matters. Behav Res Methods 2024; 56:2842-2858. [PMID: 37730934 PMCID: PMC11133123 DOI: 10.3758/s13428-023-02227-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/27/2023] [Indexed: 09/22/2023]
Abstract
Studying how sensory signals from different sources (sensory cues) are integrated within or across multiple senses allows us to better understand the perceptual computations that lie at the foundation of adaptive behaviour. As such, determining the presence of precision gains - the classic hallmark of cue combination - is important for characterising perceptual systems, their development and functioning in clinical conditions. However, empirically measuring precision gains to distinguish cue combination from alternative perceptual strategies requires careful methodological considerations. Here, we note that the majority of existing studies that tested for cue combination either omitted this important contrast, or used an analysis approach that, unknowingly, strongly inflated false positives. Using simulations, we demonstrate that this approach enhances the chances of finding significant cue combination effects in up to 100% of cases, even when cues are not combined. We establish how this error arises when the wrong cue comparator is chosen and recommend an alternative analysis that is easy to implement but has only been adopted by relatively few studies. By comparing combined-cue perceptual precision with the best single-cue precision, determined for each observer individually rather than at the group level, researchers can enhance the credibility of their reported effects. We also note that testing for deviations from optimal predictions alone is not sufficient to ascertain whether cues are combined. Taken together, to correctly test for perceptual precision gains, we advocate for a careful comparator selection and task design to ensure that cue combination is tested with maximum power, while reducing the inflation of false positives.
Collapse
Affiliation(s)
- Meike Scheller
- Department of Psychology, Durham University, Durham, UK.
| | - Marko Nardini
- Department of Psychology, Durham University, Durham, UK
| |
Collapse
|
2
|
Gori M, Sciutti A, Torazza D, Campus C, Bollini A. The effect of visuo-haptic exploration on the development of the geometric cross-sectioning ability. J Exp Child Psychol 2024; 238:105774. [PMID: 37703720 DOI: 10.1016/j.jecp.2023.105774] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Revised: 08/23/2023] [Accepted: 08/23/2023] [Indexed: 09/15/2023]
Abstract
Cross-sectioning is a shape understanding task where the participants must infer and interpret the spatial features of three-dimensional (3D) solids by depicting their internal two-dimensional (2D) arrangement. An increasing body of research provides evidence of the crucial role of sensorimotor experience in acquiring these complex geometrical concepts. Here, we focused on how cross-sectioning ability emerges in young children and the influence of multisensory visuo-haptic experience in geometrical learning through two experiments. In Experiment 1, we compared the 3D printed version of the Santa Barbara Solids Test (SBST) with its classical paper version; in Experiment 2, we contrasted the children's performance in the SBST before and after the visual or visuo-haptic experience. In Experiment 1, we did not identify an advantage in visualizing 3D shapes over the classical 2D paper test. In contrast, in Experiment 2, we found that children who had the experience of a combination of visual and tactile information during the exploration phase improved their performance in the SBST compared with children who were limited to visual exploration. Our study demonstrates how practicing novel multisensory strategies improves children's understanding of complex geometrical concepts. This outcome highlights the importance of introducing multisensory experience in educational training and the need to make way for developing new technologies that could improve learning abilities in children.
Collapse
Affiliation(s)
- Monica Gori
- Unit for Visually Impaired People, Istituto Italiano di Tecnologia, 16152 Genoa, Italy
| | | | - Diego Torazza
- Robotics, Brain and Cognitive Sciences Unit, Istituto Italiano di Tecnologia, 16152 Genoa, Italy; Mechanical Workshop, Istituto Italiano di Tecnologia, 16152 Genoa, Italy
| | - Claudio Campus
- Unit for Visually Impaired People, Istituto Italiano di Tecnologia, 16152 Genoa, Italy
| | - Alice Bollini
- Unit for Visually Impaired People, Istituto Italiano di Tecnologia, 16152 Genoa, Italy.
| |
Collapse
|
3
|
Yang J, Ganea N, Kanazawa S, Yamaguchi MK, Bhattacharya J, Bremner AJ. Cortical signatures of visual body representation develop in human infancy. Sci Rep 2023; 13:14696. [PMID: 37679386 PMCID: PMC10484977 DOI: 10.1038/s41598-023-41604-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Accepted: 08/28/2023] [Indexed: 09/09/2023] Open
Abstract
Human infants cannot report their experiences, limiting what we can learn about their bodily awareness. However, visual cortical responses to the body, linked to visual awareness and selective attention in adults, can be easily measured in infants and provide a promising marker of bodily awareness in early life. We presented 4- and 8-month-old infants with a flickering (7.5 Hz) video of a hand being stroked and recorded steady-state visual evoked potentials (SSVEPs). In half of the trials, the infants also received tactile stroking synchronously with visual stroking. The 8-month-old, but not the 4-month-old infants, showed a significant enhancement of SSVEP responses when they received tactile stimulation concurrent with the visually observed stroking. Follow-up experiments showed that this enhancement did not occur when the visual hand was presented in an incompatible posture with the infant's own body or when the visual stimulus was a body-irrelevant video. Our findings provide a novel insight into the development of bodily self-awareness in the first year of life.
Collapse
Affiliation(s)
- Jiale Yang
- School of Psychology, Chukyo University, Nagoya, Japan.
| | - Natasa Ganea
- Child Study Center, Yale University, New Haven, CT, USA
| | - So Kanazawa
- Department of Psychology, Japan Women's University, Tokyo, Japan
| | | | | | - Andrew J Bremner
- Centre for Developmental Science, School of Psychology, University of Birmingham, Birmingham, UK
| |
Collapse
|
4
|
Setti W, Cuturi LF, Cocchi E, Gori M. Spatial Memory and Blindness: The Role of Visual Loss on the Exploration and Memorization of Spatialized Sounds. Front Psychol 2022; 13:784188. [PMID: 35686077 PMCID: PMC9171105 DOI: 10.3389/fpsyg.2022.784188] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Accepted: 04/21/2022] [Indexed: 11/20/2022] Open
Abstract
Spatial memory relies on encoding, storing, and retrieval of knowledge about objects’ positions in their surrounding environment. Blind people have to rely on sensory modalities other than vision to memorize items that are spatially displaced, however, to date, very little is known about the influence of early visual deprivation on a person’s ability to remember and process sound locations. To fill this gap, we tested sighted and congenitally blind adults and adolescents in an audio-spatial memory task inspired by the classical card game “Memory.” In this research, subjects (blind, n = 12; sighted, n = 12) had to find pairs among sounds (i.e., animal calls) displaced on an audio-tactile device composed of loudspeakers covered by tactile sensors. To accomplish this task, participants had to remember the spatialized sounds’ position and develop a proper mental spatial representation of their locations. The test was divided into two experimental conditions of increasing difficulty dependent on the number of sounds to be remembered (8 vs. 24). Results showed that sighted participants outperformed blind participants in both conditions. Findings were discussed considering the crucial role of visual experience in properly manipulating auditory spatial representations, particularly in relation to the ability to explore complex acoustic configurations.
Collapse
Affiliation(s)
- Walter Setti
- Unit for Visually Impaired People (U-VIP), Italian Institute of Technology, Genoa, Italy
- *Correspondence: Walter Setti,
| | - Luigi F. Cuturi
- Unit for Visually Impaired People (U-VIP), Italian Institute of Technology, Genoa, Italy
| | | | - Monica Gori
- Unit for Visually Impaired People (U-VIP), Italian Institute of Technology, Genoa, Italy
| |
Collapse
|
5
|
Gori M, Price S, Newell FN, Berthouze N, Volpe G. Multisensory Perception and Learning: Linking Pedagogy, Psychophysics, and Human–Computer Interaction. Multisens Res 2022; 35:335-366. [PMID: 35985654 DOI: 10.1163/22134808-bja10072] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Accepted: 02/21/2022] [Indexed: 11/19/2022]
Abstract
Abstract
In this review, we discuss how specific sensory channels can mediate the learning of properties of the environment. In recent years, schools have increasingly been using multisensory technology for teaching. However, it still needs to be sufficiently grounded in neuroscientific and pedagogical evidence. Researchers have recently renewed understanding around the role of communication between sensory modalities during development. In the current review, we outline four principles that will aid technological development based on theoretical models of multisensory development and embodiment to foster in-depth, perceptual, and conceptual learning of mathematics. We also discuss how a multidisciplinary approach offers a unique contribution to development of new practical solutions for learning in school. Scientists, engineers, and pedagogical experts offer their interdisciplinary points of view on this topic. At the end of the review, we present our results, showing that one can use multiple sensory inputs and sensorimotor associations in multisensory technology to improve the discrimination of angles, but also possibly for educational purposes. Finally, we present an application, the ‘RobotAngle’ developed for primary (i.e., elementary) school children, which uses sounds and body movements to learn about angles.
Collapse
Affiliation(s)
- Monica Gori
- U-VIP — Unit for Visually Impaired People, Fondazione Istituto Italiano di Tecnologia, Italy
| | - Sara Price
- Institute of Education, University College London, London, UK
| | - Fiona N. Newell
- Department of Psychology and Institute of Neuroscience, Trinity College Dublin, Dublin, Ireland
| | - Nadia Berthouze
- Interaction Centre, Div of Psychology & Lang Sciences, University College London, London, UK
| | - Gualtiero Volpe
- Casa Paganini — InfoMus, DIBRIS, University of Genoa, Genoa, Italy
| |
Collapse
|
6
|
Auditory distance perception in front and rear space. Hear Res 2022; 417:108468. [DOI: 10.1016/j.heares.2022.108468] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Revised: 01/22/2022] [Accepted: 02/12/2022] [Indexed: 11/21/2022]
|
7
|
Zaidel A, Laurens J, DeAngelis GC, Angelaki DE. Supervised Multisensory Calibration Signals Are Evident in VIP But Not MSTd. J Neurosci 2021; 41:10108-10119. [PMID: 34716232 PMCID: PMC8660052 DOI: 10.1523/jneurosci.0135-21.2021] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Revised: 08/23/2021] [Accepted: 09/17/2021] [Indexed: 11/21/2022] Open
Abstract
Multisensory plasticity enables our senses to dynamically adapt to each other and the external environment, a fundamental operation that our brain performs continuously. We searched for neural correlates of adult multisensory plasticity in the dorsal medial superior temporal area (MSTd) and the ventral intraparietal area (VIP) in 2 male rhesus macaques using a paradigm of supervised calibration. We report little plasticity in neural responses in the relatively low-level multisensory cortical area MSTd. In contrast, neural correlates of plasticity are found in higher-level multisensory VIP, an area with strong decision-related activity. Accordingly, we observed systematic shifts of VIP tuning curves, which were reflected in the choice-related component of the population response. This is the first demonstration of neuronal calibration, together with behavioral calibration, in single sessions. These results lay the foundation for understanding multisensory neural plasticity, applicable broadly to maintaining accuracy for sensorimotor tasks.SIGNIFICANCE STATEMENT Multisensory plasticity is a fundamental and continual function of the brain that enables our senses to adapt dynamically to each other and to the external environment. Yet, very little is known about the neuronal mechanisms of multisensory plasticity. In this study, we searched for neural correlates of adult multisensory plasticity in the dorsal medial superior temporal area (MSTd) and the ventral intraparietal area (VIP) using a paradigm of supervised calibration. We found little plasticity in neural responses in the relatively low-level multisensory cortical area MSTd. By contrast, neural correlates of plasticity were found in VIP, a higher-level multisensory area with strong decision-related activity. This is the first demonstration of neuronal calibration, together with behavioral calibration, in single sessions.
Collapse
Affiliation(s)
- Adam Zaidel
- Gonda Multidisciplinary Brain Research Center, Bar-Ilan University, Ramat Gan, 5290002, Israel
| | - Jean Laurens
- Ernst Strüngmann Institute for Neuroscience in Cooperation with Max Planck Society, Frankfurt 60528, Germany
| | - Gregory C DeAngelis
- Department of Brain and Cognitive Sciences, Center for Visual Science, University of Rochester, Rochester 14627, New York
| | - Dora E Angelaki
- Center for Neural Science and Tandon School of Engineering, New York University, New York 10003, New York
| |
Collapse
|
8
|
Cuturi LF, Cappagli G, Tonelli A, Cocchi E, Gori M. Perceiving size through sound in sighted and visually impaired children. COGNITIVE DEVELOPMENT 2021. [DOI: 10.1016/j.cogdev.2021.101125] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
9
|
Raimo S, Di Vita A, Boccia M, Iona T, Cropano M, Gaita M, Guariglia C, Grossi D, Palermo L. The Body across the Lifespan: On the Relation between Interoceptive Sensibility and High-Order Body Representations. Brain Sci 2021; 11:brainsci11040493. [PMID: 33924634 PMCID: PMC8070580 DOI: 10.3390/brainsci11040493] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2021] [Revised: 04/09/2021] [Accepted: 04/11/2021] [Indexed: 12/19/2022] Open
Abstract
Background: Interoceptive information plays a pivotal role in building higher-order cognitive body representations (BR) that neuropsychological and neuroimaging evidence classifies as action-oriented (i.e., body schema) or non-action-oriented (i.e., visuo-spatial body map). This study aimed to explore the development of BR, considering the association with the interoceptive sensibility throughout the lifespan. Methods: Two hundred thirty-nine healthy participants divided into five age groups (7 to 8 years; 9 to 10 years; 18 to 40 years; 41 to 60 years; over 60 years) completed a self-report measure of interoceptive sensibility (the Self-Awareness Questionnaire; SAQ) and were given tasks assessing the two BR (action-oriented: hand laterality task; non-action-oriented: frontal body evocation task). Results: Both children (7–8 and 9–10 years) and older adults (over 60 years) performed worse than young (18–40 years) and middle-aged adults (41–60 years) in action- and non-action-oriented BR tasks. Moderation analyses showed that the SAQ score significantly moderated the relationship between age and action-oriented BR. Conclusions: The current results are consistent with inverted U-shaped developmental curves for action- and non-action-oriented BR. As an innovative aspect, the ability to mentally represent one’s own body parts in diverse states could be negatively affected by higher interoceptive sensibility levels in childhood and late adulthood.
Collapse
Affiliation(s)
- Simona Raimo
- Department of Psychology, University of Campania ‘Luigi Vanvitelli’, 81100 Caserta, Italy; (M.C.); (D.G.)
- Correspondence: (S.R.); (L.P.); Tel.: +39-0961-3694362 (L.P.)
| | - Antonella Di Vita
- Department of Human Neuroscience, ‘Sapienza’ University of Rome, 00185 Rome, Italy;
| | - Maddalena Boccia
- Department of Psychology, Sapienza University of Rome, 00185 Rome, Italy; (M.B.); (C.G.)
- IRCCS Santa Lucia Foundation, 00179 Rome, Italy
| | - Teresa Iona
- Department of Experimental and Clinical Medicine, University ‘Magna Graecia’ of Catanzaro, 88100 Catanzaro, Italy;
| | - Maria Cropano
- Department of Psychology, University of Campania ‘Luigi Vanvitelli’, 81100 Caserta, Italy; (M.C.); (D.G.)
| | - Mariachiara Gaita
- Department of Medical and Surgical Sciences, University ‘Magna Graecia’ of Catanzaro, 88100 Catanzaro, Italy;
| | - Cecilia Guariglia
- Department of Psychology, Sapienza University of Rome, 00185 Rome, Italy; (M.B.); (C.G.)
- IRCCS Santa Lucia Foundation, 00179 Rome, Italy
| | - Dario Grossi
- Department of Psychology, University of Campania ‘Luigi Vanvitelli’, 81100 Caserta, Italy; (M.C.); (D.G.)
| | - Liana Palermo
- Department of Medical and Surgical Sciences, University ‘Magna Graecia’ of Catanzaro, 88100 Catanzaro, Italy;
- Correspondence: (S.R.); (L.P.); Tel.: +39-0961-3694362 (L.P.)
| |
Collapse
|
10
|
Yamasaki D, Ashida H. Size-Distance Scaling With Absolute and Relative Auditory Distance Information. Multisens Res 2020; 33:109-126. [PMID: 31648194 DOI: 10.1163/22134808-20191467] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2019] [Accepted: 08/10/2019] [Indexed: 11/19/2022]
Abstract
In the dynamic 3D space, it is critical for survival to perceive size of an object and rescale it with distance from an observer. Humans can perceive distance via not only vision but also audition, which plays an important role in the localization of objects, especially in visually ambiguous environments. However, whether and how auditory distance information contributes to visual size perception is not well understood. To address this issue, we investigated the efficiency of size-distance scaling by using auditory distance information that was conveyed by binaurally recorded auditory stimuli. We examined the effects of absolute distance information of a single sound sequence (Experiment 1) and relative distance information between two sound sequences (Experiment 2) on visual size estimation performances in darkened and well-lit environments. We demonstrated that humans could perform size-distance disambiguation by using auditory distance information even in darkness. Curiously, relative distance information was more efficient in size-distance scaling than absolute distance information, suggesting a high reliance on relative auditory distance information in our visual spatial experiences. The results highlight a benefit of audiovisual interaction for size-distance processing and calibration of external events under visually degraded situations.
Collapse
Affiliation(s)
- Daiki Yamasaki
- 1Graduate School of Letters, Kyoto University, Japan.,2Japan Society for the Promotion of Science, Japan
| | | |
Collapse
|
11
|
Rohlf S, Li L, Bruns P, Röder B. Multisensory Integration Develops Prior to Crossmodal Recalibration. Curr Biol 2020; 30:1726-1732.e7. [DOI: 10.1016/j.cub.2020.02.048] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2019] [Revised: 12/05/2019] [Accepted: 02/18/2020] [Indexed: 11/30/2022]
|
12
|
Gori M, Ober KM, Tinelli F, Coubard OA. Temporal representation impairment in developmental dyslexia for unisensory and multisensory stimuli. Dev Sci 2020; 23:e12977. [PMID: 32333455 PMCID: PMC7507191 DOI: 10.1111/desc.12977] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2018] [Revised: 12/16/2019] [Accepted: 12/24/2019] [Indexed: 11/29/2022]
Abstract
Dyslexia has been associated with a problem in visual-audio integration mechanisms. Here, we investigate for the first time the contribution of unisensory cues on multisensory audio and visual integration in 32 dyslexic children by modelling results using the Bayesian approach. Non-linguistic stimuli were used. Children performed a temporal task: they had to report whether the middle of three stimuli was closer in time to the first one or to the last one presented. Children with dyslexia, compared with typical children, exhibited poorer unimodal thresholds, requiring greater temporal distance between items for correct judgements, while multisensory thresholds were well predicted by the Bayesian model. This result suggests that the multisensory deficit in dyslexia is due to impaired audio and visual inputs rather than impaired multisensory processing per se. We also observed that poorer temporal skills correlated with lower reading skills in dyslexic children, suggesting that this temporal capability can be linked to reading abilities.
Collapse
Affiliation(s)
- Monica Gori
- U-VIP Unit for Visually Impaired People, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Kinga M Ober
- Faculty of Educational Studies, Adam Mickiewicz University, Poznan, Poland
| | - Francesca Tinelli
- Department of Developmental Neuroscience, Stella Maris Scientific Institute, Pisa, Italy
| | | |
Collapse
|
13
|
Sciutti A, Patanè L, Sandini G. Development of visual perception of others' actions: Children's judgment of lifted weight. PLoS One 2019; 14:e0224979. [PMID: 31730653 PMCID: PMC6857952 DOI: 10.1371/journal.pone.0224979] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2018] [Accepted: 10/25/2019] [Indexed: 11/24/2022] Open
Abstract
Humans are excellent at perceiving different features of the actions performed by others. For instance, by viewing someone else manipulating an unknown object, one can infer its weight–an intrinsic feature otherwise not directly accessible through vision. How such perceptual skill develops during childhood remains unclear. To confront this gap, the current study had children (N:63, 6–10 years old) and adults (N:21) judge the weight of objects after observing videos of an actor lifting them. Although 6-year-olds could already discriminate different weights, judgment accuracy had not reached adult-like levels by 10 years of age. Additionally, children’s stature was a more reliable predictor of their ability to read others’ actions than was their chronological age. This paper discusses the results in light of a potential link between motor development and action perception.
Collapse
Affiliation(s)
- Alessandra Sciutti
- Cognitive Architecture for Collaborative Technologies (CONTACT) Unit, Istituto Italiano di Tecnologia, Genova, Italy
- * E-mail:
| | - Laura Patanè
- Robotics, Brain and Cognitive Sciences Department, Istituto Italiano di Tecnologia, Genova, Italy
| | - Giulio Sandini
- Robotics, Brain and Cognitive Sciences Department, Istituto Italiano di Tecnologia, Genova, Italy
| |
Collapse
|
14
|
Abstract
Cortical body size representations are distorted in the adult, from low-level motor and sensory maps to higher levels multisensory and cognitive representations. Little is known about how such representations are built and evolve during infancy and childhood. Here we investigated how hand size is represented in typically developing children aged 6 to 10. Participants were asked to estimate their hand size using two different sensory modalities (visual or haptic). We found a distortion (underestimation) already present in the youngest children. Crucially, such distortion increases with age and regardless of the sensory modality used to access the representation. Finally, underestimation is specific for the body as no bias was found for object estimation. This study suggests that the brain does not keep up with the natural body growth. However, since motor behavior nor perception were impaired, the distortion seems functional and/or compensated for, for proper interaction with the external environment.
Collapse
|
15
|
Cuturi LF, Tonelli A, Cappagli G, Gori M. Coarse to Fine Audio-Visual Size Correspondences Develop During Primary School Age. Front Psychol 2019; 10:2068. [PMID: 31572264 PMCID: PMC6751278 DOI: 10.3389/fpsyg.2019.02068] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2019] [Accepted: 08/26/2019] [Indexed: 11/13/2022] Open
Abstract
Developmental studies have shown that children can associate visual size with non-visual and apparently unrelated stimuli, such as pure tone frequencies. Most research to date has focused on audio-visual size associations by showing that children can associate low pure tone frequencies with large objects, and high pure tone frequencies with small objects. Researchers relate these findings to coarser association, i.e., less precise associations for which binary categories of stimuli are used such as in the case of low versus high frequencies and large versus small visual stimuli. This study investigates how finer, more precise, crossmodal audio-visual associations develop during primary school age (from 6 to 11 years old). To unveil such patterns, we took advantage of a range of auditory pure tones and tested how primary school children match sounds with visually presented shapes. We tested 66 children (6-11 years old) in an audio-visual matching task involving a range of pure tone frequencies. Visual stimuli were circles or angles of different sizes. We asked participants to indicate the shape matching the sound. All children associated large objects/angles with low pitch, and small objects/angles with high pitch sounds. Interestingly, older children made greater use of intermediate visual sizes to provide their responses. Indeed, audio-visual associations for finer differences between stimulus features such as size and pure tone frequencies, may develop later depending on the maturation of supramodal size perception processes. Considering our results, we suggest that audio-visual size correspondences can be used for educational purposes by aiding the discrimination of sizes, including angles of different aperture. Moreover, their use should be shaped according to children's specific developmental stage.
Collapse
Affiliation(s)
- Luigi F. Cuturi
- Unit for Visually Impaired People, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Alessia Tonelli
- Unit for Visually Impaired People, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Giulia Cappagli
- Unit for Visually Impaired People, Istituto Italiano di Tecnologia, Genoa, Italy
- Fondazione “Istituto Neurologico Casimiro Mondino” (IRCSS), Pavia, Italy
| | - Monica Gori
- Unit for Visually Impaired People, Istituto Italiano di Tecnologia, Genoa, Italy
| |
Collapse
|
16
|
The Role of Visual Experience in Auditory Space Perception around the Legs. Sci Rep 2019; 9:10992. [PMID: 31358878 PMCID: PMC6662833 DOI: 10.1038/s41598-019-47410-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2018] [Accepted: 07/10/2019] [Indexed: 11/08/2022] Open
Abstract
It is widely accepted that vision plays a key role in the development of spatial skills of the other senses. Recent works have shown that blindness is often associated with auditory spatial deficits. The majority of previous studies have focused on understanding the representation of the upper frontal body space where vision and actions have a central role in mapping the space, however less research has investigated the back space and the space around the legs. Here we investigate space perception around the legs and the role of previous visual experience, by studying sighted and blind participants in an audio localization task (front-back discrimination). Participants judged if a sound was delivered in their frontal or back space. The results showed that blindfolded sighted participants were more accurate than blind participants in the frontal space. However, both groups were similarly accurate when auditory information was delivered in the back space. Blind individuals performed the task with similar accuracy for sounds delivered in the frontal and back space, while sighted people performed better in the frontal space. These results suggest that visual experience influences auditory spatial representations around the legs. Moreover, these results suggest that hearing and vision play different roles in different spaces.
Collapse
|
17
|
Chen YC, Lewis TL, Shore DI, Spence C, Maurer D. Developmental changes in the perception of visuotactile simultaneity. J Exp Child Psychol 2018; 173:304-317. [DOI: 10.1016/j.jecp.2018.04.014] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2017] [Revised: 04/25/2018] [Accepted: 04/25/2018] [Indexed: 10/16/2022]
|
18
|
McLean B, Blakeman M, Carey L, Ward R, Novak I, Valentine J, Blair E, Taylor S, Bear N, Bynevelt M, Basc E, Rose S, Reid L, Pannek K, Angeli J, Harpster K, Elliott C. Discovering the sense of touch: protocol for a randomised controlled trial examining the efficacy of a somatosensory discrimination intervention for children with hemiplegic cerebral palsy. BMC Pediatr 2018; 18:252. [PMID: 30064388 PMCID: PMC6069953 DOI: 10.1186/s12887-018-1217-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/18/2017] [Accepted: 07/09/2018] [Indexed: 11/15/2022] Open
Abstract
BACKGROUND Of children with hemiplegic cerebral palsy, 75% have impaired somatosensory function, which contributes to learned non-use of the affected upper limb. Currently, motor learning approaches are used to improve upper-limb motor skills in these children, but few studies have examined the effect of any intervention to ameliorate somatosensory impairments. Recently, Sense© training was piloted with a paediatric sample, seven children with hemiplegic cerebral palsy, demonstrating statistically and clinically significant change in limb position sense, goal performance and bimanual hand-use. This paper describes a protocol for a Randomised Controlled Trial of Sense© for Kids training, hypothesising that its receipt will improve somatosensory discrimination ability more than placebo (dose-matched Goal Directed Therapy via Home Program). Secondary hypotheses include that it will alter brain activation in somatosensory processing regions, white-matter characteristics of the thalamocortical tracts and improve bimanual function, activity and participation more than Goal Directed Training via Home Program. METHODS AND DESIGN This is a single blind, randomised matched-pair, placebo-controlled trial. Participants will be aged 6-15 years with a confirmed description of hemiplegic cerebral palsy and somatosensory discrimination impairment, as measured by the sense©_assess Kids. Participants will be randomly allocated to receive 3h a week for 6 weeks of either Sense© for Kids or Goal Directed Therapy via Home Program. Children will be matched on age and severity of somatosensory discrimination impairment. The primary outcome will be somatosensory discrimination ability, measured by sense©_assess Kids score. Secondary outcomes will include degree of brain activation in response to a somatosensory task measured by functional MRI, changes in the white matter of the thalamocortical tract measured by diffusion MRI, bimanual motor function, activity and participation. DISCUSSION This study will assess the efficacy of an intervention to increase somatosensory discrimination ability in children with cerebral palsy. It will explore clinically important questions about the efficacy of intervening in somatosensation impairment to improve bimanual motor function, compared with focusing on motor impairment directly, and whether focusing on motor impairment alone can affect somatosensory ability. TRIAL REGISTRATION This trial is registered with the Australian New Zealand Clinical Trials Registry, registration number: ACTRN12618000348257. World Health Organisation universal trial number: U1111-1210-1726.
Collapse
Affiliation(s)
- Belinda McLean
- School of Adolescent and Child Health, University of Western Australia, Perth, WA Australia
- Kids Rehab Department, Perth Children’s Hospital, Perth, WA Australia
| | - Misty Blakeman
- Kids Rehab Department, Perth Children’s Hospital, Perth, WA Australia
| | - Leeanne Carey
- Department of Community and Clinical Allied Health, School of Allied Health, La Trobe University, Melbourne, VIC Australia
- Neurorehabilitation and Recovery, Stroke Division, Florey Institute of Neuroscience and Mental Health, Melbourne, VIC Australia
| | - Roslyn Ward
- School of Occupational Therapy and Social Work, Curtin University, Perth, WA Australia
| | - Iona Novak
- Cerebral Palsy Alliance, Discipline of Paediatrics and Child Health, The University of Sydney, Sydney, NSW Australia
| | - Jane Valentine
- School of Adolescent and Child Health, University of Western Australia, Perth, WA Australia
- Kids Rehab Department, Perth Children’s Hospital, Perth, WA Australia
| | - Eve Blair
- Telethon Kids Institute, University of Western Australia, Perth, WA Australia
| | - Susan Taylor
- Kids Rehab Department, Perth Children’s Hospital, Perth, WA Australia
- School of Occupational Therapy and Social Work, Curtin University, Perth, WA Australia
| | - Natasha Bear
- Department of Clinical Research and Education, Child and Adolescent Health Services, Perth, WA Australia
| | - Michael Bynevelt
- Kids Rehab Department, Perth Children’s Hospital, Perth, WA Australia
- Sir Charles Gairdner Hospital, Perth, WA Australia
| | - Emma Basc
- Consumer Representative, Perth, WA Australia
| | - Stephen Rose
- Australian e-Health Research Centre, CSIRO, Brisbane, Queensland Australia
| | - Lee Reid
- Australian e-Health Research Centre, CSIRO, Brisbane, Queensland Australia
| | - Kerstin Pannek
- Australian e-Health Research Centre, CSIRO, Brisbane, Queensland Australia
| | - Jennifer Angeli
- School of Adolescent and Child Health, University of Western Australia, Perth, WA Australia
- Kids Rehab Department, Perth Children’s Hospital, Perth, WA Australia
| | - Karen Harpster
- Cincinnati Children’s Hospital Medical Center, Cincinnati, Ohio USA
| | - Catherine Elliott
- School of Occupational Therapy and Social Work, Curtin University, Perth, WA Australia
- Department of Clinical Research and Education, Child and Adolescent Health Services, Perth, WA Australia
| |
Collapse
|
19
|
Taylor S, McLean B, Blair E, Carey LM, Valentine J, Girdler S, Elliott C. Clinical acceptability of the sense_assess© kids
: Children and youth perspectives. Aust Occup Ther J 2017; 65:79-88. [DOI: 10.1111/1440-1630.12429] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/27/2017] [Indexed: 11/29/2022]
Affiliation(s)
- Susan Taylor
- School of Occupational Therapy and Social Work; Curtin University; Perth WA Australia
- Department of Paediatric Rehabilitation; Princess Margaret Hospital for Children; Perth WA Australia
| | - Belinda McLean
- Department of Paediatric Rehabilitation; Princess Margaret Hospital for Children; Perth WA Australia
- School of Paediatrics and Child Health; University of Western Australia; Perth WA Australia
| | - Eve Blair
- Population Sciences; Telethon Kids Institute; Perth WA Australia
| | - Leeanne Mary Carey
- Neurorehabilitation and Recovery; The Florey Institute of Neuroscience and Mental Health; Melbourne VIC Australia
- Occupational Therapy; School of Allied Health; La Trobe University; Melbourne VIC Australia
| | - Jane Valentine
- Department of Paediatric Rehabilitation; Princess Margaret Hospital for Children; Perth WA Australia
- School of Paediatrics and Child Health; University of Western Australia; Perth WA Australia
| | - Sonya Girdler
- School of Occupational Therapy and Social Work; Curtin University; Perth WA Australia
- Population Sciences; Telethon Kids Institute; Perth WA Australia
| | - Catherine Elliott
- School of Occupational Therapy and Social Work; Curtin University; Perth WA Australia
- Department of Paediatric Rehabilitation; Princess Margaret Hospital for Children; Perth WA Australia
| |
Collapse
|
20
|
Dunn W, Little L, Dean E, Robertson S, Evans B. The State of the Science on Sensory Factors and Their Impact on Daily Life for Children: A Scoping Review. OTJR-OCCUPATION PARTICIPATION AND HEALTH 2017; 36:3S-26S. [PMID: 27504990 DOI: 10.1177/1539449215617923] [Citation(s) in RCA: 43] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
The objective of this study was to identify and synthesize research about how sensory factors affect daily life of children. We designed a conceptual model to guide a scoping review of research published from 2005 to October 2014 (10 years). We searched MEDLINE, CINAHL, and PsycINFO and included studies about sensory perception/processing; children, adolescents/young adults; and participation. We excluded studies about animals, adults, and review articles. Our process resulted in 261 articles meeting criteria. Research shows that children with conditions process sensory input differently than peers. Neuroscience evidence supports the relationship between sensory-related behaviors and brain activity. Studies suggest that sensory processing is linked to social participation, cognition, temperament, and participation. Intervention research illustrates the importance of contextually relevant practices. Future work can examine the developmental course of sensory processing aspects of behavior across the general population and focus on interventions that support children's sensory processing as they participate in their daily lives.
Collapse
Affiliation(s)
- Winnie Dunn
- University of Kansas Medical Center, Kansas City, KS, USA
| | - Lauren Little
- University of Kansas Medical Center, Kansas City, KS, USA
| | - Evan Dean
- University of Kansas Medical Center, Kansas City, KS, USA
| | - Sara Robertson
- University of Kansas Medical Center, Kansas City, KS, USA
| | - Benjamin Evans
- University of Kansas Medical Center, Kansas City, KS, USA
| |
Collapse
|
21
|
Using Eye Tracking to Explore the Guidance and Constancy of Visual Variables in 3D Visualization. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION 2017. [DOI: 10.3390/ijgi6090274] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
22
|
Andres E, McKyton A, Ben-Zion I, Zohary E. Size constancy following long-term visual deprivation. Curr Biol 2017; 27:R696-R697. [DOI: 10.1016/j.cub.2017.05.071] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
23
|
Multisensory Perception of Contradictory Information in an Environment of Varying Reliability: Evidence for Conscious Perception and Optimal Causal Inference. Sci Rep 2017; 7:3167. [PMID: 28600573 PMCID: PMC5466670 DOI: 10.1038/s41598-017-03521-2] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2016] [Accepted: 05/01/2017] [Indexed: 11/23/2022] Open
Abstract
Two psychophysical experiments examined multisensory integration of visual-auditory (Experiment 1) and visual-tactile-auditory (Experiment 2) signals. Participants judged the location of these multimodal signals relative to a standard presented at the median plane of the body. A cue conflict was induced by presenting the visual signals with a constant spatial discrepancy to the other modalities. Extending previous studies, the reliability of certain modalities (visual in Experiment 1, visual and tactile in Experiment 2) was varied from trial to trial by presenting signals with either strong or weak location information (e.g., a relatively dense or dispersed dot cloud as visual stimulus). We investigated how participants would adapt to the cue conflict from the contradictory information under these varying reliability conditions and whether participants had insight to their performance. During the course of both experiments, participants switched from an integration strategy to a selection strategy in Experiment 1 and to a calibration strategy in Experiment 2. Simulations of various multisensory perception strategies proposed that optimal causal inference in a varying reliability environment not only depends on the amount of multimodal discrepancy, but also on the relative reliability of stimuli across the reliability conditions.
Collapse
|
24
|
Broadbent HJ, White H, Mareschal D, Kirkham NZ. Incidental learning in a multisensory environment across childhood. Dev Sci 2017; 21. [PMID: 28447388 PMCID: PMC5873275 DOI: 10.1111/desc.12554] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2016] [Accepted: 12/29/2016] [Indexed: 11/29/2022]
Abstract
Multisensory information has been shown to modulate attention in infants and facilitate learning in adults, by enhancing the amodal properties of a stimulus. However, it remains unclear whether this translates to learning in a multisensory environment across middle childhood, and particularly in the case of incidental learning. One hundred and eighty‐one children aged between 6 and 10 years participated in this study using a novel Multisensory Attention Learning Task (MALT). Participants were asked to respond to the presence of a target stimulus whilst ignoring distractors. Correct target selection resulted in the movement of the target exemplar to either the upper left or right screen quadrant, according to category membership. Category membership was defined either by visual‐only, auditory‐only or multisensory information. As early as 6 years of age, children demonstrated greater performance on the incidental categorization task following exposure to multisensory audiovisual cues compared to unisensory information. These findings provide important insight into the use of multisensory information in learning, and particularly on incidental category learning. Implications for the deployment of multisensory learning tasks within education across development will be discussed.
Collapse
Affiliation(s)
- Hannah J Broadbent
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
| | - Hayley White
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
| | - Denis Mareschal
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
| | - Natasha Z Kirkham
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
| |
Collapse
|
25
|
Bremner AJ, Spence C. The Development of Tactile Perception. ADVANCES IN CHILD DEVELOPMENT AND BEHAVIOR 2017; 52:227-268. [PMID: 28215286 DOI: 10.1016/bs.acdb.2016.12.002] [Citation(s) in RCA: 52] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
Touch is the first of our senses to develop, providing us with the sensory scaffold on which we come to perceive our own bodies and our sense of self. Touch also provides us with direct access to the external world of physical objects, via haptic exploration. Furthermore, a recent area of interest in tactile research across studies of developing children and adults is its social function, mediating interpersonal bonding. Although there are a range of demonstrations of early competence with touch, particularly in the domain of haptics, the review presented here indicates that many of the tactile perceptual skills that we take for granted as adults (e.g., perceiving touches in the external world as well as on the body) take some time to develop in the first months of postnatal life, likely as a result of an extended process of connection with other sense modalities which provide new kinds of information from birth (e.g., vision and audition). Here, we argue that because touch is of such fundamental importance across a wide range of social and cognitive domains, it should be placed much more centrally in the study of early perceptual development than it currently is.
Collapse
Affiliation(s)
- A J Bremner
- Goldsmiths, University of London, London, United Kingdom.
| | - C Spence
- University of Oxford, Oxford, United Kingdom
| |
Collapse
|
26
|
Cuturi LF, Aggius-Vella E, Campus C, Parmiggiani A, Gori M. From science to technology: Orientation and mobility in blind children and adults. Neurosci Biobehav Rev 2016; 71:240-251. [DOI: 10.1016/j.neubiorev.2016.08.019] [Citation(s) in RCA: 44] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2016] [Revised: 08/13/2016] [Accepted: 08/16/2016] [Indexed: 11/27/2022]
|
27
|
Taylor S, McLean B, Falkmer T, Carey L, Girdler S, Elliott C, Blair E. Does somatosensation change with age in children and adolescents? A systematic review. Child Care Health Dev 2016; 42:809-824. [PMID: 27470009 DOI: 10.1111/cch.12375] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/11/2015] [Revised: 06/01/2016] [Accepted: 06/11/2016] [Indexed: 11/28/2022]
Abstract
BACKGROUND Somatosensory modalities, such as touch, proprioception and haptic ability, greatly influence the achievement of developmental milestones for children. Describing somatosensory impairment, natural variability and typical or expected developmental changes across age groups will help establish frameworks for intervention in clinical populations. This systematic review aimed to determine how different somatosensory modalities develop across childhood into adolescence to use as a point of reference for children at risk of somatosensory impairment. METHODS Searches of five electronic databases were undertaken through EBSCO-host (MEDLINE, CINAHL, PsycINFO, SPORTDiscus and ERIC) for studies measuring at least one somatosensory modality in typically developing individuals between birth and 18 years and analysed by age. Characteristics of studies were collected including country of origin, sample size, demographics and outcome measure used. Quality assessment and data extraction were performed by two independent reviewers. RESULTS Twenty three cross-sectional studies were included from a total of 188 articles retrieved: 8 examined aspects of touch, 5 proprioception and 10 haptic ability. Variability of study designs and variation in assessment tools precluded any formal meta-analysis. CONCLUSIONS Somatosensation matures through childhood into adolescence; however, the present review found the pattern of somatosensory development varied depending on the assessment tool used and the aspect of somatosensation being measured, making it difficult to describe typical performance. There is a need for comprehensive assessment batteries to measure the somatosensation, including touch, proprioception and haptic ability, of children at risk of somatosensory impairment to aid in the development of effective interventions.
Collapse
Affiliation(s)
- S Taylor
- Faculty of Computing Health and Science, Edith Cowan University, Perth, Australia. .,School of Occupational Therapy and Social work, Curtin University, Perth, Australia. .,Department of Paediatric Rehabilitation, Princess Margaret Hospital for Children, Perth, Australia.
| | - B McLean
- School of Paediatrics and Child Health, University of Western Australia, Perth, Australia.,Department of Paediatric Rehabilitation, Princess Margaret Hospital for Children, Perth, Australia
| | - T Falkmer
- School of Occupational Therapy and Social work, Curtin University, Perth, Australia
| | - L Carey
- Neurorehabilitation and Recovery, The Florey Institute of Neuroscience and Mental Health, Melbourne, Australia.,Occupational Therapy, School of Allied Health, La Trobe University, Melbourne, Australia
| | - S Girdler
- School of Occupational Therapy and Social work, Curtin University, Perth, Australia.,Population Sciences, Telethon Kids Institute, Perth, Australia
| | - C Elliott
- School of Occupational Therapy and Social work, Curtin University, Perth, Australia.,Department of Paediatric Rehabilitation, Princess Margaret Hospital for Children, Perth, Australia
| | - E Blair
- Population Sciences, Telethon Kids Institute, Perth, Australia
| |
Collapse
|
28
|
Komendziński T, Mikołajewska E, Mikołajewski D, Dreszer J, Bałaj B. Cognitive robots in the development and rehabilitation of children with developmental disorders. BIO-ALGORITHMS AND MED-SYSTEMS 2016. [DOI: 10.1515/bams-2016-0010] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
AbstractCognitive robots constitute a highly interdisciplinary approach to the issue of therapy of children with developmental disorders. Cognitive robots become more popular, especially in action and language integration areas, joining the experience of psychologists, neuroscientists, philosophers, and even engineers. The concept of a robot as a cognitive companion for humans may be very useful. The interaction between humans and cognitive robots may be a mediator of movement patterns, learning behaviors from demonstrations, group activities, and social behaviors, as far as higher-order concepts such as symbol manipulation capabilities, words acquisition, and sensorimotor knowledge organization. Moreover there is an occupation to check many theories, such as transferring the knowledge and skills between humans and robots. Although several robotic solutions for children have been proposed the diffusion of aforementioned ideas is still limited. The review summarizes the current and future role of cognitive robots in the development and rehabilitation of children with developmental disorders.
Collapse
|
29
|
Petrini K, Jones PR, Smith L, Nardini M. Hearing Where the Eyes See: Children Use an Irrelevant Visual Cue When Localizing Sounds. Child Dev 2015; 86:1449-57. [DOI: 10.1111/cdev.12397] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
30
|
Tonelli A, Brayda L, Gori M. Task-dependent calibration of auditory spatial perception through environmental visual observation. Front Syst Neurosci 2015; 9:84. [PMID: 26082692 PMCID: PMC4451354 DOI: 10.3389/fnsys.2015.00084] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2015] [Accepted: 05/18/2015] [Indexed: 12/01/2022] Open
Abstract
Visual information is paramount to space perception. Vision influences auditory space estimation. Many studies show that simultaneous visual and auditory cues improve precision of the final multisensory estimate. However, the amount or the temporal extent of visual information, that is sufficient to influence auditory perception, is still unknown. It is therefore interesting to know if vision can improve auditory precision through a short-term environmental observation preceding the audio task and whether this influence is task-specific or environment-specific or both. To test these issues we investigate possible improvements of acoustic precision with sighted blindfolded participants in two audio tasks [minimum audible angle (MAA) and space bisection] and two acoustically different environments (normal room and anechoic room). With respect to a baseline of auditory precision, we found an improvement of precision in the space bisection task but not in the MAA after the observation of a normal room. No improvement was found when performing the same task in an anechoic chamber. In addition, no difference was found between a condition of short environment observation and a condition of full vision during the whole experimental session. Our results suggest that even short-term environmental observation can calibrate auditory spatial performance. They also suggest that echoes can be the cue that underpins visual calibration. Echoes may mediate the transfer of information from the visual to the auditory system.
Collapse
Affiliation(s)
- Alessia Tonelli
- Robotics, Brain and Cognitive Sciences Department, Fondazione Istituto Italiano di Tecnologia Genoa, Italy
| | - Luca Brayda
- Robotics, Brain and Cognitive Sciences Department, Fondazione Istituto Italiano di Tecnologia Genoa, Italy
| | - Monica Gori
- Robotics, Brain and Cognitive Sciences Department, Fondazione Istituto Italiano di Tecnologia Genoa, Italy
| |
Collapse
|
31
|
Stein BE, Stanford TR, Rowland BA. Development of multisensory integration from the perspective of the individual neuron. Nat Rev Neurosci 2014; 15:520-35. [PMID: 25158358 DOI: 10.1038/nrn3742] [Citation(s) in RCA: 211] [Impact Index Per Article: 21.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
The ability to use cues from multiple senses in concert is a fundamental aspect of brain function. It maximizes the brain’s use of the information available to it at any given moment and enhances the physiological salience of external events. Because each sense conveys a unique perspective of the external world, synthesizing information across senses affords computational benefits that cannot otherwise be achieved. Multisensory integration not only has substantial survival value but can also create unique experiences that emerge when signals from different sensory channels are bound together. However, neurons in a newborn’s brain are not capable of multisensory integration, and studies in the midbrain have shown that the development of this process is not predetermined. Rather, its emergence and maturation critically depend on cross-modal experiences that alter the underlying neural circuit in such a way that optimizes multisensory integrative capabilities for the environment in which the animal will function.
Collapse
|
32
|
Seilheimer RL, Rosenberg A, Angelaki DE. Models and processes of multisensory cue combination. Curr Opin Neurobiol 2013; 25:38-46. [PMID: 24709599 DOI: 10.1016/j.conb.2013.11.008] [Citation(s) in RCA: 67] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2013] [Revised: 09/26/2013] [Accepted: 11/18/2013] [Indexed: 01/13/2023]
Abstract
Fundamental to our perception of a unified and stable environment is the capacity to combine information across the senses. Although this process appears seamless as an adult, the brain's ability to successfully perform multisensory cue combination takes years to develop and relies on a number of complex processes including cue integration, cue calibration, causal inference, and reference frame transformations. Further complexities exist because multisensory cue combination is implemented across time by populations of noisy neurons. In this review, we discuss recent behavioral studies exploring how the brain combines information from different sensory systems, neurophysiological studies relating behavior to neuronal activity, and a theory of neural sensory encoding that can account for many of these experimental findings.
Collapse
Affiliation(s)
| | - Ari Rosenberg
- Baylor College of Medicine, Houston, TX, United States
| | | |
Collapse
|
33
|
Zaidel A, Ma WJ, Angelaki DE. Supervised calibration relies on the multisensory percept. Neuron 2013; 80:1544-57. [PMID: 24290205 DOI: 10.1016/j.neuron.2013.09.026] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/13/2013] [Indexed: 11/19/2022]
Abstract
Multisensory plasticity enables us to dynamically adapt sensory cues to one another and to the environment. Without external feedback, "unsupervised" multisensory calibration reduces cue conflict in a manner largely independent of cue reliability. But environmental feedback regarding cue accuracy ("supervised") also affects calibration. Here we measured the combined influence of cue accuracy and cue reliability on supervised multisensory calibration, using discrepant visual and vestibular motion stimuli. When the less reliable cue was inaccurate, it alone got calibrated. However, when the more reliable cue was inaccurate, cues were yoked and calibrated together in the same direction. Strikingly, the less reliable cue shifted away from external feedback, becoming less accurate. A computational model in which supervised and unsupervised calibration work in parallel, where the former only relies on the multisensory percept, but the latter can calibrate cues individually, accounts for the observed behavior. In combination, they could ultimately achieve the optimal solution of both external accuracy and internal consistency.
Collapse
Affiliation(s)
- Adam Zaidel
- Department of Neuroscience, Baylor College of Medicine, Houston, TX 77030, USA.
| | - Wei Ji Ma
- Department of Neuroscience, Baylor College of Medicine, Houston, TX 77030, USA
| | - Dora E Angelaki
- Department of Neuroscience, Baylor College of Medicine, Houston, TX 77030, USA
| |
Collapse
|