1
|
Effects of neuromodulation-inspired mechanisms on the performance of deep neural networks in a spatial learning task. iScience 2023; 26:106026. [PMID: 36818295 PMCID: PMC9929609 DOI: 10.1016/j.isci.2023.106026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2022] [Revised: 11/18/2022] [Accepted: 01/19/2023] [Indexed: 01/25/2023] Open
Abstract
In recent years, the biological underpinnings of adaptive learning have been modeled, leading to faster model convergence and various behavioral benefits in tasks including spatial navigation and cue-reward association. Furthermore, studies have investigated how the neuromodulatory system, a major driver of synaptic plasticity and state-dependent changes in the brain neuronal activities, plays a role in training deep neural networks (DNNs). In this study, we extended previous studies on neuromodulation-inspired DNNs and explored the effects of neuromodulatory components on learning and single unit activities in a spatial learning task. Under the multiscale neuromodulatory framework, plastic components, dropout probability modulation, and learning rate decay were added to the single unit, layer, and whole network levels of DNN models, respectively. We observed behavioral benefits including faster learning and smaller error of ambulation. We then concluded that neuromodulatory components can affect learning trajectories, outcomes, and single unit activities, in a component- and hyperparameter-dependent manner.
Collapse
|
2
|
Zanchi S, Cuturi LF, Sandini G, Gori M. Evaluation of a Motion Platform Combined with an Acoustic Virtual Reality Tool: a Spatial Orientation Test in Sighted and Visually Impaired People. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:6078-6081. [PMID: 34892503 DOI: 10.1109/embc46164.2021.9630867] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
To orient and move efficiently in the environment, we need to rely on multiple external and internal cues. Previous studies reported the combined use of spatialized auditory cues and self-motion information in spatial navigation and orientation. In this study, we investigated the feasibility of a setup composed of a motion platform and an acoustic virtual reality tool with sighted and visually impaired participants. We compared the performance in a self-motion discrimination task with and without auditory cues. The results revealed good usability of the setup and increased precision with auditory cues for visually impaired people.
Collapse
|
3
|
Bollini A, Campus C, Gori M. The development of allocentric spatial frame in the auditory system. J Exp Child Psychol 2021; 211:105228. [PMID: 34242896 DOI: 10.1016/j.jecp.2021.105228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Revised: 06/15/2021] [Accepted: 06/15/2021] [Indexed: 10/20/2022]
Abstract
The ability to encode space is a crucial aspect of interacting with the external world. Therefore, this ability appears to be fundamental for the correct development of the capacity to integrate different spatial reference frames. The spatial reference frame seems to be present in all the sensory modalities. However, it has been demonstrated that different sensory modalities follow various developmental courses. Nevertheless, to date these courses have been investigated only in people with sensory impairments, where there is a possible bias due to compensatory strategies and it is complicated to assess the exact age when these skills emerge. For these reasons, we investigated the development of the allocentric frame in the auditory domain in a group of typically developing children aged 6-10 years. To do so, we used an auditory Simon task, a paradigm that involves implicit spatial processing, and we asked children to perform the task in both the uncrossed and crossed hands postures. We demonstrated that the crossed hands posture affected the performance only in younger children (6-7 years), whereas at 10 years of age children performed as adults and were not affected by such posture. Moreover, we found that this task's performance correlated with age and developmental differences in spatial abilities. Our results support the hypothesis that auditory spatial cognition's developmental course is similar to the visual modality development as reported in the literature.
Collapse
Affiliation(s)
- Alice Bollini
- Unit for Visually Impaired People, Center for Human Technologies, Istituto Italiano di Tecnologia, 16163 Genova, Italy.
| | - Claudio Campus
- Unit for Visually Impaired People, Center for Human Technologies, Istituto Italiano di Tecnologia, 16163 Genova, Italy
| | - Monica Gori
- Unit for Visually Impaired People, Center for Human Technologies, Istituto Italiano di Tecnologia, 16163 Genova, Italy
| |
Collapse
|
4
|
Nardi D, Singer KJ, Price KM, Carpenter SE, Bryant JA, Hatheway MA, Johnson JN, Pairitz AK, Young KL, Newcombe NS. Navigating without vision: spontaneous use of terrain slant in outdoor place learning. SPATIAL COGNITION AND COMPUTATION 2021. [DOI: 10.1080/13875868.2021.1916504] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Affiliation(s)
- Daniele Nardi
- Department of Psychological Science, Ball State University, Muncie, IN, USA
| | - Katelyn J. Singer
- Department of Psychological Science, Ball State University, Muncie, IN, USA
| | - Krista M. Price
- Department of Psychological Science, Ball State University, Muncie, IN, USA
| | | | - Joseph A. Bryant
- Department of Psychological Science, Ball State University, Muncie, IN, USA
| | | | - Jada N. Johnson
- Department of Psychological Science, Ball State University, Muncie, IN, USA
| | - Annika K. Pairitz
- Department of Psychological Science, Ball State University, Muncie, IN, USA
| | - Keldyn L. Young
- Department of Psychological Science, Ball State University, Muncie, IN, USA
| | - Nora S. Newcombe
- Department of Psychology, Temple University, Philadelphia, PA, USA
| |
Collapse
|
5
|
Nardi D, Carpenter SE, Johnson SR, Gilliland GA, Melo VL, Pugliese R, Coppola VJ, Kelly DM. Spatial reorientation with a geometric array of auditory cues. Q J Exp Psychol (Hove) 2020; 75:362-373. [PMID: 32111145 DOI: 10.1177/1747021820913295] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
A visuocentric bias has dominated the literature on spatial navigation and reorientation. Studies on visually accessed environments indicate that, during reorientation, human and non-human animals encode the geometric shape of the environment, even if this information is unnecessary and insufficient for the task. In an attempt to extend our limited knowledge on the similarities and differences between visual and non-visual navigation, here we examined whether the same phenomenon would be observed during auditory-guided reorientation. Provided with a rectangular array of four distinct auditory landmarks, blindfolded, sighted participants had to learn the location of a target object situated on a panel of an octagonal arena. Subsequent test trials were administered to understand how the task was acquired. Crucially, in a condition in which the auditory cues were indistinguishable (same sound sample), participants could still identify the correct target location, suggesting that the rectangular array of auditory landmarks was encoded as a geometric configuration. This is the first evidence of incidental encoding of geometric information with auditory cues and, consistent with the theory of functional equivalence, it supports the generalisation of mechanisms of spatial learning across encoding modalities.
Collapse
Affiliation(s)
- Daniele Nardi
- Department of Psychological Science, Ball State University, Muncie, IN, USA
| | | | - Somer R Johnson
- Department of Psychological Science, Ball State University, Muncie, IN, USA
| | - Greg A Gilliland
- Department of Psychological Science, Ball State University, Muncie, IN, USA
| | - Viveka L Melo
- Department of Psychological Science, Ball State University, Muncie, IN, USA
| | - Roberto Pugliese
- Academy of Fine Arts, University of the Arts Helsinki, Helsinki, Finland
| | - Vincent J Coppola
- Department of Psychology, Eastern Illinois University, Charleston, IL, USA
| | - Debbie M Kelly
- Department of Psychology, University of Manitoba, Winnipeg, Manitoba, Canada
| |
Collapse
|
6
|
Nardi D, Twyman AD, Holden MP, Clark JM. Tuning in: can humans use auditory cues for spatial reorientation? SPATIAL COGNITION AND COMPUTATION 2019. [DOI: 10.1080/13875868.2019.1702665] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Affiliation(s)
- Daniele Nardi
- Department of Psychological Science, Ball State University, Muncie, IN, USA
- Department of Psychology, Eastern Illinois University, Charleston, IL, USA
| | - Alexandra D. Twyman
- Department of Psychology, University of Calgary, Calgary, Canada
- Department of Psychology, Mount Royal University, Calgary, Canada
- Department of Psychology, Athabasca University, Athabasca, Canada
| | - Mark P. Holden
- Department of Psychology, University of Calgary, Calgary, Canada
| | - Josie M. Clark
- Department of Educational Leadership, Southern Illinois University Edwardsville, Edwardsville, IL, USA
| |
Collapse
|