The use of exploratory procedures by blind and sighted adults and children

Prior visual experience increases children's use of effective haptic exploration strategies in audio-tactile sound-shape correspondences

Sound-shape correspondence refers to the preferential mapping of information across the senses, such as associating a nonsense word like bouba with rounded abstract shapes and kiki with spiky abstract shapes. Here we focused on audio-tactile (AT) sound-shape correspondences between nonsense words and abstract shapes that are felt but not seen. Despite previous research indicating a role for visual experience in establishing AT associations, it remains unclear how visual experience facilitates AT correspondences. Here we investigated one hypothesis: seeing the abstract shapes improve haptic exploration by (a) increasing effective haptic strategies and/or (b) decreasing ineffective haptic strategies. We analyzed five haptic strategies in video-recordings of 6- to 8-year-old children obtained in a previous study. We found the dominant strategy used to explore shapes differed based on visual experience. Effective strategies, which provide information about shape, were dominant in participants with prior visual experience, whereas ineffective strategies, which do not provide information about shape, were dominant in participants without prior visual experience. With prior visual experience, poking-an effective and efficient strategy-was dominant, whereas without prior visual experience, uncategorizable and ineffective strategies were dominant. These findings suggest that prior visual experience of abstract shapes in 6- to 8-year-olds can increase the effectiveness and efficiency of haptic exploration, potentially explaining why prior visual experience can increase the strength of AT sound-shape correspondences.

Visual experience shapes the Bouba-Kiki effect and the size-weight illusion upon sight restoration from congenital blindness

The Bouba-Kiki effect is the systematic mapping between round/spiky shapes and speech sounds ("Bouba"/"Kiki"). In the size-weight illusion, participants judge the smaller of two equally-weighted objects as being heavier. Here we investigated the contribution of visual experience to the development of these phenomena. We compared three groups: early blind individuals (no visual experience), individuals treated for congenital cataracts years after birth (late visual experience), and typically sighted controls (visual experience from birth). We found that, in cataract-treated participants (tested visually/visuo-haptically), both phenomena are absent shortly after sight onset, just like in blind individuals (tested haptically). However, they emerge within months following surgery, becoming statistically indistinguishable from the sighted controls. This suggests a pivotal role of visual experience and refutes the existence of an early sensitive period: A short period of experience, even when gained only years after birth, is sufficient for participants to visually pick-up regularities in the environment, contributing to the development of these phenomena.

Idiosyncratic selection of active touch for shape perception

Hand movements are essential for tactile perception of objects. However, the specific functions served by active touch strategies, and their dependence on physiological parameters, are unclear and understudied. Focusing on planar shape perception, we tracked at high resolution the hands of 11 participants during shape recognition task. Two dominant hand movement strategies were identified: contour following and scanning. Contour following movements were either tangential to the contour or oscillating perpendicular to it. Scanning movements crossed between distant parts of the shapes’ contour. Both strategies exhibited non-uniform coverage of the shapes’ contours. Idiosyncratic movement patterns were specific to the sensed object. In a second experiment, we have measured the participants’ spatial and temporal tactile thresholds. Significant portions of the variations in hand speed and in oscillation patterns could be explained by the idiosyncratic thresholds. Using data-driven simulations, we show how specific strategy choices may affect receptors activation. These results suggest that motion strategies of active touch adapt to both the sensed object and to the perceiver’s physiological parameters.

Exploring to learn and learning to explore

In respect to ecological psychology processes of attunement and calibration, this critical review focusses on how exploratory behaviors may contribute to skilled perception and action, with particular attention to sport. Based on the theoretical insights of Gibson (The senses considered as perceptual systems, Houghton Mifflin, Boston, 1966) and Reed (Encountering the world: Toward an ecological psychology, Oxford University Press, New York, 1996), exploratory and performatory actions have been differentiated in numerous experiments to study the perception of opportunities of action. The distinction between exploratory and performatory actions has informed the study of infant behavior in developmental psychology. In the current article, we highlight limitations with this distinction in the study of sports performers. We propose that a dynamic view of exploratory behavior would reveal how individuals develop exploratory activity that generates information about the fit between environmental properties and action capabilities. In this aim, practitioners should: (1) give learners the opportunity to safely develop exploratory behaviors even when they act outside their action boundary; and (2) guide learners to search for more reliable information to develop exploratory behaviors that would enhance the transfer of skills to various performance contexts.

The feeling of "kiki": Comparing developmental changes in sound-shape correspondence for audio-visual and audio-tactile stimuli

Sound-shape crossmodal correspondence, the naturally occurring associations between abstract visual shapes and nonsense sounds, is one aspect of multisensory processing that strengthens across early childhood. Little is known regarding whether school-aged children exhibit other variants of sound-shape correspondences such as audio-tactile (AT) associations between tactile shapes and nonsense sounds. Based on previous research in blind individuals suggesting the role of visual experience in establishing sound-shape correspondence, we hypothesized that children would show weaker AT association than adults and that children's AT association would be enhanced with visual experience of the shapes. In Experiment 1, we showed that, when asked to match shapes explored haptically via touch to nonsense words, 6- to 8-year-olds exhibited inconsistent AT associations, whereas older children and adults exhibited the expected AT associations, despite robust audio-visual (AV) associations found across all age groups in a related study. In Experiment 2, we confirmed the role of visual experience in enhancing AT association; here, 6- to 8-year-olds could exhibit the expected AT association if first exposed to the AV condition, whereas adults showed the expected AT association irrespective of whether the AV condition was tested first or second. Our finding suggests that AT sound-shape correspondence is weak early in development relative to AV sound-shape correspondence, paralleling previous findings on the development of other types of multisensory associations. The potential role of visual experience in the development of sound-shape correspondences in other senses is discussed.

The associations between vision level and early hand use in children aged 6–36 months with visual impairment: A cross-sectional, historical case note review

Vision level varies within the population of children born with visual impairment (VI). Children with profound visual impairment (PVI – with light awareness at best) are more developmentally vulnerable than peers born with typical sight or those with severe visual impairment (SVI – basic form vision). Many children with VI are dependent on their hand skills to support their development. However, the impact of vision level on the development of hand use is poorly understood. The aim of the study was to describe the associations between vision level and early hand use in children between 6 and 36 months of age with SVI and PVI. A historical case note review, including video footage of 19 children with SVI ([Formula: see text] = 19 months) and 12 children with PVI ([Formula: see text] = 16 months), was completed. Hand use was observed while the children completed the Reynell-Zinkin Scales. Observations were recorded using a data collection tool designed for the study. The tool included a checklist of developmentally appropriate hand skills expected to emerge in the first 3 years of life. The observer marked each skill as present, absent or emerging in the video clips. Children with SVI used 80.2% (95% confidence interval [CI] = [75.0, 87.5]) of the hand skills under observation. Those with PVI used 57.1% (95% CI = [46.4, 67.9]) of these skills. Vision level and hand use were positively correlated: rs  = .564 (95% CI = [.263, .765]), p < .01. This correlation was stronger than the association between developmental level and hand use: r  = .364 (95% CI = [.012, .636]), p < .05. Furthermore, 15.8% (95% CI = [0.0, 31.6]) of the children with SVI and 66.7% (95% CI = [41.7, 91.7]) with PVI showed some reluctance to touch objects ( p < .05) by withdrawing their hands actively from items offered to them. Vision level and developmental level influenced hand use; however, vision level appeared to have the greater impact. Interventions that are tailored to promote hand use according to vision level have the potential to improve functional participation.

Haptic Exploratory Procedures of Children and Youth with and without Cerebral Palsy

Aims: Compare haptic exploratory procedures (EPs) and exploratory movements (EMs) of children. This study also tested the interrater reliability of a novel digital recording method. Methods: Participants were 31 children with typical development (TD) (aged 6 years 1 month to 15 years 9 months; 14 male) and 23 children with spastic unilateral cerebral palsy (CP) (aged 6 years to 15 years 5 months; 13 males; right hemiplegia, n = 12). Results: There were no statistically significant differences between groups for expected EP (p = .15), additional EPs (p = .78), or EMs (p = .69) but there was for mean duration of exploration (p < .001) and accuracy (p < .001). This suggests that although children with CP performed similar haptic EPs for each object as children with TD, they took more time and were less accurate in their identification. There was substantial agreement between the two raters' observations of expected EP, κ = .64, p < .0005. Conclusion: Children with CP performed similar haptic EPs as their TD peers. However, despite similarities, the results indicate that for children with CP manual ability was not the primary determinant of accuracy or speed of identification. This study provides evidence for a reliable method of recording haptic EPs.

Haptic Object Recognition is View-Independent in Early Blind but not Sighted People

Object recognition, whether visual or haptic, is impaired in sighted people when objects are rotated between learning and test, relative to an unrotated condition, that is, recognition is view-dependent. Loss of vision early in life results in greater reliance on haptic perception for object identification compared with the sighted. Therefore, we hypothesized that early blind people may be more adept at recognizing objects despite spatial transformations. To test this hypothesis, we compared early blind and sighted control participants on a haptic object recognition task. Participants studied pairs of unfamiliar three-dimensional objects and performed a two-alternative forced-choice identification task, with the learned objects presented both unrotated and rotated 180° about they-axis. Rotation impaired the recognition accuracy of sighted, but not blind, participants. We propose that, consistent with our hypothesis, haptic view-independence in the early blind reflects their greater experience with haptic object perception.

Haptic exploratory behavior during object discrimination: a novel automatic annotation method

In order to acquire information concerning the geometry and material of handheld objects, people tend to execute stereotypical hand movement patterns called haptic Exploratory Procedures (EPs). Manual annotation of haptic exploration trials with these EPs is a laborious task that is affected by subjectivity, attentional lapses, and viewing angle limitations. In this paper we propose an automatic EP annotation method based on position and orientation data from motion tracking sensors placed on both hands and inside a stimulus. A set of kinematic variables is computed from these data and compared to sets of predefined criteria for each of four EPs. Whenever all criteria for a specific EP are met, it is assumed that that particular hand movement pattern was performed. This method is applied to data from an experiment where blindfolded participants haptically discriminated between objects differing in hardness, roughness, volume, and weight. In order to validate the method, its output is compared to manual annotation based on video recordings of the same trials. Although mean pairwise agreement is less between human-automatic pairs than between human-human pairs (55.7% vs 74.5%), the proposed method performs much better than random annotation (2.4%). Furthermore, each EP is linked to a specific object property for which it is optimal (e.g., Lateral Motion for roughness). We found that the percentage of trials where the expected EP was found does not differ between manual and automatic annotation. For now, this method cannot yet completely replace a manual annotation procedure. However, it could be used as a starting point that can be supplemented by manual annotation.

Grasping without sight: insights from the congenitally blind

We reach for and grasp different sized objects numerous times per day. Most of these movements are visually-guided, but some are guided by the sense of touch (i.e. haptically-guided), such as reaching for your keys in a bag, or for an object in a dark room. A marked right-hand preference has been reported during visually-guided grasping, particularly for small objects. However, little is known about hand preference for haptically-guided grasping. Recently, a study has shown a reduction in right-hand use in blindfolded individuals, and an absence of hand preference if grasping was preceded by a short haptic experience. These results suggest that vision plays a major role in hand preference for grasping. If this were the case, then one might expect congenitally blind (CB) individuals, who have never had a visual experience, to exhibit no hand preference. Two novel findings emerge from the current study: first, the results showed that contrary to our expectation, CB individuals used their right hand during haptically-guided grasping to the same extent as visually-unimpaired (VU) individuals did during visually-guided grasping. And second, object size affected hand use in an opposite manner for haptically- versus visually-guided grasping. Big objects were more often picked up with the right hand during haptically-guided, but less often during visually-guided grasping. This result highlights the different demands that object features pose on the two sensory systems. Overall the results demonstrate that hand preference for grasping is independent of visual experience, and they suggest a left-hemisphere specialization for the control of grasping that goes beyond sensory modality.