1
|
Non-signing children's assessment of telicity in sign language. Cognition 2024; 249:105811. [PMID: 38776621 DOI: 10.1016/j.cognition.2024.105811] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Revised: 03/15/2024] [Accepted: 05/03/2024] [Indexed: 05/25/2024]
Abstract
Adults with no knowledge of sign languages can perceive distinctive markers that signal event boundedness (telicity), suggesting that telicity is a cognitively natural semantic feature that can be marked iconically (Strickland et al., 2015). This study asks if non-signing children (5-year-olds) can also link telicity to iconic markers in sign. Experiment 1 attempted three close replications of Strickland et al. (2015) and found only limited success. However, Experiment 2 showed that children can both perceive the relevant visual feature and can succeed at linking the visual property to telicity semantics when allowed to filter their answer through their own linguistic choices. Children's performance demonstrates the cognitive naturalness and early availability of the semantics of telicity, supporting the idea that telicity helps guide the language acquisition process.
Collapse
|
2
|
The role of valence and arousal for phonological iconicity in the lexicon of German: a cross-validation study using pseudoword ratings. Cogn Emot 2024:1-22. [PMID: 38773881 DOI: 10.1080/02699931.2024.2353775] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2023] [Accepted: 05/05/2024] [Indexed: 05/24/2024]
Abstract
The notion of sound symbolism receives increasing interest in psycholinguistics. Recent research - including empirical effects of affective phonological iconicity on language processing (Adelman et al., 2018; Conrad et al., 2022) - suggested language codes affective meaning at a basic phonological level using specific phonemes as sublexical markers of emotion. Here, in a series of 8 rating-experiments, we investigate the sensitivity of language users to assumed affectively-iconic systematic distribution patterns of phonemes across the German vocabulary:After computing sublexical-affective-values (SAV) concerning valence and arousal for the entire German phoneme inventory according to occurrences of syllabic onsets, nuclei and codas in a large-scale affective normative lexical database, we constructed pseudoword material differing in SAV to test for subjective affective impressions.Results support affective iconicity as affective ratings mirrored sound-to-meaning correspondences in the lexical database. Varying SAV of otherwise semantically meaningless pseudowords altered affective impressions: Higher arousal was consistently assigned to pseudowords made of syllabic constituents more often used in high-arousal words - contrasted by less straightforward effects of valence SAV. Further disentangling specific differential effects of the two highly-related affective dimensions valence and arousal, our data clearly suggest arousal, rather than valence, as the relevant dimension driving affective iconicity effects.
Collapse
|
3
|
Systematic mappings of sound to meaning: A theoretical review. Psychon Bull Rev 2024; 31:627-648. [PMID: 37803232 DOI: 10.3758/s13423-023-02395-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/19/2023] [Indexed: 10/08/2023]
Abstract
The form of a word sometimes conveys semantic information. For example, the iconic word gurgle sounds like what it means, and busy is easy to identify as an English adjective because it ends in -y. Such links between form and meaning matter because they help people learn and use language. But gurgle also sounds like gargle and burble, and the -y in busy is morphologically and etymologically unrelated to the -y in crazy and watery. Whatever processing effects gurgle and busy have in common likely stem not from iconic, morphological, or etymological relationships but from systematicity more broadly: the phenomenon whereby semantically related words share a phonological or orthographic feature. In this review, we evaluate corpus evidence that spoken languages are systematic (even when controlling for iconicity, morphology, and etymology) and experimental evidence that systematicity impacts word processing (even in lieu of iconic, morphological, and etymological relationships). We conclude by drawing attention to the relationship between systematicity and low-frequency words and, consequently, the role that systematicity plays in natural language processing.
Collapse
|
4
|
Effects of Iconicity in Recognition Memory. Cogn Sci 2023; 47:e13382. [PMID: 38010057 DOI: 10.1111/cogs.13382] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Revised: 10/01/2023] [Accepted: 11/07/2023] [Indexed: 11/29/2023]
Abstract
Iconicity refers to a resemblance between word form and meaning. Previous work has shown that iconic words are learned earlier and processed faster. Here, we examined whether iconic words are recognized better on a recognition memory task. We also manipulated the level at which items were encoded-with a focus on either their meaning or their form-in order to gain insight into the mechanism by which iconicity would affect memory. In comparison with non-iconic words, iconic words were associated with a higher false alarm rate, a lower d' score, and a lower response criterion in Experiment 1. We did not observe any interaction between iconicity and encoding condition. To test the generalizability of these findings, we examined effects of iconicity in a recognition memory megastudy across 3880 items. After controlling for a variety of lexical and semantic variables, iconicity was predictive of more hits and false alarms, and a lower response criterion in this dataset. In Experiment 2, we examined whether these effects were due to increased feelings of familiarity for iconic items by including a familiar versus recollect decision. This experiment replicated the overall results of Experiment 1 and found that participants were more likely to categorize words that they had seen before as familiar (vs. recollected) if they were iconic. Together, these results demonstrate that iconicity has an effect on memory. We discuss implications for theories of iconicity.
Collapse
|
5
|
The Iconicity Ring Hypothesis Bridges the Gap Between Symbol Grounding and Linguistic Relativity. Top Cogn Sci 2023; 15:676-682. [PMID: 37331018 DOI: 10.1111/tops.12671] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2023] [Revised: 05/15/2023] [Accepted: 05/22/2023] [Indexed: 06/20/2023]
Abstract
Kemmerer captured the drastic change in theories of word meaning representations, contrasting the view that word meaning representations are amodal and universal, with the view that they are grounded and language-specific. However, he does not address how language can be simultaneously grounded and language-specific. Here, we approach this question from the perspective of language acquisition and evolution. We argue that adding a new element-iconicity-is critically beneficial and offer the iconicity ring hypothesis, which explains how language-specific, secondary iconicity might emerge from biologically grounded and universally shared iconicity in the course of language acquisition and evolution.
Collapse
|
6
|
I don't see what you're saying: The maluma/takete effect does not depend on the visual appearance of phonemes as they are articulated. Psychon Bull Rev 2023; 30:1521-1529. [PMID: 36520277 PMCID: PMC10482773 DOI: 10.3758/s13423-022-02224-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/16/2022] [Indexed: 12/23/2022]
Abstract
In contrast to the principle of arbitrariness, recent work has shown that language can iconically depict referents being talked about. One such example is the maluma/takete effect: an association between certain phonemes (e.g., those in maluma) and round shapes, and other phonemes (e.g., those in takete and spiky shapes). An open question has been whether this association is crossmodal (arising from phonemes' sound or kinesthetics) or unimodal (arising from phonemes' visual appearance). In the latter case, individuals may associate a person's rounded lips as they pronounce the /u/ in maluma with round shapes. We examined this hypothesis by having participants pair nonwords with shapes in either an audio-only condition (they only heard nonwords) or an audiovisual condition (they both heard nonwords and saw them articulated). We found no evidence that seeing nonwords articulated enhanced the maluma/takete effect. In fact, there was evidence that it decreased it in some cases. This was confirmed with a Bayesian analysis. These results eliminate a plausible explanation for the maluma/takete effect, as an instance of visual matching. We discuss the alternate possibility that it involves crossmodal associations.
Collapse
|
7
|
Cross-Modal Musical Expectancy in Complex Sound Music: A Grounded Theory. J Cogn 2023; 6:33. [PMID: 37426063 PMCID: PMC10327858 DOI: 10.5334/joc.281] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Accepted: 05/16/2023] [Indexed: 07/11/2023] Open
Abstract
Expectancy is a core mechanism for constructing affective and cognitive experiences of music. However, research on musical expectations has been largely founded upon the perception of tonal music. Therefore, it is still to be determined how this mechanism explains the cognition of sound-based acoustic and electroacoustic music, such as complex sound music (CSM). Additionally, the dominant methodologies have consisted of well-controlled experimental designs with low ecological validity that have overlooked the listening experience as described by the listeners. This paper presents results concerning musical expectancy from a qualitative research project that investigated the listening experiences of 15 participants accustomed to CSM listening. Corbin and Strauss' (2015) grounded theory was used to triangulate data from interviews along with musical analyses of the pieces chosen by the participants to describe their listening experiences. Cross-modal musical expectancy (CMME) emerged from the data as a subcategory that explained prediction through the interaction of multimodal elements beyond just the acoustic properties of music. The results led to hypothesise that multimodal information coming from sounds, performance gestures, and indexical, iconic, and conceptual associations re-enact cross-modal schemata and episodic memories where real and imagined sounds, objects, actions, and narratives interrelate to give rise to CMME processes. This construct emphasises the effect of CSM's subversive acoustic features and performance practices on the listening experience. Further, it reveals the multiplicity of factors involved in musical expectancy, such as cultural values, subjective musical and non-musical experiences, music structure, listening situation, and psychological mechanisms. Following these ideas, CMME is conceived as a grounded cognition process.
Collapse
|
8
|
How (and why) does iconicity effect lexical access: An electrophysiological study of American sign language. Neuropsychologia 2023; 183:108516. [PMID: 36796720 PMCID: PMC10576952 DOI: 10.1016/j.neuropsychologia.2023.108516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Revised: 12/17/2022] [Accepted: 02/13/2023] [Indexed: 02/16/2023]
Abstract
Prior research has found that iconicity facilitates sign production in picture-naming paradigms and has effects on ERP components. These findings may be explained by two separate hypotheses: (1) a task-specific hypothesis that suggests these effects occur because visual features of the iconic sign form can map onto the visual features of the pictures, and (2) a semantic feature hypothesis that suggests that the retrieval of iconic signs results in greater semantic activation due to the robust representation of sensory-motor semantic features compared to non-iconic signs. To test these two hypotheses, iconic and non-iconic American Sign Language (ASL) signs were elicited from deaf native/early signers using a picture-naming task and an English-to-ASL translation task, while electrophysiological recordings were made. Behavioral facilitation (faster response times) and reduced negativities were observed for iconic signs (both prior to and within the N400 time window), but only in the picture-naming task. No ERP or behavioral differences were found between iconic and non-iconic signs in the translation task. This pattern of results supports the task-specific hypothesis and provides evidence that iconicity only facilitates sign production when the eliciting stimulus and the form of the sign can visually overlap (a picture-sign alignment effect).
Collapse
|
9
|
Iconicity in Ideophones: Guessing, Memorizing, and Reassessing. Cogn Sci 2023; 47:e13268. [PMID: 37062829 DOI: 10.1111/cogs.13268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 02/15/2023] [Accepted: 02/21/2023] [Indexed: 04/18/2023]
Abstract
Iconicity, or the resemblance between form and meaning, is often ascribed to a special status and contrasted with default assumptions of arbitrariness in spoken language. But does iconicity in spoken language have a special status when it comes to learnability? A simple way to gauge learnability is to see how well something is retrieved from memory. We can further contrast this with guessability, to see (1) whether the ease of guessing the meanings of ideophones outperforms the rate at which they are remembered; and (2) how willing participants' are to reassess what they were taught in a prior task-a novel contribution of this study. We replicate prior guessing and memory tasks using ideophones and adjectives from Japanese, Korean, and Igbo. Our results show that although native Cantonese speakers guessed ideophone meanings above chance level, they memorized both ideophones and adjectives with comparable accuracy. However, response time data show that participants took significantly longer to respond correctly to adjective-meaning pairs-indicating a discrepancy in a cognitive effort that favored the recognition of ideophones. In a follow-up reassessment task, participants who were taught foil translations were more likely to choose the true translations for ideophones rather than adjectives. By comparing the findings from our guessing and memory tasks, we conclude that iconicity is more accessible if a task requires participants to actively seek out sound-meaning associations.
Collapse
|
10
|
The Whale and the Microorganism: A Tale of a Classic Example and Linguistic Intuitions. Cogn Sci 2023; 47:e13287. [PMID: 37062824 DOI: 10.1111/cogs.13287] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Revised: 03/28/2023] [Accepted: 03/30/2023] [Indexed: 04/18/2023]
Abstract
A classic example of the arbitrary relation between the way a word sounds and its meaning is that microorganism is a very long word that refers to a very small entity, whereas whale is a very short word that refers to something very big. This example, originally presented in Hockett's list of language's design features, has been often cited over the years, not only by those discussing the arbitrary nature of language, but also by researchers of sound symbolism. While the two groups disagreed regarding the role of arbitrariness and sound symbolism in language, they both agreed there is a nonsound symbolic relation between word length and entity size in this case. This paper shows that the length of the words whale and microorganism in fact reflects a sound symbolic pattern. An analysis of >600 languages from >100 language families shows that languages use longer words to denote the concept small than they do to denote the concept big. The paper thus shows how explicit judgments might differ from implicit cognitive association and the problem of relying on these in sound symbolism research.
Collapse
|
11
|
The Effects of Iconicity and Conventionalization on Word Order Preferences. Cogn Sci 2022; 46:e13203. [PMID: 36251421 PMCID: PMC9787421 DOI: 10.1111/cogs.13203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 08/12/2022] [Accepted: 09/04/2022] [Indexed: 12/30/2022]
Abstract
Of the six possible orderings of the three main constituents of language (subject, verb, and object), two-SOV and SVO-are predominant cross-linguistically. Previous research using the silent gesture paradigm in which hearing participants produce or respond to gestures without speech has shown that different factors such as reversibility, salience, and animacy can affect the preferences for different orders. Here, we test whether participants' preferences for orders that are conditioned on the semantics of the event change depending on (i) the iconicity of individual gestural elements and (ii) the prior knowledge of a conventional lexicon. Our findings demonstrate the same preference for semantically conditioned word order found in previous studies, specifically that SOV and SVO are preferred differentially for different types of events. We do not find that iconicity of individual gestures affects participants' ordering preferences; however, we do find that learning a lexicon leads to a stronger preference for SVO-like orders overall. Finally, we compare our findings from English speakers, using an SVO-dominant language, with data from speakers of an SOV-dominant language, Turkish. We find that, while learning a lexicon leads to an increase in SVO preference for both sets of participants, this effect is mediated by language background and event type, suggesting that an interplay of factors together determines preferences for different ordering patterns. Taken together, our results support a view of word order as a gradient phenomenon responding to multiple biases.
Collapse
|
12
|
The In-Out Effect in the Perception and Production of Real Words. Cogn Sci 2022; 46:e13193. [PMID: 36044014 PMCID: PMC9541009 DOI: 10.1111/cogs.13193] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Revised: 06/30/2022] [Accepted: 07/06/2022] [Indexed: 12/05/2022]
Abstract
The in‐out effect refers to the tendency that novel words whose consonants follow an inward‐wandering pattern (e.g., P‐T‐K) are rated more positively than stimuli whose consonants follow an outward‐wandering pattern (e.g., K‐T‐P). While this effect appears to be reliable, it is not yet clear to what extent it generalizes to existing words in a language. In two large‐scale studies, we sought to extend the in‐out effect from pseudowords to real words and from perception to production. In Study 1, we investigated whether previously collected affective ratings for English and Dutch words were more positive for inward‐wandering words and more negative for outward‐wandering words. No systematic relationship between wandering direction and affective valence was found. In Study 2, we investigated whether inward‐wandering words are more likely to occur in positive online consumer restaurant reviews written in English and Dutch, compared to negative reviews, and whether this association was stronger for food ratings than for decor ratings. Again, no systematic relationship between wandering direction and review rating emerged. We suggest that the affective states triggered by different consonantal wandering directions might be used as a cue for forming judgments in the absence of other information, but that wandering direction is too low in salience to drive the shape of words in the lexicon.
Collapse
|
13
|
Simultaneity as an Emergent Property of Efficient Communication in Language: A Comparison of Silent Gesture and Sign Language. Cogn Sci 2022; 46:e13133. [PMID: 35613353 PMCID: PMC9287048 DOI: 10.1111/cogs.13133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2020] [Revised: 02/25/2022] [Accepted: 03/16/2022] [Indexed: 11/27/2022]
Abstract
Sign languages use multiple articulators and iconicity in the visual modality which allow linguistic units to be organized not only linearly but also simultaneously. Recent research has shown that users of an established sign language such as LIS (Italian Sign Language) use simultaneous and iconic constructions as a modality‐specific resource to achieve communicative efficiency when they are required to encode informationally rich events. However, it remains to be explored whether the use of such simultaneous and iconic constructions recruited for communicative efficiency can be employed even without a linguistic system (i.e., in silent gesture) or whether they are specific to linguistic patterning (i.e., in LIS). In the present study, we conducted the same experiment as in Slonimska et al. (2020) with 23 Italian speakers using silent gesture and compared the results of the two studies. The findings showed that while simultaneity was afforded by the visual modality to some extent, its use in silent gesture was nevertheless less frequent and qualitatively different than when used within a linguistic system. Thus, the use of simultaneous and iconic constructions for communicative efficiency constitutes an emergent property of sign languages. The present study highlights the importance of studying modality‐specific resources and their use for linguistic expression in order to promote a more thorough understanding of the language faculty and its modality‐specific adaptive capabilities.
Collapse
|
14
|
Mapping Word to World in ASL: Evidence from a Human Simulation Paradigm. Cogn Sci 2021; 45:e13061. [PMID: 34861057 PMCID: PMC9365062 DOI: 10.1111/cogs.13061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2020] [Revised: 09/27/2021] [Accepted: 10/05/2021] [Indexed: 11/30/2022]
Abstract
Across languages, children map words to meaning with great efficiency, despite a seemingly unconstrained space of potential mappings. The literature on how children do this is primarily limited to spoken language. This leaves a gap in our understanding of sign language acquisition, because several of the hypothesized mechanisms that children use are visual (e.g., visual attention to the referent), and sign languages are perceived in the visual modality. Here, we used the Human Simulation Paradigm in American Sign Language (ASL) to determine potential cues to word learning. Sign-naïve adult participants viewed video clips of parent-child interactions in ASL, and at a designated point, had to guess what ASL sign the parent produced. Across two studies, we demonstrate that referential clarity in ASL interactions is characterized by access to information about word class and referent presence (for verbs), similarly to spoken language. Unlike spoken language, iconicity is a cue to word meaning in ASL, although this is not always a fruitful cue. We also present evidence that verbs are highlighted well in the input, relative to spoken English. The results shed light on both similarities and differences in the information that learners may have access to in acquiring signed versus spoken languages.
Collapse
|
15
|
Matching pictures and signs: An ERP study of the effects of iconic structural alignment in American sign language. Neuropsychologia 2021; 162:108051. [PMID: 34624260 DOI: 10.1016/j.neuropsychologia.2021.108051] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2020] [Revised: 07/28/2021] [Accepted: 10/02/2021] [Indexed: 10/20/2022]
Abstract
Event-related potentials (ERPs) were used to explore the effects of iconicity and structural visual alignment between a picture-prime and a sign-target in a picture-sign matching task in American Sign Language (ASL). Half the targets were iconic signs and were presented after a) a matching visually-aligned picture (e.g., the shape and location of the hands in the sign COW align with the depiction of a cow with visible horns), b) a matching visually-nonaligned picture (e.g., the cow's horns were not clearly shown), and c) a non-matching picture (e.g., a picture of a swing instead of a cow). The other half of the targets were filler signs. Trials in the matching condition were responded to faster than those in the non-matching condition and were associated with smaller N400 amplitudes in deaf ASL signers. These effects were also observed for hearing non-signers performing the same task with spoken-English targets. Trials where the picture-prime was aligned with the sign target were responded to faster than non-aligned trials and were associated with a reduced P3 amplitude rather than a reduced N400, suggesting that picture-sign alignment facilitated the decision process, rather than lexical access. These ERP and behavioral effects of alignment were found only for the ASL signers. The results indicate that iconicity effects on sign comprehension may reflect a task-dependent strategic use of iconicity, rather than facilitation of lexical access.
Collapse
|
16
|
Amount of Learning and Signal Stability Modulate Emergence of Structure and Iconicity in Novel Signaling Systems. Cogn Sci 2021; 45:e13057. [PMID: 34758143 PMCID: PMC9286673 DOI: 10.1111/cogs.13057] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 09/01/2021] [Accepted: 09/21/2021] [Indexed: 11/26/2022]
Abstract
Iterated language learning experiments that explore the emergence of linguistic structure in the laboratory vary considerably in methodological implementation, limiting the generalizability of findings. Most studies also restrict themselves to exploring the emergence of combinatorial and compositional structure in isolation. Here, we use a novel signal space comprising binary auditory and visual sequences and manipulate the amount of learning and temporal stability of these signals. Participants had to learn signals for meanings differing in size, shape, and brightness; their productions in the test phase were transmitted to the next participant. Across transmission chains of 10 generations each, Experiment 1 varied how much learning of auditory signals took place, and Experiment 2 varied temporal stability of visual signals. We found that combinatorial structure emerged only for auditory signals, and iconicity emerged when the amount of learning was reduced, as an opportunity for rote‐memorization hampers the exploration of the iconic affordances of the signal space. In addition, compositionality followed an inverted u‐shaped trajectory raising across several generations before declining again toward the end of the transmission chains. This suggests that detection of systematic form‐meaning linkages requires stable combinatorial units that can guide learners toward the structural properties of signals, but these combinatorial units had not yet emerged in these unfamiliar systems. Our findings underscore the importance of systematically manipulating training conditions and signal characteristics in iterated language learning experiments to study the interactions between the emergence of iconicity, combinatorial and compositional structure in novel signaling systems.
Collapse
|
17
|
Phonation Types Matter in Sound Symbolism. Cogn Sci 2021; 45:e12982. [PMID: 34018216 PMCID: PMC8244085 DOI: 10.1111/cogs.12982] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Revised: 04/01/2021] [Accepted: 04/03/2021] [Indexed: 11/28/2022]
Abstract
Sound symbolism is a non-arbitrary correspondence between sound and meaning. The majority of studies on sound symbolism have focused on consonants and vowels, and the sound-symbolic properties of suprasegmentals, particularly phonation types, have been largely neglected. This study examines the size and shape symbolism of four phonation types: modal and creaky voices, falsetto, and whisper. Japanese speakers heard 12 novel words (e.g., /íbi/, /ápa/) pronounced with the four types of phonation and rated the size and roundedness/pointedness each of the 48 stimuli seemed to represent on seven-point scales. The results showed that phonation types as well as consonantal and vocalic features influenced the ratings. Creaky voice was associated with larger and more pointed images than modal voice, which was in turn associated with larger and more pointed images than whisper. Falsetto was also associated with roundedness but not with smallness. These results shed new light on the acoustic approaches to sound symbolism and suggest the significance of phonation types and other suprasegmental features in the phenomenon.
Collapse
|
18
|
Correlations Between Handshape and Movement in Sign Languages. Cogn Sci 2021; 45:e12944. [PMID: 34018242 PMCID: PMC8243953 DOI: 10.1111/cogs.12944] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2020] [Revised: 12/27/2020] [Accepted: 12/31/2020] [Indexed: 12/04/2022]
Abstract
Sign language phonological parameters are somewhat analogous to phonemes in spoken language. Unlike phonemes, however, there is little linguistic literature arguing that these parameters interact at the sublexical level. This situation raises the question of whether such interaction in spoken language phonology is an artifact of the modality or whether sign language phonology has not been approached in a way that allows one to recognize sublexical parameter interaction. We present three studies in favor of the latter alternative: a shape‐drawing study with deaf signers from six countries, an online dictionary study of American Sign Language, and a study of selected lexical items across 34 sign languages. These studies show that, once iconicity is considered, handshape and movement parameters interact at the sublexical level. Thus, consideration of iconicity makes transparent similarities in grammar across both modalities, allowing us to maintain certain key findings of phonological theory as evidence of cognitive architecture.
Collapse
|
19
|
Iconicity and Diachronic Language Change. Cogn Sci 2021; 45:e12968. [PMID: 33877696 DOI: 10.1111/cogs.12968] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2019] [Revised: 01/20/2021] [Accepted: 03/02/2021] [Indexed: 11/27/2022]
Abstract
Iconicity, the resemblance between the form of a word and its meaning, has effects on behavior in both communicative symbol development and language learning experiments. These results have invited speculation about iconicity being a key feature of the origins of language, yet the presence of iconicity in natural languages seems limited. In a diachronic study of language change, we investigated the extent to which iconicity is a stable property of vocabulary, alongside previously investigated psycholinguistic predictors of change. Analyzing 784 English words with data on their historical forms, we found that stable words are higher in iconicity, longer in length, and earlier acquired during development, but that the role of frequency and grammatical category may be less important than previously suggested. Iconicity is revealed as a feature of ultra-conserved words and potentially also as a property of vocabulary early in the history of language origins.
Collapse
|
20
|
What Is the Buzz About Iconicity? How Iconicity in Caregiver Speech Supports Children's Word Learning. Cogn Sci 2021; 45:e12976. [PMID: 33873243 DOI: 10.1111/cogs.12976] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2020] [Revised: 03/20/2021] [Accepted: 03/23/2021] [Indexed: 11/29/2022]
Abstract
One cue that may facilitate children's word learning is iconicity, or the correspondence between a word's form and meaning. Some have even proposed that iconicity in the early lexicon may serve to help children learn how to learn words, supporting the acquisition of even noniconic, or arbitrary, word-referent associations. However, this proposal remains untested. Here, we investigate the iconicity of caregivers' speech to young children during a naturalistic free-play session with novel stimuli and ask whether the iconicity of caregivers' speech facilitates children's learning of the noniconic novel names of those stimuli. Thirty-four 1.5-2-year-olds (19 girls; half monolingual English learners and half bilingual English-Spanish learners) participated in a naturalistic free-play task with their caregivers followed by a test of word-referent retention. We found that caregivers' use of iconicity, particularly in utterances in which they named the novel stimuli, was associated with the likelihood that children learned that novel name. This result held even when controlling for other factors associated with word learning, such as the concreteness and frequency of words in caregiver speech. Together, the results demonstrate that iconicity not only can serve to help children identify the referent of novel words (as in previous research) but can also support their ability to retain even noniconic word-referent mappings.
Collapse
|
21
|
Sound symbolism shapes the English language: The maluma/takete effect in English nouns. Psychon Bull Rev 2021; 28:1390-1398. [PMID: 33821463 DOI: 10.3758/s13423-021-01883-3] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/13/2021] [Indexed: 11/08/2022]
Abstract
Sound symbolism refers to associations between language sounds (i.e., phonemes) and perceptual and/or semantic features. One example is the maluma/takete effect: an association between certain phonemes (e.g., /m/, /u/) and roundness, and others (e.g., /k/, /ɪ/) and spikiness. While this association has been demonstrated in laboratory tasks with nonword stimuli, its presence in existing spoken language is unknown. Here we examined whether the maluma/takete effect is attested in English, across a broad sample of words. Best-worst judgments from 171 university students were used to quantify the shape of 1,757 objects, from spiky to round. We then examined whether the presence of certain phonemes in words predicted the shape of the objects to which they refer. We found evidence that phonemes associated with roundness are more common in words referring to round objects, and phonemes associated with spikiness are more common in words referring to spiky objects. This represents an instance of iconicity, and thus nonarbitrariness, in human language.
Collapse
|
22
|
Abstract
Interest in iconicity (the resemblance-based mapping between aspects of form and meaning) is in the midst of a resurgence, and a prominent focus in the field has been the possible role of iconicity in language learning. Here we critically review theory and empirical findings in this domain. We distinguish local learning enhancement (where the iconicity of certain lexical items influences the learning of those items) and general learning enhancement (where the iconicity of certain lexical items influences the later learning of non-iconic items or systems). We find that evidence for local learning enhancement is quite strong, though not as clear cut as it is often described and based on a limited sample of languages. Despite common claims about broader facilitatory effects of iconicity on learning, we find that current evidence for general learning enhancement is lacking. We suggest a number of productive avenues for future research and specify what types of evidence would be required to show a role for iconicity in general learning enhancement. We also review evidence for functions of iconicity beyond word learning: iconicity enhances comprehension by providing complementary representations, supports communication about sensory imagery, and expresses affective meanings. Even if learning benefits may be modest or cross-linguistically varied, on balance, iconicity emerges as a vital aspect of language.
Collapse
|
23
|
Psycholinguistic norms for more than 300 lexical signs in German Sign Language (DGS). Behav Res Methods 2021; 53:1817-1832. [PMID: 33575986 PMCID: PMC8516755 DOI: 10.3758/s13428-020-01524-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/11/2020] [Indexed: 02/06/2023]
Abstract
Sign language offers a unique perspective on the human faculty of language by illustrating that linguistic abilities are not bound to speech and writing. In studies of spoken and written language processing, lexical variables such as, for example, age of acquisition have been found to play an important role, but such information is not as yet available for German Sign Language (Deutsche Gebärdensprache, DGS). Here, we present a set of norms for frequency, age of acquisition, and iconicity for more than 300 lexical DGS signs, derived from subjective ratings by 32 deaf signers. We also provide additional norms for iconicity and transparency for the same set of signs derived from ratings by 30 hearing non-signers. In addition to empirical norming data, the dataset includes machine-readable information about a sign’s correspondence in German and English, as well as annotations of lexico-semantic and phonological properties: one-handed vs. two-handed, place of articulation, most likely lexical class, animacy, verb type, (potential) homonymy, and potential dialectal variation. Finally, we include information about sign onset and offset for all stimulus clips from automated motion-tracking data. All norms, stimulus clips, data, as well as code used for analysis are made available through the Open Science Framework in the hope that they may prove to be useful to other researchers: 10.17605/OSF.IO/MZ8J4
Collapse
|
24
|
Are Children With Autism More Likely to Retain Object Names When Learning From Colour Photographs or Black-and-White Cartoons? J Autism Dev Disord 2020; 51:3050-3062. [PMID: 33156474 PMCID: PMC8349349 DOI: 10.1007/s10803-020-04771-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/23/2020] [Indexed: 12/21/2022]
Abstract
For the first time, this study investigated whether children with autism spectrum disorder (ASD) and typically developing (TD) children matched on language comprehension (M age equivalent = ~ 44 months) are more likely to retain words when learning from colour photographs than black-and-white cartoons. Participants used mutual exclusivity to fast map novel word-picture relationships and retention was assessed following a 5-min delay. Children with ASD achieved significantly greater retention accuracy when learning from photographs rather than cartoons and, surprisingly, responded more accurately than TD children when learning from photographs. Our results demonstrate that children with ASD benefit from greater iconicity when learning words from pictures, providing a data-grounded rationale for using colour photographs when administering picture-based interventions.
Collapse
|
25
|
Iconicity ratings for 10,995 Spanish words and their relationship with psycholinguistic variables. Behav Res Methods 2020; 53:1262-1275. [PMID: 33037603 DOI: 10.3758/s13428-020-01496-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/30/2020] [Indexed: 11/08/2022]
Abstract
The study of iconicity, or the resemblance between word forms and their meanings, has been the focus of increasing attention in recent years. Nevertheless, there is a lack of large-scale normative studies on the iconic properties of words, which could prove crucial to expanding our understanding of form-meaning associations. In this work, we report subjective iconicity ratings for 10,995 visually presented Spanish words from 1350 participants who were asked to repeat each of the words aloud before rating them. The response reliability and the consistency between the present and previous ratings were good. The relationships between iconicity and several psycholinguistic variables were examined through multiple regression analyses. We found that sensory experience ratings were the main predictor of iconicity, and that early-acquired and more abstract words received higher iconicity scores. We also found that onomatopoeias and interjections were the most iconic words, followed by adjectives. Finally, a follow-up study was conducted in which a subsample of 360 words with different levels of iconicity from the visual presentation study was auditorily presented to the participants. A high correlation was observed between the iconicity scores in the visual and auditory presentations. The normative data provided in this database might prove useful in expanding the body of knowledge on issues such as the processing of the iconic properties of words and the role of word-form associations in the acquisition of vocabularies. The database can be downloaded from https://osf.io/v5er3/ .
Collapse
|
26
|
Manual Movement in Sign Languages: One Hand Versus Two in Communicating Shapes. Cogn Sci 2020; 43:e12741. [PMID: 31529533 PMCID: PMC6771514 DOI: 10.1111/cogs.12741] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2018] [Revised: 03/24/2019] [Accepted: 04/15/2019] [Indexed: 12/03/2022]
Abstract
In sign languages, the task of communicating a shape involves drawing in the air with one moving hand (Method One) or two (Method Two). Since the movement path is iconic, method choice might be based on the shape. In the present studies we aimed to determine whether geometric properties motivate method choice. In a study of 17 deaf signers from six countries, the strongest predictors of method choice were whether the shape has any curved edges (Method One), and whether the shape is symmetrical across the Y‐axis (Method Two), where the default was Method One. In a second study of ASL dictionary entries for which the movement path of the sign is iconic of an entity's shape, the same predictors surfaced. These tendencies are captured in the Lexical Drawing Principle, which is coherent with biological constraints on movement in general. Drawing in the air with two hands, however, is costly, both cognitively and biomechanically. Furthermore, it distinguishes signers from non‐signers, who draw shapes with only one hand. Signers assume this extra cost in the lexicon because of the enhanced iconicity the possibility of two hands offers; they assume it in drawing shapes in the air because they apply the same linguistic principle they use in the lexicon. Additionally, having a choice of methods allows the signer to benefit from over‐specification in providing redundant information about the shape, enhancing comprehensibility and resolving ambiguity.
Collapse
|
27
|
Picture-naming in American Sign Language: an electrophysiological study of the effects of iconicity and structured alignment. LANGUAGE, COGNITION AND NEUROSCIENCE 2020; 36:199-210. [PMID: 33732747 PMCID: PMC7959108 DOI: 10.1080/23273798.2020.1804601] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/22/2020] [Accepted: 07/25/2020] [Indexed: 06/12/2023]
Abstract
A picture-naming task and ERPs were used to investigate effects of iconicity and visual alignment between signs and pictures in American Sign Language (ASL). For iconic signs, half the pictures visually overlapped with phonological features of the sign (e.g., the fingers of CAT align with a picture of a cat with prominent whiskers), while half did not (whiskers are not shown). Iconic signs were produced numerically faster than non-iconic signs and were associated with larger N400 amplitudes, akin to concreteness effects. Pictures aligned with iconic signs were named faster than non-aligned pictures, and there was a reduction in N400 amplitude. No behavioral effects were observed for the control group (English speakers). We conclude that sensory-motoric semantic features are represented more robustly for iconic than non-iconic signs (eliciting a concreteness-like N400 effect) and visual overlap between pictures and the phonological form of iconic signs facilitates lexical retrieval (eliciting a reduced N400).
Collapse
|
28
|
Systematic mappings between semantic categories and types of iconic representations in the manual modality: A normed database of silent gesture. Behav Res Methods 2020; 52:51-67. [PMID: 30788798 PMCID: PMC7005091 DOI: 10.3758/s13428-019-01204-6] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
An unprecedented number of empirical studies have shown that iconic gestures-those that mimic the sensorimotor attributes of a referent-contribute significantly to language acquisition, perception, and processing. However, there has been a lack of normed studies describing generalizable principles in gesture production and in comprehension of the mappings of different types of iconic strategies (i.e., modes of representation; Müller, 2013). In Study 1 we elicited silent gestures in order to explore the implementation of different types of iconic representation (i.e., acting, representing, drawing, and personification) to express concepts across five semantic domains. In Study 2 we investigated the degree of meaning transparency (i.e., iconicity ratings) of the gestures elicited in Study 1. We found systematicity in the gestural forms of 109 concepts across all participants, with different types of iconicity aligning with specific semantic domains: Acting was favored for actions and manipulable objects, drawing for nonmanipulable objects, and personification for animate entities. Interpretation of gesture-meaning transparency was modulated by the interaction between mode of representation and semantic domain, with some couplings being more transparent than others: Acting yielded higher ratings for actions, representing for object-related concepts, personification for animate entities, and drawing for nonmanipulable entities. This study provides mapping principles that may extend to all forms of manual communication (gesture and sign). This database includes a list of the most systematic silent gestures in the group of participants, a notation of the form of each gesture based on four features (hand configuration, orientation, placement, and movement), each gesture's mode of representation, iconicity ratings, and professionally filmed videos that can be used for experimental and clinical endeavors.
Collapse
|
29
|
The role of iconicity and simultaneity for efficient communication: The case of Italian Sign Language (LIS). Cognition 2020; 200:104246. [PMID: 32197151 DOI: 10.1016/j.cognition.2020.104246] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2019] [Revised: 02/09/2020] [Accepted: 02/22/2020] [Indexed: 11/17/2022]
Abstract
A fundamental assumption about language is that, regardless of language modality, it faces the linearization problem, i.e., an event that occurs simultaneously in the world has to be split in language to be organized on a temporal scale. However, the visual modality of signed languages allows its users not only to express meaning in a linear manner but also to use iconicity and multiple articulators together to encode information simultaneously. Accordingly, in cases when it is necessary to encode informatively rich events, signers can take advantage of simultaneous encoding in order to represent information about different referents and their actions simultaneously. This in turn would lead to more iconic and direct representation. Up to now, there has been no experimental study focusing on simultaneous encoding of information in signed languages and its possible advantage for efficient communication. In the present study, we assessed how many information units can be encoded simultaneously in Italian Sign Language (LIS) and whether the amount of simultaneously encoded information varies based on the amount of information that is required to be expressed. Twenty-three deaf adults participated in a director-matcher game in which they described 30 images of events that varied in amount of information they contained. Results revealed that as the information that had to be encoded increased, signers also increased use of multiple articulators to encode different information (i.e., kinematic simultaneity) and density of simultaneously encoded information in their production. Present findings show how the fundamental properties of signed languages, i.e., iconicity and simultaneity, are used for the purpose of efficient information encoding in Italian Sign Language (LIS).
Collapse
|
30
|
Hands show where things are: The close similarity between sign and natural space. Cognition 2019; 196:104106. [PMID: 31841814 DOI: 10.1016/j.cognition.2019.104106] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2017] [Revised: 09/20/2019] [Accepted: 10/10/2019] [Indexed: 10/25/2022]
Abstract
Many of the signs produced across sign languages are iconic, in the sense that they resemble the concepts they represent. We examined whether location, one of basic sign parameters along with handshape and movement, is systematically used for purposes of iconicity. Our findings revealed a mapping of vertical sign space that is exploited in its entirety for encoding typical locations in natural space. In all of the twenty sign languages we analyzed, signs were more likely to have high locations with concepts typically occurring in high vs. low regions of natural space (e.g., cloud vs. root). Furthermore, the height of signs produced to identify a visual object varied depending on object position (e.g., it was higher for basketball in the basket than basketball on the floor). It thus appears that signing space is permeable to semantic and episodic features, and iconicity plays a crucial role in making signing space so adaptable.
Collapse
|
31
|
What Does a Horgous Look Like? Nonsense Words Elicit Meaningful Drawings. Cogn Sci 2019; 43:e12791. [PMID: 31621119 DOI: 10.1111/cogs.12791] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2019] [Revised: 08/29/2019] [Accepted: 09/03/2019] [Indexed: 11/28/2022]
Abstract
To what extent do people attribute meanings to "nonsense" words? How general is such attribution of meaning? We used a set of words lacking conventional meanings to elicit drawings of made-up creatures. Separate groups of participants rated the nonsense words and the drawings on several semantic dimensions and selected what name best corresponded to each creature. Despite lacking conventional meanings, "nonsense" words elicited a high level of consistency in the produced drawings. Meaning attributions made to nonsense words corresponded with meaning attributions made by separate people to drawings that were inspired by the name. Naïve participants were able to recover the name that inspired the drawing with greater-than-chance accuracy. These results suggest that people make liberal and consistent use of non-arbitrary relationships between forms and meanings. OPEN RESEARCH BADGES: This article has been awarded Open Materials and Open Data badges. All materials and data are publicly accessible via the Open Science Framework at https://osf.io/8juyc/. Learn more about the Open Practices badges from the Center for Open Science: https://osf.io/tvyxz/wiki.
Collapse
|
32
|
Hearing non-signers use their gestures to predict iconic form-meaning mappings at first exposure to signs. Cognition 2019; 191:103996. [PMID: 31238248 DOI: 10.1016/j.cognition.2019.06.008] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2018] [Revised: 06/04/2019] [Accepted: 06/06/2019] [Indexed: 11/20/2022]
Abstract
The sign languages of deaf communities and the gestures produced by hearing people are communicative systems that exploit the manual-visual modality as means of expression. Despite their striking differences they share the property of iconicity, understood as the direct relationship between a symbol and its referent. Here we investigate whether non-signing hearing adults exploit their implicit knowledge of gestures to bootstrap accurate understanding of the meaning of iconic signs they have never seen before. In Study 1 we show that for some concepts gestures exhibit systematic forms across participants, and share different degrees of form overlap with the signs for the same concepts (full, partial, and no overlap). In Study 2 we found that signs with stronger resemblance with signs are more accurately guessed and are assigned higher iconicity ratings by non-signers than signs with low overlap. In addition, when more people produced a systematic gesture resembling a sign, they assigned higher iconicity ratings to that sign. Furthermore, participants had a bias to assume that signs represent actions and not objects. The similarities between some signs and gestures could be explained by deaf signers and hearing gesturers sharing a conceptual substrate that is rooted in our embodied experiences with the world. The finding that gestural knowledge can ease the interpretation of the meaning of novel signs and predicts iconicity ratings is in line with embodied accounts of cognition and the influence of prior knowledge to acquire new schemas. Through these mechanisms we propose that iconic gestures that overlap in form with signs may serve as some type of 'manual cognates' that help non-signing adults to break into a new language at first exposure.
Collapse
|
33
|
Abstract
Sound symbolism refers to an association between phonemes and stimuli containing particular perceptual and/or semantic elements (e.g., objects of a certain size or shape). Some of the best-known examples include the mil/mal effect (Sapir, Journal of Experimental Psychology, 12, 225-239, 1929) and the maluma/takete effect (Köhler, 1929). Interest in this topic has been on the rise within psychology, and studies have demonstrated that sound symbolic effects are relevant for many facets of cognition, including language, action, memory, and categorization. Sound symbolism also provides a mechanism by which words' forms can have nonarbitrary, iconic relationships with their meanings. Although various proposals have been put forth for how phonetic features (both acoustic and articulatory) come to be associated with stimuli, there is as yet no generally agreed-upon explanation. We review five proposals: statistical co-occurrence between phonetic features and associated stimuli in the environment, a shared property among phonetic features and stimuli; neural factors; species-general, evolved associations; and patterns extracted from language. We identify a number of outstanding questions that need to be addressed on this topic and suggest next steps for the field.
Collapse
|
34
|
Visual-graphic symbol acquisition in school age children with developmental and language delays. Augment Altern Commun 2018; 34:265-275. [PMID: 30514122 DOI: 10.1080/07434618.2018.1522547] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022] Open
Abstract
Augmented language systems have become both an integral component of communication intervention programs for children with severe communicative impairments and spurred research on their language and communication development. This study examined intrinsic and extrinsic factors that may influence the language development process for children with developmental disabilities, by exploring the relationship between varying degrees of symbol arbitrariness and extant speech comprehension skills in the discrimination, learning, and use of symbols for communication. For the study, 13 school-aged participants (M = 8.24 [years; months]), with both developmental and language delays, were provided experience with iconic Blissymbols and an arbitrary symbol set of lexigrams via observational computerized experience sessions. There was a modest difference in their ability to learn arbitrary versus iconic symbols. There were no differences if the vocabulary item was unknown prior to the symbol learning experience. These findings suggest that iconicity of a symbol may not be a critical factor in learning a symbol-referent relationship if a target referent is not yet known in comprehension.
Collapse
|
35
|
The emergence of systematicity: How environmental and communicative factors shape a novel communication system. Cognition 2018; 181:93-104. [PMID: 30173106 DOI: 10.1016/j.cognition.2018.08.014] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2018] [Revised: 08/22/2018] [Accepted: 08/22/2018] [Indexed: 10/28/2022]
Abstract
Where does linguistic structure come from? We suggest that systematicity in language evolves adaptively in response to environmental and contextual affordances associated with the practice of communication itself. In two experiments, we used a silent gesture referential game paradigm to investigate environmental and social factors promoting the propagation of systematicity in a novel communication system. We found that structure in the emerging communication systems evolve contingent on structural properties of the environment. More specifically, interlocutors spontaneously relied on structural features of the referent stimuli they communicated about to motivate systematic aspects of the evolving communication system even when idiosyncratic iconic strategies were equally afforded. Furthermore, we found systematicity to be promoted by the nature of the referent environment. When the referent environment was open and unstable, analytic systematic strategies were more likely to emerge compared to stimulus environments with a closed set of referents. Lastly, we found that displacement of communication promoted systematicity. That is, when interlocutors had to communicate about items not immediately present in the moment of communication, they were more likely to evolve systematic solutions, supposedly due to working memory advantages. Together, our findings provide experimental evidence for the idea that linguistic structure evolves adaptively from contextually situated language use.
Collapse
|
36
|
Why Choo-Choo Is Better Than Train: The Role of Register-Specific Words in Early Vocabulary Growth. Cogn Sci 2018; 42:1974-1999. [PMID: 29998604 PMCID: PMC6120503 DOI: 10.1111/cogs.12628] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2017] [Revised: 05/03/2018] [Accepted: 05/07/2018] [Indexed: 11/27/2022]
Abstract
Across languages, lexical items specific to infant-directed speech (i.e., 'baby-talk words') are characterized by a preponderance of onomatopoeia (or highly iconic words), diminutives, and reduplication. These lexical characteristics may help infants discover the referential nature of words, identify word referents, and segment fluent speech into words. If so, the amount of lexical input containing these properties should predict infants' rate of vocabulary growth. To test this prediction, we tracked the vocabulary size in 47 English-learning infants from 9 to 21 months and examined whether the patterns of growth can be related to measures of iconicity, diminutives, and reduplication in the lexical input at 9 months. Our analyses showed that both diminutives and reduplication in the input were associated with vocabulary growth, although measures of iconicity were not. These results are consistent with the hypothesis that phonological properties typical of lexical input in infant-directed speech play a role in early vocabulary growth.
Collapse
|
37
|
Do Verbal Children with Autism Comprehend Gesture as Readily as Typically Developing Children? J Autism Dev Disord 2018; 47:3267-3280. [PMID: 28744759 DOI: 10.1007/s10803-017-3243-9] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Gesture comprehension remains understudied, particularly in children with autism spectrum disorder (ASD) who have difficulties in gesture production. Using a novel gesture comprehension task, Study 1 examined how 2- to 4-year-old typically-developing (TD) children comprehend types of gestures and gesture-speech combinations, and showed better comprehension of deictic gestures and reinforcing gesture-speech combinations than iconic/conventional gestures and supplementary gesture-speech combinations at each age. Study 2 compared verbal children with ASD to TD children, comparable in receptive language ability, and showed similar patterns of comprehension in each group. Our results suggest that children comprehend deictic gestures and reinforcing gesture-speech combinations better than iconic/conventional gestures and supplementary combinations-a pattern that remains robust across different ages within TD children and children with ASD.
Collapse
|
38
|
Mapping language to visual referents: Does the degree of image realism matter? Acta Psychol (Amst) 2018; 182:91-99. [PMID: 29154035 DOI: 10.1016/j.actpsy.2017.11.003] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2017] [Revised: 10/10/2017] [Accepted: 11/04/2017] [Indexed: 11/28/2022] Open
Abstract
Studies of real-time spoken language comprehension have shown that listeners rapidly map unfolding speech to available referents in the immediate visual environment. This has been explored using various kinds of 2-dimensional (2D) stimuli, with convenience or availability typically motivating the choice of a particular image type. However, work in other areas has suggested that certain cognitive processes are sensitive to the level of realism in 2D representations. The present study examined the process of mapping language to depictions of objects that are more or less realistic, namely photographs versus clipart images. A custom stimulus set was first created by generating clipart images directly from photographs of real objects. Two visual world experiments were then conducted, varying whether referent identification was driven by noun or verb information. A modest benefit for clipart stimuli was observed during real-time processing, but only for noun-driving mappings. The results are discussed in terms of their implications for studies of visually situated language processing.
Collapse
|
39
|
Abstract
ASL-LEX is a lexical database that catalogues information about nearly 1,000 signs in American Sign Language (ASL). It includes the following information: subjective frequency ratings from 25-31 deaf signers, iconicity ratings from 21-37 hearing non-signers, videoclip duration, sign length (onset and offset), grammatical class, and whether the sign is initialized, a fingerspelled loan sign, or a compound. Information about English translations is available for a subset of signs (e.g., alternate translations, translation consistency). In addition, phonological properties (sign type, selected fingers, flexion, major and minor location, and movement) were coded and used to generate sub-lexical frequency and neighborhood density estimates. ASL-LEX is intended for use by researchers, educators, and students who are interested in the properties of the ASL lexicon. An interactive website where the database can be browsed and downloaded is available at http://asl-lex.org .
Collapse
|
40
|
"I use it when I see it": The role of development and experience in Deaf and hearing children's understanding of iconic gesture. Cognition 2017; 162:73-86. [PMID: 28219036 DOI: 10.1016/j.cognition.2017.01.015] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2015] [Revised: 01/06/2017] [Accepted: 01/21/2017] [Indexed: 10/19/2022]
Abstract
Iconicity is prevalent in gesture and in sign languages, yet the degree to which children recognize and leverage iconicity for early language learning is unclear. In Experiment 1 of the current study, we presented sign-naïve 3-, 4- and 5-year-olds (n=87) with iconic shape gestures and no additional scaffolding to ask whether children can spontaneously map iconic gestures to their referents. Four- and five-year-olds, but not three-year-olds, recognized the referents of iconic shape gestures above chance. Experiment 2 asked whether preschoolers (n=93) show an advantage in fast-mapping iconic gestures compared to arbitrary ones. We found that iconicity played a significant role in supporting 4- and 5-year-olds' ability to learn new gestures presented in an explicit pedagogical context, and a lesser role in 3-year-olds' learning. Using similar tasks in Experiment 3, we found that Deaf preschoolers (n=41) exposed to American Sign Language showed a similar pattern of recognition and learning but starting at an earlier age, suggesting that learning a language with rich iconicity may lead to earlier use of iconicity. These results suggest that sensitivity to iconicity is shaped by experience, and while not fundamental to the earliest stages of language development, is a useful tool once children unlock these form-meaning relationships.
Collapse
|
41
|
Abstract
In face-to-face communication, speakers typically integrate information acquired through different sources, including what they see and what they know, into their communicative messages. In this study, we asked how these different input sources influence the frequency and type of iconic gestures produced by speakers during a communication task, under two degrees of task complexity. Specifically, we investigated whether speakers gestured differently when they had to describe an object presented to them as an image or as a written word (input modality) and, additionally, when they were allowed to explicitly name the object or not (task complexity). Our results show that speakers produced more gestures when they attended to a picture. Further, speakers more often gesturally depicted shape information when attended to an image, and they demonstrated the function of an object more often when they attended to a word. However, when we increased the complexity of the task by forbidding speakers to name the target objects, these patterns disappeared, suggesting that speakers may have strategically adapted their use of iconic strategies to better meet the task’s goals. Our study also revealed (independent) effects of object manipulability on the type of gestures produced by speakers and, in general, it highlighted a predominance of molding and handling gestures. These gestures may reflect stronger motoric and haptic simulations, lending support to activation-based gesture production accounts.
Collapse
|
42
|
Abstract
In language, a small number of meaningless building blocks can be combined into an unlimited set of meaningful utterances. This is known as combinatorial structure. One hypothesis for the initial emergence of combinatorial structure in language is that recombining elements of signals solves the problem of overcrowding in a signal space. Another hypothesis is that iconicity may impede the emergence of combinatorial structure. However, how these two hypotheses relate to each other is not often discussed. In this paper, we explore how signal space dimensionality relates to both overcrowding in the signal space and iconicity. We use an artificial signalling experiment to test whether a signal space and a meaning space having similar topologies will generate an iconic system and whether, when the topologies differ, the emergence of combinatorially structured signals is facilitated. In our experiments, signals are created from participants' hand movements, which are measured using an infrared sensor. We found that participants take advantage of iconic signal-meaning mappings where possible. Further, we use trajectory predictability, measures of variance, and Hidden Markov Models to measure the use of structure within the signals produced and found that when topologies do not match, then there is more evidence of combinatorial structure. The results from these experiments are interpreted in the context of the differences between the emergence of combinatorial structure in different linguistic modalities (speech and sign).
Collapse
|
43
|
Abstract
Analogy researchers do not often examine gesture, and gesture researchers do not often borrow ideas from the study of analogy. One borrowable idea from the world of analogy is the importance of distinguishing between attributes and relations. Gentner (, ) observed that some metaphors highlight attributes and others highlight relations, and called the latter analogies. Mirroring this logic, we observe that some metaphoric gestures represent attributes and others represent relations, and propose to call the latter analogical gestures. We provide examples of such analogical gestures and show how they relate to the categories of iconic and metaphoric gestures described previously. Analogical gestures represent different types of relations and different degrees of relational complexity, and sometimes cohere into larger analogical models. Treating analogical gestures as a distinct phenomenon prompts new questions and predictions, and illustrates one way that the study of gesture and the study of analogy can be mutually informative.
Collapse
|
44
|
The Interactive Origin of Iconicity. Cogn Sci 2017; 42:334-349. [PMID: 28503811 DOI: 10.1111/cogs.12497] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2016] [Revised: 02/28/2017] [Accepted: 03/07/2017] [Indexed: 11/30/2022]
Abstract
We investigate the emergence of iconicity, specifically a bouba-kiki effect in miniature artificial languages under different functional constraints: when the languages are reproduced and when they are used communicatively. We ran transmission chains of (a) participant dyads who played an interactive communicative game and (b) individual participants who played a matched learning game. An analysis of the languages over six generations in an iterated learning experiment revealed that in the Communication condition, but not in the Reproduction condition, words for spiky shapes tend to be rated by naive judges as more spiky than the words for round shapes. This suggests that iconicity may not only be the outcome of innovations introduced by individuals, but, crucially, the result of interlocutor negotiation of new communicative conventions. We interpret our results as an illustration of cultural evolution by random mutation and selection (as opposed to by guided variation).
Collapse
|
45
|
Arbitrariness, Iconicity, and Systematicity in Language. Trends Cogn Sci 2016; 19:603-615. [PMID: 26412098 DOI: 10.1016/j.tics.2015.07.013] [Citation(s) in RCA: 156] [Impact Index Per Article: 19.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2015] [Revised: 07/20/2015] [Accepted: 07/30/2015] [Indexed: 10/23/2022]
Abstract
The notion that the form of a word bears an arbitrary relation to its meaning accounts only partly for the attested relations between form and meaning in the languages of the world. Recent research suggests a more textured view of vocabulary structure, in which arbitrariness is complemented by iconicity (aspects of form resemble aspects of meaning) and systematicity (statistical regularities in forms predict function). Experimental evidence suggests these form-to-meaning correspondences serve different functions in language processing, development, and communication: systematicity facilitates category learning by means of phonological cues, iconicity facilitates word learning and communication by means of perceptuomotor analogies, and arbitrariness facilitates meaning individuation through distinctive forms. Processes of cultural evolution help to explain how these competing motivations shape vocabulary structure.
Collapse
|
46
|
Iconicity and the Emergence of Combinatorial Structure in Language. Cogn Sci 2015; 40:1969-1994. [PMID: 26706244 DOI: 10.1111/cogs.12326] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2014] [Revised: 06/11/2015] [Accepted: 09/16/2015] [Indexed: 11/29/2022]
Abstract
In language, recombination of a discrete set of meaningless building blocks forms an unlimited set of possible utterances. How such combinatorial structure emerged in the evolution of human language is increasingly being studied. It has been shown that it can emerge when languages culturally evolve and adapt to human cognitive biases. How the emergence of combinatorial structure interacts with the existence of holistic iconic form-meaning mappings in a language is still unknown. The experiment presented in this paper studies the role of iconicity and human cognitive learning biases in the emergence of combinatorial structure in artificial whistled languages. Participants learned and reproduced whistled words for novel objects with the use of a slide whistle. Their reproductions were used as input for the next participant, to create transmission chains and simulate cultural transmission. Two conditions were studied: one in which the persistence of iconic form-meaning mappings was possible and one in which this was experimentally made impossible. In both conditions, cultural transmission caused the whistled languages to become more learnable and more structured, but this process was slightly delayed in the first condition. Our findings help to gain insight into when and how words may lose their iconic origins when they become part of an organized linguistic system.
Collapse
|
47
|
Learning from gesture: How early does it happen? Cognition 2015; 142:138-47. [PMID: 26036925 DOI: 10.1016/j.cognition.2015.05.018] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2014] [Revised: 05/08/2015] [Accepted: 05/22/2015] [Indexed: 10/23/2022]
Abstract
Iconic gesture is a rich source of information for conveying ideas to learners. However, in order to learn from iconic gesture, a learner must be able to interpret its iconic form-a nontrivial task for young children. Our study explores how young children interpret iconic gesture and whether they can use it to infer a previously unknown action. In Study 1, 2- and 3-year-old children were shown iconic gestures that illustrated how to operate a novel toy to achieve a target action. Children in both age groups successfully figured out the target action more often after seeing an iconic gesture demonstration than after seeing no demonstration. However, the 2-year-olds (but not the 3-year-olds) figured out fewer target actions after seeing an iconic gesture demonstration than after seeing a demonstration of an incomplete-action and, in this sense, were not yet experts at interpreting gesture. Nevertheless, both age groups seemed to understand that gesture could convey information that can be used to guide their own actions, and that gesture is thus not movement for its own sake. That is, the children in both groups produced the action displayed in gesture on the object itself, rather than producing the action in the air (in other words, they rarely imitated the experimenter's gesture as it was performed). Study 2 compared 2-year-olds' performance following iconic vs. point gesture demonstrations. Iconic gestures led children to discover more target actions than point gestures, suggesting that iconic gesture does more than just focus a learner's attention, it conveys substantive information about how to solve the problem, information that is accessible to children as young as 2. The ability to learn from iconic gesture is thus in place by toddlerhood and, although still fragile, allows children to process gesture, not as meaningless movement, but as an intentional communicative representation.
Collapse
|
48
|
On the temporal dynamics of sign production: An ERP study in Catalan Sign Language (LSC). Brain Res 2015; 1609:40-53. [PMID: 25801115 DOI: 10.1016/j.brainres.2015.03.013] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2014] [Revised: 03/05/2015] [Accepted: 03/08/2015] [Indexed: 11/30/2022]
Abstract
This study investigates the temporal dynamics of sign production and how particular aspects of the signed modality influence the early stages of lexical access. To that end, we explored the electrophysiological correlates associated to sign frequency and iconicity in a picture signing task in a group of bimodal bilinguals. Moreover, a subset of the same participants was tested in the same task but naming the pictures instead. Our results revealed that both frequency and iconicity influenced lexical access in sign production. At the ERP level, iconicity effects originated very early in the course of signing (while absent in the spoken modality), suggesting a stronger activation of the semantic properties for iconic signs. Moreover, frequency effects were modulated by iconicity, suggesting that lexical access in signed language is determined by the iconic properties of the signs. These results support the idea that lexical access is sensitive to the same phenomena in word and sign production, but its time-course is modulated by particular aspects of the modality in which a lexical item will be finally articulated.
Collapse
|
49
|
What is the link between synaesthesia and sound symbolism? Cognition 2015; 136:186-95. [PMID: 25498744 PMCID: PMC4415500 DOI: 10.1016/j.cognition.2014.11.013] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2012] [Revised: 11/04/2014] [Accepted: 11/17/2014] [Indexed: 10/24/2022]
Abstract
Sound symbolism is a property of certain words which have a direct link between their phonological form and their semantic meaning. In certain instances, sound symbolism can allow non-native speakers to understand the meanings of etymologically unfamiliar foreign words, although the mechanisms driving this are not well understood. We examined whether sound symbolism might be mediated by the same types of cross-modal processes that typify synaesthetic experiences. Synaesthesia is an inherited condition in which sensory or cognitive stimuli (e.g., sounds, words) cause additional, unusual cross-modal percepts (e.g., sounds trigger colours, words trigger tastes). Synaesthesia may be an exaggeration of normal cross-modal processing, and if so, there may be a link between synaesthesia and the type of cross-modality inherent in sound symbolism. To test this we predicted that synaesthetes would have superior understanding of unfamiliar (sound symbolic) foreign words. In our study, 19 grapheme-colour synaesthetes and 57 non-synaesthete controls were presented with 400 adjectives from 10 unfamiliar languages and were asked to guess the meaning of each word in a two-alternative forced-choice task. Both groups showed superior understanding compared to chance levels, but synaesthetes significantly outperformed controls. This heightened ability suggests that sound symbolism may rely on the types of cross-modal integration that drive synaesthetes' unusual experiences. It also suggests that synaesthesia endows or co-occurs with heightened multi-modal skills, and that this can arise in domains unrelated to the specific form of synaesthesia.
Collapse
|
50
|
When semantics aids phonology: A processing advantage for iconic word forms in aphasia. Neuropsychologia 2015; 76:264-75. [PMID: 25637775 DOI: 10.1016/j.neuropsychologia.2015.01.042] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2014] [Revised: 01/09/2015] [Accepted: 01/20/2015] [Indexed: 11/24/2022]
Abstract
Iconicity is the non-arbitrary relation between properties of a phonological form and semantic content (e.g. "moo", "splash"). It is a common feature of both spoken and signed languages, and recent evidence shows that iconic forms confer an advantage during word learning. We explored whether iconic forms conferred a processing advantage for 13 individuals with aphasia following left-hemisphere stroke. Iconic and control words were compared in four different tasks: repetition, reading aloud, auditory lexical decision and visual lexical decision. An advantage for iconic words was seen for some individuals in all tasks, with consistent group effects emerging in reading aloud and auditory lexical decision. Both these tasks rely on mapping between semantics and phonology. We conclude that iconicity aids spoken word processing for individuals with aphasia. This advantage is due to a stronger connection between semantic information and phonological forms.
Collapse
|