Nonverbal category knowledge limits the amount of information encoded in object representations: EEG evidence from 12-month-old infants

Helpless infants are learning a foundation model

Humans have a protracted postnatal helplessness period, typically attributed to human-specific maternal constraints causing an early birth when the brain is highly immature. By aligning neurodevelopmental events across species, however, it has been found that humans are not born with especially immature brains compared with animal species with a shorter helpless period. Consistent with this, the rapidly growing field of infant neuroimaging has found that brain connectivity and functional activation at birth share many similarities with the mature brain. Inspired by machine learning, where deep neural networks also benefit from a 'helpless period' of pre-training, we propose that human infants are learning a foundation model: a set of fundamental representations that underpin later cognition with high performance and rapid generalisation.

The language-of-thought hypothesis as a working hypothesis in cognitive science

The target article attempted to draw connections between broad swaths of evidence by noticing a common thread: Abstract, symbolic, compositional codes, that is, language-of-thoughts (LoTs). Commentators raised concerns about the evidence and offered fascinating extensions to areas we overlooked. Here we respond and highlight the many specific empirical questions to be answered in the next decade and beyond.

An object's categorizability impacts whether infants encode surface features into their object representations

Infants encode the surface features of simple, unfamiliar objects (e.g., red triangle) and the categorical identities of familiar, categorizable objects (e.g., car) into their representations of these objects. We asked whether 16-18-month-olds ignore non-diagnostic surface features (e.g., color) in favor of encoding an object's categorical identity (e.g., car) when objects are from familiar categories. In Experiment 1 (n = 18), we hid a categorizable object inside an opaque box. In No Switch trials, infants retrieved the object that was hidden. In Switch trials, infants retrieved a different object: an object from a different category (Between-Category-Switch trials) or a different object from the same category (Within-Category-Switch trials). We measured infants' subsequent searching in the box. Infants' pattern of searching suggested that only infants who completed a Within-Category-Switch trial as their first Switch trial encoded objects' surface features, and an exploratory analysis suggested that infants who completed a Between-Category-Switch trial as their first Switch trial only encoded objects' categories. In Experiment 2 (n = 18), we confirmed that these results were due to objects' categorizability. These results suggest infants may tailor the way they encode categorizable objects depending on which object dimensions are perceived to be task relevant.

A principled link between object naming and representation is available to infants by seven months of age

By their first birthdays, infants represent objects flexibly as a function of not only whether but how the objects are named. Applying the same name to a set of different objects from the same category supports object categorization, with infants encoding commonalities among objects at the expense of individuating details. In contrast, applying a distinct name to each object supports individuation, with infants encoding distinct features at the expense of categorical information. Here, we consider the development of this nuanced link between naming and representation in infants' first year. Infants at 12 months (Study 1; N = 55) and 7 months (Study 2; N = 96) participated in an online recognition memory task. All infants saw the same objects, but their recognition of these objects at test varied as a function of how they had been named. At both ages, infants successfully recognized objects that had been named with distinct labels but failed to recognize these objects when they had all been named with the same, consistent label. This new evidence demonstrates that a principled link between object naming and representation is available by 7 months, early enough to support infants as they begin mapping words to meaning.

The best game in town: The reemergence of the language-of-thought hypothesis across the cognitive sciences

Mental representations remain the central posits of psychology after many decades of scrutiny. However, there is no consensus about the representational format(s) of biological cognition. This paper provides a survey of evidence from computational cognitive psychology, perceptual psychology, developmental psychology, comparative psychology, and social psychology, and concludes that one type of format that routinely crops up is the language-of-thought (LoT). We outline six core properties of LoTs: (i) discrete constituents; (ii) role-filler independence; (iii) predicate-argument structure; (iv) logical operators; (v) inferential promiscuity; and (vi) abstract content. These properties cluster together throughout cognitive science. Bayesian computational modeling, compositional features of object perception, complex infant and animal reasoning, and automatic, intuitive cognition in adults all implicate LoT-like structures. Instead of regarding LoT as a relic of the previous century, researchers in cognitive science and philosophy-of-mind must take seriously the explanatory breadth of LoT-based architectures. We grant that the mind may harbor many formats and architectures, including iconic and associative structures as well as deep-neural-network-like architectures. However, as computational/representational approaches to the mind continue to advance, classical compositional symbolic structures - that is, LoTs - only prove more flexible and well-supported over time.

Nonverbal Action Interpretation Guides Novel Word Disambiguation in 12-Month-Olds

Whether young infants can exploit sociopragmatic information to interpret new words is a matter of debate. Based on findings and theories from the action interpretation literature, we hypothesized that 12-month-olds should distinguish communicative object-directed actions expressing reference from instrumental object-directed actions indicative of one’s goals, and selectively use the former to identify referents of novel linguistic expressions. This hypothesis was tested across four eye-tracking experiments. Infants watched pairs of unfamiliar objects, one of which was first targeted by either a communicative action (e.g., pointing) or an instrumental action (e.g., grasping) and then labeled with a novel word. As predicted, infants fast-mapped the novel words onto the targeted objects after pointing (Experiments 1 and 4) but not after grasping (Experiment 2) unless the grasping action was preceded by an ostensive signal (Experiment 3). Moreover, whenever infants mapped a novel word onto the object indicated by a communicative action, they tended to map a different novel word onto the distractor object, displaying a mutual exclusivity effect. This reliance on nonverbal action interpretation in the disambiguation of novel words indicates that sociopragmatic inferences about reference likely supplement associative and statistical learning mechanisms from the outset of word learning.

Nonverbal category knowledge limits the amount of information encoded in object representations: EEG evidence from 12-month-old infants

To what extent does language shape how we think about the world? Studies suggest that linguistic symbols expressing conceptual categories ('apple', 'squirrel') make us focus on categorical information (e.g. that you saw a squirrel) and disregard individual information (e.g. whether that squirrel had a long or short tail). Across two experiments with preverbal infants, we demonstrated that it is not language but nonverbal category knowledge that determines what information is packed into object representations. Twelve-month-olds (N = 48) participated in an electroencephalography (EEG) change-detection task involving objects undergoing a brief occlusion. When viewing objects from unfamiliar categories, infants detected both across- and within-category changes, as evidenced by their negative central wave (Nc) event-related potential. Conversely, when viewing objects from familiar categories, they did not respond to within-category changes, which indicates that nonverbal category knowledge interfered with the representation of individual surface features necessary to detect such changes. Furthermore, distinct patterns of γ and α oscillations between familiar and unfamiliar categories were evident before and during occlusion, suggesting that categorization had an influence on the format of recruited object representations. Thus, we show that nonverbal category knowledge has rapid and enduring effects on object representation and discuss their functional significance for generic knowledge acquisition in the absence of language.