51
|
Kolvoort IR, Fisher EL, van Rooij R, Schulz K, van Maanen L. Probabilistic causal reasoning under time pressure. PLoS One 2024; 19:e0297011. [PMID: 38603716 PMCID: PMC11008876 DOI: 10.1371/journal.pone.0297011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2023] [Accepted: 12/26/2023] [Indexed: 04/13/2024] Open
Abstract
While causal reasoning is a core facet of our cognitive abilities, its time-course has not received proper attention. As the duration of reasoning might prove crucial in understanding the underlying cognitive processes, we asked participants in two experiments to make probabilistic causal inferences while manipulating time pressure. We found that participants are less accurate under time pressure, a speed-accuracy-tradeoff, and that they respond more conservatively. Surprisingly, two other persistent reasoning errors-Markov violations and failures to explain away-appeared insensitive to time pressure. These observations seem related to confidence: Conservative inferences were associated with low confidence, whereas Markov violations and failures to explain were not. These findings challenge existing theories that predict an association between time pressure and all causal reasoning errors including conservatism. Our findings suggest that these errors should not be attributed to a single cognitive mechanism and emphasize that causal judgements are the result of multiple processes.
Collapse
Affiliation(s)
- Ivar R. Kolvoort
- Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands
- Institute for Logic, Language, and Computation, University of Amsterdam, Amsterdam, The Netherlands
- Department of Experimental Psychology, Utrecht University, Utrecht, The Netherlands
| | - Elizabeth L. Fisher
- Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands
- Turner Institute for Brain and Mental Health, School of Psychological Sciences, and Cognition & Philosophy Laboratory, Monash University, Clayton, Australia
| | - Robert van Rooij
- Institute for Logic, Language, and Computation, University of Amsterdam, Amsterdam, The Netherlands
| | - Katrin Schulz
- Institute for Logic, Language, and Computation, University of Amsterdam, Amsterdam, The Netherlands
| | - Leendert van Maanen
- Department of Experimental Psychology, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
52
|
Gotzner N, Scontras G. On the Role of Loopholes in Polite Communication: Linking Subjectivity and Pragmatic Inference. Open Mind (Camb) 2024; 8:500-510. [PMID: 38681213 PMCID: PMC11049673 DOI: 10.1162/opmi_a_00133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Accepted: 02/14/2024] [Indexed: 05/01/2024] Open
Abstract
Existing proposals on the attenuating uses of indirect, negated expressions (e.g., not happy to mean sad) agree that speakers exploit indirectness for pragmatic purposes but differ on the underlying sources they attribute to these uses. Here, we synthesize existing proposals via adjective subjectivity, which operationalizes the notion of loopholes for plausible deniability. We present experimental evidence that the degree of subjectivity of an adjective predicts the degree to which participants strengthen the negated adjective's meaning, but only if the adjective under consideration has an evaluatively-positive meaning. This finding indicates that speakers may intentionally use negation to leave themselves the option to retract the implicated face-threatening meaning if openly challenged.
Collapse
Affiliation(s)
- Nicole Gotzner
- Cognitive Science Institute, Osnabrück University, Osnabrück, Germany
| | - Gregory Scontras
- Department of Language Science, University of California, Irvine, Irvine, CA, USA
| |
Collapse
|
53
|
Berent I. Consciousness isn't "hard"-it's human psychology that makes it so! Neurosci Conscious 2024; 2024:niae016. [PMID: 38585293 PMCID: PMC10996123 DOI: 10.1093/nc/niae016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Revised: 01/23/2024] [Accepted: 03/26/2024] [Indexed: 04/09/2024] Open
Abstract
Consciousness arguably presents a "hard problem" for scholars. An influential position asserts that the "problem" is rooted in ontology-it arises because consciousness "is" distinct from the physical. "Problem intuitions" are routinely taken as evidence for this view. In so doing, it is assumed that (i) people do not consider consciousness as physical and (ii) their intuitions faithfully reflect what exists (or else, intuitions would not constitute evidence). New experimental results challenge both claims. First, in some scenarios, people demonstrably view consciousness as a physical affair that registers in the body (brain). Second, "problem intuitions" are linked to psychological biases, so they cannot be trusted to reflect what consciousness is. I conclude that the roots of the "hard problem" are partly psychological. Accordingly, its resolution requires careful characterization of the psychological mechanisms that engender "problem intuitions."
Collapse
Affiliation(s)
- Iris Berent
- Department of Psychology, Northeastern University, 360 Huntington Ave., Boston, MA 02115, USA
| |
Collapse
|
54
|
Prado J, Knops A. Spatial attention in mental arithmetic: A literature review and meta-analysis. Psychon Bull Rev 2024:10.3758/s13423-024-02499-z. [PMID: 38565841 DOI: 10.3758/s13423-024-02499-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/06/2024] [Indexed: 04/04/2024]
Abstract
We review the evidence for the conceptual association between arithmetic and space and quantify the effect size in meta-analyses. We focus on three effects: (a) the operational momentum effect (OME), which has been defined as participants' tendency to overestimate results of addition problems and underestimate results of subtraction problems; (b) the arithmetic cueing effect, in which arithmetic problems serve as spatial cues in target detection or temporal order judgment tasks; and (c) the associations between arithmetic and space observed with eye- and hand-tracking studies. The OME was consistently found in paradigms that provided the participants with numerical response alternatives. The OME shows a large effect size, driven by an underestimation during subtraction while addition was unbiased. In contrast, paradigms in which participants indicated their estimate by transcoding their final estimate to a spatial reference frame revealed no consistent OME. Arithmetic cueing studies show a reliable small to medium effect size, driven by a rightward bias for addition. Finally, eye- and hand-tracking studies point to replicable associations between arithmetic and eye or hand movements. To account for the complexity of the observed pattern, we introduce the Adaptive Pathways in Mental Arithmetic (APiMA) framework. The model accommodates central notions of numerical and arithmetic processing and helps identifying which pathway a given paradigm operates on. It proposes that the divergence between OME and arithmetic cueing studies comes from the predominant use of non-symbolic versus symbolic stimuli, respectively. Overall, our review and findings clearly support an association between arithmetic and spatial processing.
Collapse
Affiliation(s)
- Jérôme Prado
- Centre de Recherche en Neurosciences de Lyon (CRNL), INSERM U1028 - CNRS UMR5292, Université de Lyon, Lyon, France
| | - André Knops
- Université Paris Cité, LaPsyDÉ, CNRS, F-75005, Paris, France.
| |
Collapse
|
55
|
Long B, Goodin S, Kachergis G, Marchman VA, Radwan SF, Sparks RZ, Xiang V, Zhuang C, Hsu O, Newman B, Yamins DLK, Frank MC. The BabyView camera: Designing a new head-mounted camera to capture children's early social and visual environments. Behav Res Methods 2024; 56:3523-3534. [PMID: 37656342 DOI: 10.3758/s13428-023-02206-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/24/2023] [Indexed: 09/02/2023]
Abstract
Head-mounted cameras have been used in developmental psychology research for more than a decade to provide a rich and comprehensive view of what infants see during their everyday experiences. However, variation between these devices has limited the field's ability to compare results across studies and across labs. Further, the video data captured by these cameras to date has been relatively low-resolution, limiting how well machine learning algorithms can operate over these rich video data. Here, we provide a well-tested and easily constructed design for a head-mounted camera assembly-the BabyView-developed in collaboration with Daylight Design, LLC., a professional product design firm. The BabyView collects high-resolution video, accelerometer, and gyroscope data from children approximately 6-30 months of age via a GoPro camera custom mounted on a soft child-safety helmet. The BabyView also captures a large, portrait-oriented vertical field-of-view that encompasses both children's interactions with objects and with their social partners. We detail our protocols for video data management and for handling sensitive data from home environments. We also provide customizable materials for onboarding families with the BabyView. We hope that these materials will encourage the wide adoption of the BabyView, allowing the field to collect high-resolution data that can link children's everyday environments with their learning outcomes.
Collapse
Affiliation(s)
- Bria Long
- Department of Psychology, Stanford University, Stanford, CA, USA.
| | | | - George Kachergis
- Department of Psychology, Stanford University, Stanford, CA, USA
| | | | - Samaher F Radwan
- Department of Psychology, Stanford University, Stanford, CA, USA
- Graduate School of Education, Stanford University, Stanford, CA, USA
| | - Robert Z Sparks
- Department of Psychology, Stanford University, Stanford, CA, USA
| | - Violet Xiang
- Department of Psychology, Stanford University, Stanford, CA, USA
| | - Chengxu Zhuang
- Department of Psychology, Stanford University, Stanford, CA, USA
| | - Oliver Hsu
- Daylight Design, LLC, San Francisco, CA, USA
| | | | - Daniel L K Yamins
- Department of Psychology, Stanford University, Stanford, CA, USA
- Department of Computer Science, Stanford University, Stanford, CA, USA
| | - Michael C Frank
- Department of Psychology, Stanford University, Stanford, CA, USA
| |
Collapse
|
56
|
Goldstone RL, Andrade-Lotero EJ, Hawkins RD, Roberts ME. The Emergence of Specialized Roles Within Groups. Top Cogn Sci 2024; 16:257-281. [PMID: 36843212 DOI: 10.1111/tops.12644] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2022] [Revised: 02/08/2023] [Accepted: 02/09/2023] [Indexed: 02/28/2023]
Abstract
Humans routinely form groups to achieve goals that no individual can accomplish alone. Group coordination often brings to mind synchrony and alignment, where all individuals do the same thing (e.g., driving on the right side of the road, marching in lockstep, or playing musical instruments on a regular beat). Yet, effective coordination also typically involves differentiation, where specialized roles emerge for different members (e.g., prep stations in a kitchen or positions on an athletic team). Role specialization poses a challenge for computational models of group coordination, which have largely focused on achieving synchrony. Here, we present the CARMI framework, which characterizes role specialization processes in terms of five core features that we hope will help guide future model development: Communication, Adaptation to feedback, Repulsion, Multi-level planning, and Intention modeling. Although there are many paths to role formation, we suggest that roles emerge when each agent in a group dynamically allocates their behavior toward a shared goal to complement what they expect others to do. In other words, coordination concerns beliefs (who will do what) rather than simple actions. We describe three related experimental paradigms-"Group Binary Search," "Battles of the Exes," and "Find the Unicorn"-that we have used to study differentiation processes in the lab, each emphasizing different aspects of the CARMI framework.
Collapse
|
57
|
Huber E, Sauppe S, Isasi-Isasmendi A, Bornkessel-Schlesewsky I, Merlo P, Bickel B. Surprisal From Language Models Can Predict ERPs in Processing Predicate-Argument Structures Only if Enriched by an Agent Preference Principle. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2024; 5:167-200. [PMID: 38645615 PMCID: PMC11025647 DOI: 10.1162/nol_a_00121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Accepted: 08/30/2023] [Indexed: 04/23/2024]
Abstract
Language models based on artificial neural networks increasingly capture key aspects of how humans process sentences. Most notably, model-based surprisals predict event-related potentials such as N400 amplitudes during parsing. Assuming that these models represent realistic estimates of human linguistic experience, their success in modeling language processing raises the possibility that the human processing system relies on no other principles than the general architecture of language models and on sufficient linguistic input. Here, we test this hypothesis on N400 effects observed during the processing of verb-final sentences in German, Basque, and Hindi. By stacking Bayesian generalised additive models, we show that, in each language, N400 amplitudes and topographies in the region of the verb are best predicted when model-based surprisals are complemented by an Agent Preference principle that transiently interprets initial role-ambiguous noun phrases as agents, leading to reanalysis when this interpretation fails. Our findings demonstrate the need for this principle independently of usage frequencies and structural differences between languages. The principle has an unequal force, however. Compared to surprisal, its effect is weakest in German, stronger in Hindi, and still stronger in Basque. This gradient is correlated with the extent to which grammars allow unmarked NPs to be patients, a structural feature that boosts reanalysis effects. We conclude that language models gain more neurobiological plausibility by incorporating an Agent Preference. Conversely, theories of human processing profit from incorporating surprisal estimates in addition to principles like the Agent Preference, which arguably have distinct evolutionary roots.
Collapse
Affiliation(s)
- Eva Huber
- Department of Comparative Language Science, University of Zurich, Zurich, Switzerland
- Center for the Interdisciplinary Study of Language Evolution, University of Zurich, Zurich, Switzerland
| | - Sebastian Sauppe
- Department of Comparative Language Science, University of Zurich, Zurich, Switzerland
- Center for the Interdisciplinary Study of Language Evolution, University of Zurich, Zurich, Switzerland
- Department of Psychology, University of Zurich, Zurich, Switzerland
| | - Arrate Isasi-Isasmendi
- Department of Comparative Language Science, University of Zurich, Zurich, Switzerland
- Center for the Interdisciplinary Study of Language Evolution, University of Zurich, Zurich, Switzerland
| | - Ina Bornkessel-Schlesewsky
- Cognitive Neuroscience Laboratory, Australian Research Centre for Interactive and Virtual Environments, University of South Australia, Adelaide, Australia
| | - Paola Merlo
- Department of Linguistics, University of Geneva, Geneva, Switzerland
- University Center for Computer Science, University of Geneva, Geneva, Switzerland
| | - Balthasar Bickel
- Department of Comparative Language Science, University of Zurich, Zurich, Switzerland
- Center for the Interdisciplinary Study of Language Evolution, University of Zurich, Zurich, Switzerland
| |
Collapse
|
58
|
Lonardo L, Völter CJ, Hepach R, Lamm C, Huber L. Do dogs preferentially encode the identity of the target object or the location of others' actions? Anim Cogn 2024; 27:28. [PMID: 38553650 PMCID: PMC10980658 DOI: 10.1007/s10071-024-01870-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2023] [Revised: 03/22/2024] [Accepted: 03/24/2024] [Indexed: 04/02/2024]
Abstract
The ability to make sense of and predict others' actions is foundational for many socio-cognitive abilities. Dogs (Canis familiaris) constitute interesting comparative models for the study of action perception due to their marked sensitivity to human actions. We tested companion dogs (N = 21) in two screen-based eye-tracking experiments, adopting a task previously used with human infants and apes, to assess which aspects of an agent's action dogs consider relevant to the agent's underlying intentions. An agent was shown repeatedly acting upon the same one of two objects, positioned in the same location. We then presented the objects in swapped locations and the agent approached the objects centrally (Experiment 1) or the old object in the new location or the new object in the old location (Experiment 2). Dogs' anticipatory fixations and looking times did not reflect an expectation that agents should have continued approaching the same object nor the same location as witnessed during the brief familiarization phase; this contrasts with some findings with infants and apes, but aligns with findings in younger infants before they have sufficient motor experience with the observed action. However, dogs' pupil dilation and latency to make an anticipatory fixation suggested that, if anything, dogs expected the agents to keep approaching the same location rather than the same object, and their looking times showed sensitivity to the animacy of the agents. We conclude that dogs, lacking motor experience with the observed actions of grasping or kicking performed by a human or inanimate agent, might interpret such actions as directed toward a specific location rather than a specific object. Future research will need to further probe the suitability of anticipatory looking as measure of dogs' socio-cognitive abilities given differences between the visual systems of dogs and primates.
Collapse
Affiliation(s)
- Lucrezia Lonardo
- Comparative Cognition, Messerli Research Institute, University of Veterinary Medicine of Vienna, Medical University of Vienna and University of Vienna, Veterinärplatz 1, Vienna, 1210, Austria.
| | - Christoph J Völter
- Comparative Cognition, Messerli Research Institute, University of Veterinary Medicine of Vienna, Medical University of Vienna and University of Vienna, Veterinärplatz 1, Vienna, 1210, Austria
- Department of Comparative Cultural Psychology, Max Planck Institute for Evolutionary Anthropology, Leipzig, 04103, Germany
| | - Robert Hepach
- Department of Experimental Psychology, University of Oxford, Oxford, OX2 6GG, UK
| | - Claus Lamm
- Social, Cognitive and Affective Neuroscience Unit, Department of Cognition, Emotion and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, 1010, Austria
| | - Ludwig Huber
- Comparative Cognition, Messerli Research Institute, University of Veterinary Medicine of Vienna, Medical University of Vienna and University of Vienna, Veterinärplatz 1, Vienna, 1210, Austria
| |
Collapse
|
59
|
Coffey JR, Zeitlin M, Crawford J, Snedeker J. It's All in the Interaction: Early Acquired Words Are Both Frequent and Highly Imageable. Open Mind (Camb) 2024; 8:309-332. [PMID: 38571529 PMCID: PMC10990573 DOI: 10.1162/opmi_a_00130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Accepted: 02/10/2024] [Indexed: 04/05/2024] Open
Abstract
Prior studies have found that children are more likely to learn words that are frequent in the input and highly imageable. Many theories of word learning, however, predict that these variables should interact, particularly early in development: frequency of a form is of little use if you cannot infer its meaning, and a concrete word cannot be acquired if you never hear it. The present study explores this interaction, how it changes over time and its relationship to syntactic category effects in children acquiring American English. We analyzed 1461 monolingual English-speaking children aged 1;4-2;6 from the MB-CDI norming study (Fenson et al., 1994). Word frequency was estimated from the CHILDES database, and imageability was measured using adult ratings. There was a strong over-additive interaction between frequency and imageability, such that children were more likely to learn a word if it was both highly imageable and very frequent. This interaction was larger in younger children than in older children. There were reliable differences between syntactic categories independent of frequency and imageability, which did not interact with age. These findings are consistent with theories in which children's early words are acquired by mapping frequent word forms onto concrete, perceptually available referents, such that highly frequent items are only acquired if they are also imageable, and vice versa.
Collapse
|
60
|
Fairchild GT, Holler DE, Fabbri S, Gomez MA, Walsh-Snow JC. Naturalistic Object Representations Depend on Distance and Size Cues. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.16.585308. [PMID: 38559105 PMCID: PMC10980039 DOI: 10.1101/2024.03.16.585308] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Egocentric distance and real-world size are important cues for object perception and action. Nevertheless, most studies of human vision rely on two-dimensional pictorial stimuli that convey ambiguous distance and size information. Here, we use fMRI to test whether pictures are represented differently in the human brain from real, tangible objects that convey unambiguous distance and size cues. Participants directly viewed stimuli in two display formats (real objects and matched printed pictures of those objects) presented at different egocentric distances (near and far). We measured the effects of format and distance on fMRI response amplitudes and response patterns. We found that fMRI response amplitudes in the lateral occipital and posterior parietal cortices were stronger overall for real objects than for pictures. In these areas and many others, including regions involved in action guidance, responses to real objects were stronger for near vs. far stimuli, whereas distance had little effect on responses to pictures-suggesting that distance determines relevance to action for real objects, but not for pictures. Although stimulus distance especially influenced response patterns in dorsal areas that operate in the service of visually guided action, distance also modulated representations in ventral cortex, where object responses are thought to remain invariant across contextual changes. We observed object size representations for both stimulus formats in ventral cortex but predominantly only for real objects in dorsal cortex. Together, these results demonstrate that whether brain responses reflect physical object characteristics depends on whether the experimental stimuli convey unambiguous information about those characteristics. Significance Statement Classic frameworks of vision attribute perception of inherent object characteristics, such as size, to the ventral visual pathway, and processing of spatial characteristics relevant to action, such as distance, to the dorsal visual pathway. However, these frameworks are based on studies that used projected images of objects whose actual size and distance from the observer were ambiguous. Here, we find that when object size and distance information in the stimulus is less ambiguous, these characteristics are widely represented in both visual pathways. Our results provide valuable new insights into the brain representations of objects and their various physical attributes in the context of naturalistic vision.
Collapse
|
61
|
Segal O, Moyal D. Listening Preference for Child-Directed Speech Versus Time-Reversed Speech in Moderate-Preterm Infants Compared to Full-Term Infants. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2024; 67:900-916. [PMID: 38394254 DOI: 10.1044/2023_jslhr-23-00040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/25/2024]
Abstract
PURPOSE The purpose of the present study was to examine whether there is a listening preference for child-directed speech (CDS) over backward speech in moderate-preterm infants (MPIs). METHOD Eighteen MPIs of gestational age of 32.0 weeks (range: 32-34.06 weeks), chronological age of 8.09 months, and maturation age of 6.48 months served as the experimental group. The two control groups consisted of a total of 36 infants-20 full-term infants matched for chronological age and 16 full-term infants matched for maturation age. The infants were tested using the central fixation procedure and were presented with 16 trials of CDS and backward speech. A follow-up was conducted 5 years after the initial experiment using a developmental and a five-item parent questionnaire. RESULTS MPIs did not demonstrate a preference for CDS over backward speech, whereas both control groups demonstrated a listening preference for CDS over backward speech. MPIs showed a delayed use of first words and word combinations and lower scores on the five-item questionnaire compared to term infants. Twelve MPIs (67%) did not demonstrate a preference for CDS over backward speech. Four of them (33%) were later diagnosed with neurodevelopmental disorders. CONCLUSIONS The lack of preference for CDS over backward speech in the MPIs group suggests delayed developmental pattern of speech processing compared to full-term peers. Delays in neurological maturation as well as listening experience in an unregulated environment outside the uterus during a sensitive period of brain development may affect the recognition of phonological and prosodic patterns that support listening preference for speech over backward speech.
Collapse
|
62
|
Shain C. Word Frequency and Predictability Dissociate in Naturalistic Reading. Open Mind (Camb) 2024; 8:177-201. [PMID: 38476662 PMCID: PMC10932590 DOI: 10.1162/opmi_a_00119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Accepted: 01/10/2024] [Indexed: 03/14/2024] Open
Abstract
Many studies of human language processing have shown that readers slow down at less frequent or less predictable words, but there is debate about whether frequency and predictability effects reflect separable cognitive phenomena: are cognitive operations that retrieve words from the mental lexicon based on sensory cues distinct from those that predict upcoming words based on context? Previous evidence for a frequency-predictability dissociation is mostly based on small samples (both for estimating predictability and frequency and for testing their effects on human behavior), artificial materials (e.g., isolated constructed sentences), and implausible modeling assumptions (discrete-time dynamics, linearity, additivity, constant variance, and invariance over time), which raises the question: do frequency and predictability dissociate in ordinary language comprehension, such as story reading? This study leverages recent progress in open data and computational modeling to address this question at scale. A large collection of naturalistic reading data (six datasets, >2.2 M datapoints) is analyzed using nonlinear continuous-time regression, and frequency and predictability are estimated using statistical language models trained on more data than is currently typical in psycholinguistics. Despite the use of naturalistic data, strong predictability estimates, and flexible regression models, results converge with earlier experimental studies in supporting dissociable and additive frequency and predictability effects.
Collapse
Affiliation(s)
- Cory Shain
- Department of Brain & Cognitive Sciences and McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| |
Collapse
|
63
|
Twomey CR, Brainard DH, Plotkin JB. History constrains the evolution of efficient color naming, enabling historical inference. Proc Natl Acad Sci U S A 2024; 121:e2313603121. [PMID: 38416682 PMCID: PMC10927505 DOI: 10.1073/pnas.2313603121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Accepted: 12/16/2023] [Indexed: 03/01/2024] Open
Abstract
Color naming in natural languages is not arbitrary: It reflects efficient partitions of perceptual color space [T. Regier, P. Kay, N. Khetarpal, Proc. Natl. Acad. Sci. U.S.A. 104, 1436-1441 (2007)] modulated by the relative needs to communicate about different colors [C. Twomey, G. Roberts, D. Brainard, J. Plotkin, Proc. Natl. Acad. Sci. U.S.A. 118, e2109237118 (2021)]. These psychophysical and communicative constraints help explain why languages around the world have remarkably similar, but not identical, mappings of colors to color terms. Languages converge on a small set of efficient representations.But languages also evolve, and the number of terms in a color vocabulary may change over time. Here we show that history, i.e. the existence of an antecedent color vocabulary, acts as a nonadaptive constraint that biases the choice of efficient solution as a language transitions from a vocabulary of size [Formula: see text] to [Formula: see text] terms. Moreover, as efficient vocabularies evolve to include more terms they explore a smaller fraction of all possible efficient vocabularies compared to equally sized vocabularies constructed de novo. This path dependence of the cultural evolution of color naming presents an opportunity. Historical constraints can be used to reconstruct ancestral color vocabularies, allowing us to answer long-standing questions about the evolutionary sequences of color words, and enabling us to draw inferences from phylogenetic patterns of language change.
Collapse
Affiliation(s)
- Colin R. Twomey
- Data Driven Discovery Initiative, University of Pennsylvania, Philadelphia, PA19104
- Department of Biology, University of Pennsylvania, Philadelphia, PA19104
| | - David H. Brainard
- Department of Psychology, University of Pennsylvania, Philadelphia, PA19104
| | - Joshua B. Plotkin
- Department of Biology, University of Pennsylvania, Philadelphia, PA19104
| |
Collapse
|
64
|
Arnon I, Kirby S. Cultural evolution creates the statistical structure of language. Sci Rep 2024; 14:5255. [PMID: 38438558 PMCID: PMC10912608 DOI: 10.1038/s41598-024-56152-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2023] [Accepted: 03/01/2024] [Indexed: 03/06/2024] Open
Abstract
Human language is unique in its structure: language is made up of parts that can be recombined in a productive way. The parts are not given but have to be discovered by learners exposed to unsegmented wholes. Across languages, the frequency distribution of those parts follows a power law. Both statistical properties-having parts and having them follow a particular distribution-facilitate learning, yet their origin is still poorly understood. Where do the parts come from and why do they follow a particular frequency distribution? Here, we show how these two core properties emerge from the process of cultural evolution with whole-to-part learning. We use an experimental analog of cultural transmission in which participants copy sets of non-linguistic sequences produced by a previous participant: This design allows us to ask if parts will emerge purely under pressure for the system to be learnable, even without meanings to convey. We show that parts emerge from initially unsegmented sequences, that their distribution becomes closer to a power law over generations, and, importantly, that these properties make the sets of sequences more learnable. We argue that these two core statistical properties of language emerge culturally both as a cause and effect of greater learnability.
Collapse
Affiliation(s)
- Inbal Arnon
- Psychology Department, Hebrew University of Jerusalem, Jerusalem, Israel.
| | - Simon Kirby
- School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, UK
| |
Collapse
|
65
|
Wojcik EH, Pierce MC, Stevens G, Goulding SJ. Referent-oriented interactions in infancy: A naturalistic, longitudinal case study from an English-speaking household. Infant Behav Dev 2024; 74:101911. [PMID: 38056189 DOI: 10.1016/j.infbeh.2023.101911] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Revised: 10/14/2023] [Accepted: 11/16/2023] [Indexed: 12/08/2023]
Abstract
Caregivers use a of combination labeling, pointing, object grasping, and gaze to communicate with infants about referents in their environment. By two years of age, children reliably use these referent-oriented cues to communicate and learn. While there is some evidence from lab-based studies that younger infants attend to and use referent-oriented cues during communication, some more naturalistic studies have found that in the first year of life, infants do not robustly leverage these cues during dyadic interactions. The current study examined parent and infant gaze, touching, pointing, and reaching to referents for a wide range of nouns, verbs, adjectives, and other early-learned words during 59 one-hour head-camera recordings sampled from one English-learning infants' life between 6 and 12 months of age. We found substantial variability across individual words for all cues. Some variability was explained by referent concreteness and the grammatical category of the label. The parent's touching of labeled referents increased across months, suggesting that parent-infant-referent interactions may change with development. Future studies should investigate the trajectories of specific types of words and contexts, rather than attempting to discover possibly non-existent universal trajectories of parent and infant referent-oriented behaviors.
Collapse
|
66
|
Schulz L, Bhui R. Political reinforcement learners. Trends Cogn Sci 2024; 28:210-222. [PMID: 38195364 DOI: 10.1016/j.tics.2023.12.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 12/09/2023] [Accepted: 12/11/2023] [Indexed: 01/11/2024]
Abstract
Politics can seem home to the most calculating and yet least rational elements of humanity. How might we systematically characterize this spectrum of political cognition? Here, we propose reinforcement learning (RL) as a unified framework to dissect the political mind. RL describes how agents algorithmically navigate complex and uncertain domains like politics. Through this computational lens, we outline three routes to political differences, stemming from variability in agents' conceptions of a problem, the cognitive operations applied to solve the problem, or the backdrop of information available from the environment. A computational vantage on maladies of the political mind offers enhanced precision in assessing their causes, consequences, and cures.
Collapse
Affiliation(s)
- Lion Schulz
- Department of Computational Neuroscience, Max Planck Institute for Biological Cybernetics, Max-Planck-Ring 8-14, 72076 Tübingen, Germany.
| | - Rahul Bhui
- Sloan School of Management and Institute for Data, Systems, and Society, Massachusetts Institute of Technology, Cambridge, MA, USA
| |
Collapse
|
67
|
Denić M, Szymanik J. Recursive Numeral Systems Optimize the Trade-off Between Lexicon Size and Average Morphosyntactic Complexity. Cogn Sci 2024; 48:e13424. [PMID: 38497509 DOI: 10.1111/cogs.13424] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Revised: 02/12/2024] [Accepted: 02/21/2024] [Indexed: 03/19/2024]
Abstract
Human languages vary in terms of which meanings they lexicalize, but this variation is constrained. It has been argued that languages are under two competing pressures: the pressure to be simple (e.g., to have a small lexicon) and to allow for informative (i.e., precise) communication, and that which meanings get lexicalized may be explained by languages finding a good way to trade off between these two pressures. However, in certain semantic domains, languages can reach very high levels of informativeness even if they lexicalize very few meanings in that domain. This is due to productive morphosyntax and compositional semantics, which may allow for construction of meanings which are not lexicalized. Consider the semantic domain of natural numbers: many languages lexicalize few natural number meanings as monomorphemic expressions, but can precisely convey very many natural number meanings using morphosyntactically complex numerals. In such semantic domains, lexicon size is not in direct competition with informativeness. What explains which meanings are lexicalized in such semantic domains? We will propose that in such cases, languages need to solve a different kind of trade-off problem: the trade-off between the pressure to lexicalize as few meanings as possible (i.e, to minimize lexicon size) and the pressure to produce as morphosyntactically simple utterances as possible (i.e, to minimize average morphosyntactic complexity of utterances). To support this claim, we will present a case study of 128 natural languages' numeral systems, and show computationally that they achieve a near-optimal trade-off between lexicon size and average morphosyntactic complexity of numerals. This study in conjunction with previous work on communicative efficiency suggests that languages' lexicons are shaped by a trade-off between not two but three pressures: be simple, be informative, and minimize average morphosyntactic complexity of utterances.
Collapse
Affiliation(s)
| | - Jakub Szymanik
- Department of Information Engineering and Computer Science, University of Trento
| |
Collapse
|
68
|
Berent I, Sansiveri A. Davinci the Dualist: The Mind-Body Divide in Large Language Models and in Human Learners. Open Mind (Camb) 2024; 8:84-101. [PMID: 38435703 PMCID: PMC10898781 DOI: 10.1162/opmi_a_00120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Accepted: 01/10/2024] [Indexed: 03/05/2024] Open
Abstract
A large literature suggests that people are intuitive Dualists-they consider the mind ethereal, distinct from the body. Furthermore, Dualism emerges, in part, via learning (e.g., Barlev & Shtulman, 2021). Human learners, however, are also endowed with innate systems of core knowledge, and recent results suggest that core knowledge begets Dualism (Berent, 2023a; Berent et al., 2022). The resulting question, then, is whether the acquisition of Dualism requires core knowledge, or whether Dualism is learnable from experience alone, via domain-general mechanism. Since human learners are equipped with both systems, the evidence from humans cannot decide this question. Accordingly, here, we probe for a mind-body divide in Davinci-a large language model (LLM) that is devoid of core knowledge. We show that Davinci still leans towards Dualism, and that this bias increases systematically with the learner's inductive potential. Thus, davinci (which forms part of the GPT-3 suite) exhibits mild Dualist tendencies, whereas its descendent, text-davinci-003 (a GPT-3.5 model), shows a stronger bias. It selectively considers thoughts (epistemic states) as disembodied-as unlikely to show up in the body (in the brain). Unlike humans, GPT 3.5 categorically rejected the persistence of the psyche after death. Still, when probed about life, GPT 3.5 showed robust Dualist tendencies. These results demonstrate that the mind-body divide is partly learnable from experience. While results from LLMs cannot fully determine how humans acquire Dualism, they do place a higher burden of proof on nativist theories that trace Dualism to innate core cognition (Berent, 2023a; Berent et al., 2022).
Collapse
Affiliation(s)
- Iris Berent
- Department of Psychology, Northeastern University, Boston, MA, USA
| | | |
Collapse
|
69
|
Li J, Armstrong BC. Probing the Representational Structure of Regular Polysemy via Sense Analogy Questions: Insights from Contextual Word Vectors. Cogn Sci 2024; 48:e13416. [PMID: 38482721 DOI: 10.1111/cogs.13416] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Revised: 01/02/2024] [Accepted: 02/05/2024] [Indexed: 05/16/2024]
Abstract
Regular polysemes are sets of ambiguous words that all share the same relationship between their meanings, such as CHICKEN and LOBSTER both referring to an animal or its meat. To probe how a distributional semantic model, here exemplified by bidirectional encoder representations from transformers (BERT), represents regular polysemy, we analyzed whether its embeddings support answering sense analogy questions similar to "is the mapping between CHICKEN (as an animal) and CHICKEN (as a meat) similar to that which maps between LOBSTER (as an animal) to LOBSTER (as a meat)?" We did so using the LRcos model, which combines a logistic regression classifier of different categories (e.g., animal vs. meat) with a measure of cosine similarity. We found that (a) the model was sensitive to the shared structure within a given regular relationship; (b) the shared structure varies across different regular relationships (e.g., animal/meat vs. location/organization), potentially reflective of a "regularity continuum;" (c) some high-order latent structure is shared across different regular relationships, suggestive of a similar latent structure across different types of relationships; and (d) there is a lack of evidence for the aforementioned effects being explained by meaning overlap. Lastly, we found that both components of the LRcos model made important contributions to accurate responding and that a variation of this method could yield an accuracy boost of 10% in answering sense analogy questions. These findings enrich previous theoretical work on regular polysemy with a computationally explicit theory and methods, and provide evidence for an important organizational principle for the mental lexicon and the broader conceptual knowledge system.
Collapse
Affiliation(s)
| | - Blair C Armstrong
- Department of Psychology and Department of Computer Science, University of Toronto BCBL, Basque Center on Cognition, Brain, and Language
| |
Collapse
|
70
|
Laing C, Bergelson E. Analyzing the effect of sibling number on input and output in the first 18 months. INFANCY 2024; 29:175-195. [PMID: 38183663 PMCID: PMC10900282 DOI: 10.1111/infa.12578] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 10/24/2023] [Accepted: 12/04/2023] [Indexed: 01/08/2024]
Abstract
Prior research suggests that across a wide range of cognitive, educational, and health-based measures, first-born children outperform their later-born peers. Expanding on this literature using naturalistic home-recorded data and parental vocabulary reports, we find that early language outcomes vary by number of siblings in a sample of 43 English-learning U.S. children from mid-to-high socioeconomic status homes. More specifically, we find that children in our sample with two or more-but not one-older siblings had smaller productive vocabularies at 18 months, and heard less input from caregivers across several measures than their peers with less than two siblings. We discuss implications regarding what infants experience and learn across a range of family sizes in infancy.
Collapse
|
71
|
Yang H, Jia L, Zhu J, Zhang J, Li M, Li C, Pan Y. The interplay of motor adaptation and groupitizing in numerosity perception: Insights from visual motion adaptation and proprioceptive motor adaptation. PeerJ 2024; 12:e16887. [PMID: 38436019 PMCID: PMC10906262 DOI: 10.7717/peerj.16887] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Accepted: 01/14/2024] [Indexed: 03/05/2024] Open
Abstract
Groupitizing is a well-established strategy in numerosity perception that enhances speed and sensory precision. Building on the ATOM theory, Anobile proposed the sensorimotor numerosity system, which posits a strong link between number and action. Previous studies using motor adaptation technology have shown that high-frequency motor adaptation leads to underestimation of numerosity perception, while low-frequency adaptation leads to overestimation. However, the impact of motor adaptation on groupitizing, and whether visual motion adaptation produces similar effects, remain unclear. In this study, we investigate the persistence of the advantage of groupitizing after motor adaptation and explore the effects of visual motion adaptation. Surprisingly, our findings reveal that proprioceptive motor adaptation weakens the advantage of groupitizing, indicating a robust effect of motor adaptation even when groupitizing is employed. Moreover, we observe a bidirectional relationship, as groupitizing also weakens the adaptation effect. These results highlight the complex interplay between motor adaptation and groupitizing in numerosity perception. Furthermore, our study provides evidence that visual motion adaptation also has an adaptation effect, but does not fully replicate the effects of proprioceptive motor adaptation on groupitizing. In conclusion, our research underscores the importance of groupitizing as a valuable strategy in numerosity perception, and sheds light on the influence of motion adaptation on this strategy.
Collapse
Affiliation(s)
- Huanyu Yang
- Key Laboratory of Basic Psychological and Cognitive Neuroscience, School of Psychology, Guizhou Normal University, Guiyang, China
| | - Liangzhi Jia
- Key Laboratory of Basic Psychological and Cognitive Neuroscience, School of Psychology, Guizhou Normal University, Guiyang, China
| | - Jun Zhu
- Key Laboratory of Basic Psychological and Cognitive Neuroscience, School of Psychology, Guizhou Normal University, Guiyang, China
| | - Jian Zhang
- Key Laboratory of Basic Psychological and Cognitive Neuroscience, School of Psychology, Guizhou Normal University, Guiyang, China
| | - Mengmeng Li
- Key Laboratory of Basic Psychological and Cognitive Neuroscience, School of Psychology, Guizhou Normal University, Guiyang, China
| | - Chenli Li
- Key Laboratory of Basic Psychological and Cognitive Neuroscience, School of Psychology, Guizhou Normal University, Guiyang, China
| | - Yun Pan
- Key Laboratory of Basic Psychological and Cognitive Neuroscience, School of Psychology, Guizhou Normal University, Guiyang, China
| |
Collapse
|
72
|
Masullo C, Casado A, Leivada E. The role of minority language bilingualism in spotting agreement attraction errors: Evidence from Italian varieties. PLoS One 2024; 19:e0298648. [PMID: 38412192 PMCID: PMC10898745 DOI: 10.1371/journal.pone.0298648] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Accepted: 01/30/2024] [Indexed: 02/29/2024] Open
Abstract
Bilingual adaptations remain a subject of ongoing debate, with varying results reported across cognitive domains. A possible way to disentangle the apparent inconsistency of results is to focus on the domain of language processing, which is what the bilingual experience boils down to. This study delves into the role of the bilingual experience on the processing of agreement mismatches. Given the underrepresentation of minority bilingual speakers of non-standard varieties, we advance a unique comparative perspective that includes monolinguals, standard language bilinguals, and different groups of minority language bilinguals, taking advantage of the rich linguistic diversity of the Italian peninsula. This comparative approach can reveal the impact of various sociolinguistic aspects of the bilingual experience across different bilingual trajectories. We developed an auditory acceptability judgement task in Italian, featuring Subject-Verb agreement mismatches. Participants evaluated the stimuli on a 5-point Likert scale and reaction times were recorded. The results do not reveal significant differences between the speakers of standard languages: Italian monolinguals and Italian-Spanish bilinguals. Instead, significant differences are found between monolinguals and the two groups of minority language bidialectals, as well as between the bidialectal groups themselves: Italian-Pavese bidialectals were faster than both Italian-Agrigentino bidialectals and Italian monolinguals, while Italian-Agrigentino bidialectals were less accurate than both Italian-Pavese bidialectals and Italian monolinguals. This intricate picture is explained through variables associated with second language use and language switching. Our findings suggest that if bilingualism is viewed as a yes/no phenotype, it is unavoidable that the bilingual experience will remain a mystery linked to intensely debated results. If, however, one accepts that bilingual adaptations are shaped by the environmental ecology of each trajectory, variation across bilingual processing outcomes is unsurprising. Overall, we argue that specific sociolinguistic factors behind each bilingual experience can reveal where bilingual adaptations on language and cognition stem from.
Collapse
Affiliation(s)
- Camilla Masullo
- Department of English and German Studies, Universitat Rovira i Virgili, Tarragona, Spain
| | - Alba Casado
- Department of Experimental Psychology, Mind, Brain, and Behavior Research Center, University of Granada, Granada, Spain
| | - Evelina Leivada
- Department of Catalan Philology, Universitat Autònoma de Barcelona, Barcelona, Spain
- Institució Catalana de Recerca i Estudis Avançats (ICREA), Barcelona, Spain
| |
Collapse
|
73
|
Cordonier N, Schaffner E, Zeroual L, Fossard M. Time reference in aphasia: are there differences between tenses and aphasia fluency type? A systematic review and individual participant data meta-analysis. Front Psychol 2024; 15:1322539. [PMID: 38406299 PMCID: PMC10885357 DOI: 10.3389/fpsyg.2024.1322539] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2023] [Accepted: 01/23/2024] [Indexed: 02/27/2024] Open
Abstract
Time reference is used to build the temporal framework of discourse and is essential in ensuring efficient communication. Several studies have reported time reference deficits in fluent and non-fluent aphasia and have shown that tenses (past, present, future) are not all impaired to the same extent. However, there is little consensus on the dissociations between tenses, and the question of the influence of the type of aphasia (fluent vs. non-fluent) on time reference remains open. Therefore, a systematic review and an individual participant data meta-analysis (or mega-analysis) were conducted to determine (1) whether one tense is more impaired than another in fluent and non-fluent aphasia and, if so, (2) which task and speaker-related factors moderate tense effects. The systematic review resulted in 35 studies reporting the performance in time reference of 392 participants. The mega-analysis was then performed on 23 studies for a total of 232 participants and showed an alteration of past tense compared to present and future tenses in both types of aphasia. The analysis also showed a task and an age effect on time reference but no gender effect, independently of tenses. These results add to our knowledge of time reference in aphasia and have implications for future therapies.
Collapse
|
74
|
Long B, Fan JE, Huey H, Chai Z, Frank MC. Parallel developmental changes in children's production and recognition of line drawings of visual concepts. Nat Commun 2024; 15:1191. [PMID: 38331850 PMCID: PMC10853520 DOI: 10.1038/s41467-023-44529-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Accepted: 12/18/2023] [Indexed: 02/10/2024] Open
Abstract
Childhood is marked by the rapid accumulation of knowledge and the prolific production of drawings. We conducted a systematic study of how children create and recognize line drawings of visual concepts. We recruited 2-10-year-olds to draw 48 categories via a kiosk at a children's museum, resulting in >37K drawings. We analyze changes in the category-diagnostic information in these drawings using vision algorithms and annotations of object parts. We find developmental gains in children's inclusion of category-diagnostic information that are not reducible to variation in visuomotor control or effort. Moreover, even unrecognizable drawings contain information about the animacy and size of the category children tried to draw. Using guessing games at the same kiosk, we find that children improve across childhood at recognizing each other's line drawings. This work leverages vision algorithms to characterize developmental changes in children's drawings and suggests that these changes reflect refinements in children's internal representations.
Collapse
Affiliation(s)
- Bria Long
- Department of Psychology, Stanford University, Building 420, 450 Jane Stanford Way, Stanford, 94305, CA, USA.
| | - Judith E Fan
- Department of Psychology, Stanford University, Building 420, 450 Jane Stanford Way, Stanford, 94305, CA, USA
- Department of Psychology, University of California, San Diego, 9500 Gilman Dr., La Jolla, 92093, CA, USA
| | - Holly Huey
- Department of Psychology, University of California, San Diego, 9500 Gilman Dr., La Jolla, 92093, CA, USA
| | - Zixian Chai
- Department of Psychology, Stanford University, Building 420, 450 Jane Stanford Way, Stanford, 94305, CA, USA
| | - Michael C Frank
- Department of Psychology, University of California, San Diego, 9500 Gilman Dr., La Jolla, 92093, CA, USA
| |
Collapse
|
75
|
Kempf A, Benedek M, Schiavio A. An observation of a negative effect of social cohesion on creativity in musical improvisation. Sci Rep 2024; 14:2922. [PMID: 38316826 PMCID: PMC10844246 DOI: 10.1038/s41598-024-52350-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Accepted: 01/17/2024] [Indexed: 02/07/2024] Open
Abstract
Although various social factors can significantly impact creative performance, it is still unclear how social cohesion (i.e., how close we feel to others) influences creativity. We therefore conducted two studies exploring the association between social cohesion and creativity within the domain of musical improvisation, a prime example of creative performance, which usually plays out in social contexts. The first study (n = 58 musical novices) showed that music-induced synchrony facilitates social cohesion. In our second study (n = 18 musical novices), we found that in two out of three experimental conditions, increased social cohesion is associated with less creative musical outcomes, as rated by nine expert musicians. In our subsequent analysis we related measures of social cohesion and creativity. This approach highlights how, within a musical setting, creativity unfolds in the context of social contingencies as social cohesion and related factors.
Collapse
Affiliation(s)
- Adrian Kempf
- Department of Psychology, University of Graz, Glacisstraße 27, 8010, Graz, Austria.
| | | | - Andrea Schiavio
- Department of Psychology, University of Graz, Glacisstraße 27, 8010, Graz, Austria
- School of Arts and Creative Technologies, University of York, York, UK
| |
Collapse
|
76
|
Vong WK, Wang W, Orhan AE, Lake BM. Grounded language acquisition through the eyes and ears of a single child. Science 2024; 383:504-511. [PMID: 38300999 DOI: 10.1126/science.adi1374] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Accepted: 12/31/2023] [Indexed: 02/03/2024]
Abstract
Starting around 6 to 9 months of age, children begin acquiring their first words, linking spoken words to their visual counterparts. How much of this knowledge is learnable from sensory input with relatively generic learning mechanisms, and how much requires stronger inductive biases? Using longitudinal head-mounted camera recordings from one child aged 6 to 25 months, we trained a relatively generic neural network on 61 hours of correlated visual-linguistic data streams, learning feature-based representations and cross-modal associations. Our model acquires many word-referent mappings present in the child's everyday experience, enables zero-shot generalization to new visual referents, and aligns its visual and linguistic conceptual systems. These results show how critical aspects of grounded word meaning are learnable through joint representation and associative learning from one child's input.
Collapse
Affiliation(s)
- Wai Keen Vong
- Center for Data Science, New York University, New York, NY, USA
| | - Wentao Wang
- Center for Data Science, New York University, New York, NY, USA
| | - A Emin Orhan
- Center for Data Science, New York University, New York, NY, USA
| | - Brenden M Lake
- Center for Data Science, New York University, New York, NY, USA
- Department of Psychology, New York University, New York, NY, USA
| |
Collapse
|
77
|
Maruya A, Zaidi Q. Perceptual transitions between object rigidity and non-rigidity: Competition and cooperation among motion energy, feature tracking, and shape-based priors. J Vis 2024; 24:3. [PMID: 38306112 PMCID: PMC10848565 DOI: 10.1167/jov.24.2.3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Accepted: 12/20/2023] [Indexed: 02/03/2024] Open
Abstract
Why do moving objects appear rigid when projected retinal images are deformed non-rigidly? We used rotating rigid objects that can appear rigid or non-rigid to test whether shape features contribute to rigidity perception. When two circular rings were rigidly linked at an angle and jointly rotated at moderate speeds, observers reported that the rings wobbled and were not linked rigidly, but rigid rotation was reported at slow speeds. When gaps, paint, or vertices were added, the rings appeared rigidly rotating even at moderate speeds. At high speeds, all configurations appeared non-rigid. Salient features thus contribute to rigidity at slow and moderate speeds but not at high speeds. Simulated responses of arrays of motion-energy cells showed that motion flow vectors are predominantly orthogonal to the contours of the rings, not parallel to the rotation direction. A convolutional neural network trained to distinguish flow patterns for wobbling versus rotation gave a high probability of wobbling for the motion-energy flows. However, the convolutional neural network gave high probabilities of rotation for motion flows generated by tracking features with arrays of MT pattern-motion cells and corner detectors. In addition, circular rings can appear to spin and roll despite the absence of any sensory evidence, and this illusion is prevented by vertices, gaps, and painted segments, showing the effects of rotational symmetry and shape. Combining convolutional neural network outputs that give greater weight to motion energy at fast speeds and to feature tracking at slow speeds, with the shape-based priors for wobbling and rolling, explained rigid and non-rigid percepts across shapes and speeds (R2 = 0.95). The results demonstrate how cooperation and competition between different neuronal classes lead to specific states of visual perception and to transitions between the states.
Collapse
Affiliation(s)
- Akihito Maruya
- Graduate Center for Vision Research, State University of New York, New York, NY, USA
| | - Qasim Zaidi
- Graduate Center for Vision Research, State University of New York, New York, NY, USA
| |
Collapse
|
78
|
Vizmathy L, Begus K, Knoblich G, Gergely G, Curioni A. Better Together: 14-Month-Old Infants Expect Agents to Cooperate. Open Mind (Camb) 2024; 8:1-16. [PMID: 38419792 PMCID: PMC10898613 DOI: 10.1162/opmi_a_00115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 12/09/2023] [Indexed: 03/02/2024] Open
Abstract
Humans engage in cooperative activities from early on and the breadth of human cooperation is unparalleled. Human preference for cooperation might reflect cognitive and motivational mechanisms that drive engagement in cooperative activities. Here we investigate early indices of humans' cooperative abilities and test whether 14-month-old infants expect agents to prefer cooperative over individual goal achievement. Three groups of infants saw videos of agents facing a choice between two actions that led to identical rewards but differed in the individual costs. Our results show that, in line with prior research, infants expect agents to make instrumentally rational choices and prefer the less costly of two individual action alternatives. In contrast, when one of the action alternatives is cooperative, infants expect agents to choose cooperation over individual action, even though the cooperative action demands more effort from each agent to achieve the same outcome. Finally, we do not find evidence that infants expect agents to choose the less costly alternative when both options entail cooperative action. Combined, these results indicate an ontogenetically early expectation of cooperation, and raise interesting implications and questions regarding the nature of infants' representations of cooperative actions and their utility.
Collapse
Affiliation(s)
- Liza Vizmathy
- Department of Cognitive Science, Central European University, Vienna, Austria
| | - Katarina Begus
- Department of Psychology, University of Copenhagen, Copenhagen, Denmark
| | - Gunther Knoblich
- Department of Cognitive Science, Central European University, Vienna, Austria
| | - György Gergely
- Department of Cognitive Science, Central European University, Vienna, Austria
| | - Arianna Curioni
- Institute of Computer Technology, Technische Universität Wien, Vienna, Austria
| |
Collapse
|
79
|
Abassi E, Papeo L. Category-Selective Representation of Relationships in the Visual Cortex. J Neurosci 2024; 44:e0250232023. [PMID: 38124013 PMCID: PMC10860595 DOI: 10.1523/jneurosci.0250-23.2023] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Revised: 09/29/2023] [Accepted: 10/14/2023] [Indexed: 12/23/2023] Open
Abstract
Understanding social interaction requires processing social agents and their relationships. The latest results show that much of this process is visually solved: visual areas can represent multiple people encoding emergent information about their interaction that is not explained by the response to the individuals alone. A neural signature of this process is an increased response in visual areas, to face-to-face (seemingly interacting) people, relative to people presented as unrelated (back-to-back). This effect highlighted a network of visual areas for representing relational information. How is this network organized? Using functional MRI, we measured the brain activity of healthy female and male humans (N = 42), in response to images of two faces or two (head-blurred) bodies, facing toward or away from each other. Taking the facing > non-facing effect as a signature of relation perception, we found that relations between faces and between bodies were coded in distinct areas, mirroring the categorical representation of faces and bodies in the visual cortex. Additional analyses suggest the existence of a third network encoding relations between (nonsocial) objects. Finally, a separate occipitotemporal network showed the generalization of relational information across body, face, and nonsocial object dyads (multivariate pattern classification analysis), revealing shared properties of relations across categories. In sum, beyond single entities, the visual cortex encodes the relations that bind multiple entities into relationships; it does so in a category-selective fashion, thus respecting a general organizing principle of representation in high-level vision. Visual areas encoding visual relational information can reveal the processing of emergent properties of social (and nonsocial) interaction, which trigger inferential processes.
Collapse
Affiliation(s)
- Etienne Abassi
- Institut des Sciences Cognitives-Marc Jeannerod, UMR5229, Centre National de la Recherche Scientifique (CNRS), Université Claude Bernard Lyon 1, Bron 69675, France
| | - Liuba Papeo
- Institut des Sciences Cognitives-Marc Jeannerod, UMR5229, Centre National de la Recherche Scientifique (CNRS), Université Claude Bernard Lyon 1, Bron 69675, France
| |
Collapse
|
80
|
Van de Cruys S, Frascaroli J, Friston K. Order and change in art: towards an active inference account of aesthetic experience. Philos Trans R Soc Lond B Biol Sci 2024; 379:20220411. [PMID: 38104600 PMCID: PMC10725768 DOI: 10.1098/rstb.2022.0411] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Accepted: 10/31/2023] [Indexed: 12/19/2023] Open
Abstract
How to account for the power that art holds over us? Why do artworks touch us deeply, consoling, transforming or invigorating us in the process? In this paper, we argue that an answer to this question might emerge from a fecund framework in cognitive science known as predictive processing (a.k.a. active inference). We unpack how this approach connects sense-making and aesthetic experiences through the idea of an 'epistemic arc', consisting of three parts (curiosity, epistemic action and aha experiences), which we cast as aspects of active inference. We then show how epistemic arcs are built and sustained by artworks to provide us with those satisfying experiences that we tend to call 'aesthetic'. Next, we defuse two key objections to this approach; namely, that it places undue emphasis on the cognitive component of our aesthetic encounters-at the expense of affective aspects-and on closure and uncertainty minimization (order)-at the expense of openness and lingering uncertainty (change). We show that the approach offers crucial resources to account for the open-ended, free and playful behaviour inherent in aesthetic experiences. The upshot is a promising but deflationary approach, both philosophically informed and psychologically sound, that opens new empirical avenues for understanding our aesthetic encounters. This article is part of the theme issue 'Art, aesthetics and predictive processing: theoretical and empirical perspectives'.
Collapse
Affiliation(s)
| | | | - Karl Friston
- The Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3BG, UK
- VERSES AI Research Lab, Los Angeles, 900016, CA, USA
| |
Collapse
|
81
|
Kalagara R, Hrabarchuk EI, Hannah TC, Downes MH, Li T, Vasan V, Li AY, Asfaw ZK, Quinones A, McCarthy L, Schupper AJ, Gometz A, Lovell MR, Choudhri TF. The effect of age on baseline neurocognitive performance. Brain Inj 2024; 38:136-141. [PMID: 38328998 DOI: 10.1080/02699052.2024.2307968] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Accepted: 01/17/2024] [Indexed: 02/09/2024]
Abstract
OBJECTIVE Evaluate the independent effect of age on baseline neurocognitive performance. STUDY DESIGN Baseline ImPACT scores from tests taken by 7454 athletes aged 12-22 from 2009 to 2019 were split into three age cohorts: 12-14 years (3244), 15-17 years (3732), and 18-22 years (477). Linear regression analyses were used to evaluate the effect of age on ImPACT composite scores while controlling for demographic differences, medication-use, and symptom burden. Significance values have been set at p < 0.05. RESULTS Linear regression analyses demonstrated that increased age does not significantly affect symptom score (β = 0.06, p = 0.54) but does improve impulse control (β = -0.45, p < 0.0001), verbal memory (β = 0.23, p = 0.03), visualmotor (β = 0.77, p < 0.0001), and reaction time (β = -0.008, p < 0.0001) scores. However, age did not have an effect on visual memory scores (β = -0.25, p = 0.07). CONCLUSIONS Age was shown to be an independent modifier of impulse control, verbal memory, visual motor, and reaction time scores but not visual memory or symptom scores. This underscores the previous literature showing developmental differences as age increases among the adolescent athlete population. This data also indicates the need for repeat neurocognitive baseline testing every other year as baseline scoring is likely to change as athletes become older.
Collapse
Affiliation(s)
- Roshini Kalagara
- Department of Neurosurgery, Icahn School of Medicine, at Mount Sinai, New York, USA
| | - Eugene I Hrabarchuk
- Department of Neurosurgery, Icahn School of Medicine, at Mount Sinai, New York, USA
| | - Theodore C Hannah
- Department of Neurosurgery, Icahn School of Medicine, at Mount Sinai, New York, USA
| | - Margaret H Downes
- Department of Neurosurgery, Icahn School of Medicine, at Mount Sinai, New York, USA
| | - Troy Li
- Department of Neurosurgery, Icahn School of Medicine, at Mount Sinai, New York, USA
| | - Vikram Vasan
- Department of Neurosurgery, Icahn School of Medicine, at Mount Sinai, New York, USA
| | - Adam Y Li
- Department of Neurosurgery, Icahn School of Medicine, at Mount Sinai, New York, USA
| | - Zerubabbel K Asfaw
- Department of Neurosurgery, Icahn School of Medicine, at Mount Sinai, New York, USA
| | - Addison Quinones
- Department of Neurosurgery, Icahn School of Medicine, at Mount Sinai, New York, USA
| | - Lily McCarthy
- Department of Neurosurgery, Icahn School of Medicine, at Mount Sinai, New York, USA
| | - Alexander J Schupper
- Department of Neurosurgery, Icahn School of Medicine, at Mount Sinai, New York, USA
| | - Alex Gometz
- Concussion Management of New York, New York, USA
| | - Mark R Lovell
- Department of Neurological Surgery, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania, USA
| | - Tanvir F Choudhri
- Department of Neurosurgery, Icahn School of Medicine, at Mount Sinai, New York, USA
| |
Collapse
|
82
|
Tan AWM, Marchman VA, Frank MC. The role of translation equivalents in bilingual word learning. Dev Sci 2024:e13476. [PMID: 38226762 DOI: 10.1111/desc.13476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Revised: 11/09/2023] [Accepted: 12/20/2023] [Indexed: 01/17/2024]
Abstract
Bilingual environments present an important context for word learning. One feature of bilingual environments is the existence of translation equivalents (TEs)-words in different languages that share similar meanings. Documenting TE learning over development may give us insight into the mechanisms underlying word learning in young bilingual children. Prior studies of TE learning have often been confounded by the fact that increases in overall vocabulary size with age lead to greater opportunities for learning TEs. To address this confound, we employed an item-level analysis, which controls for the age trajectory of each item independently. We used Communicative Development Inventory data from four bilingual datasets (two English-Spanish and two English-French; total N = 419) for modeling. Results indicated that knowing a word's TE increased the likelihood of knowing that word for younger children and for TEs that are more similar phonologically. These effects were consistent across datasets, but varied across lexical categories. Thus, TEs may allow bilingual children to bootstrap their early word learning in one language using their knowledge of the other language. RESEARCH HIGHLIGHTS: Bilingual children must learn words that share a common meaning across both languages, that is, translation equivalents, like dog in English and perro in Spanish. Item-level models explored how translation equivalents affect word learning, in addition to child-level (e.g., exposure) and item-level (e.g., phonological similarity) factors. Knowing a word increased the probability of knowing its corresponding translation equivalent, particularly for younger children and for more phonologically-similar translation equivalents. These findings suggest that young bilingual children use their word knowledge in one language to bootstrap their learning of words in the other language.
Collapse
Affiliation(s)
- Alvin W M Tan
- Department of Psychology, Stanford University, Stanford, California, USA
| | | | - Michael C Frank
- Department of Psychology, Stanford University, Stanford, California, USA
| |
Collapse
|
83
|
Tafazoli A, Cronin-Wood K. Pediatric Oncology Hospice: A Comprehensive Review. Am J Hosp Palliat Care 2024:10499091241227609. [PMID: 38225192 DOI: 10.1177/10499091241227609] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2024] Open
Abstract
Pediatric hospice is a new terminology in current medical literature. Implementation of pediatric hospice care in oncology setting is a vast but subspecialized field of research and practice. However, it is accompanied by substantial uncertainties, shortages and unexplored sections. The lack of globally established definitions, principles, and guidelines in this field has adversely impacted the quality of end-of-life experiences for children with hospice needs worldwide. To address this gap, we conducted a comprehensive review of scientific literature, extracting and compiling the available but sparse data on pediatric oncology hospice from the PubMed database. Our systematic approach led to development of a well-organized structure introducing the foundational elements, highlighting complications, and uncovering hidden gaps in this critical area. This structured framework comprises nine major categories including general ideology, population specifications, role of parents and family, psychosocial issues, financial complications, service locations, involved specialties, regulations, and quality improvement. This platform can serve as a valuable resource in establishing a scientifically reliable foundation for future experiments and practices in pediatric oncology hospice.
Collapse
Affiliation(s)
- Ali Tafazoli
- Healthcare administration program, St Lawrence College, Kingston Campus, ON, Canada
- Hospice Kingston, Queen's University, Kingston, ON, Canada
- Department of Biomedical and Molecular Sciences, Queen's University, Kingston, ON, Canada
| | | |
Collapse
|
84
|
Kadiyala S, Bhamidipati P, Malla RR. Neuroplasticity: Pathophysiology and Role in Major Depressive Disorder. Crit Rev Oncog 2024; 29:19-32. [PMID: 38989735 DOI: 10.1615/critrevoncog.2024051197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/12/2024]
Abstract
Neuroplasticity is characterized by the brain's ability to change its activity in response to extrinsic and intrinsic factors and is thought to be the mechanism behind all brain functions. Neuroplasticity causes structural and functional changes on a molecular level, specifically the growth of different regions in the brain and changes in synaptic and post-synaptic activities. The four types of neuroplasticity are homologous area adaption, compensatory masquerade, cross-modal reassignment, and map expansion. All of these help the brain work around injuries or new information inputs. In addition to baseline physical functions, neuroplasticity is thought to be the basis of emotional and mental regulations and the impairment of it can cause various mental illnesses. Concurrently, these mental illnesses further the damage of synaptic plasticity in the brain. Major depressive disorder (MDD) is one of the most common mental illnesses. It is affected by and accelerates the impairment of neuroplasticity. It is characterized by a chronically depressed state of mind that can impact the patient's daily life, including work life and interests. This review will focus on highlighting the physiological aspects of the disease and the role of neuroplasticity in the pathogenesis and pathology of the disorder. Moreover, the role of monoamine regulation and ketamine uptake will be discussed in terms of their antidepressant effects on the outcomes of MDD.
Collapse
Affiliation(s)
| | - Priyamvada Bhamidipati
- Cancer Biology Laboratory, Department of Biochemistry and Bioinformatics, GITAM School of Science, GITAM (Deemed to be University), Visakhapatnam 530045, Andhra Pradesh, India
| | - Rama Rao Malla
- Cancer Biology Laboratory, Department of Biochemistry and Bioinformatics, School of Science, Gandhi Institute of Technology and Management (GITAM) (Deemed to be University), Visakhapatnam-530045, Andhra Pradesh, India; Department of Biochemistry and Bioinformatics, School of Science, GITAM (Deemed to be University), Visakhapatnam-530045, Andhra Pradesh, India
| |
Collapse
|
85
|
Kosie JE, Lew-Williams C. Open Science Considerations for Descriptive Research in Developmental Science. INFANT AND CHILD DEVELOPMENT 2024; 33:e2377. [PMID: 38389731 PMCID: PMC10881201 DOI: 10.1002/icd.2377] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2021] [Accepted: 09/09/2022] [Indexed: 02/24/2024]
Abstract
Descriptive developmental research seeks to document, describe, and analyze the conditions under which infants and children live and learn. Here, we articulate how open-science practices can be incorporated into descriptive research to increase its transparency, reliability, and replicability. To date, most open-science practices have been oriented toward experimental rather than descriptive studies, and it can be confusing to figure out how to translate open-science practices (e.g., preregistration) for research that is more descriptive in nature. We discuss a number of unique considerations for descriptive developmental research, taking inspiration from existing open-science practices and providing examples from recent and ongoing studies. By embracing a scientific culture where descriptive research and open science coexist productively, developmental science will be better positioned to generate comprehensive theories of development and understand variability in development across communities and cultures.
Collapse
|
86
|
Seidl AH, Indarjit M, Borovsky A. Touch to learn: Multisensory input supports word learning and processing. Dev Sci 2024; 27:e13419. [PMID: 37291692 PMCID: PMC10704002 DOI: 10.1111/desc.13419] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2022] [Revised: 04/14/2023] [Accepted: 05/22/2023] [Indexed: 06/10/2023]
Abstract
Infants experience language in rich multisensory environments. For example, they may first be exposed to the word applesauce while touching, tasting, smelling, and seeing applesauce. In three experiments using different methods we asked whether the number of distinct senses linked with the semantic features of objects would impact word recognition and learning. Specifically, in Experiment 1 we asked whether words linked with more multisensory experiences were learned earlier than words linked fewer multisensory experiences. In Experiment 2, we asked whether 2-year-olds' known words linked with more multisensory experiences were better recognized than those linked with fewer. Finally, in Experiment 3, we taught 2-year-olds labels for novel objects that were linked with either just visual or visual and tactile experiences and asked whether this impacted their ability to learn the new label-to-object mappings. Results converge to support an account in which richer multisensory experiences better support word learning. We discuss two pathways through which rich multisensory experiences might support word learning.
Collapse
Affiliation(s)
- Amanda H Seidl
- Speech, Language, and Hearing Sciences, Purdue University, West Lafayette, Indiana, USA
| | - Michelle Indarjit
- Speech, Language, and Hearing Sciences, Purdue University, West Lafayette, Indiana, USA
| | - Arielle Borovsky
- Speech, Language, and Hearing Sciences, Purdue University, West Lafayette, Indiana, USA
| |
Collapse
|
87
|
Kanngiesser P, Sunderarajan J, Woike JK. Cheating and the effect of promises in Indian and German children. Child Dev 2024; 95:16-23. [PMID: 37307385 DOI: 10.1111/cdev.13952] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Cheating is harmful to others and society at large. Promises have been shown to increase honesty in children, but their effectiveness has not been compared between different cultural contexts. In a study (2019) with 7- to 12-year-olds (N = 406, 48% female, middle-class), voluntary promises reduced cheating in Indian, but not in German children. Children in both contexts cheated, but cheating rates were lower in Germany than in India. In both contexts, cheating decreased with age in the (no-promise) control condition and was unaffected by age in the promise condition. These findings suggest that there may exist a threshold beyond which cheating cannot be further reduced by promises. This opens new research avenues on how children navigate honesty and promise norms.
Collapse
Affiliation(s)
- Patricia Kanngiesser
- School of Psychology, University of Plymouth, Plymouth, UK
- Faculty of Education and Psychology, Freie Universität Berlin, Berlin, Germany
| | - Jahnavi Sunderarajan
- Faculty of Education and Psychology, Freie Universität Berlin, Berlin, Germany
- Department of Social Sciences, Flame University, Pune, India
| | - Jan K Woike
- School of Psychology, University of Plymouth, Plymouth, UK
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany
| |
Collapse
|
88
|
Holt S, Fan JE, Barner D. Creating ad hoc graphical representations of number. Cognition 2024; 242:105665. [PMID: 37992512 DOI: 10.1016/j.cognition.2023.105665] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Revised: 11/09/2023] [Accepted: 11/11/2023] [Indexed: 11/24/2023]
Abstract
The ability to communicate about exact number is critical to many modern human practices spanning science, industry, and politics. Although some early numeral systems used 1-to-1 correspondence (e.g., 'IIII' to represent 4), most systems provide compact representations via more arbitrary conventions (e.g., '7' and 'VII'). When people are unable to rely on conventional numerals, however, what strategies do they initially use to communicate number? Across three experiments, participants used pictures to communicate about visual arrays of objects containing 1-16 items, either by producing freehand drawings or combining sets of visual tokens. We analyzed how the pictures they produced varied as a function of communicative need (Experiment 1), spatial regularities in the arrays (Experiment 2), and visual properties of tokens (Experiment 3). In Experiment 1, we found that participants often expressed number in the form of 1-to-1 representations, but sometimes also exploited the configuration of sets. In Experiment 2, this strategy of using configural cues was exaggerated when sets were especially large, and when the cues were predictably correlated with number. Finally, in Experiment 3, participants readily adopted salient numerical features of objects (e.g., four-leaf clover) and generally combined them in a cumulative-additive manner. Taken together, these findings corroborate historical evidence that humans exploit correlates of number in the external environment - such as shape, configural cues, or 1-to-1 correspondence - as the basis for innovating more abstract number representations.
Collapse
Affiliation(s)
- Sebastian Holt
- Department of Psychology, University of California, San Diego, 9500 Gilman Drive, La Jolla, CA 92093, USA.
| | - Judith E Fan
- Department of Psychology, University of California, San Diego, 9500 Gilman Drive, La Jolla, CA 92093, USA; Department of Psychology, Stanford University, 450 Jane Stanford Way, Stanford, CA 94305, USA
| | - David Barner
- Department of Psychology, University of California, San Diego, 9500 Gilman Drive, La Jolla, CA 92093, USA; Department of Linguistics, University of California, San Diego, 9500 Gilman Drive, La Jolla, CA 92093, USA
| |
Collapse
|
89
|
Fränken JP, Valentin S, Lucas CG, Bramley NR. Naïve information aggregation in human social learning. Cognition 2024; 242:105633. [PMID: 37897881 DOI: 10.1016/j.cognition.2023.105633] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Revised: 09/27/2023] [Accepted: 10/02/2023] [Indexed: 10/30/2023]
Abstract
To glean accurate information from social networks, people should distinguish evidence from hearsay. For example, when testimony depends on others' beliefs as much as on first-hand information, there is a danger of evidence becoming inflated or ignored as it passes from person to person. We compare human inferences with an idealized rational account that anticipates and adjusts for these dependencies by evaluating peers' communications with respect to the underlying communication pathways. We report on three multi-player experiments examining the dynamics of both mixed human-artificial and all-human social networks. Our analyses suggest that most human inferences are best described by a naïve learning account that is insensitive to known or inferred dependencies between network peers. Consequently, we find that simulated social learners that assume their peers behave rationally make systematic judgment errors when reasoning on the basis of actual human communications. We suggest human groups learn collectively through naïve signaling and aggregation that is computationally efficient and surprisingly robust. Overall, our results challenge the idea that everyday social inference is well captured by idealized rational accounts and provide insight into the conditions under which collective wisdom can emerge from social interactions.
Collapse
Affiliation(s)
- J-Philipp Fränken
- Stanford University, United States of America; The University of Edinburgh, United Kingdom.
| | | | | | | |
Collapse
|
90
|
Li W, Germine LT, Mehr SA, Srinivasan M, Hartshorne J. Developmental psychologists should adopt citizen science to improve generalization and reproducibility. INFANT AND CHILD DEVELOPMENT 2024; 33:e2348. [PMID: 38515737 PMCID: PMC10957098 DOI: 10.1002/icd.2348] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2021] [Accepted: 05/17/2022] [Indexed: 11/08/2022]
Abstract
Widespread failures of replication and generalization are, ironically, a scientific triumph, in that they confirm the fundamental metascientific theory that underlies our field. Generalizable and replicable findings require testing large numbers of subjects from a wide range of demographics with a large, randomly-sampled stimulus set, and using a variety of experimental parameters. Because few studies accomplish any of this, meta-scientists predict that findings will frequently fail to replicate or generalize. We argue that to be more robust and replicable, developmental psychology needs to find a mechanism for collecting data at greater scale and from more diverse populations. Luckily, this mechanism already exists: Citizen science, in which large numbers of uncompensated volunteers provide data. While best-known for its contributions to astronomy and ecology, citizen science has also produced major findings in neuroscience and psychology, and increasingly in developmental psychology. We provide examples, address practical challenges, discuss limitations, and compare to other methods of obtaining large datasets. Ultimately, we argue that the range of studies where it makes sense *not* to use citizen science is steadily dwindling.
Collapse
Affiliation(s)
- Wei Li
- Department of Psychology and Neuroscience, Boston College, Chestnut Hill, MA, USA
| | - Laura Thi Germine
- McLean Hospital, Belmont, MA, USA
- Department of Psychiatry, Harvard Medical School, Cambridge, MA
| | - Samuel A. Mehr
- Data Science Initiative, Harvard University, Cambridge, MA
- School of Psychology, Victoria University of Wellington, Wellington, New Zealand
| | | | - Joshua Hartshorne
- Department of Psychology and Neuroscience, Boston College, Chestnut Hill, MA, USA
| |
Collapse
|
91
|
Schwering SC, Jacobs CL, Montemayor J, MacDonald MC. Lexico-syntactic constraints influence verbal working memory in sentence-like lists. Mem Cognit 2023:10.3758/s13421-023-01496-2. [PMID: 38129629 DOI: 10.3758/s13421-023-01496-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/11/2023] [Indexed: 12/23/2023]
Abstract
We test predictions from the language emergent perspective on verbal working memory that lexico-syntactic constraints should support both item and order memory. In natural language, long-term knowledge of lexico-syntactic patterns involving part of speech, verb biases, and noun animacy support language comprehension and production. In three experiments, participants were presented with randomly generated dative-like sentences or lists in which part of speech, verb biases, and animacy of a single word were manipulated. Participants were more likely to recall words in the correct position when presented with a verb over a noun in the verb position, a good dative verb over an intransitive verb in the verb position, and an animate noun over an inanimate noun in the subject noun position. These results demonstrate that interactions between words and their context in the form of lexico-syntactic constraints influence verbal working memory.
Collapse
|
92
|
Ahmad Z, Kelly KR, Freud E. Reduced perception-action dissociation in children with amblyopia. Neuropsychologia 2023; 191:108738. [PMID: 38007150 DOI: 10.1016/j.neuropsychologia.2023.108738] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 11/08/2023] [Accepted: 11/19/2023] [Indexed: 11/27/2023]
Abstract
The functional distinction between vision-for-perception and vision-for-action is a key aspect of understanding the primate visual system. While this dissociation has been well-established in adulthood, its development and dependence on typical visual experience remain unclear. To address these questions, we examined two groups of children: typically developed children and those with amblyopia, who presumably have a sub-optimal visual experience. The Ponzo illusion, known to impact perception but not visuomotor behaviors across age groups, was employed to assess the extent of dissociation. Participants engaged in two tasks involving the Ponzo illusion: a grasping task (vision-for-action) and a manual estimation task (vision-for-perception), with objects placed on the "close" and "far" surfaces of the illusion. Typically developed children displayed grasping movements that were unaffected by the illusion, as their grasping apertures were scaled based on object size, independent of its location. In contrast, children with amblyopia exhibited a clear susceptibility to the illusion, showing larger apertures for objects placed on the 'far' surface of the illusion, and smaller apertures for objects placed on the 'close' surface. Interestingly, both groups of children demonstrated similar susceptibility to the illusion during the perceptual task, with objects placed on the far surface being perceived as longer compared to objects placed on the close surface. These findings shed light on the impact of atypical visual development on the emergence of the dissociation between perception and action, highlighting the crucial role of typical visual experience in establishing this distinction.
Collapse
Affiliation(s)
- Zoha Ahmad
- Department of Biology, York University, Canada; The Centre for Vision Research, York University, Canada.
| | - Krista R Kelly
- School of Optometry and Vision Science, University of Waterloo, Canada; Retina Foundation of the Southwest, Dallas, USA
| | - Erez Freud
- The Centre for Vision Research, York University, Canada; Department of Psychology, York University, Canada
| |
Collapse
|
93
|
Bosco A, Sanz Diez P, Filippini M, De Vitis M, Fattori P. A focus on the multiple interfaces between action and perception and their neural correlates. Neuropsychologia 2023; 191:108722. [PMID: 37931747 DOI: 10.1016/j.neuropsychologia.2023.108722] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 10/13/2023] [Accepted: 10/31/2023] [Indexed: 11/08/2023]
Abstract
Successful behaviour relies on the appropriate interplay between action and perception. The well-established dorsal and ventral stream theories depicted two distinct functional pathways for the processes of action and perception, respectively. In physiological conditions, the two pathways closely cooperate in order to produce successful adaptive behaviour. As the coupling between perception and action exists, this requires an interface that is responsible for a common reading of the two functions. Several studies have proposed different types of perception and action interfaces, suggesting their role in the creation of the shared interaction channel. In the present review, we describe three possible perception and action interfaces: i) the motor code, including common coding approaches, ii) attention, and iii) object affordance; we highlight their potential neural correlates. From this overview, a recurrent neural substrate that underlies all these interface functions appears to be crucial: the parieto-frontal circuit. This network is involved in the mirror mechanism which underlies the perception and action interfaces identified as common coding and motor code theories. The same network is also involved in the spotlight of attention and in the encoding of potential action towards objects; these are manifested in the perception and action interfaces for common attention and object affordance, respectively. Within this framework, most studies were dedicated to the description of the role of the inferior parietal lobule; growing evidence, however, suggests that the superior parietal lobule also plays a crucial role in the interplay between action and perception. The present review proposes a novel model that is inclusive of the superior parietal regions and their relative contribution to the different action and perception interfaces.
Collapse
Affiliation(s)
- A Bosco
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Piazza di Porta San Donato 2, 40126, Bologna, Italy; Alma Mater Research Institute For Human-Centered Artificial Intelligence (Alma Human AI), University of Bologna, Via Galliera 3 Bologna, 40121, Bologna, Italy.
| | - P Sanz Diez
- Carl Zeiss Vision International GmbH, Turnstrasse 27, 73430, Aalen, Germany; Institute for Ophthalmic Research, Eberhard Karls University Tuebingen, Elfriede-Aulhorn-Straße 7, 72076, Tuebingen, Germany
| | - M Filippini
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Piazza di Porta San Donato 2, 40126, Bologna, Italy; Alma Mater Research Institute For Human-Centered Artificial Intelligence (Alma Human AI), University of Bologna, Via Galliera 3 Bologna, 40121, Bologna, Italy
| | - M De Vitis
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Piazza di Porta San Donato 2, 40126, Bologna, Italy
| | - P Fattori
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Piazza di Porta San Donato 2, 40126, Bologna, Italy; Alma Mater Research Institute For Human-Centered Artificial Intelligence (Alma Human AI), University of Bologna, Via Galliera 3 Bologna, 40121, Bologna, Italy
| |
Collapse
|
94
|
Adibpour P, Hochmann JR. Infants' understanding of the causal power of agents and tools. Proc Natl Acad Sci U S A 2023; 120:e2309669120. [PMID: 38064512 PMCID: PMC10723150 DOI: 10.1073/pnas.2309669120] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Accepted: 11/01/2023] [Indexed: 12/17/2023] Open
Abstract
Tools are objects that are manipulated by agents with the intention to cause an effect in the world. We show that the cognitive capacity to understand tools is present in young infants, even if these tools produce arbitrary, causally opaque effects. In experiments 1-2, we used pupillometry to show that 8-mo-old infants infer an invisible causal contact to account for the-otherwise unexplained-motion of a ball. In experiments 3, we probed 8-mo-old infants' account of a state change event (flickering of a cube) that lies outside of the explanatory power of intuitive physics. Infants repeatedly watched an intentional agent launch a ball behind an occluder. After a short delay, a cube, positioned at the other end of the occluder began flickering. Rare unoccluded events served to probe infants' representation of what happened behind the occluder. Infants exhibited larger pupil dilation, signaling more surprise, when the ball stopped before touching the cube, than when it contacted the cube, suggesting that infants inferred that the cause of the state change was contact between the ball and the cube. This effect was canceled in experiment 4, when an inanimate sphere replaced the intentional agent. Altogether, results suggest that, in the infants' eyes, a ball (an inanimate object) has the power to cause an arbitrary state change, but only if it inherits this power from an intentional agent. Eight-month-olds are thus capable of representing complex event structures, involving an intentional agent causing a change with a tool.
Collapse
Affiliation(s)
- Parvaneh Adibpour
- Université Paris Cité, NeuroDiderot Unit UMR1141, INSERM, Paris75019, France
- Université Paris Saclay, Commissariat à l'Energie Atomique, NeuroSpin, Unité de recherche en NeuroImagerie Applicative Clinique et Translationnelle, Gif-sur-YvetteF-91191, France
| | - Jean-Rémy Hochmann
- CNRSUMR5229–Institut des Sciences Cognitives Marc Jeannerod, Bron69675, France
- Université Lyon 1 Claude Bernard, Villeurbanne69100, France
| |
Collapse
|
95
|
Linsley D, Serre T. Fixing the problems of deep neural networks will require better training data and learning algorithms. Behav Brain Sci 2023; 46:e400. [PMID: 38054333 DOI: 10.1017/s0140525x23001589] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/07/2023]
Abstract
Bowers et al. argue that deep neural networks (DNNs) are poor models of biological vision because they often learn to rival human accuracy by relying on strategies that differ markedly from those of humans. We show that this problem is worsening as DNNs are becoming larger-scale and increasingly more accurate, and prescribe methods for building DNNs that can reliably model biological vision.
Collapse
Affiliation(s)
- Drew Linsley
- Department of Cognitive Linguistic & Psychological Sciences, Carney Institute for Brain Science, Brown University, Providence, RI, USA ://sites.brown.edu/drewlinsleyhttps://serre-lab.clps.brown.edu
| | - Thomas Serre
- Department of Cognitive Linguistic & Psychological Sciences, Carney Institute for Brain Science, Brown University, Providence, RI, USA ://sites.brown.edu/drewlinsleyhttps://serre-lab.clps.brown.edu
| |
Collapse
|
96
|
Bergey CA, Yurovsky D. Using contrastive inferences to learn about new words and categories. Cognition 2023; 241:105597. [PMID: 37678085 DOI: 10.1016/j.cognition.2023.105597] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Revised: 08/03/2023] [Accepted: 08/08/2023] [Indexed: 09/09/2023]
Abstract
In the face of unfamiliar language or objects, description is one cue people can use to learn about both. Beyond narrowing potential referents to those that match a descriptor (e.g., "tall"), people could infer that a described object is one that contrasts with other relevant objects of the same type (e.g., "the tall cup" contrasts with another, shorter cup). This contrast may be in relation to other objects present in the environment (this cup is tall among present cups) or to the referent's category (this cup is tall for a cup in general). In three experiments, we investigate whether people use such contrastive inferences from description to learn new word-referent mappings and learn about new categories' feature distributions. People use contrastive inferences to guide their referent choice, though size - and not color - adjectives prompt them to consistently choose the contrastive target over alternatives (Experiment 1). People also use color and size description to infer that a novel object is atypical of its category (Experiments 2 and 3): utterances like "the blue toma" prompt people to infer that tomas are less likely to be blue in general. However, these two inferences do not trade off substantially: people infer a described referent is atypical even when the descriptor was necessary to establish reference. We model these experiments in the Rational Speech Act (RSA) framework and find that it predicts both of these inferences. Overall, people are able to use contrastive inferences from description to resolve reference and make inferences about a novel object's category, letting them learn more about new things than literal meaning alone allows.
Collapse
|
97
|
Zhang Z, Chen T, Liu Y, Wang C, Zhao K, Liu CH, Fu X. Decoding the temporal representation of facial expression in face-selective regions. Neuroimage 2023; 283:120442. [PMID: 37926217 DOI: 10.1016/j.neuroimage.2023.120442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Revised: 10/23/2023] [Accepted: 11/02/2023] [Indexed: 11/07/2023] Open
Abstract
The ability of humans to discern facial expressions in a timely manner typically relies on distributed face-selective regions for rapid neural computations. To study the time course in regions of interest for this process, we used magnetoencephalography (MEG) to measure neural responses participants viewed facial expressions depicting seven types of emotions (happiness, sadness, anger, disgust, fear, surprise, and neutral). Analysis of the time-resolved decoding of neural responses in face-selective sources within the inferior parietal cortex (IP-faces), lateral occipital cortex (LO-faces), fusiform gyrus (FG-faces), and posterior superior temporal sulcus (pSTS-faces) revealed that facial expressions were successfully classified starting from ∼100 to 150 ms after stimulus onset. Interestingly, the LO-faces and IP-faces showed greater accuracy than FG-faces and pSTS-faces. To examine the nature of the information processed in these face-selective regions, we entered with facial expression stimuli into a convolutional neural network (CNN) to perform similarity analyses against human neural responses. The results showed that neural responses in the LO-faces and IP-faces, starting ∼100 ms after the stimuli, were more strongly correlated with deep representations of emotional categories than with image level information from the input images. Additionally, we observed a relationship between the behavioral performance and the neural responses in the LO-faces and IP-faces, but not in the FG-faces and lpSTS-faces. Together, these results provided a comprehensive picture of the time course and nature of information involved in facial expression discrimination across multiple face-selective regions, which advances our understanding of how the human brain processes facial expressions.
Collapse
Affiliation(s)
- Zhihao Zhang
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Tong Chen
- Chongqing Key Laboratory of Non-Linear Circuit and Intelligent Information Processing, Southwest University, Chongqing 400715, China; Chongqing Key Laboratory of Artificial Intelligence and Service Robot Control Technology, Chongqing 400715, China
| | - Ye Liu
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Chongyang Wang
- Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China
| | - Ke Zhao
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, China.
| | - Chang Hong Liu
- Department of Psychology, Bournemouth University, Dorset, United Kingdom
| | - Xiaolan Fu
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, China.
| |
Collapse
|
98
|
Pinheiro-Chagas P, Sava-Segal C, Akkol S, Daitch A, Parvizi J. Spatiotemporal dynamics of successive activations across the human brain during simple arithmetic processing. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.11.22.568334. [PMID: 38045319 PMCID: PMC10690273 DOI: 10.1101/2023.11.22.568334] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/05/2023]
Abstract
Previous neuroimaging studies have offered unique insights about the spatial organization of activations and deactivations across the brain, however these were not powered to explore the exact timing of events at the subsecond scale combined with precise anatomical source information at the level of individual brains. As a result, we know little about the order of engagement across different brain regions during a given cognitive task. Using experimental arithmetic tasks as a prototype for human-unique symbolic processing, we recorded directly across 10,076 brain sites in 85 human subjects (52% female) using intracranial electroencephalography (iEEG). Our data revealed a remarkably distributed change of activity in almost half of the sampled sites. Notably, an orderly successive activation of a set of brain regions - anatomically consistent across subjects-was observed in individual brains. Furthermore, the temporal order of activations across these sites was replicable across subjects and trials. Moreover, the degree of functional connectivity between the sites decreased as a function of temporal distance between regions, suggesting that information is partially leaked or transformed along the processing chain. Furthermore, in each activated region, distinct neuronal populations with opposite activity patterns during target and control conditions were juxtaposed in an anatomically orderly manner. Our study complements the prior imaging studies by providing hitherto unknown information about the timing of events in the brain during arithmetic processing. Such findings can be a basis for developing mechanistic computational models of human-specific cognitive symbolic systems. Significance statement Our study elucidates the spatiotemporal dynamics and anatomical specificity of brain activations across >10,000 sites during arithmetic tasks, as captured by intracranial EEG. We discovered an orderly, successive activation of brain regions, consistent across individuals, and a decrease in functional connectivity as a function of temporal distance between regions. Our findings provide unprecedented insights into the sequence of cognitive processing and regional interactions, offering a novel perspective for enhancing computational models of cognitive symbolic systems.
Collapse
|
99
|
Maruya A, Zaidi Q. Perceptual Transitions between Object Rigidity & Non-rigidity: Competition and cooperation between motion-energy, feature-tracking and shape-based priors. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.04.07.536067. [PMID: 37503257 PMCID: PMC10369874 DOI: 10.1101/2023.04.07.536067] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/29/2023]
Abstract
Why do moving objects appear rigid when projected retinal images are deformed non-rigidly? We used rotating rigid objects that can appear rigid or non-rigid to test whether shape features contribute to rigidity perception. When two circular rings were rigidly linked at an angle and jointly rotated at moderate speeds, observers reported that the rings wobbled and were not linked rigidly but rigid rotation was reported at slow speeds. When gaps, paint or vertices were added, the rings appeared rigidly rotating even at moderate speeds. At high speeds, all configurations appeared non-rigid. Salient features thus contribute to rigidity at slow and moderate speeds, but not at high speeds. Simulated responses of arrays of motion-energy cells showed that motion flow vectors are predominantly orthogonal to the contours of the rings, not parallel to the rotation direction. A convolutional neural network trained to distinguish flow patterns for wobbling versus rotation, gave a high probability of wobbling for the motion-energy flows. However, the CNN gave high probabilities of rotation for motion flows generated by tracking features with arrays of MT pattern-motion cells and corner detectors. In addition, circular rings can appear to spin and roll despite the absence of any sensory evidence, and this illusion is prevented by vertices, gaps, and painted segments, showing the effects of rotational symmetry and shape. Combining CNN outputs that give greater weight to motion energy at fast speeds and to feature tracking at slow, with the shape-based priors for wobbling and rolling, explained rigid and nonrigid percepts across shapes and speeds (R2=0.95). The results demonstrate how cooperation and competition between different neuronal classes leads to specific states of visual perception and to transitions between the states.
Collapse
Affiliation(s)
- Akihito Maruya
- Graduate Center for Vision Research, State University of New York, 33 West 42nd St, New York, NY 10036
| | - Qasim Zaidi
- Graduate Center for Vision Research, State University of New York, 33 West 42nd St, New York, NY 10036
| |
Collapse
|
100
|
Ramírez-Moreno MA, Cruz-Garza JG, Acharya A, Chatufale G, Witt W, Gelok D, Reza G, Contreras-Vidal JL. Brain-to-brain communication during musical improvisation: a performance case study. F1000Res 2023; 11:989. [PMID: 37809054 PMCID: PMC10558998 DOI: 10.12688/f1000research.123515.3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 11/01/2023] [Indexed: 10/10/2023] Open
Abstract
Understanding and predicting others' actions in ecological settings is an important research goal in social neuroscience. Here, we deployed a mobile brain-body imaging (MoBI) methodology to analyze inter-brain communication between professional musicians during a live jazz performance. Specifically, bispectral analysis was conducted to assess the synchronization of scalp electroencephalographic (EEG) signals from three expert musicians during a three-part 45 minute jazz performance, during which a new musician joined every five minutes. The bispectrum was estimated for all musician dyads, electrode combinations, and five frequency bands. The results showed higher bispectrum in the beta and gamma frequency bands (13-50 Hz) when more musicians performed together, and when they played a musical phrase synchronously. Positive bispectrum amplitude changes were found approximately three seconds prior to the identified synchronized performance events suggesting preparatory cortical activity predictive of concerted behavioral action. Moreover, a higher amount of synchronized EEG activity, across electrode regions, was observed as more musicians performed, with inter-brain synchronization between the temporal, parietal, and occipital regions the most frequent. Increased synchrony between the musicians' brain activity reflects shared multi-sensory processing and movement intention in a musical improvisation task.
Collapse
Affiliation(s)
- Mauricio A. Ramírez-Moreno
- School of Engineering and Sciences, Mechatronics Department, Tecnologico de Monterrey, Monterrey, Nuevo Leon, 64849, Mexico
- Noninvasive Brain-Machine Interface Systems Laboratory, NSF IUCRC BRAIN, University of Houston, Houston, Texas, 77004, USA
| | - Jesús G. Cruz-Garza
- Noninvasive Brain-Machine Interface Systems Laboratory, NSF IUCRC BRAIN, University of Houston, Houston, Texas, 77004, USA
| | - Akanksha Acharya
- Noninvasive Brain-Machine Interface Systems Laboratory, NSF IUCRC BRAIN, University of Houston, Houston, Texas, 77004, USA
| | - Girija Chatufale
- Noninvasive Brain-Machine Interface Systems Laboratory, NSF IUCRC BRAIN, University of Houston, Houston, Texas, 77004, USA
- University of California, Los Angeles, Los Angeles, California, 90095, USA
| | - Woody Witt
- Moores School of Music, University of Houston, Houston, Texas, 77004, USA
- Houston Community College, Houston, Texas, 77004, USA
| | - Dan Gelok
- Moores School of Music, University of Houston, Houston, Texas, 77004, USA
| | | | - José L. Contreras-Vidal
- Noninvasive Brain-Machine Interface Systems Laboratory, NSF IUCRC BRAIN, University of Houston, Houston, Texas, 77004, USA
| |
Collapse
|