TEST: a tropic, embodied, and situated theory of cognition

On the embodied nature of knowledge: From neurons to numbers

Interdisciplinary investigations of the human mind through the cognitive sciences have identified a key role of the body in representing knowledge. After characterizing knowledge at grounded, embodied, and situated levels, number knowledge is analyzed from this hierarchical perspective. Lateralized cortical processing of coarse versus fine detail is identified as a grounding substrate for the population stereotype few/left, many/right, which then contributes to number-related sensory and motor biases at the embodied and situated levels. Implications of this perspective for education and rehabilitation are discussed.

Invariant representations in abstract concept grounding - the physical world in grounded cognition

Grounded cognition states that mental representations of concepts consist of experiential aspects. For example, the concept "cup" consists of the sensorimotor experiences from interactions with cups. Typical modalities in which concepts are grounded are: The sensorimotor system (including interoception), emotion, action, language, and social aspects. Here, we argue that this list should be expanded to include physical invariants (unchanging features of physical motion; e.g., gravity, momentum, friction). Research on physical reasoning consistently demonstrates that physical invariants are represented as fundamentally as other grounding substrates, and therefore should qualify. We assess several theories of concept representation (simulation, conceptual metaphor, conceptual spaces, predictive processing) and their positions on physical invariants. We find that the classic grounded cognition theories, simulation and conceptual metaphor theory, have not considered physical invariants, while conceptual spaces and predictive processing have. We conclude that physical invariants should be included into grounded cognition theories, and that the core mechanisms of simulation and conceptual metaphor theory are well suited to do this. Furthermore, conceptual spaces and predictive processing are very promising and should also be integrated with grounded cognition in the future.

Keeping track of time: Horizontal spatial biases for hours, days, and months

In many Western cultures, the processing of temporal words related to the past and to the future is associated with left and right space, respectively - a phenomenon known as the horizontal Mental Time Line (MTL). While this mapping is apparently quite ubiquitous, its regularity and consistency across different types of temporal concepts remain to be determined. Moreover, it is unclear whether such spatial mappings are an essential and early constituent of concept activation. In the present study, we used words denoting time units at different scales (hours of the day, days of the week, months of the year) associated with either left space (e.g., 9 a.m., Monday, February) or right space (e.g., 8 p.m., Saturday, November) as cues in a line bisection task. Fifty-seven healthy adults listened to temporal words and then moved a mouse cursor to the perceived midpoint of a horizontally presented line. We measured movement trajectories, initial line intersection coordinates, and final bisection response coordinates. We found movement trajectory displacements for left- vs. right-biasing hour and day cues. Initial line intersections were biased specifically by month cues, while final bisection responses were biased specifically by hour cues. Our findings offer general support to the notion of horizontal space-time associations and suggest further investigation of the exact chronometry and strength of this association across individual time units.

Face Age is Mapped Into Three-Dimensional Space

People can represent temporal stimuli (e.g., pictures depicting past and future events) as spatially connoted dimensions arranged along the three main axes (horizontal, sagittal, and vertical). For example, past and future events are generally represented, from the perspective of the individuals, as being placed behind and in front of them, respectively. Here, we report that such a 3D representation can also emerge for facial stimuli of different ages. In three experiments, participants classified a central target face, representing an individual at different age stages, as younger or older than the reference face of 40 years. Manual responses were provided with two keys placed along the horizontal axis (Experiment 1), the sagittal axis (Experiment 2), and the vertical axis (Experiment 3). The results indicated that the younger faces were represented on the left/back/top side of the space, whereas the older faces were represented on the right/forward/bottom side of the space. Furthermore, in all experiments, the latencies decreased with the absolute difference between the age of the target face and that of the reference face (i.e., a distance effect). Overall, this work suggests that the spatial representation of time includes social features of the human face.

Embodied Processing at Six Linguistic Granularity Levels: A Consensus Paper

Language processing is influenced by sensorimotor experiences. Here, we review behavioral evidence for embodied and grounded influences in language processing across six linguistic levels of granularity. We examine (a) sub-word features, discussing grounded influences on iconicity (systematic associations between word form and meaning); (b) words, discussing boundary conditions and generalizations for the simulation of color, sensory modality, and spatial position; (c) sentences, discussing boundary conditions and applications of action direction simulation; (d) texts, discussing how the teaching of simulation can improve comprehension in beginning readers; (e) conversations, discussing how multi-modal cues improve turn taking and alignment; and (f) text corpora, discussing how distributional semantic models can reveal how grounded and embodied knowledge is encoded in texts. These approaches are converging on a convincing account of the psychology of language, but at the same time, there are important criticisms of the embodied approach and of specific experimental paradigms. The surest way forward requires the adoption of a wide array of scientific methods. By providing complimentary evidence, a combination of multiple methods on various levels of granularity can help us gain a more complete understanding of the role of embodiment and grounding in language processing.

When time stands upright: STEARC effects along the vertical axis

According to the spatial-temporal association of response codes (STEARC) effect, time can be spatially represented from left to right. However, exploration of a possible STEARC effect along the vertical axis has yielded mixed results. Here, in six experiments based on a novel paradigm, we systematically explored whether a STEARC effect could emerge when participants were asked to classify the actual temporal duration of a visual stimulus. Speeded manual responses were provided using a vertically oriented response box. Interestingly, although a top-to-bottom time representation emerged when only two temporal durations were employed, an inverted bottom-to-top time representation emerged when a denser set of temporal durations, arranged along a continuum, was used. Moreover, no STEARC effects emerged when participants classified the shapes of visual stimuli rather than their temporal duration. Finally, three additional experiments explored the STEARC effect along the horizontal axis, confirming that the paradigm we devised successfully replicated the standard left-to-right representation of time. These results provide supporting evidence for the notion that temporal durations can be mapped along the vertical axis, and that such mapping appears to be relatively flexible.

Abstract concepts: external influences, internal constraints, and methodological issues

There is a longstanding and widely held misconception about the relative remoteness of abstract concepts from concrete experiences. This review examines the current evidence for external influences and internal constraints on the processing, representation, and use of abstract concepts, like truth, friendship, and number. We highlight the theoretical benefit of distinguishing between grounded and embodied cognition and then ask which roles do perception, action, language, and social interaction play in acquiring, representing and using abstract concepts. By reviewing several studies, we show that they are, against the accepted definition, not detached from perception and action. Focussing on magnitude-related concepts, we also discuss evidence for cultural influences on abstract knowledge and explore how internal processes such as inner speech, metacognition, and inner bodily signals (interoception) influence the acquisition and retrieval of abstract knowledge. Finally, we discuss some methodological developments. Specifically, we focus on the importance of studies that investigate the time course of conceptual processing and we argue that, because of the paramount role of sociality for abstract concepts, new methods are necessary to study concepts in interactive situations. We conclude that bodily, linguistic, and social constraints provide important theoretical limitations for our theories of conceptual knowledge.

Influences of hand action on the processing of symbolic numbers: A special role of pointing?

Embodied and grounded cognition theories state that cognitive processing is built upon sensorimotor systems. In the context of numerical cognition, support to this framework comes from the interactions between numerical processing and the hand actions of reaching and grasping documented in skilled adults. Accordingly, mechanisms for the processing of object size and location during reach and grasp actions might scaffold the development of mental representations of numerical magnitude. The present study exploited motor adaptation to test the hypothesis of a functional overlap between neurocognitive mechanisms of hand action and numerical processing. Participants performed repetitive grasping of an object, repetitive pointing, repetitive tapping, or passive viewing. Subsequently, they performed a symbolic number comparison task. Importantly, hand action and number comparison were functionally and temporally dissociated, thereby minimizing context-based effects. Results showed that executing the action of pointing slowed down the responses in number comparison. Moreover, the typical distance effect (faster responses for numbers far from the reference as compared to close ones) was not observed for small numbers after pointing, while it was enhanced by grasping. These findings confirm the functional link between hand action and numerical processing, and suggest new hypotheses on the role of pointing as a meaningful gesture in the development and embodiment of numerical skills.

Social Perception of Artificial Intelligence and Digitization of Cultural Heritage: Russian Context

The article considers the social perception of artificial intelligence (AI) as an essential factor having an impact on the digitization, transfer, and popularization of cultural heritage. The article aims at the theoretical comprehension of the digital ontology and implementation of AI in the context of Russian realia. The research relies on comprehensive analysis based on statistical data, using descriptive and comparative methods. The interdisciplinary approach adopted includes reflexive analysis of both positive and negative consequences of the digitalization process. The article examines the peculiarities of the “digital ontology”, deterritorization effect, new actors in the digital process, the effect of digital trust, and opposite views of AI-enthusiasts and AI-alarmists. The article describes objective and subjective reasons for the negative perception of digital artifacts, and states the need to consider the influence of key figures in digital ontology: influencers, stakeholders, and data scientists. The ambivalence of public perception of both artificial intelligence and digital cultural heritage is stated. The research reveals digitization frontiers, which involve three factors: the axiological factor, indicating the need for consistency between a human values system and AI development programs; the subject vector, emphasizing the role of a new type of digital heritage bearers and digital influence actors; ethical factor associated with the need to transform relations with information technologies in order to subordinate them to human reflection and comprehension. The authors conclude that cultural heritage digitization should be aimed at generating a human-centered future.

Does the body talk to the body? The relationship between different body representations while observing others' body parts

The way human bodies are represented is central in everyday activities. The cognitive system must combine internal, visceral, and somatosensory, signals to external, visually driven information generated from the spatial placement of others’ bodies and the own body in the space. However, how different body representations covertly interact among them when observing human body parts is still unclear. Therefore, we investigated the implicit processing of body parts by manipulating either the body part stimuli’ posture (conditions a and b) or the participants’ response body posture (conditions c, d, and e) in healthy participants (N = 70) using a spatial compatibility task called Sidedness task. The task requires participants to judge the colour of a circle superimposed on a task‐irrelevant body part picture. Responses are facilitated when the spatial side of the responding hand corresponds to the spatial code generated by the hand stimulus's position with respect to a body of reference. Results showed that the observation of the task‐irrelevant body parts oriented participants’ attention and facilitated responses that were spatial compatible with the spatial position such body parts have within a configural representation of the body structure (i.e., Body Structural Representation) in all the five experimental conditions. Notably, the body part stimuli were mentally attached to the body according to the most comfortable and less awkward postures, following the anatomo‐physiological constraints. Moreover, the pattern of the results was not influenced by manipulating the participants’ response postures, suggesting that the automatic and implicit coding of the body part stimuli does not rely on proprioceptive information about one's body (i.e., Body Schema). We propose that the human body's morphometry knowledge is enriched by biomechanical and anatomo‐physiological information about the real body movement possibilities. Moreover, we discuss the importance of the automatic orienting of attention based on the sidedness within the context of imitational learning.

Spatial conceptual mapping of words with temporal semantics

Unlike concrete words related to sensory perception (e.g., hear, sun), abstract words (including the words with temporal semantics, e.g., year, tomorrow) do not have direct embodied sensory correlates. Nevertheless, existing research indicates that abstract concepts’ representations make regular reference to sensorimotor processes, e.g., visual perception. For example, regular expressions such as “the future is ahead” or “the flow of time” are common in different languages reflecting a relatively universal nature of space-time correspondences. Moreover, these regular correspondences are commonly demonstrated in experimental studies; for example — by registering attentional displacement during processing of past and future related words. Here, the main theoretical approaches as well as existing experimental data documenting neurocognitive foundations of space-time representations are reviewed. A detailed overview of research on spatial-conceptual mapping of time concepts in three-dimensional visual space is offered. We also consider features of space-time associations that reflect linguistic and socio-cultural differences. In conclusion, the main areas of current and future that will allow an integration of the existing data within a common theoretical framework are defined.

Effects of attentional shifts along the vertical axis on number processing: An eye-tracking study with optokinetic stimulation

Previous studies suggest that associations between numbers and space are mediated by shifts of visuospatial attention along the horizontal axis. In this study, we investigated the effect of vertical shifts of overt attention, induced by optokinetic stimulation (OKS) and monitored through eye-tracking, in two tasks requiring explicit (number comparison) or implicit (parity judgment) processing of number magnitude. Participants were exposed to black-and-white stripes (OKS) that moved vertically (upward or downward) or remained static (control condition). During the OKS, participants were asked to verbally classify auditory one-digit numbers as larger/smaller than 5 (comparison task; Exp. 1) or as odd/even (parity task; Exp. 2). OKS modulated response times in both experiments. In Exp.1, upward attentional displacement decreased the Magnitude effect (slower responses for large numbers) and increased the Distance effect (slower responses for numbers close to the reference). In Exp.2, we observed a complex interaction between parity, magnitude, and OKS, indicating that downward attentional displacement slowed down responses for large odd numbers. Moreover, eye tracking analyses revealed an influence of number processing on eye movements both in Exp. 1, with eye gaze shifting downwards during the processing of small numbers as compared to large ones; and in Exp. 2, with leftward shifts after large even numbers (6,8) and rightward shifts after large odd numbers (7,9). These results provide evidence of bidirectional links between number and space and extend them to the vertical dimension. Moreover, they document the influence of visuo-spatial attention on processing of numerical magnitude, numerical distance, and parity. Together, our findings are in line with grounded and embodied accounts of numerical cognition.

Grounding (fairly) complex numerical knowledge: an educational example

In this article, we contextualize and discuss an on-line contribution to this special issue in which a video-recorded lecture demonstrates the teaching of an abstract mathematical concept, namely regression to the mean. We first motivate the pertinence of this example from the perspective of embodied cognition. Then, we identify mechanisms of teaching that reflect embodied cognitive practices, such as the concreteness fading approach. Rather than a comprehensive review of multiple extensive literatures, this article provides the interested reader with several sources or entries into those literatures.

The vertical space-time association

The space-time interaction suggests a left-to-right directionality in the mind's representation of elapsing time. However, studies showing a possible vertical time representation are scarce and contradictory. In Experiment 1, 32 participants had to judge the duration (200, 300, 500, or 600 ms) of the target stimulus that appeared at the top, centre, or bottom of the screen, compared with a reference stimulus (400 ms) that always appeared in the centre of the screen. In Experiment 2, 32 participants were administered the same procedure, but the reference stimulus appeared at the top, centre, or bottom of the screen and the target stimulus was fixed in the centre location. In both experiments, a space-time interaction was found with an association between short durations and bottom response key as well as between long durations and top key. The evidence of a vertical mental timeline was further confirmed by the distance effect with a lower level of performance for durations close to that of the reference stimulus. The results suggest a bottom-to-top mapping of time representation, more in line with the metaphor "more is up."

Is Face Age Mapped Asymmetrically onto Space? Insights from a SNARC-like Task

The magnitude associated with a stimulus can be spatially connoted, with relatively smaller and larger magnitudes that would be represented on the left and on the right side of space, respectively. According to recent evidence, this space–magnitude association could reflect specific brain asymmetries. In this study, we explored whether such an association can also emerge for face age, assuming that responders should represent relatively younger and older adult faces on the left and on the right, respectively. A sample of young adults performed a speeded binary classification task aimed at categorising the age of a centrally placed adult face stimulus as either younger or older than the age of a reference face. A left-side and a right-side response key were used to collect manual responses. Overall, older faces were categorised faster than younger faces, and response latencies decreased with the absolute difference between the age of the target stimulus and the age of the reference, in line with a distance effect. However, no evidence of a left-to-right spatial representation of face age emerged. Taken together, these results suggest that face age is mapped onto space differently from other magnitudes.

Grounding Language Processing: The Added Value of Specifying Linguistic/Compositional Representations and Processes

Abundant empirical evidence suggests that visual perception and motor responses are involved in language comprehension ('grounding'). However, when modeling the grounding of sentence comprehension on a word-by-word basis, linguistic representations and cognitive processes are rarely made fully explicit. This article reviews representational formalisms and associated (computational) models with a view to accommodating incremental and compositional grounding effects. Are different representation formats equally suitable and what mechanisms and representations do models assume to accommodate grounding effects? I argue that we must minimally specify compositional semantic representations, a set of incremental processes/mechanisms, and an explicit link from the assumed processes to measured behavior. Different representational formats can be contrasted in psycholinguistic modeling by holding the set of processes/mechanisms constant; contrasting different processes/mechanisms is possible by holding representations constant. Such psycholinguistic modeling could be applied across a wide range of experimental investigations and complement computational modeling.

Separation/connection procedures: From cleansing behavior to numerical cognition

Lee and Schwarz (L&S) suggest that separation is the grounded procedure underlying cleansing effects in different psychological domains. Here, we interpret L&S's account from a hierarchical view of cognition that considers the influence of physical properties and sensorimotor constraints on mental representations. This approach allows theoretical integration and generalization of L&S's account to the domain of formal quantitative reasoning.

The Brain’s Asymmetric Frequency Tuning: Asymmetric Behavior Originates from Asymmetric Perception

To construct a coherent multi-modal percept, vertebrate brains extract low-level features (such as spatial and temporal frequencies) from incoming sensory signals. However, because frequency processing is lateralized with the right hemisphere favouring low frequencies while the left favours higher frequencies, this introduces asymmetries between the hemispheres. Here, we describe how this lateralization shapes the development of several cognitive domains, ranging from visuo-spatial and numerical cognition to language, social cognition, and even aesthetic appreciation, and leads to the emergence of asymmetries in behaviour. We discuss the neuropsychological and educational implications of these emergent asymmetries and suggest future research approaches.

A biological foundation for spatial-numerical associations: the brain's asymmetric frequency tuning

"Left" and "right" coordinates control our spatial behavior and even influence abstract thoughts. For number concepts, horizontal spatial-numerical associations (SNAs) have been widely documented: we associate few with left and many with right. Importantly, increments are universally coded on the right side even in preverbal humans and nonhuman animals, thus questioning the fundamental role of directional cultural habits, such as reading or finger counting. Here, we propose a biological, nonnumerical mechanism for the origin of SNAs on the basis of asymmetric tuning of animal brains for different spatial frequencies (SFs). The resulting selective visual processing predicts both universal SNAs and their context-dependence. We support our proposal by analyzing the stimuli used to document SNAs in newborns for their SF content. As predicted, the SFs contained in visual patterns with few versus many elements preferentially engage right versus left brain hemispheres, respectively, thus predicting left-versus rightward behavioral biases. Our "brain's asymmetric frequency tuning" hypothesis explains the perceptual origin of horizontal SNAs for nonsymbolic visual numerosities and might be extensible to the auditory domain.

Is 'heavy' up or down? Testing the vertical spatial representation of weight

Smaller numbers are typically responded to faster with a bottom than a top key, whereas the opposite occurs for larger numbers (a vertical spatial-numerical association of response codes: i.e. the vertical SNARC effect). Here, in four experiments, we explored whether a vertical spatial-magnitude association can emerge for lighter vs. heavier items. Participants were presented with a central target stimulus that could be a word describing a material (e.g. 'paper', 'iron': Experiment 1), a numerical quantity of weight (e.g. '1 g', '1 kg': Experiment 2) or a picture associated with a real object that participants weighed before the experiment (Experiments 3a/3b). Participants were asked to respond either to the weight (Experiments 1-3a) or to the size (i.e. weight was task-irrelevant; Experiment 3b) of the stimuli by pressing vertically placed keys. In Experiments 1 and 2, faster responses emerged for the lighter-bottom/heavier-top mapping-in line with a standard SNARC-like effect-whereas in Experiment 3a the opposite mapping emerged (lighter-top/heavier-bottom). No evidence of an implicit weight-space association emerged in Experiment 3b. Overall, these results provide evidence indicating a possible context-dependent vertical spatial representation of weight.

Functional lateralization of arithmetic processing in the intraparietal sulcus is associated with handedness

Functional lateralization is established for various cognitive functions, but was hardly ever investigated for arithmetic processing. Most neurocognitive models assume a central role of the bilateral intraparietal sulcus (IPS) in arithmetic processing and there is some evidence for more pronounced left-hemispheric activation for symbolic arithmetic. However, evidence was mainly obtained by studies in right-handers. Therefore, we conducted a functional near-infrared spectroscopy (fNIRS) study, in which IPS activation of left-handed adults was compared to right-handed adults in a symbolic approximate calculation task. The results showed that left-handers had a stronger functional right-lateralization in the IPS than right-handers. This finding has important consequences, as the bilateral IPS activation pattern for arithmetic processing seems to be shaped by functional lateralization and thus differs between left- and right-handers. We propose three possible accounts for the observed functional lateralization of arithmetic processing.

Low numbers from a low head? Effects of observed head orientation on numerical cognition

The present research shows effects of observed vertical head orientation of another person on numerical cognition in the observer. Participants saw portrait-like photographs of persons from a frontal view with gaze being directed at the camera and the head being tilted up or down (vs. not tilted). The photograph appeared immediately before each trial in different numerical cognition tasks. In Experiment 1, participants produced smaller numbers in a random number generation task after having viewed persons with a down-tilted head orientation relative to up-tilted and non-tilted head orientations. In Experiment 2, numerical estimates in an anchoring-like trivia question task were smaller following presentations of persons with a down-tilted head orientation relative to a non-tilted head orientation. In Experiment 3, a response key that was associated with larger numbers in a numerical magnitude task was pressed less frequently in a randomly intermixed free choice task when the photograph showed a person with a down-tilted relative to an up-tilted head orientation. These findings consistently show that social displays can influence numerical cognition across a variety of task settings.

Random word generation reveals spatial encoding of syllabic word length

Existing random number generation studies demonstrate the presence of an embodied attentional bias in spontaneous number production corresponding to the horizontal Mental Number Line: Larger numbers are produced on right-hand turns and smaller numbers on left-hand turns (Loetscher et al.,2008, Curr. Biol., 18, R60). Furthermore, other concepts were also shown to rely on horizontal attentional displacement (Di Bono and Zorzi, 2013, Quart. J. Exp. Psychol., 66, 2348). In two experiments, we used a novel random word generation paradigm combined with two different ways to orient attention in horizontal space: Participants randomly generated words on left and right head turns (Experiment 1) or following left and right key presses (Experiment 2). In both studies, syllabically longer words were generated on right-hand head turns and following right key strokes. Importantly, variables related to semantic magnitude or cardinality (whether the generated words were plural-marked, referred to uncountable concepts, or were associated with largeness) were not affected by lateral manipulations. We discuss our data in terms of the ATOM (Walsh, 2015, The Oxford handbook of numerical cognition, 552) which suggests a general magnitude mechanism shared by different conceptual domains.

Evidence of SQUARC and distance effects in a weight comparison task

Stimuli associated with large quantities are typically responded to faster with a right- than a left-side key, whereas stimuli associated with small quantities are typically responded to faster with a left- than a right-side key. This phenomenon is known as the spatial-quantity association of response codes (SQUARC) effect. Here, in two experiments, we explored whether a SQUARC effect can emerge for light versus heavy items. Participants judged whether the weight associated with a central target word, describing an animal (e.g. 'cow'; Experiment 1) or a material (e.g. 'iron'; Experiment 2), was lighter or heavier than the weight associated with a reference word. Responses were provided with a left- and a right-side button. Then, participants estimated the weight associated with target and reference words. In both experiments, evidence for a SQUARC effect emerged. Moreover, response times for each target word decreased with absolute difference between its rated weight and the rated weight of the reference word, in line with a distance effect. Overall, these results provide evidence of a possible spatial representation of weight.

Spatial Presentations, but Not Response Formats Influence Spatial-Numerical Associations in Adults

According to theories of embodied numerosity, processing of numerical magnitude is anchored in bodily experiences. In particular, spatial representations of number interact with movement in physical space, but it is still unclear whether the extent of the movement is relevant for this interaction. In this study, we compared spatial-numerical associations over response movements of differing spatial expansion. We expected spatial-numerical effects to increase with the extent of physical response movements. In addition, we hypothesized that these effects should be influenced by whether or not a spatial representation of numbers was presented. Adult participants performed two tasks: a magnitude classification (comparing numbers to the fixed standard 5), from which we calculated the Spatial Numerical Association of Response Codes (SNARC) effect; and a magnitude comparison task (comparing two numbers against each other), from which we calculated a relative numerical congruity effect (NCE), which describes that when two relatively small numbers are compared, responses to the smaller number are faster than responses to the larger number; and vice versa for large numbers. A SNARC effect was observed across all conditions and was not influenced by response movement extent but increased when a number line was presented. In contrast, an NCE was only observed when no number line was presented. This suggests that the SNARC effect and the NCE reflect two different processes. The SNARC effect seems to represent a highly automated classification of numbers as large or small, which is further emphasized by the presentation of a number line. In contrast, the NCE likely results from participants not only classifying numbers as small or large, but also processing their relative size within the relevant section of their mental number line representation. An additional external presentation of a number line might interfere with this process, resulting in overall slower responses. This study follows up on previous spatial-numerical training studies and has implications for future spatial-numerical trainings. Specifically, similar studies with children showed contrasting results, in that response format but not number line presentation influenced spatial-numerical associations. Accordingly, during development, the relative relevance of physical experiences and presentation format for spatial-numerical associations might change.

Number concepts: abstract and embodied

Numerical knowledge, including number concepts and arithmetic procedures, seems to be a clear-cut case for abstract symbol manipulation. Yet, evidence from perceptual and motor behaviour reveals that natural number knowledge and simple arithmetic also remain closely associated with modal experiences. Following a review of behavioural, animal and neuroscience studies of number processing, we propose a revised understanding of psychological number concepts as grounded in physical constraints, embodied in experience and situated through task-specific intentions. The idea that number concepts occupy a range of positions on the continuum between abstract and modal conceptual knowledge also accounts for systematic heuristics and biases in mental arithmetic, thus inviting psycho-logical approaches to the study of the mathematical mind.This article is part of the theme issue 'Varieties of abstract concepts: development, use and representation in the brain'.

Spatial grounding of symbolic arithmetic: an investigation with optokinetic stimulation

Growing evidence suggests that mental calculation might involve movements of attention along a spatial representation of numerical magnitude. Addition and subtraction on nonsymbolic numbers (numerosities) seem to induce a “momentum” effect, and have been linked to distinct patterns of neural activity in cortical regions subserving attention and eye movements. We investigated whether mental arithmetic on symbolic numbers, a cornerstone of abstract mathematical reasoning, can be affected by the manipulation of overt spatial attention induced by optokinetic stimulation (OKS). Participants performed additions or subtractions of auditory two-digit numbers during horizontal (experiment 1) or vertical OKS (experiment 2), and eye movements were concurrently recorded. In both experiments, the results of addition problems were underestimated, whereas results of subtractions were overestimated (a pattern that is opposite to the classic Operational Momentum effect). While this tendency was unaffected by OKS, vertical OKS modulated the occurrence of decade errors during subtractions (i.e., fewer during downward OKS and more frequent during upward OKS). Eye movements, on top of the classic effect induced by OKS, were affected by the type of operation during the calculation phase, with subtraction consistently leading to a downward shift of gaze position and addition leading to an upward shift. These results highlight the pervasive nature of spatial processing in mental arithmetic. Furthermore, the preeminent effect of vertical OKS is in line with the hypothesis that the vertical dimension of space–number associations is grounded in universal (physical) constraints and, thereby, more robust than situated and culture-dependent associations with the horizontal dimension.

The depersonalized brain: New evidence supporting a distinction between depersonalization and derealization from discrete patterns of autonomic suppression observed in a non-clinical sample

Depersonalization and Derealization are characterised by feelings of detachment from one's bodily self/surroundings and a general emotional numbness. We explored predisposition to trait-based experiences of depersonalization/derealization-type experiences and autonomic arousal toward simulated body-threats, which were delivered to the participant's own body (i.e. Self) and when observed being delivered to another individual (i.e. Other). Ninety participants took part in an "Implied Body-Threat Illusion" task (Dewe, Watson, & Braithwaite, 2016) and autonomic arousal was recorded via standardised skin conductance responses and finger temperature. Autonomic suppression in response to threats delivered to the Self correlated with increases in trait-based depersonalization-type experiences. In contrast, autonomic suppression for threats delivered to Others correlated with trait-based derealization-like experiences. Body-temperature and anticipatory arousal did not correlate reliably with predisposition to depersonalization- or derealization-type experiences. The theoretical implications of these findings are discussed in terms of a fronto-limbic autonomic suppression mechanism.

Does Grammatical Number Influence the Semantic Priming Between Number Cues and Words Related to Vertical Space? An Investigation Using Virtual Reality

The GES framework postulates a hierarchical order between grounded, embodied, and situated representations. Against this background, the present study investigated the relation of two effects: (i) a semantic priming between number cues and words with referents up or down in the world according to the number's magnitude which is supposed to be grounded (cf. Lachmair et al., 2014) and (ii) the compatibility between number cues and the grammatical word form of the words according to the number's multitude which is supposed to be embodied (cf. Roettger and Domahs, 2015). In two experiments words referring to objects up or down in the world and spatially neutral words were presented subsequent to the numbers “1” and “9.” In Experiment 1 words were presented in singular word form and in Experiment 2 in plural word form. For the first time, Virtual Reality was used in such an experimental setup in order to reduce spatial predispositions of participants and to provide a homogeneous experimental environment for replication purposes. According to GES it was expected that the spatial semantic priming should occur in both grammatical word forms. However, the compatibility with grammatical number should only occur for the plural word form due to its markedness. The results of Experiment 1 support the spatial-semantic-priming-hypothesis but not the grammatical-number-hypothesis. The results of Experiment 2 supported only the grammatical-number-hypothesis. It is argued that the grounded spatial effect of Experiment 1 was not affected by grammatical number. However, in Experiment 2 this effect vanished due to an activated embodied reference frame according to grammatical number.

Magnitude or Multitude - What Counts?

Recent studies revealed an association of low or high numbers (e.g., 1 vs. 9) and word semantics referring to entities typically found in upper or lower space (e.g., roof vs. root) indicating overlapping spatial representations. Another line of research revealed a similar association of grammatical number as a syntactic aspect of language and physical space: singular words were associated with left and plural words with right - resembling spatial-numerical associations of low numbers with left and high numbers with right. The present study aimed at integrating these lines of research by evaluating both types of spatial relations in one experiment. In a lexical decision task, pairs of a numerical cue and a subsequent plural noun were presented. For word with spatial associations (e.g., roofs vs. roots) number magnitude was expected to serve as a spatial cue. For spatially neutral words (e.g., tables) numbers were expected to cue multitude. Results showed the expected congruency-effect between the numbers and words with spatial associations (i.e., small numbers facilitate responses to down-words and high numbers to up-words). However, no effect was found for numbers and spatially neutral words. This seems to indicate that spatial aspects of word meaning may be related more closely to the magnitude of numbers than grammatical number is to the multitude reflected by numbers - at least in the current experimental setting, where only plural words were presented.

Extending Situated Language Comprehension (Accounts) with Speaker and Comprehender Characteristics: Toward Socially Situated Interpretation

More and more findings suggest a tight temporal coupling between (non-linguistic) socially interpreted context and language processing. Still, real-time language processing accounts remain largely elusive with respect to the influence of biological (e.g., age) and experiential (e.g., world and moral knowledge) comprehender characteristics and the influence of the 'socially interpreted' context, as for instance provided by the speaker. This context could include actions, facial expressions, a speaker's voice or gaze, and gestures among others. We review findings from social psychology, sociolinguistics and psycholinguistics to highlight the relevance of (the interplay between) the socially interpreted context and comprehender characteristics for language processing. The review informs the extension of an extant real-time processing account (already featuring a coordinated interplay between language comprehension and the non-linguistic visual context) with a variable ('ProCom') that captures characteristics of the language user and with a first approximation of the comprehender's speaker representation. Extending the CIA to the sCIA (social Coordinated Interplay Account) is the first step toward a real-time language comprehension account which might eventually accommodate the socially situated communicative interplay between comprehenders and speakers.

Cognitive Mechanisms Underlying Directional and Non-directional Spatial-Numerical Associations across the Lifespan

There is accumulating evidence suggesting an association of numbers with physical space. However, the origin of such spatial-numerical associations (SNAs) is still debated. In the present study we investigated the development of two SNAs in a cross-sectional study involving children, young and middle-aged adults as well as the elderly: (1) the SNARC (spatial-numerical association of response codes) effect, reflecting a directional SNA; and (2) the numerical bisection bias in a line bisection task with numerical flankers. Results revealed a consistent SNARC effect in all age groups that continuously increased with age. In contrast, a numerical bisection bias was only observed for children and elderly participants, implying an U-shaped distribution of this bias across age groups. Additionally, individual SNARC effects and numerical bisection biases did not correlate significantly. We argue that the SNARC effect seems to be influenced by longer-lasting experiences of cultural constraints such as reading and writing direction and may thus reflect embodied representations. Contrarily, the numerical bisection bias may originate from insufficient inhibition of the semantic influence of irrelevant numerical flankers, which should be more pronounced in children and elderly people due to development and decline of cognitive control, respectively. As there is an ongoing debate on the origins of SNAs in general and the SNARC effect in particular, the present results are discussed in light of these differing accounts in an integrative approach. However, taken together, the present pattern of results suggests that different cognitive mechanisms underlie the SNARC effect and the numerical bisection bias.

Music-space associations are grounded, embodied and situated: examination of cello experts and non-musicians in a standard tone discrimination task

In recent research, a systematic association of musical pitch with space has been described in the so-called Spatial-Pitch-Association-of-Response Codes-effect (SPARC). Typically, high pitch is associated with upper/right and low pitch with lower/left space. However, a theoretical classification of these associations regarding their experiential sources is difficult. Therefore, we applied a theoretical framework of numerical cognition classifying similar Space-Associated Response Codes (SARC) effects according to their groundedness, embodiedness and situatedness. We tested these attributes with a group of non-musicians and with a group of highly skilled cello players playing high tones with lower hand positions (i.e., reverse SPARC alignment) in a standard SPARC context of a piano and a reversed SPARC context of a cello. The results showed that SPARC is grounded, in general. However, for cello player SPARC is also situated and embodied. We conclude that groundedness, embodiedness and situatedness provide general characteristics of mapping cognitive representations to space.

Cross-Representational Interactions: Interface and Overlap Mechanisms

A crucial question facing cognitive science concerns the nature of conceptual representations as well as the constraints on the interactions between them. One specific question we address in this paper is what makes cross-representational interplay possible? We offer two distinct theoretical scenarios: according to the first scenario, co-activated knowledge representations interact with the help of an interface established between them via congruent activation in a mediating third-party general cognitive mechanism, e.g., attention. According to the second scenario, co-activated knowledge representations interact due to an overlap between their features, for example when they share a magnitude component. First, we make a case for cross-representational interplay based on grounded and situated theories of cognition. Second, we discuss interface-based interactions between distinct (i.e., non-overlapping) knowledge representations. Third, we discuss how co-activated representations may share their architecture via partial overlap. Finally, we outline constraints regarding the flexibility of these proposed mechanisms.

Judgments of Learning for Words in Vertical Space

Close relationship between physical space and internal knowledge representations has received ample support in the literature. For example, location of visually perceived information in vertical space has been shown to affect different numerical judgments. In addition, physical dimensions, such as weight or font size, were shown to affect judgments of learning (JOLs, an estimation of the likelihood that an item will be remembered later, or its perceived memorability). In two experiments we tested the hypothesis that differences in positioning words in vertical space may affect their perceived memorability, i.e., JOLs. In both Experiments, the words were presented in lower or in upper screen locations. In Experiment 1, JOLs were collected in the centre of the screen following word presentation. In Experiment 2, JOLs were collected at the point of word presentation and in the same location. In both experiments participants completed a free recall test. JOLs were compared between different vertically displaced presentation locations. In general, Bayesian analyses showed evidence in support for the null effect of vertical location on JOLs. We interpret our results as indicating that the effects of physical dimensions on JOLs are mediated by subjective importance, information that vertical location alone fails to convey.

Deliberate and spontaneous sensations of disembodiment: capacity or flaw?

INTRODUCTION

Hallucinations that involve shifts in the subjectively experienced location of the self, have been termed "out-of-body experiences" (OBEs). Early psychiatric accounts cast OBEs as a specific instance of depersonalisation and derealisation disorder (DPD-DR). However, during feelings of alienation and lack of body realism in DPD-DR the self is experienced within the physical body. Deliberate forms of "disembodiment" enable humans to imagine another's visuo-spatial perspective taking (VPT), thus, if a strong relationship between deliberate and spontaneous forms of disembodiment could be revealed, then uncontrolled OBEs could be "the other side of the coin" of a uniquely human capacity.

METHODS

We present a narrative review of behavioural and neuroimaging work emphasising methodological and theoretical aspects of OBE and VPT research and a potential relationship.

RESULTS

Results regarding a direct behavioural relationship between VPT and OBE are mixed and we discuss reasons by pointing out the importance of using realistic tasks and recruiting genuine OBEers instead of general DPD-DR patients. Furthermore, we review neuroimaging evidence showing overlapping neural substrates between VPT and OBE, providing a strong argument for a relationship between the two processes.

CONCLUSIONS

We conclude that OBE should be regarded as a necessary implication of VPT ability in humans, or even as a necessary and potentially sufficient condition for the evolution of VPT.

Composite body movements modulate numerical cognition: evidence from the motion-numerical compatibility effect

A recent hierarchical model of numerical processing, initiated by Fischer and Brugger (2011) and Fischer (2012), suggested that situated factors, such as different body postures and body movements, can influence the magnitude representation and bias numerical processing. Indeed, Loetscher et al. (2008) found that participants’ behavior in a random number generation task was biased by head rotations. More small numbers were reported after leftward than rightward head turns, i.e., a motion-numerical compatibility effect. Here, by carrying out two experiments, we explored whether similar motion-numerical compatibility effects exist for movements of other important body components, e.g., arms, and for composite body movements as well, which are basis for complex human activities in many ecologically meaningful situations. In Experiment 1, a motion-numerical compatibility effect was observed for lateral rotations of two body components, i.e., the head and arms. Relatively large numbers were reported after making rightward compared to leftward movements for both lateral head and arm turns. The motion-numerical compatibility effect was observed again in Experiment 2 when participants were asked to perform composite body movements of congruent movement directions, e.g., simultaneous head left turns and arm left turns. However, it disappeared when the movement directions were incongruent, e.g., simultaneous head left turns and arm right turns. Taken together, our results extended Loetscher et al.’s (2008) finding by demonstrating that their effect is effector-general and exists for arm movements. Moreover, our study reveals for the first time that the impact of spatial information on numerical processing induced by each of the two sensorimotor-based situated factors, e.g., a lateral head turn and a lateral arm turn, can cancel each other out.

Mechanisms of embodiment

This paper is a critical review of recent studies demonstrating the mechanism of sensorimotor simulation in different cognitive domains. Empirical studies that specify conditions under which embodiment occurs in different domains will be discussed and evaluated. Examples of relevant domains are language comprehension (Tucker and Ellis, 1998), autobiographical memory (Dijkstra et al., 2007), gestures (Alibali et al., 2014), facial mimicry (Stel and Vonk, 2010), and problem solving (Wiemers et al., 2014). The focus of the review is on supporting claims regarding sensorimotor simulation as well as on factors that modulate dynamic relationships between sensorimotor components in action and cognitive domains, such as expertise (Boschker et al., 2002). This discussion takes place within the context of currently debated issues, specifically the need to specify the underlying mechanisms of embodied representations (Zwaan, 2014; Körner et al., 2015).

SMART-ER: a Situation Model of Anticipated Response consequences in Tactical decisions in skill acquisition - Extended and Revised

Situation Model of Anticipated Response consequences in tactical decisions (SMART) describes the interaction of top–down and bottom–up processes in skill acquisition and thus the dynamic interaction of sensory and motor capacities in embodied cognition. The empirically validated, extended, and revised SMART-ER can now predict when specific dynamic interactions of top–down and bottom–up processes have a beneficial or detrimental effect on performance and learning depending on situational constraints. The model is empirically supported and proposes learning strategies for when situation complexity varies or time pressure is present. Experiments from expertise research in sports illustrate that neither bottom–up nor top–down processes are bad or good per se but their effects depend on personal and situational characteristics.

The embodied mind extended: using words as social tools

The extended mind view and the embodied-grounded view of cognition and language are typically considered as rather independent perspectives. In this paper we propose a possible integration of the two views and support it proposing the idea of “Words As social Tools” (WAT). In this respect, we will propose that words, also due to their social and public character, can be conceived as quasi-external devices that extend our cognition. Moreover, words function like tools in that they enlarge the bodily space of action thus modifying our sense of body. To support our proposal, we review the relevant literature on tool-use and on words as tools and report recent evidence indicating that word use leads to an extension of space close to the body. In addition, we outline a model of the neural processes that may underpin bodily space extension via word use and may reflect possible effects on cognition of the use of words as external means. We also discuss how reconciling the two perspectives can help to overcome the limitations they encounter if considered independently.