Separate visual pathways for perception and action

Reliable object tracking by multimodal hybrid feature extraction and transformer-based fusion

Visual object tracking, which is primarily based on visible light image sequences, encounters numerous challenges in complicated scenarios, such as low light conditions, high dynamic ranges, and background clutter. To address these challenges, incorporating the advantages of multiple visual modalities is a promising solution for achieving reliable object tracking. However, the existing approaches usually integrate multimodal inputs through adaptive local feature interactions, which cannot leverage the full potential of visual cues, thus resulting in insufficient feature modeling. In this study, we propose a novel multimodal hybrid tracker (MMHT) that utilizes frame-event-based data for reliable single object tracking. The MMHT model employs a hybrid backbone consisting of an artificial neural network (ANN) and a spiking neural network (SNN) to extract dominant features from different visual modalities and then uses a unified encoder to align the features across different domains. Moreover, we propose an enhanced transformer-based module to fuse multimodal features using attention mechanisms. With these methods, the MMHT model can effectively construct a multiscale and multidimensional visual feature space and achieve discriminative feature modeling. Extensive experiments demonstrate that the MMHT model exhibits competitive performance in comparison with that of other state-of-the-art methods. Overall, our results highlight the effectiveness of the MMHT model in terms of addressing the challenges faced in visual object tracking tasks.

Towards a model of eye-movement control in Chinese reading

The Chinese writing system has several features that make it markedly different from the alphabetic systems that have most often been examined in reading research, including the fact that individual words consist of various uniformly sized, box-shaped characters whose boundaries are not clearly demarcated (e.g., by blank spaces). These features raise the question: How do readers of Chinese "know" where to move their eyes for the purpose of efficiently segmenting and/or identifying words? To answer this question, we used the E-Z Reader model of eye-movement control in reading to run an 'experiment' involving a series of simulations in which two saccade-targeting assumptions (i.e., directing the eyes towards default targets vs. adjusting saccade length as a function of parafoveal processing difficulty) were factorially manipulated with three word-segmentation heuristics (i.e., ideal-observer knowledge of word boundaries vs. probabilistic guessing vs. familiarity-based segmentation) to examine which combination of assumptions provide the best quantitative account of eye-movement control during the reading of Chinese. Based on these simulations, we conclude the best account is one in which readers use relative differences in the familiarity of groups of parafoveal characters to dynamically adjust the lengths of saccades in a manner that affords efficient word identification. We discuss the broader theoretical implications of these conclusions for models of Chinese reading and for models of reading more generally.

Wide-field calcium imaging of cortical activation and functional connectivity in externally- and internally-driven locomotion

The role of the cerebral cortex in self-initiated versus sensory-driven movements is central to understanding volitional action. Whether the differences in these two movement classes are due to specific cortical areas versus more cortex-wide engagement is debated. Using wide-field Ca2+ imaging, we compared neural dynamics during spontaneous and motorized treadmill locomotion, determining the similarities and differences in cortex-wide activation and functional connectivity (FC). During motorized locomotion, the cortex exhibits greater activation globally prior to and during locomotion starting compared to spontaneous and less during steady-state walking, during stopping, and after termination. Both conditions are characterized by FC increases in anterior secondary motor cortex (M2) nodes and decreases in all other regions. There are also cortex-wide differences; most notably, M2 decreases in FC with all other nodes during motorized stopping and after termination. Therefore, both internally- and externally-generated movements widely engage the cortex, with differences represented in cortex-wide activation and FC patterns.

Simple actions modulate context-dependent visual size perception at late processing stages

A simple button press towards a prime stimulus enhances subsequent visual search for objects that match the prime. The present study investigated whether this action effect is a general phenomenon across different task domains, and the underlying neural mechanisms. The action effect was measured in an unspeeded size-matching task, with the presentation of the central target and the surrounding inducers of the Ebbinghaus illusion together to one eye or separately to each eye, and when repetitive TMS was applied over right primary motor cortex (M1). The results showed that a prior key-press significantly reduced the illusion effect compared to passive viewing. Notably, the action effect persisted with dichoptic presentation of the Ebbinghaus configuration, but disappeared with the right M1 disruption. These results suggest that action guides visual perception to influence human behavior, which mainly affects the late visual processing stage and probably relies on feedback projections from the motor cortex.

The functional role of conscious sensation of movement

This paper proposes a new framework for investigating neural signals sufficient for a conscious sensation of movement and their role in motor control. We focus on signals sufficient for proprioceptive awareness, particularly from muscle spindle activation and from primary motor cortex (M1). Our review of muscle vibration studies reveals that afferent signals alone can induce conscious sensations of movement. Similarly, studies employing peripheral nerve blocks suggest that efferent signals from M1 are sufficient for sensations of movement. On this basis, we show that competing theories of motor control assign different roles to sensation of movement. According to motor command theories, sensation of movement corresponds to an estimation of the current state based on afferent signals, efferent signals, and predictions. In contrast, within active inference architectures, sensations correspond to proprioceptive predictions driven by efferent signals from M1. The focus on sensation of movement provides a way to critically compare and evaluate the two theories. Our analysis offers new insights into the functional roles of movement sensations in motor control and consciousness.

The relational bottleneck as an inductive bias for efficient abstraction

A central challenge for cognitive science is to explain how abstract concepts are acquired from limited experience. This has often been framed in terms of a dichotomy between connectionist and symbolic cognitive models. Here, we highlight a recently emerging line of work that suggests a novel reconciliation of these approaches, by exploiting an inductive bias that we term the relational bottleneck. In that approach, neural networks are constrained via their architecture to focus on relations between perceptual inputs, rather than the attributes of individual inputs. We review a family of models that employ this approach to induce abstractions in a data-efficient manner, emphasizing their potential as candidate models for the acquisition of abstract concepts in the human mind and brain.

Spatial attention in three-dimensional space: A meta-analysis for the near advantage in target detection and localization

Studies have explored how human spatial attention appears allocated in three-dimensional (3D) space. It has been demonstrated that target distance from the viewer can modulate performance in target detection and localization tasks: reaction times are shorter when targets appear nearer to the observer compared to farther distances (i.e., near advantage). Times have reached to quantitatively analyze this literature. In the current meta-analysis, 29 studies (n = 1260 participants) examined target detection and localization across 3-D space. Moderator analyses included: detection vs localization tasks, spatial cueing vs uncued tasks, control of retinal size across depth, central vs peripheral targets, real-space vs stereoscopic vs monocular depth environments, and inclusion of in-trial motion. The analyses revealed a near advantage for spatial attention that was affected by the moderating variables of controlling for retinal size across depth, the use of spatial cueing tasks, and the inclusion of in-trial motion. Overall, these results provide an up-to-date quantification of the effect of depth and provide insight into methodological differences in evaluating spatial attention.

A prominent vertical occipital white matter fasciculus unique to primate brains

Vision in humans and other primates enlists parallel processing streams in the dorsal and ventral visual cortex, known to support spatial and object processing, respectively. These streams are bridged, however, by a prominent white matter tract, the vertical occipital fasciculus (VOF), identified in both classical neuroanatomy and recent diffusion-weighted magnetic resonance imaging (dMRI) studies. Understanding the evolution of the VOF may shed light on its origin, function, and role in visually guided behaviors. To this end, we acquired high-resolution dMRI data from the brains of select mammalian species, including anthropoid and strepsirrhine primates, a tree shrew, rodents, and carnivores. In each species, we attempted to delineate the VOF after first locating the optic radiations in the occipital white matter. In all primate species examined, the optic radiation was flanked laterally by a prominent and coherent white matter fasciculus recognizable as the VOF. By contrast, the equivalent analysis applied to four non-primate species from the same superorder as primates (tree shrew, ground squirrel, paca, and rat) failed to reveal white matter tracts in the equivalent location. Clear evidence for a VOF was also absent in two larger carnivore species (ferret and fox). Although we cannot rule out the existence of minor or differently organized homologous fiber pathways in the non-primate species, the results suggest that the VOF has greatly expanded, or possibly emerged, in the primate lineage. This adaptation likely facilitated the evolution of unique visually guided behaviors in primates, with direct impacts on manual object manipulation, social interactions, and arboreal locomotion.

Identifying novel data-driven subgroups in congenital heart disease using multi-modal measures of brain structure

Individuals with congenital heart disease (CHD) have an increased risk of neurodevelopmental impairments. Given the hypothesized complexity linking genomics, atypical brain structure, cardiac diagnoses and their management, and neurodevelopmental outcomes, unsupervised methods may provide unique insight into neurodevelopmental variability in CHD. Using data from the Pediatric Cardiac Genomics Consortium Brain and Genes study, we identified data-driven subgroups of individuals with CHD from measures of brain structure. Using structural magnetic resonance imaging (MRI; N = 93; cortical thickness, cortical volume, and subcortical volume), we identified subgroups that differed primarily on cardiac anatomic lesion and language ability. In contrast, using diffusion MRI (N = 88; white matter connectivity strength), we identified subgroups that were characterized by differences in associations with rare genetic variants and visual-motor function. This work provides insight into the differential impacts of cardiac lesions and genomic variation on brain growth and architecture in patients with CHD, with potentially distinct effects on neurodevelopmental outcomes.

Adaptive Changes in Neurovascular Properties With Binocular Accommodation Functions in Myopic Participants by 3D Visual Training: An EEG and fNIRS Study

Although three-dimensional visual training (3DVT) has been used for myopia intervention, its neural mechanisms remain largely unknown. In this study, visual function was examined before and after 3DVT, while resting-state EEG-fNIRS signals were recorded from 38 myopic participants. A graph theoretical analysis was applied to compute the neurovascular properties, including static brain networks (SBNs), dynamic brain networks (DBNs), and dynamic neurovascular coupling (DNC). Correlations between the changes in neurovascular properties and the changes in visual functions were calculated. After 3DVT, the local efficiency and node efficiency in the frontal lobes increased in the SBNs constructed from EEG δ -band; the global efficiency and node efficiency in the frontal-parietal lobes decreased in the DBNs variability constructed from EEG δ -band. For the DNC constructed with EEG α -band and oxyhemoglobin (HbO), the local efficiency decreased, for EEG α -band and deoxyhemoglobin (HbR), the node efficiency in the frontal-occipital lobes decreased. For the SBNs constructed from HbO, the functional connectivity (FC) between the frontal-occipital lobes increased. The DNC constructed between the FC of the frontal-parietal lobes from EEG β -band and the FC of the frontal-occipital lobes from HbO increased, and between the FC of the frontal-occipital lobes from EEG β -band and the FC of the inter-frontal lobes from HbR increased. The neurovascular properties were significantly correlated with the amplitude of accommodation and accommodative facility. The result indicated the positive effects of 3DVT on myopic participants, including improved efficiency of brain networks, increased FC of SBNs and DNC, and enhanced binocular accommodation functions.

Sensitivity and specificity of the action observation network to kinematics, target object, and gesture meaning

Hierarchical models have been proposed to explain how the brain encodes actions, whereby different areas represent different features, such as gesture kinematics, target object, action goal, and meaning. The visual processing of action-related information is distributed over a well-known network of brain regions spanning separate anatomical areas, attuned to specific stimulus properties, and referred to as action observation network (AON). To determine the brain organization of these features, we measured representational geometries during the observation of a large set of transitive and intransitive gestures in two independent functional magnetic resonance imaging experiments. We provided evidence for a partial dissociation between kinematics, object characteristics, and action meaning in the occipito-parietal, ventro-temporal, and lateral occipito-temporal cortex, respectively. Importantly, most of the AON showed low specificity to all the explored features, and representational spaces sharing similar information content were spread across the cortex without being anatomically adjacent. Overall, our results support the notion that the AON relies on overlapping and distributed coding and may act as a unique representational space instead of mapping features in a modular and segregated manner.

Associations Between Autism Spectrum Quotient and Integration of Visual Stimuli in 9-year-old Children: Preliminary Evidence of Sex Differences

PURPOSE

The dorsal stream vulnerability hypothesis posits that the dorsal stream, responsible for visual motion and visuo-motor processing, may be particularly vulnerable during neurodevelopment. Consistent with this, autism spectrum disorder (ASD) has been associated with deficits in global motion integration, though deficits in ventral stream tasks, such as form identification, have also been reported. In the current study, we examined whether a similar pattern of results is found in a cohort of 381 children born with neurodevelopmental risk factors and exhibiting a wide spectrum of caregiver-reported autistic traits.

METHODS

We examined the associations between global motion perception, global form perception, fine motor function, visual-motor integration, and autistic traits (autism spectrum quotient, AQ) using linear regression, accounting for possible interactions with sex and other factors relevant to neurodevelopment.

RESULTS

All assessments of dorsal stream function were significantly associated with AQ such that worse performance predicted higher AQ scores. We also observed a significant sex interaction, with worse global form perception associated with higher AQ in boys (n = 202) but not girls (n = 179).

CONCLUSION

We found widespread associations between dorsal stream functions and autistic traits. These associations were observed in a large group of children with a range of AQ scores, demonstrating a range of visual function across the full spectrum of autistic traits. In addition, ventral function was associated with AQ in boys but not girls. Sex differences in the associations between visual processing and neurodevelopment should be considered in the designs of future studies.

Interpreting the orientation of objects: A cross-disciplinary review

Is object orientation an inherent aspect of the shape of the object or is it represented separately and bound to the object shape in a similar way to other features, such as colour? This review brings together findings from neuropsychological studies of patients with agnosia for object orientation and experimental studies of object perception in healthy individuals that provide converging evidence of separate processing of object identity and orientation. Individuals with agnosia for object orientation, which typically results from damage to the right parietal lobe, can recognize objects presented in a range of orientations yet are unable to interpret or discriminate the objects' orientation. Healthy individuals tested with briefly presented objects demonstrate a similar dissociation: object identity is extracted rapidly in an orientation-invariant way, whereas processing the object's orientation is slower, requires attention and is influenced by the degree of departure from the canonical orientation. This asymmetry in processing can sometimes lead to incorrect bindings between the identity and orientation of objects presented in close temporal proximity. Overall, the available evidence indicates that object recognition is achieved in a largely orientation-invariant manner and that interpreting the object's orientation requires an additional step of mapping this orientation-invariant representation to a spatial reference frame.

Flicker adaptation improves acuity for briefly presented stimuli by reducing crowding

Adaptation to flickering/dynamic noise improves visual acuity for briefly presented stimuli (Arnold et al., 2016). Here, we investigate whether such adaptation operates directly on our ability to see detail or by changing fixational eye movements and pupil size or by reducing visual crowding. Following earlier work, visual acuity was measured in observers who were either unadapted or who had adapted to a 60-Hz flickering noise pattern. Participants reported the orientation of a white tumbling-T target (four-alternative forced choice [4AFC], ⊤⊣⊥⊢). The target was presented for 110 ms either in isolation or flanked by randomly oriented T's (e.g., ⊣⊤⊢) followed by an isolated (+) or flanked (+++) mask, respectively. We measured fixation stability (using an infrared eye tracker) while observers performed the task (with and without adaptation). Visual acuity improved modestly (around 8.4%) for flanked optotypes following adaptation to flicker (mean, -0.038 ± 0.063 logMAR; p = 0.015; BF10 = 3.66) but did not when measured with isolated letters (mean, -0.008 ± 0.055 logMAR; p = 0.5; BF10 = 0.29). The magnitude of acuity improvement was associated with individuals' (unadapted) susceptibility to crowding (the ratio of crowded to uncrowded acuity; r = -0.58, p = 0.008, BF10 = 7.70) but to neither fixation stability nor pupil size. Confirming previous reports, flicker improved acuity for briefly presented stimuli, but we show that this was only the case for crowded letters. These improvements likely arise from attenuation of sensitivity to a transient low spatial frequency (SF) image structure (Arnold et al., 2016; Tagoh et al., 2022), which may, for example, reduce masking of high SFs by low SFs. We also suggest that this attenuation could reduce backward masking and so reduce foveal crowding.

Exploring perceptual grouping by proximity principle in multistable dot lattices: Dissociation between vision-for-perception and vision-for-action

Perceptual grouping, a fundamental mechanism in our visual system, significantly influences our interpretation of and interaction with the surrounding world. This study explores the impact of the proximity principle from the perspective of the Two Visual Systems (TVS) model. The TVS model argues that the visual system comprises two distinct streams: the ventral stream, which forms the neural basis for "vision-for-perception," and the dorsal stream, which underlies "vision-for-action." We designed a perceptual grouping task using dot lattices as well as a line-orientation discrimination task. Data were collected using vocal and mouse methods for the vision-for-perception mode, and joystick and pen-paper methods for the vision-for-action mode. Each method, except for vocal, included separate blocks for right and left hands. The proximity data were fitted using exponential and power models. Linear mixed-effects models were used for the statistical analyses. The results revealed similar line-orientation discrimination accuracy across all conditions. The exponential model emerged as the best fit, demonstrating adherence to the Pure Distance Law in both perceptual modes. Sensitivity to the proximity principle was higher in the vision-for-action mode compared to the vision-for-perception. In terms of orientation biases, a strong preference for vertical orientation was observed in the vision-for-perception mode, whereas a noticeable preference toward either of the oblique orientations was detected in the vision-for-action mode. Analysis of free-drawn lines demonstrated an affordance bias in the vision-for-action mode. This suggests a remarkable tendency to perceive organizations within specific orientations that offer more affordances due to the interaction between the body postures and tools.

Vertical prism adaptation, but not sound presentation, modulates the visuospatial representation: A manual line-bisection study

The present study aimed at testing whether vertical prism adaptation (PA) can modulate vertical visuospatial representation, assessed with a vertical manual line-bisection (MLB) task (Experiment 1). In a second time, we wanted to investigate the potential influence of sound presentation during such a task. Sound is a spatially valued element that has previously been reported to modify horizontal visuospatial representation. In Experiment 2, we presented either a high pitch, a low pitch, or no sound during the same MLB as in Experiment 1. With this experiment, we also searched for an eventual interaction between the effect of sound presentation and the potential cognitive aftereffects of vertical PA on visual representation. Both Experiments 1 and 2 were constructed with the same design and conducted with two distinct groups of young healthy right-handed participants. First, we assessed the initial sensorimotor state with an open-loop pointing task, and the initial representational state through a vertical MLB (with addition of sound for Experiment 2). Then participants were submitted to a 16-minute PA procedure and were tested again on the open-loop pointing task and the MLB to assess the aftereffects following prism removal. Our results showed sensorimotor aftereffects following both upward and downward PA, in a direction opposed to the optical deviation used. The early aftereffects measured following PA were symmetrical, but at the end of the experiment the residual aftereffects were smaller following downward PA than upward PA. We also provide a new insight on the aftereffects of vertical PA on visuospatial representation, showing that downward PA (but not upward PA) can produce an upward bias on the manual line-bisection task. This is the first proof of such cognitive aftereffects following vertical PA. However, we found no effect of sound presentation on the vertical visual space representation and no interaction between PA and sound presentation.

Automatic imitation is modulated by stimulus clarity but not by animacy

Observing actions evokes an automatic imitative response that activates mechanisms required to execute these actions. Automatic imitation is measured using the Stimulus Response Compatibility (SRC) task, which presents participants with compatible and incompatible prompt-distractor pairs. Automatic imitation, or the compatibility effect, is the difference in response times (RTs) between incompatible and compatible trials. Past results suggest that an action's animacy affects automatic imitation: human-produced actions evoke larger effects than computer-generated actions. However, it appears that animacy effects occur mostly when non-human stimuli are less complex or less clear. Theoretical accounts make conflicting predictions regarding both stimulus manipulations. We conducted two SRC experiments that presented participants with an animacy manipulation (human and computer-generated stimuli, Experiment 1) and a clarity manipulation (stimuli with varying visual clarity using Gaussian blurring, Experiments 1 and 2) to tease apart effect of these manipulations. Participants in Experiment 1 responded slower for incompatible than for compatible trials, showing a compatibility effect. Experiment 1 found a null effect of animacy, but stimuli with lower visual clarity evoked smaller compatibility effects. Experiment 2 modulated clarity in five steps and reports decreasing compatibility effects for stimuli with lower clarity. Clarity, but not animacy, therefore affected automatic imitation, and theoretical implications and future directions are considered.

Psycho-physio-neurological correlates of qualitative attention, emotion and flow experiences in a close-to-real-life extreme sports situation: low- and high-altitude slackline walking

It has been indicated that extreme sport activities result in a highly rewarding experience, despite also providing fear, stress and anxiety. Studies have related this experience to the concept of flow, a positive feeling that individuals undergo when they are completely immersed in an activity. However, little is known about the exact nature of these experiences, and, there are still no empirical results to characterize the brain dynamics during extreme sport practice. This work aimed at investigating changes in psychological responses while recording physiological (heart rate-HR, and breathing rate-BR) and neural (electroencephalographic-EEG) data of eight volunteers, during outdoors slackline walking in a mountainous environment at two different altitude conditions (1 m-low-walk- and 45 m-high-walk-from the ground). Low-walk showed a higher score on flow scale, while high-walk displayed a higher score in the negative affect aspects, which together point to some level of flow restriction during high-walk. The order of task performance was shown to be relevant for the physiological and neural variables. The brain behavior during flow, mainly considering attention networks, displayed the stimulus-driven ventral attention network-VAN, regionally prevailing (mainly at the frontal lobe), over the goal-directed dorsal attention network-DAN. Therefore, we suggest an interpretation of flow experiences as an opened attention to more changing details in the surroundings, i.e., configured as a 'task-constantly-opened-to-subtle-information experience', rather than a 'task-focused experience'.

Neural Substrates for Early Data Reduction in Fast Vision: A Psychophysical Investigation

To ensure survival, the visual system must rapidly extract the most important elements from a large stream of information. This necessity clashes with the computational limitations of the human brain, so a strong early data reduction is required to efficiently process information in fast vision. A theoretical early vision model, recently developed to preserve maximum information using minimal computational resources, allows efficient image data reduction by extracting simplified sketches containing only optimally informative, salient features. Here, we investigate the neural substrates of this mechanism for optimal encoding of information, possibly located in early visual structures. We adopted a flicker adaptation paradigm, which has been demonstrated to specifically impair the contrast sensitivity of the magnocellular pathway. We compared flicker-induced contrast threshold changes in three different tasks. The results indicate that, after adapting to a uniform flickering field, thresholds for image discrimination using briefly presented sketches increase. Similar threshold elevations occur for motion discrimination, a task typically targeting the magnocellular system. Instead, contrast thresholds for orientation discrimination, a task typically targeting the parvocellular system, do not change with flicker adaptation. The computation performed by this early data reduction mechanism seems thus consistent with magnocellular processing.

Dissonant music engages early visual processing

The neuroscientific examination of music processing in audio-visual contexts offers a valuable framework to assess how auditory information influences the emotional encoding of visual information. Using fMRI during naturalistic film viewing, we investigated the neural mechanisms underlying the effect of music on valence inferences during mental state attribution. Thirty-eight participants watched the same short-film accompanied by systematically controlled consonant or dissonant music. Subjects were instructed to think about the main character's intentions. The results revealed that increasing levels of dissonance led to more negatively valenced inferences, displaying the profound emotional impact of musical dissonance. Crucially, at the neuroscientific level and despite music being the sole manipulation, dissonance evoked the response of the primary visual cortex (V1). Functional/effective connectivity analysis showed a stronger coupling between the auditory ventral stream (AVS) and V1 in response to tonal dissonance and demonstrated the modulation of early visual processing via top-down feedback inputs from the AVS to V1. These V1 signal changes indicate the influence of high-level contextual representations associated with tonal dissonance on early visual cortices, serving to facilitate the emotional interpretation of visual information. Our results highlight the significance of employing systematically controlled music, which can isolate emotional valence from the arousal dimension, to elucidate the brain's sound-to-meaning interface and its distributive crossmodal effects on early visual encoding during naturalistic film viewing.

An Unavoidable Mind-Set Reversal: Consciousness in Vision Science

In recent decades, the debate on consciousness has been conditioned by the idea of bottom-up emergence, which has influenced scientific research and raised a few obstacles to any attempt to bridge the explanatory gap. The analysis and explanation of vision conducted according to the accredited methodologies of scientific research in terms of physical stimuli, objectivity, methods, and explanation has encountered the resistance of subjective experience. Moreover, original Gestalt research into vision has generally been merged with cognitive neuroscience. Experimental phenomenology, building on the legacy of Gestalt psychology, has obtained new results in the fields of amodal contours and color stratifications, light perception, figurality, space, so-called perceptual illusions, and subjective space and time. Notwithstanding the outcomes and the impulse given to neuroscientific analyses, the research carried out around these phenomena has never directly confronted the issue of what it means to be conscious or, in other words, the nature of consciousness as self-referentiality. Research has tended to focus on the percept. Therefore, explaining the non-detachability of parts in subjective experience risks becoming a sort of impossible achievement, similar to that of Baron Munchausen, who succeeds in escaping unharmed from this quicksand by pulling himself out by his hair. This paper addresses how to analyze seeing as an undivided whole by discussing several basic dimensions of phenomenal consciousness on an experimental basis and suggesting an alternative way of escaping this quicksand. This mind-set reversal also sheds light on the organization and dependence relationships between phenomenology, psychophysics, and neuroscience.

A preliminary study of white matter disconnections underlying deficits in praxis in left hemisphere stroke patients

Limb apraxia is a higher-order motor disorder often occurring post-stroke, which affects skilled actions. It is assessed through tasks involving gesture production or pantomime, recognition, meaningless gesture imitation, complex figure drawing, single and multi-object use. A two-system model for the organisation of actions hypothesizes distinct pathways mediating praxis deficits via conceptual, 'indirect', and perceptual 'direct' routes to action. Traditional lesion- symptom mapping techniques have failed to identify these distinct routes. We assessed 29 left hemisphere stroke patients to investigate white matter disconnections on deficits of praxis tasks from the Birmingham Cognitive Screening. White matter disconnection maps derived from patients' structural T1 lesions were created using a diffusion-weighted healthy participant dataset acquired from the human connectome project (HCP). Initial group-level regression analyses revealed significant disconnection between occipital lobes via the splenium of the corpus callosum and involvement of the inferior longitudinal fasciculus in meaningless gesture imitation deficits. There was a trend of left fornix disconnection in gesture production deficits. Further, voxel-wise Bayesian Crawford single-case analyses performed on two patients with the most severe meaningless gesture imitation and meaningful gesture production deficits, respectively, confirmed distinct posterior interhemispheric disconnection, for the former, and disconnections between temporal and frontal areas via the fornix, rostrum of the corpus callosum and anterior cingulum, for the latter. Our results suggest distinct pathways associated with perceptual and conceptual deficits akin to 'direct' and 'indirect' action routes, with some patients displaying both. Larger studies are needed to validate and elaborate on these findings, advancing our understanding of limb apraxia.

Object recognition in primates: what can early visual areas contribute?

Introduction

If neuroscientists were asked which brain area is responsible for object recognition in primates, most would probably answer infero-temporal (IT) cortex. While IT is likely responsible for fine discriminations, and it is accordingly dominated by foveal visual inputs, there is more to object recognition than fine discrimination. Importantly, foveation of an object of interest usually requires recognizing, with reasonable confidence, its presence in the periphery. Arguably, IT plays a secondary role in such peripheral recognition, and other visual areas might instead be more critical.

Methods

To investigate how signals carried by early visual processing areas (such as LGN and V1) could be used for object recognition in the periphery, we focused here on the task of distinguishing faces from non-faces. We tested how sensitive various models were to nuisance parameters, such as changes in scale and orientation of the image, and the type of image background.

Results

We found that a model of V1 simple or complex cells could provide quite reliable information, resulting in performance better than 80% in realistic scenarios. An LGN model performed considerably worse.

Discussion

Because peripheral recognition is both crucial to enable fine recognition (by bringing an object of interest on the fovea), and probably sufficient to account for a considerable fraction of our daily recognition-guided behavior, we think that the current focus on area IT and foveal processing is too narrow. We propose that rather than a hierarchical system with IT-like properties as its primary aim, object recognition should be seen as a parallel process, with high-accuracy foveal modules operating in parallel with lower-accuracy and faster modules that can operate across the visual field.

Distributed representations of behavior-derived object dimensions in the human visual system

Object vision is commonly thought to involve a hierarchy of brain regions processing increasingly complex image features, with high-level visual cortex supporting object recognition and categorization. However, object vision supports diverse behavioral goals, suggesting basic limitations of this category-centric framework. To address these limitations, we mapped a series of dimensions derived from a large-scale analysis of human similarity judgments directly onto the brain. Our results reveal broadly distributed representations of behaviorally-relevant information, demonstrating selectivity to a wide variety of novel dimensions while capturing known selectivities for visual features and categories. Behavior-derived dimensions were superior to categories at predicting brain responses, yielding mixed selectivity in much of visual cortex and sparse selectivity in category-selective clusters. This framework reconciles seemingly disparate findings regarding regional specialization, explaining category selectivity as a special case of sparse response profiles among representational dimensions, suggesting a more expansive view on visual processing in the human brain.

Going beyond still images to improve input variance resilience in multi-stream vision understanding models

Traditionally, vision models have predominantly relied on spatial features extracted from static images, deviating from the continuous stream of spatiotemporal features processed by the brain in natural vision. While numerous video-understanding models have emerged, incorporating videos into image-understanding models with spatiotemporal features has been limited. Drawing inspiration from natural vision, which exhibits remarkable resilience to input changes, our research focuses on the development of a brain-inspired model for vision understanding trained with videos. Our findings demonstrate that models that train on videos instead of still images and include temporal features become more resilient to various alternations on input media.

Instruction alters the influence of allocentric landmarks in a reach task

Allocentric landmarks have an implicit influence on aiming movements, but it is not clear how an explicit instruction (to aim relative to a landmark) influences reach accuracy and precision. Here, 12 participants performed a task with two instruction conditions (egocentric vs. allocentric) but with similar sensory and motor conditions. Participants fixated gaze near the center of a display aligned with their right shoulder while a target stimulus briefly appeared alongside a visual landmark in one visual field. After a brief mask/memory delay the landmark then reappeared at a different location (same or opposite visual field), creating an ego/allocentric conflict. In the egocentric condition, participants were instructed to ignore the landmark and point toward the remembered location of the target. In the allocentric condition, participants were instructed to remember the initial target location relative to the landmark and then reach relative to the shifted landmark (same or opposite visual field). To equalize motor execution between tasks, participants were instructed to anti-point (point to the visual field opposite to the remembered target) on 50% of the egocentric trials. Participants were more accurate and precise and quicker to react in the allocentric condition, especially when pointing to the opposite field. We also observed a visual field effect, where performance was worse overall in the right visual field. These results suggest that, when egocentric and allocentric cues conflict, explicit use of the visual landmark provides better reach performance than reliance on noisy egocentric signals. Such instructions might aid rehabilitation when the egocentric system is compromised by disease or injury.

Prematurity May Affect the Postoperative Sensory Results in Children With Strabismus

PURPOSE

To analyze the motor and sensory outcomes of strabismus surgery in children born preterm (premature group) and full-term (control group).

METHODS

The study was performed at a tertiary university hospital. Children who underwent strabismus surgery between 2012 and 2019 were retrospectively reviewed. The success of surgery, postoperative over-correction and undercorrection rates, and stereopsis and fusion test results were compared between the premature and control groups.

RESULTS

There were 70 patients in the premature group (mean gestational age: 31.25 weeks; range: 24 to 35 weeks) and 242 patients in the control group. The amounts of preoperative and postoperative deviations and overcorrection, undercorrection, and success rates were similar between the premature and control groups (P > .05). Stereopsis improved from 560 to 300 arc/sec postoperatively in the premature group (P = .066) and from 1,156 to 685 arc/sec in the control group (P < .001). The rate of fusion increased from 12.5% to 25% in the premature group (P = .50) and from 17% to 47% in the control group (P < .001). The analysis of strabismus subgroups revealed significant improvement of fusion in full-term patients (P < .001) and not in preterm patients (P = .50) with esotropia. Preoperative amount of deviation was the only risk factor for surgical success (P < .001). Age, sex, history of prematurity, and spherical equivalent refraction were not correlated with undercorrection (P > .05).

CONCLUSIONS

Regardless of the type of strabismus, although the functional results after strabismus surgery were similar in preterm and full-term patients, the gain of stereopsis and central fusion was significantly higher in full-term patients compared to preterm patients. [J Pediatr Ophthalmol Strabismus. 2024;61(4):267-272.].

Deep Brain Stimulation Modulates the Visual Pathway to Improve Freezing of Gait in Parkinson's Disease Patients

OBJECTIVE

To investigate the involvement of the visual cortex in improving freezing of gait (FoG) after subthalamic nucleus (STN) deep brain stimulation (DBS) in Parkinson's disease (PD) patients using whole-brain seed-based functional connectivity.

METHODS

A total of 66 PD patients with FoG who underwent bilateral STN-DBS were included in our study. Patients were divided into a FoG responder group and an FoG nonresponder group according to whether FoG improved 1 year after DBS. We compared the differences in clinical characteristics, brain structural imaging, and seed-based functional connectivity between the 2 groups. The locations of active contacts were further analyzed.

RESULTS

All PD patients benefited from STN-DBS. No significant differences in the baseline characteristics or brain structures were found between the 2 groups. Seed-based functional connectivity analysis revealed that better connectivity in bilateral primary visual areas was associated with better clinical improvement in FoG (P < 0.05 familywise error corrected). Further analysis revealed that this disparity was associated with the location of the active contacts within the rostral region of the sensorimotor subregion in the FoG responder group, in contrast to the findings in the FoG nonresponder group.

CONCLUSIONS

This study suggested that DBS in the rostral region of the STN sensorimotor subregion may alleviate FoG by strengthening functional connectivity in primary visual areas, which has significant implications for guiding surgical strategies for FoG in the future.

A scoping review and critique of the Input-Output subtyping dimension of spatial neglect

Spatial neglect is a common and debilitating disorder after stroke whereby individuals have difficulty reporting, orienting, and/or responding to the contralesional side of space. Given the heterogeneity of neglect symptom presentation, various neglect subtypes have been proposed to better characterize the disorder. This review focuses on the distinction between Input neglect (i.e., difficulty perceiving and/or attending to contralesional stimuli) and Output neglect (i.e., difficulty planning and/or executing movements toward contralesional stimuli). Conceptualizations of Input and Output neglect have varied considerably. We provide a novel summary of the terminology, measurement approaches, and neural correlates of these subtypes. A protocol detailing our systematic scoping review strategy is registered on the Open Science Framework (https://osf.io/bvtxf/). For feasibility and greater comparability across studies, we limited our inclusion criteria to tasks focused on visual stimuli and upper-limb movements. A total of 110 articles were included in the review. Subtyping tasks were categorized based on whether they mainly manipulated aspects of the input (i.e., congruence of visual input with motor output, presence of visual input) or the output (i.e., modality, goal, or direction of output) to produce an Input-Output subtype dissociation. We used our review results to identify four main critiques of this literature: 1) lack of consistency/clarity in conceptual models; 2) methodological issues of dissociating Input and Output subtypes; 3) a need for updated neural theories; and 4) barriers to clinical application. We discuss the lessons learned from this subtyping dimension that can be applied to future research on neglect subtype assessment and treatment.

The neural correlates of limb apraxia: An anatomical likelihood estimation meta-analysis of lesion-symptom mapping studies in brain-damaged patients

Limb apraxia is a motor disorder frequently observed following a stroke. Apraxic deficits are classically assessed with four tasks: tool use, pantomime of tool use, imitation, and gesture understanding. These tasks are supported by several cognitive processes represented in a left-lateralized brain network including inferior frontal gyrus, inferior parietal lobe (IPL), and lateral occipito-temporal cortex (LOTC). For the past twenty years, voxel-wise lesion symptom mapping (VLSM) studies have been used to unravel the neural correlates associated with apraxia, but none of them has proposed a comprehensive view of the topic. In the present work, we proposed to fill this gap by performing a systematic Anatomic Likelihood Estimation meta-analysis of VLSM studies which included tasks traditionally used to assess apraxia. We found that the IPL was crucial for all the tasks. Moreover, lesions within the LOTC were more associated with imitation deficits than tool use or pantomime, confirming its important role in higher visual processing. Our results questioned traditional neurocognitive models on apraxia and may have important clinical implications.

Increased Functional Connectivity Between the Parietal and Occipital Modules Among Flight Cadets

INTRODUCTION: Modular organization in brain regions often performs specific biological functions and is largely based on anatomically and/or functionally related brain areas. The current study aimed to explore changes in whole-brain modular organization affected by flight training.METHODS: The study included 25 male flight cadets and 24 male controls. The first assessment was performed in 2019, when the subjects were university freshmen. The second assessment was completed in 2022. High spatial resolution structural imaging (T1) and resting-state functional MRI data were collected. Then, 90 cerebral regions were organized into 6 brain modules. The intensity of intra- and intermodular communication was calculated.RESULTS: Mixed-effect regression model analysis identified significantly increased interconnections between the parietal and occipital modules in the cadet group, but significantly decreased interconnections in the control group. This change was largely attributed to flight training.DISCUSSION: Pilots need to control the aircraft (e.g., attitude, heading, etc.) using the stick and pedal in response to the current state of the aircraft displayed by the instrument panel; as such, flying requires a large amount of hand-eye coordination. Day-to-day flight training appeared to intensify the connection between the parietal and occipital modules among cadets.Chen X, Jiang H, Meng Y, Xu Z, Luo C. Increased functional connectivity between the parietal and occipital modules among flight cadets. Aerosp Med Hum Perform. 2024; 95(7):375-380.

Tractometry of Human Visual White Matter Pathways in Health and Disease

Diffusion-weighted MRI (dMRI) provides a unique non-invasive view of human brain tissue properties. The present review article focuses on tractometry analysis methods that use dMRI to assess the properties of brain tissue within the long-range connections comprising brain networks. We focus specifically on the major white matter tracts that convey visual information. These connections are particularly important because vision provides rich information from the environment that supports a large range of daily life activities. Many of the diseases of the visual system are associated with advanced aging, and tractometry of the visual system is particularly important in the modern aging society. We provide an overview of the tractometry analysis pipeline, which includes a primer on dMRI data acquisition, voxelwise model fitting, tractography, recognition of white matter tracts, and calculation of tract tissue property profiles. We then review dMRI-based methods for analyzing visual white matter tracts: the optic nerve, optic tract, optic radiation, forceps major, and vertical occipital fasciculus. For each tract, we review background anatomical knowledge together with recent findings in tractometry studies on these tracts and their properties in relation to visual function and disease. Overall, we find that measurements of the brain's visual white matter are sensitive to a range of disorders and correlate with perceptual abilities. We highlight new and promising analysis methods, as well as some of the current barriers to progress toward integration of these methods into clinical practice. These barriers, such as variability in measurements between protocols and instruments, are targets for future development.

Retrieving and reconstructing conceptually similar images from fMRI with latent diffusion models and a neuro-inspired brain decoding model

Objective.Brain decoding is a field of computational neuroscience that aims to infer mental states or internal representations of perceptual inputs from measurable brain activity. This study proposes a novel approach to brain decoding that relies on semantic and contextual similarity.Approach.We use several functional magnetic resonance imaging (fMRI) datasets of natural images as stimuli and create a deep learning decoding pipeline inspired by the bottom-up and top-down processes in human vision. Our pipeline includes a linear brain-to-feature model that maps fMRI activity to semantic visual stimuli features. We assume that the brain projects visual information onto a space that is homeomorphic to the latent space of last layer of a pretrained neural network, which summarizes and highlights similarities and differences between concepts. These features are categorized in the latent space using a nearest-neighbor strategy, and the results are used to retrieve images or condition a generative latent diffusion model to create novel images.Main results.We demonstrate semantic classification and image retrieval on three different fMRI datasets: Generic Object Decoding (vision perception and imagination), BOLD5000, and NSD. In all cases, a simple mapping between fMRI and a deep semantic representation of the visual stimulus resulted in meaningful classification and retrieved or generated images. We assessed quality using quantitative metrics and a human evaluation experiment that reproduces the multiplicity of conscious and unconscious criteria that humans use to evaluate image similarity. Our method achieved correct evaluation in over 80% of the test set.Significance.Our study proposes a novel approach to brain decoding that relies on semantic and contextual similarity. The results demonstrate that measurable neural correlates can be linearly mapped onto the latent space of a neural network to synthesize images that match the original content. These findings have implications for both cognitive neuroscience and artificial intelligence.

Assessing brain neuroplasticity: Surface morphometric analysis of cortical changes induced by Quadrato motor training

Morphological markers for brain plasticity are still lacking and their findings are challenged by the extreme variability of cortical brain surface. Trying to overcome the "correspondence problem," we applied a landmark-free method (the generalized procrustes surface analysis (GPSA)) for investigating the shape variation of cortical surface in a group of 40 healthy volunteers (i.e., the practice group) subjected to daily motor training known as Quadrato motor training (QMT). QMT is a sensorimotor walking meditation that aims at balancing body, cognition, and emotion. More specifically, QMT requires coordination and attention and consists of moving in one of three possible directions on corners of a 50 × 50 cm2. Brain magnetic resonance images (MRIs) of practice group (acquired at baseline, as well as after 6 and 12 weeks of QMT), were 3D reconstructed and here compared with brain MRIs of six more volunteers never practicing the QMT (naïve group). Cortical regions mostly affected by morphological variations were visualized on a 3D average color-scaled brain surface indicating from higher (red) to lower (blue) levels of variation. Cortical regions interested in most of the shape variations were as follows: (1) the supplementary motor cortex; (2) the inferior frontal gyrus (pars opercolaris) and the anterior insula; (3) the visual cortex; (4) the inferior parietal lobule (supramarginal gyrus and angular gyrus). Our results show that surface morphometric analysis (i.e., GPSA) can be applied to assess brain neuroplasticity processes, such as those stimulated by QMT.

Neural connectivity patterns explain why adolescents perceive the world as moving slow

That younger individuals perceive the world as moving slower than adults is a familiar phenomenon. Yet, it remains an open question why that is. Using event segmentation theory, electroencephalogram (EEG) beamforming and nonlinear causal relationship estimation using artificial neural network methods, we studied neural activity while adolescent and adult participants segmented a movie. We show when participants were instructed to segment a movie into meaningful units, adolescents partitioned incoming information into fewer encapsulated segments or episodes of longer duration than adults. Importantly, directed communication between medial frontal and lower-level perceptual areas and between occipito-temporal regions in specific neural oscillation spectrums explained behavioral differences between groups. Overall, the study reveals that a different organization of directed communication between brain regions and inefficient transmission of information between brain regions are key to understand why younger people perceive the world as moving slow.

Neural correlates of musical timbre: an ALE meta-analysis of neuroimaging data

Timbre is a central aspect of music that allows listeners to identify musical sounds and conveys musical emotion, but also allows for the recognition of actions and is an important structuring property of music. The former functions are known to be implemented in a ventral auditory stream in processing musical timbre. While the latter functions are commonly attributed to areas in a dorsal auditory processing stream in other musical domains, its involvement in musical timbre processing is so far unknown. To investigate if musical timbre processing involves both dorsal and ventral auditory pathways, we carried out an activation likelihood estimation (ALE) meta-analysis of 18 experiments from 17 published neuroimaging studies on musical timbre perception. We identified consistent activations in Brodmann areas (BA) 41, 42, and 22 in the bilateral transverse temporal gyri, the posterior superior temporal gyri and planum temporale, in BA 40 of the bilateral inferior parietal lobe, in BA 13 in the bilateral posterior Insula, and in BA 13 and 22 in the right anterior insula and superior temporal gyrus. The vast majority of the identified regions are associated with the dorsal and ventral auditory processing streams. We therefore propose to frame the processing of musical timbre in a dual-stream model. Moreover, the regions activated in processing timbre show similarities to the brain regions involved in processing several other fundamental aspects of music, indicating possible shared neural bases of musical timbre and other musical domains.

Withdrawn: The altered dynamic community structure for adaptive adjustment in stroke patients with multidomain cognitive impairments: A multilayer network analysis

This article has been withdrawn at the request of the author(s) and/or editor. The Publisher apologizes for any inconveniencethis may cause. The full Elsevier Policy on Article Withdrawal can be found at https://www.elsevier.com/about/policies/article-withdrawal.

Reciprocal interactions among parietal and occipito-temporal representations support everyday object-directed actions

Everyday interactions with common manipulable objects require the integration of conceptual knowledge about objects and actions with real-time sensory information about the position, orientation and volumetric structure of the grasp target. The ability to successfully interact with everyday objects involves analysis of visual form and shape, surface texture, material properties, conceptual attributes such as identity, function and typical context, and visuomotor processing supporting hand transport, grasp form, and object manipulation. Functionally separable brain regions across the dorsal and ventral visual pathways support the processing of these different object properties and, in cohort, are necessary for functional object use. Object-directed grasps display end-state-comfort: they anticipate in form and force the shape and material properties of the grasp target, and how the object will be manipulated after it is grasped. End-state-comfort is the default for everyday interactions with manipulable objects and implies integration of information across the ventral and dorsal visual pathways. We propose a model of how visuomotor and action representations in parietal cortex interact with object representations in ventral and lateral occipito-temporal cortex. One pathway, from the supramarginal gyrus to the middle and inferior temporal gyrus, supports the integration of action-related information, including hand and limb position (supramarginal gyrus) with conceptual attributes and an appreciation of the action goal (middle temporal gyrus). A second pathway, from posterior IPS to the fusiform gyrus and collateral sulcus supports the integration of grasp parameters (IPS) with the surface texture and material properties (e.g., weight distribution) of the grasp target. Reciprocal interactions among these regions are part of a broader network of regions that support everyday functional object interactions.

Object-based suppression in target search but not in distractor inhibition

The present study investigated the effect of object representation on attentional priority regarding distractor inhibition and target search processes while the statistical regularities of singleton distractor location were biased. A color singleton distractor appeared more frequently at one of six stimulus locations, called the 'high-probability location,' to induce location-based suppression. Critically, three objects were presented, each of which paired two adjacent stimuli in a target display by adding background contours (Experiment 1) or using perceptual grouping (Experiments 2 and 3). The results revealed that attention capture by singleton distractors was hardly modulated by objects. In contrast, target selection was impeded at the location in the object containing the high-probability location compared to an equidistant location in a different object. This object-based suppression in target selection was evident when object-related features were parts of task-relevant features. These findings suggest that task-irrelevant objects modulate attentional suppression. Moreover, different features are engaged in determining attentional priority for distractor inhibition and target search processes.

Social Perception in the Infant Brain and Its Link to Social Behavior

The current longitudinal study (n = 98) utilized a developmental cognitive neuroscience approach to examine whether and how variability in social perception is linked to social behavior in early human development. Cortical responses to processing dynamic faces were investigated using functional near-infrared spectroscopy at 7 months. Individual differences in sociability were measured using the Early Childhood Behavior Questionnaire at 18 months. Confirming previous work with infants and adults, functional near-infrared spectroscopy results show that viewing changing faces recruited superior temporal cortices in 7-month-old infants, adding to the view that this brain system is specialized in social perception from early in ontogeny. Our longitudinal results show that greater engagement of the right superior temporal cortex at 7 months predicts higher levels of sociability at 18 months. This suggests that early variability in social perception is linked to later differences in overtly displayed social behavior, providing novel longitudinal evidence for a social brain-behavior association.

Common and specific activations supporting optic flow processing and navigation as revealed by a meta-analysis of neuroimaging studies

Optic flow provides useful information in service of spatial navigation. However, whether brain networks supporting these two functions overlap is still unclear. Here we used Activation Likelihood Estimation (ALE) to assess the correspondence between brain correlates of optic flow processing and spatial navigation and their specific neural activations. Since computational and connectivity evidence suggests that visual input from optic flow provides information mainly during egocentric navigation, we further tested the correspondence between brain correlates of optic flow processing and that of both egocentric and allocentric navigation. Optic flow processing shared activation with egocentric (but not allocentric) navigation in the anterior precuneus, suggesting its role in providing information about self-motion, as derived from the analysis of optic flow, in service of egocentric navigation. We further documented that optic flow perception and navigation are partially segregated into two functional and anatomical networks, i.e., the dorsal and the ventromedial networks. Present results point to a dynamic interplay between the dorsal and ventral visual pathways aimed at coordinating visually guided navigation in the environment.

Neuroanatomical correlates of peripersonal space: bridging the gap between perception, action, emotion and social cognition

Peripersonal space (PPS) is a construct referring to the portion of space immediately surrounding our bodies, where most of the interactions between the subject and the environment, including other individuals, take place. Decades of animal and human neuroscience research have revealed that the brain holds a separate representation of this region of space: this distinct spatial representation has evolved to ensure proper relevance to stimuli that are close to the body and prompt an appropriate behavioral response. The neural underpinnings of such construct have been thoroughly investigated by different generations of studies involving anatomical and electrophysiological investigations in animal models, and, recently, neuroimaging experiments in human subjects. Here, we provide a comprehensive anatomical overview of the anatomical circuitry underlying PPS representation in the human brain. Gathering evidence from multiple areas of research, we identified cortical and subcortical regions that are involved in specific aspects of PPS encoding.We show how these regions are part of segregated, yet integrated functional networks within the brain, which are in turn involved in higher-order integration of information. This wide-scale circuitry accounts for the relevance of PPS encoding in multiple brain functions, including not only motor planning and visuospatial attention but also emotional and social cognitive aspects. A complete characterization of these circuits may clarify the derangements of PPS representation observed in different neurological and neuropsychiatric diseases.

Force matching: motor effects that are not reported by the actor

We explored unintentional drifts of finger forces during force production and matching task. Based on earlier studies, we predicted that force matching with the other hand would reduce or stop the force drift in instructed fingers while uninstructed (enslaved) fingers remain unaffected. Twelve young, healthy, right-handed participants performed two types of tasks with both hands (task hand and match hand). The task hand produced constant force at 20% of MVC level with the Index and Ring fingers pressing in parallel on strain gauge force sensors. The Middle finger force wasn't instructed, and its enslaved force was recorded. Visual feedback on the total force by the instructed fingers was either present throughout the trial or only during the first 5 s (no-feedback condition). The other hand matched the perceived force level of the task hand starting at either 4, 8, or 15 s from the trial initiation. No feedback was ever provided for the match hand force. After the visual feedback was removed, the task hand showed a consistent drift to lower magnitudes of total force. Contrary to our prediction, over all conditions, force matching caused a brief acceleration of force drift in the task hand, which then reached a plateau. There was no effect of matching on drifts in enslaved finger force. We interpret the force drifts within the theory of control with spatial referent coordinates as consequences of drifts in the command (referent coordinate) to the antagonist muscles. This command is not adequately incorporated into force perception.

The effect of the Uznadze illusion is temporally dynamic in closed-loop but temporally constant in open-loop grasping

Although it is known that the availability of visual feedback modulates grasping kinematics, it is unclear whether this extends to both the early and late stages of the movement. We tackled this issue by exposing participants to the Uznadze illusion (a medium stimulus appears larger or smaller after exposure to smaller or larger inducers). After seeing smaller or larger discs, participants grasped a medium disc with (closed-loop [CL]) or without (open-loop [OL]) visual feedback. Our main aim was to assess whether the time course of the illusion from the movement onset up to the grasp differed between OL and CL. Moreover, we compared OL and CL illusory effects on maximum grip aperture (MGA) and tested whether preparation time, movement time, and time to MGA predicted illusion magnitude. Results revealed that CL illusory effects decreased over movement time, whereas OL ones remained constant. At the time of MGA, OL, and CL effects were, however, of similar size. Although OL grasps were longer to prepare and showed earlier and larger MGAs, such differences had little impact on modulating the illusion. These results suggest that the early stage of grasping is sensitive to the Uznadze illusion both under CL and OL conditions, whereas the late phase is sensitive to it only under OL conditions. We discuss these findings within the framework of theoretical models on the functional properties of the dorsal stream for visually guided actions.

Neuronal tuning and population representations of shape and category in human visual cortex

Object recognition and categorization are essential cognitive processes which engage considerable neural resources in the human ventral visual stream. However, the tuning properties of human ventral stream neurons for object shape and category are virtually unknown. We performed large-scale recordings of spiking activity in human Lateral Occipital Complex in response to stimuli in which the shape dimension was dissociated from the category dimension. Consistent with studies in nonhuman primates, the neuronal representations were primarily shape-based, although we also observed category-like encoding for images of animals. Surprisingly, linear decoders could reliably classify stimulus category even in data sets that were entirely shape-based. In addition, many recording sites showed an interaction between shape and category tuning. These results represent a detailed study on shape and category coding at the neuronal level in the human ventral visual stream, furnishing essential evidence that reconciles human imaging and macaque single-cell studies.

On the connection between creativity and aesthetics

Within cognitive psychology, there are separate experimental fields devoted to the study of creativity, on the one hand, and aesthetics, on the other, with virtually no cross-talk between them. In this article, I propose a means of uniting creativity and aesthetics via a consideration of the mechanisms of cultural evolution. I call this the creativity/aesthetics cycle. The basic tenet of the model is that creativity and aesthetics mediate, respectively, the processes of variation (production) and selection (perception or consumption) in evolutionary models of culture. By means of this cycle, creators produce works that they hope will be evaluated positively by consumers, where such appraisals ultimately feed back to influence the subsequent decision-making processes of creators. I discuss the implications of this model for the fields of creativity and aesthetics.

Visual sensitivity at the service of action control in posterior parietal cortex

The posterior parietal cortex (PPC) serves as a crucial hub for the integration of sensory with motor cues related to voluntary actions. Visual input is used in different ways along the dorsomedial and the dorsolateral visual pathways. Here we focus on the dorsomedial pathway and recognize a visual representation at the service of action control. Employing different experimental paradigms applied to behaving monkeys while single neural activity is recorded from the medial PPC (area V6A), we show how plastic visual representation can be, matching the different contexts in which the same object is proposed. We also present data on the exchange between vision and arm actions and highlight how this rich interplay can be used to weight different sensory inputs in order to monitor and correct arm actions online. Indeed, neural activity during reaching or reach-to-grasp actions can be excited or inhibited by visual information, suggesting that the visual perception of action, rather than object recognition, is the most effective factor for area V6A. Also, three-dimensional object shape is encoded dynamically by the neural population, according to the behavioral context of the monkey. Along this line, mirror neuron discharges in V6A indicate the plasticity of visual representation of the graspable objects, that changes according to the context and peaks when the object is the target of one's own action. In other words, object encoding in V6A is a visual encoding for action.

Taking consciousness for real: Increasing the ecological validity of the study of conscious vs. unconscious processes

The study of consciousness has developed well-controlled, rigorous methods for manipulating and measuring consciousness. Yet, in the process, experimental paradigms grew farther away from everyday conscious and unconscious processes, which raises the concern of ecological validity. In this review, we suggest that the field can benefit from adopting a more ecological approach, akin to other fields of cognitive science. There, this approach challenged some existing hypotheses, yielded stronger effects, and enabled new research questions. We argue that such a move is critical for studying consciousness, where experimental paradigms tend to be artificial and small effect sizes are relatively prevalent. We identify three paths for doing so-changing the stimuli and experimental settings, changing the measures, and changing the research questions themselves-and review works that have already started implementing such approaches. While acknowledging the inherent challenges, we call for increasing ecological validity in consciousness studies.

Updating the sulcal landscape of the human lateral parieto-occipital junction provides anatomical, functional, and cognitive insights

Recent work has uncovered relationships between evolutionarily new small and shallow cerebral indentations, or sulci, and human behavior. Yet, this relationship remains unexplored in the lateral parietal cortex (LPC) and the lateral parieto-occipital junction (LPOJ). After defining thousands of sulci in a young adult cohort, we revised the previous LPC/LPOJ sulcal landscape to include four previously overlooked, small, shallow, and variable sulci. One of these sulci (ventral supralateral occipital sulcus, slocs-v) is present in nearly every hemisphere and is morphologically, architecturally, and functionally dissociable from neighboring sulci. A data-driven, model-based approach, relating sulcal depth to behavior further revealed that the morphology of only a subset of LPC/LPOJ sulci, including the slocs-v, is related to performance on a spatial orientation task. Our findings build on classic neuroanatomical theories and identify new neuroanatomical targets for future "precision imaging" studies exploring the relationship among brain structure, brain function, and cognitive abilities in individual participants.

Contrasting neurofunctional correlates of face- and visuospatial-processing in children and adolescents with Williams syndrome: convergent results from four fMRI paradigms

Understanding neurogenetic mechanisms underlying neuropsychiatric disorders such as schizophrenia and autism is complicated by their inherent clinical and genetic heterogeneity. Williams syndrome (WS), a rare neurodevelopmental condition in which both the genetic alteration (hemideletion of ~ twenty-six 7q11.23 genes) and the cognitive/behavioral profile are well-defined, offers an invaluable opportunity to delineate gene-brain-behavior relationships. People with WS are characterized by increased social drive, including particular interest in faces, together with hallmark difficulty in visuospatial processing. Prior work, primarily in adults with WS, has searched for neural correlates of these characteristics, with reports of altered fusiform gyrus function while viewing socioemotional stimuli such as faces, along with hypoactivation of the intraparietal sulcus during visuospatial processing. Here, we investigated neural function in children and adolescents with WS by using four separate fMRI paradigms, two that probe each of these two cognitive/behavioral domains. During the two visuospatial tasks, but not during the two face processing tasks, we found bilateral intraparietal sulcus hypoactivation in WS. In contrast, during both face processing tasks, but not during the visuospatial tasks, we found fusiform hyperactivation. These data not only demonstrate that previous findings in adults with WS are also present in childhood and adolescence, but also provide a clear example that genetic mechanisms can bias neural circuit function, thereby affecting behavioral traits.