Color-biased regions in the ventral visual pathway are food selective

Principles of intensive human neuroimaging

The rise of large, publicly shared functional magnetic resonance imaging (fMRI) data sets in human neuroscience has focused on acquiring either a few hours of data on many individuals ('wide' fMRI) or many hours of data on a few individuals ('deep' fMRI). In this opinion article, we highlight an emerging approach within deep fMRI, which we refer to as 'intensive' fMRI: one that strives for extensive sampling of cognitive phenomena to support computational modeling and detailed investigation of brain function at the single voxel level. We discuss the fundamental principles, trade-offs, and practical considerations of intensive fMRI. We also emphasize that intensive fMRI does not simply mean collecting more data: it requires careful design of experiments to enable a rich hypothesis space, optimizing data quality, and strategically curating public resources to maximize community impact.

Positive serial dependence in ratings of food images for appeal and calories

Food is fundamental to survival, and our brains are highly attuned to rapidly process food stimuli. Neural signals show that foods can be discriminated as edible or inedible as early as 85 ms after stimulus onset,1 distinguished as processed or unprocessed beginning at 130 ms,2 and as high or low density from 165 ms.3 Recent evidence revealed specialized processing of food stimuli in the ventral visual pathway,4,5,6 an area that underlies perception of faces and other important objects. For many visual objects, perception can be biased toward recent perceptual history (known as serial dependence7,8). We examined serial dependence for food in two large samples (n > 300) who rated sequences of food images for either "appeal" or "calories." Ratings for calories were highly correlated between participants and were similar for males and females. Appeal ratings varied considerably between participants, consistent with the idiosyncratic nature of food preferences, and tended to be higher for males than females. High-calorie ratings were associated with high appeal, especially in males. Importantly, response biases showed clear positive serial dependences: higher stimulus values in the previous trials led to positive biases, and vice versa. The effects were similar for males and females and for calories and appeal ratings and were remarkably consistent across participants. These findings square with recently found food selectively in the visual temporal cortex, reveal a new mechanism influencing food decision-making, and suggest a new sensory-level component that could complement cognitive strategies in diet intervention.

Distributed representations of behaviour-derived object dimensions in the human visual system

Object vision is commonly thought to involve a hierarchy of brain regions processing increasingly complex image features, with high-level visual cortex supporting object recognition and categorization. However, object vision supports diverse behavioural goals, suggesting basic limitations of this category-centric framework. To address these limitations, we mapped a series of dimensions derived from a large-scale analysis of human similarity judgements directly onto the brain. Our results reveal broadly distributed representations of behaviourally relevant information, demonstrating selectivity to a wide variety of novel dimensions while capturing known selectivities for visual features and categories. Behaviour-derived dimensions were superior to categories at predicting brain responses, yielding mixed selectivity in much of visual cortex and sparse selectivity in category-selective clusters. This framework reconciles seemingly disparate findings regarding regional specialization, explaining category selectivity as a special case of sparse response profiles among representational dimensions, suggesting a more expansive view on visual processing in the human brain.

Graspable foods and tools elicit similar responses in visual cortex

The extrastriatal visual cortex is known to exhibit distinct response profiles to complex stimuli of varying ecological importance (e.g. faces, scenes, and tools). Although food is primarily distinguished from other objects by its edibility, not its appearance, recent evidence suggests that there is also food selectivity in human visual cortex. Food is also associated with a common behavior, eating, and food consumption typically also involves the manipulation of food, often with hands. In this context, food items share many properties with tools: they are graspable objects that we manipulate in self-directed and stereotyped forms of action. Thus, food items may be preferentially represented in extrastriatal visual cortex in part because of these shared affordance properties, rather than because they reflect a wholly distinct kind of category. We conducted functional MRI and behavioral experiments to test this hypothesis. We found that graspable food items and tools were judged to be similar in their action-related properties and that the location, magnitude, and patterns of neural responses for images of graspable food items were similar in profile to the responses for tool stimuli. Our findings suggest that food selectivity may reflect the behavioral affordances of food items rather than a distinct form of category selectivity.

Distributed representations of behavior-derived object dimensions in the human visual system

Object vision is commonly thought to involve a hierarchy of brain regions processing increasingly complex image features, with high-level visual cortex supporting object recognition and categorization. However, object vision supports diverse behavioral goals, suggesting basic limitations of this category-centric framework. To address these limitations, we mapped a series of dimensions derived from a large-scale analysis of human similarity judgments directly onto the brain. Our results reveal broadly distributed representations of behaviorally-relevant information, demonstrating selectivity to a wide variety of novel dimensions while capturing known selectivities for visual features and categories. Behavior-derived dimensions were superior to categories at predicting brain responses, yielding mixed selectivity in much of visual cortex and sparse selectivity in category-selective clusters. This framework reconciles seemingly disparate findings regarding regional specialization, explaining category selectivity as a special case of sparse response profiles among representational dimensions, suggesting a more expansive view on visual processing in the human brain.

Trait food craving predicts functional connectivity between dopaminergic midbrain and the fusiform food area during eating imagery

Neurofunctional coupling between the dopaminergic midbrain (i.e., ventral tegmental area, VTA) and higher-order visual regions may contribute to food craving, leading to the onset or maintenance of obesity. We recently showed that the VTA resting-state functional connectivity with the occipitotemporal cortex, at the level of the fusiform gyrus (FFG), was specifically associated with trait food craving and the implicit bias for food images, suggesting that VTA-FFG connectivity may reflect the association between the visual representations of food and its motivational properties. To further test this hypothesis, this time we studied task-based functional connectivity in twenty-eight healthy-weight participants while imagining eating their most liked high-calorie (HC) or least liked low-calorie food (LC) or drinking water (control condition). Trait food craving scores were used to predict changes in task-based functional connectivity of the VTA during imagery of HC compared to LC foods (relative to the control condition). Trait food craving was positively associated with the functional connectivity of the VTA with the left FFG: people with higher trait food craving scores show stronger VTA-FFG connectivity, specifically for the imagery of the liked HC foods. This association was not linked to the quality of imagery nor to state measures of craving, appetite, or thirst. These findings emphasize the contribution of the functional coupling between dopaminergic midbrain and higher-order visual regions to food craving, suggesting a neurofunctional mechanism by which the mental representations of the HC food we like can become much more salient if not irresistible.

Graspable foods and tools elicit similar responses in visual cortex

Extrastriatal visual cortex is known to exhibit distinct response profiles to complex stimuli of varying ecological importance (e.g., faces, scenes, and tools). The dominant interpretation of these effects is that they reflect activation of distinct "category-selective" brain regions specialized to represent these and other stimulus categories. We sought to explore an alternative perspective: that the response to these stimuli is determined less by whether they form distinct categories, and more by their relevance to different forms of natural behavior. In this regard, food is an interesting test case, since it is primarily distinguished from other objects by its edibility, not its appearance, and there is evidence of food-selectivity in human visual cortex. Food is also associated with a common behavior, eating, and food consumption typically also involves the manipulation of food, often with the hands. In this context, food items share many properties in common with tools: they are graspable objects that we manipulate in self-directed and stereotyped forms of action. Thus, food items may be preferentially represented in extrastriatal visual cortex in part because of these shared affordance properties, rather than because they reflect a wholly distinct kind of category. We conducted fMRI and behavioral experiments to test this hypothesis. We found that behaviorally graspable food items and tools were judged to be similar in their action-related properties, and that the location, magnitude, and patterns of neural responses for images of graspable food items were similar in profile to the responses for tool stimuli. Our findings suggest that food-selectivity may reflect the behavioral affordances of food items rather than a distinct form of category-selectivity.

The Geometry of Low- and High-Level Perceptual Spaces

Low-level features are typically continuous (e.g., the gamut between two colors), but semantic information is often categorical (there is no corresponding gradient between dog and turtle) and hierarchical (animals live in land, water, or air). To determine the impact of these differences on cognitive representations, we characterized the geometry of perceptual spaces of five domains: a domain dominated by semantic information (animal names presented as words), a domain dominated by low-level features (colored textures), and three intermediate domains (animal images, lightly texturized animal images that were easy to recognize, and heavily texturized animal images that were difficult to recognize). Each domain had 37 stimuli derived from the same animal names. From 13 participants (9F), we gathered similarity judgments in each domain via an efficient psychophysical ranking paradigm. We then built geometric models of each domain for each participant, in which distances between stimuli accounted for participants' similarity judgments and intrinsic uncertainty. Remarkably, the five domains had similar global properties: each required 5-7 dimensions, and a modest amount of spherical curvature provided the best fit. However, the arrangement of the stimuli within these embeddings depended on the level of semantic information: dendrograms derived from semantic domains (word, image, and lightly texturized images) were more "tree-like" than those from feature-dominated domains (heavily texturized images and textures). Thus, the perceptual spaces of domains along this feature-dominated to semantic-dominated gradient shift to a tree-like organization when semantic information dominates, while retaining a similar global geometry.

High-dimensional topographic organization of visual features in the primate temporal lobe

The inferotemporal cortex supports our supreme object recognition ability. Numerous studies have been conducted to elucidate the functional organization of this brain area, but there are still important questions that remain unanswered, including how this organization differs between humans and non-human primates. Here, we use deep neural networks trained on object categorization to construct a 25-dimensional space of visual features, and systematically measure the spatial organization of feature preference in both male monkey brains and human brains using fMRI. These feature maps allow us to predict the selectivity of a previously unknown region in monkey brains, which is corroborated by additional fMRI and electrophysiology experiments. These maps also enable quantitative analyses of the topographic organization of the temporal lobe, demonstrating the existence of a pair of orthogonal gradients that differ in spatial scale and revealing significant differences in the functional organization of high-level visual areas between monkey and human brains.

How images of food become cravingly salient in obesity

OBJECTIVE

This case-control study was aimed at testing two main hypotheses: (i) obesity is characterized by neurofunctional alterations within the mesocorticolimbic reward system, a brain network originating from the midbrain ventral tegmental area (VTA); and (ii) these alterations are associated with a bias for food-related stimuli and craving.

METHODS

Normal-weight individuals and individuals with obesity underwent a resting-state functional magnetic resonance imaging scan and the assessment of impulsivity, food craving, appetite, and implicit bias for food and non-food stimuli. The VTA was used as a seed to map, for each participant, the strength of its functional connections with the rest of the brain. The between-group difference in functional connectivity was then computed, and brain-behavior correlations were performed.

RESULTS

Individuals with obesity showed hyper-connectivity of the VTA with part of the ventral occipitotemporal cortex, recently found to be specialized for food images, and hypo-connectivity with the left inferior frontal gyrus, devoted to cognitive control. VTA-ventral occipitotemporal cortex connectivity was positively associated with food craving and food-related bias; the reverse correlation was observed for VTA-inferior frontal gyrus connectivity.

CONCLUSIONS

These findings reveal that, in obesity, food-related visual stimuli become cravingly salient through an imbalanced connectivity of the reward system with sensory-specific regions and the frontal cortex involved in cognitive control.

Color appearance and the end of Hering's Opponent-Colors Theory

Hering's Opponent-Colors Theory has been central to understanding color appearance for 150 years. It aims to explain the phenomenology of colors with two linked propositions. First, a psychological hypothesis stipulates that any color is described necessarily and sufficiently by the extent to which it appears reddish-versus-greenish, bluish-versus-yellowish, and blackish-versus-whitish. Second, a physiological hypothesis stipulates that these perceptual mechanisms are encoded by three innate brain mechanisms. We review the evidence and conclude that neither side of the linking proposition is accurate: the theory is wrong. We sketch out an alternative, Utility-Based Coding, by which the known retinal cone-opponent mechanisms represent optimal encoding of spectral information given competing selective pressure to extract high-acuity spatial information; and phenomenological color categories represent an adaptive, efficient, output of the brain governed by behavioral demands.

A large-scale fMRI dataset for the visual processing of naturalistic scenes

One ultimate goal of visual neuroscience is to understand how the brain processes visual stimuli encountered in the natural environment. Achieving this goal requires records of brain responses under massive amounts of naturalistic stimuli. Although the scientific community has put a lot of effort into collecting large-scale functional magnetic resonance imaging (fMRI) data under naturalistic stimuli, more naturalistic fMRI datasets are still urgently needed. We present here the Natural Object Dataset (NOD), a large-scale fMRI dataset containing responses to 57,120 naturalistic images from 30 participants. NOD strives for a balance between sampling variation between individuals and sampling variation between stimuli. This enables NOD to be utilized not only for determining whether an observation is generalizable across many individuals, but also for testing whether a response pattern is generalized to a variety of naturalistic stimuli. We anticipate that the NOD together with existing naturalistic neuroimaging datasets will serve as a new impetus for our understanding of the visual processing of naturalistic stimuli.

Nourishing the brain on deep space missions: nutritional psychiatry in promoting resilience

The grueling psychological demands of a journey into deep space coupled with ever-increasing distances away from home pose a unique problem: how can we best take advantage of the benefits of fresh foods in a place that has none? Here, we consider the biggest challenges associated with our current spaceflight food system, highlight the importance of supporting optimal brain health on missions into deep space, and discuss evidence about food components that impact brain health. We propose a future food system that leverages the gut microbiota that can be individually tailored to best support the brain and mental health of crews on deep space long-duration missions. Working toward this goal, we will also be making investments in sustainable means to nourish the crew that remains here on spaceship Earth.

Spikiness and animacy as potential organizing principles of human ventral visual cortex

Considerable research has been devoted to understanding the fundamental organizing principles of the ventral visual pathway. A recent study revealed a series of 3-4 topographical maps arranged along the macaque inferotemporal (IT) cortex. The maps articulated a two-dimensional space based on the spikiness and animacy of visual objects, with "inanimate-spiky" and "inanimate-stubby" regions of the maps constituting two previously unidentified cortical networks. The goal of our study was to determine whether a similar functional organization might exist in human IT. To address this question, we presented the same object stimuli and images from "classic" object categories (bodies, faces, houses) to humans while recording fMRI activity at 7 Tesla. Contrasts designed to reveal the spikiness-animacy object space evoked extensive significant activation across human IT. However, unlike the macaque, we did not observe a clear sequence of complete maps, and selectivity for the spikiness-animacy space was deeply and mutually entangled with category-selectivity. Instead, we observed multiple new stimulus preferences in category-selective regions, including functional sub-structure related to object spikiness in scene-selective cortex. Taken together, these findings highlight spikiness as a promising organizing principle of human IT and provide new insights into the role of category-selective regions in visual object processing.