From Visual Perception to Aesthetic Appeal: Brain Responses to Aesthetically Appealing Natural Landscape Movies

Integrative processing in artificial and biological vision predicts the perceived beauty of natural images

Previous research shows that the beauty of natural images is already determined during perceptual analysis. However, it is unclear which perceptual computations give rise to the perception of beauty. Here, we tested whether perceived beauty is predicted by spatial integration across an image, a perceptual computation that reduces processing demands by aggregating image parts into more efficient representations of the whole. We quantified integrative processing in an artificial deep neural network model, where the degree of integration was determined by the amount of deviation between activations for the whole image and its constituent parts. This quantification of integration predicted beauty ratings for natural images across four studies with different stimuli and designs. In a complementary functional magnetic resonance imaging study, we show that integrative processing in human visual cortex similarly predicts perceived beauty. Together, our results establish integration as a computational principle that facilitates perceptual analysis and thereby mediates the perception of beauty.

Modelling individual aesthetic judgements over time

Listening to music, watching a sunset-many sensory experiences are valuable to us, to a degree that differs significantly between individuals, and within an individual over time. We have theorized (Brielmann & Dayan 2022 Psychol. Rev. 129, 1319-1337 (doi:10.1037/rev0000337))) that these idiosyncratic values derive from the task of using experiences to tune the sensory-cognitive system to current and likely future input. We tested the theory using participants' (n = 59) ratings of a set of dog images (n = 55) created using the NeuralCrossbreed morphing algorithm. A full realization of our model that uses feature representations extracted from image-recognizing deep neural nets (e.g. VGG-16) is able to capture liking judgements on a trial-by-trial basis (median r = 0.65), outperforming predictions based on population averages (median r = 0.01). Furthermore, the model's learning component allows it to explain image sequence dependent rating changes, capturing on average 17% more variance in the ratings for the true trial order than for simulated random trial orders. This validation of our theory is the first step towards a comprehensive treatment of individual differences in evaluation. This article is part of the theme issue 'Art, aesthetics and predictive processing: theoretical and empirical perspectives'.

Modeling the Visual Landscape: A Review on Approaches, Methods and Techniques

Modeling the perception and evaluation of landscapes from the human perspective is a desirable goal for several scientific domains and applications. Human vision is the dominant sense, and human eyes are the sensors for apperceiving the environmental stimuli of our surroundings. Therefore, exploring the experimental recording and measurement of the visual landscape can reveal crucial aspects about human visual perception responses while viewing the natural or man-made landscapes. Landscape evaluation (or assessment) is another dimension that refers mainly to preferences of the visual landscape, involving human cognition as well, in ways that are often unpredictable. Yet, landscape can be approached by both egocentric (i.e., human view) and exocentric (i.e., bird's eye view) perspectives. The overarching approach of this review article lies in systematically presenting the different ways for modeling and quantifying the two 'modalities' of human perception and evaluation, under the two geometric perspectives, suggesting integrative approaches on these two 'diverging' dualities. To this end, several pertinent traditions/approaches, sensor-based experimental methods and techniques (e.g., eye tracking, fMRI, and EEG), and metrics are adduced and described. Essentially, this review article acts as a 'guide-map' for the delineation of the different activities related to landscape experience and/or management and to the valid or potentially suitable types of stimuli, sensors techniques, and metrics for each activity. Throughout our work, two main research directions are identified: (1) one that attempts to transfer the visual landscape experience/management from the one perspective to the other (and vice versa); (2) another one that aims to anticipate the visual perception of different landscapes and establish connections between perceptual processes and landscape preferences. As it appears, the research in the field is rapidly growing. In our opinion, it can be greatly advanced and enriched using integrative, interdisciplinary approaches in order to better understand the concepts and the mechanisms by which the visual landscape, as a complex set of stimuli, influences visual perception, potentially leading to more elaborate outcomes such as the anticipation of landscape preferences. As an effect, such approaches can support a rigorous, evidence-based, and socially just framework towards landscape management, protection, and decision making, based on a wide spectrum of well-suited and advanced sensor-based technologies.

You can touch this! Brain correlates of aesthetic processing of active fingertip exploration of material surfaces

The haptic exploration and aesthetic processing of all kinds of materials' surfaces are part of everyday life. In the present study, functional near-infrared spectroscopy (fNIRS) was used to investigate the brain correlates of active fingertip exploration of material surfaces and subsequent aesthetic judgments of their pleasantness (feels good or bad?). In absence of other sensory modalities, individuals (n = 21) performed lateral movements on a total of 48 textile and wood surfaces varying in terms of their roughness. Behavioral results confirmed the influence of the stimuli's roughness on aesthetic judgments, with smoother textures being rated as feeling better than rough textures. At the neural level, fNIRS activation results revealed an overall increased engagement of the contralateral sensorimotor areas as well as left prefrontal areas. Moreover, the perceived pleasantness modulated specific activations of left prefrontal areas with increasing pleasantness showing greater activations of these regions. Interestingly, this positive relationship between the individual aesthetic judgments and brain activity was most pronounced for smooth woods. These results demonstrate that positively valenced touch by actively exploring material surfaces is linked to left prefrontal activity and extend previous findings of affective touch underlying passive movements on hairy skin. We suggest that fNIRS can be a valuable tool to provide new insights in the field of experimental aesthetics.

The intrinsic variance of beauty judgment

Recall memory and sequential dependence threaten the independence of successive beauty ratings. Such independence is usually assumed when using repeated measures to estimate the intrinsic variance of a rating. We call "intrinsic" the variance of all possible responses that the participant could give on a trial. Variance arises within and across participants. In attributing the measured variance to sources, the first step is to assess how much is intrinsic. In seven experiments, we measure how much of the variability across beauty ratings can be attributed to recall memory and sequential dependence. With a set size of one, memory is a problem and contributes half the measured variance. However, we showed that for both beauty and ellipticity, with set size of nine or more, recall memory causes a mere 10% increase in the variance of repeated ratings. Moreover, we showed that as long as the stimuli are diverse (i.e., represent different object categories), sequential dependence does not affect the variance of beauty ratings. Lastly, the variance of beauty ratings increases in proportion to the 0.15 power of stimulus set size. We show that the beauty rating of a stimulus in a diverse set is affected by the stimulus set size and not the value of other stimuli. Overall, we conclude that the variance of repeated ratings is a good way to estimate the intrinsic variance of a beauty rating of a stimulus in a diverse set.

Spectral brain signatures of aesthetic natural perception in the α and β frequency bands

During our everyday lives, visual beauty is often conveyed by sustained and dynamic visual stimulation, such as when we walk through an enchanting forest or watch our pets playing. Here, I devised an MEG experiment that mimics such situations: participants viewed 8 s videos of everyday situations and rated their beauty. Using multivariate analysis, I linked aesthetic ratings to 1) sustained MEG broadband responses and 2) spectral MEG responses in the α and β frequency bands. These effects were not accounted for by a set of high- and low-level visual descriptors of the videos, suggesting that they are genuinely related to aesthetic perception. My findings provide the first characterization of spectral brain signatures linked to aesthetic experiences in the real world.NEW & NOTEWORTHY In the real world, aesthetic experiences arise from complex and dynamic inputs. This study shows that such aesthetic experiences are represented in a spectral neural code: cortical α and β activity track our judgments of the aesthetic appearance of natural videos, providing a new starting point for studying the neural correlates of beauty through rhythmic brain activity.

Characterizing Dynamic Neural Representations of Scene Attractiveness

Aesthetic experiences during natural vision are varied: They can arise from viewing scenic landscapes, interesting architecture, or attractive people. Recent research in the field of neuroaesthetics has taught us a lot about where in the brain such aesthetic experiences are represented. Much less is known about when such experiences arise during the cortical processing cascade. Particularly, the dynamic neural representation of perceived attractiveness for rich natural scenes is not well understood. Here, I present data from an EEG experiment, in which participants provided attractiveness judgments for a set of diverse natural scenes. Using multivariate pattern analysis, I demonstrate that scene attractiveness is mirrored in early brain signals that arise within 200 msec of vision, suggesting that the aesthetic appeal of scenes is first resolved during perceptual processing. In more detailed analyses, I show that even such early neural correlates of scene attractiveness are partly related to interindividual variation in aesthetic preferences and that they generalize across scene contents. Together, these results characterize the time-resolved neural dynamics that give rise to aesthetic experiences in complex natural environments.

Watching Nature Videos Promotes Physiological Restoration: Evidence From the Modulation of Alpha Waves in Electroencephalography

Various lines of evidence have shown that nature exposure is beneficial for humans. Despite several empirical findings pointing out to cognitive and emotional positive effects, most of the evidence of these effects are correlational, and it has been challenging to identify a cause-effect relationship between nature exposure and cognitive and emotional benefits. Only few of the published studies use psychophysiological methods to assess the biological correlates of these positive effects. Establishing a connection between human physiology and contact with natural settings is important for identifying cause-effect relationships between exposure to natural environments and the positive effects commonly reported in connection to nature exposure. In the present study, we recorded physiological indexes of brain activity (electroencephalography) and sympathetic nervous system (electrodermal activity), while the participants were presented with a series of videos displaying natural, urban, or neutral (non-environmental, computerized) scenes. Participants rated the scenes for their perceived relaxing value, and after each experimental condition, they performed a cognitive task (digit span backward). Participants rated natural videos as the most relaxing. Spectral analyses of EEG showed that natural scenes promoted alpha waves, especially over the central brain. The results suggest that experiencing natural environments virtually produces measurable and reliable brain activity markers which are known to be related to restorative processes.

Pleistocene Hypothesis - Moving Savanna Perceptual Preference Hypothesis Beyond Savanna

We provide an extension of the Savanna perceptual preference hypothesis ("Savanna Hypothesis"), supposing that interaction with landscapes offering survival advantage for human groups during evolution might have gradually evolved to permanent landscape preferences. This additional support is based on the palaeoenvironmental analysis of the spread of modern humans into Europe in the late Pleistocene and their living environments there. Our hypothesis is that the preference for park-like landscapes after African savannas experienced a kind of "refreshment" in the Pleistocene. Thus, preferences for certain types of natural settings and scenes may have a more continuous evolutionary history than previously thought. The extended Savanna Hypothesis termed "Pleistocene Hypothesis" might stimulate further work on this important topic linking human evolution and human environmental preferences.

Exploring the Integration Between Colour Theory and Biodiversity Values in the Design of Living Walls

Designing green infrastructure in cities requires vegetation that has multiple outcomes and functions, particularly using plants that have both attractive visual or aesthetic features and high biodiversity values. Plantings that have high visual appeal are more highly valued by people and increase their feeling of wellbeing. Increasing biodiversity in cities is one of the major challenges facing urban planning and design. However, balancing biodiversity and aesthetic outcomes in urban planting design is complex, and to date there are few methods that can be used to guide plant selection. To address this knowledge gap, we investigated the use of a colour theory framework for planting arrangements to see if we could design vegetation that is highly aesthetic and has high biodiversity. We did this by configuring planting combinations for living walls in Malmö, Sweden, using principles based on Johannes Itten’s colour theories. The plant combinations on each wall were graphically arranged using (1) colour analysis of each plant and (2) design of the plant species into two colour schemes: light-dark colour concept and a complementary colour concept. For each species used in the compositions we created a biodiversity classification, based on its pollination value, “nativeness” and conservation value as a cultivar; and a plant visual quality classification, based on the performance from living walls studies. The graphical colour composition and interlinked biodiversity value were then compared to designs created with randomly selected plant species. The results showed that it is possible to design a living wall based on colour theory without compromising with biodiversity outcomes, namely species richness, pollination and the nativeness of the species. The results also indicate the potential application of this design approach to deliver greater aesthetic appreciation and enjoyment from plantings. While more work is needed, this study has shown that a theoretical colour framework can be a useful tool in designing green infrastructure to improve delivery of both cultural and regulatory ecosystem services.

Naturalistic viewing conditions can increase task engagement and aesthetic preference but have only minimal impact on EEG quality

Free gaze and moving images are typically avoided in EEG experiments due to the expected generation of artifacts and noise. Yet for a growing number of research questions, loosening these rigorous restrictions would be beneficial. Among these is research on visual aesthetic experiences, which often involve open-ended exploration of highly variable stimuli. Here we systematically compare the effect of conservative vs. more liberal experimental settings on various measures of behavior, brain activity and physiology in an aesthetic rating task. Our primary aim was to assess EEG signal quality. 43 participants either maintained fixation or were allowed to gaze freely, and viewed either static images or dynamic (video) stimuli consisting of dance performances or nature scenes. A passive auditory background task (auditory steady-state response; ASSR) was added as a proxy measure for overall EEG recording quality. We recorded EEG, ECG and eyetracking data, and participants rated their aesthetic preference and state of boredom on each trial. Whereas both behavioral ratings and gaze behavior were affected by task and stimulus manipulations, EEG SNR was barely affected and generally robust across all conditions, despite only minimal preprocessing and no trial rejection. In particular, we show that using video stimuli does not necessarily result in lower EEG quality and can, on the contrary, significantly reduce eye movements while increasing both the participants' aesthetic response and general task engagement. We see these as encouraging results indicating that - at least in the lab - more liberal experimental conditions can be adopted without significant loss of signal quality.

The evolutionary circular and human centered city: Towards an ecological and humanistic “re-generation” of the current city governance

BACKGROUND: Local governments are fundamental for achieving the ecological transition of our societies/cities. Also COVID-19 has shown that many of the barriers and bottlenecks in implementing public top-down initiatives are not technical (financial, economic, administrative, etc.) but cultural. They generate a lack of consensus with the risks of reducing the effectiveness of public interventions and investments. OBJECTIVE: The paper proposes the profile of a “circular governance” (i.e. that assumes the model of the circular economy) that is also “human centered”, capable of reducing inequalities, enhancing the processes of real participation in the construction of a desirable future for cities, through its capacity to regenerate material and no-material components/values. This perspective intersects with the cultural/educational dimension to which the new governance should devote much greater attention. CONCLUSION: A critical test is the transformation of abandoned urban spaces into attractive places for activities, investments and people. These disused spaces, which have often become repulsive waste deposits, are especially abundant in port cities. They are most often included in areas of particularly high landscape and cultural value. The paper suggests the elaboration of prototypes of “circular heritage symbiotic ecosystems” that are able to respect some general conditions (or principles). Suitable and effective assessment tools must be available to public, private and social actors to verify the proposal consistency and then to build new win-win-win partnerships. But it is also necessary to strengthen the educational perspective in the activities of the new governance, because preferences, values and needs should not be considered as already “given”, but should be constructed, thus nourishing the critical spirit of citizens so that they can creatively combine private interests and common good, thus becoming “artist of citizenship/civic engagement”.