Inferring Master Painters' Esthetic Biases from the Statistics of Portraits

Social groups and polarization of aesthetic values from symmetry and complexity

When deciding what images we prefer, our brain must weigh many aesthetic variables, such as symmetry and complexity. To date, aesthetic research has mainly focused on investigating one variable at a time. In this article, we use symmetry and complexity to study the problem of multi aesthetic-variable interactions. For symmetry and complexity, there are two simple interaction hypotheses. The independence hypothesis proposes that the evaluation of aesthetic variables is mutually independent. Meanwhile, Birkhoff's aesthetic-measure hypothesis predicts that people prefer images high in symmetry and low in complexity, and dislike the opposite. To test these hypotheses, we generated images that systematically varied in levels of symmetry and complexity. We then compared the subjects' preference maps to identify regions of likes and dislikes. Unlike the predictions from these hypotheses, we found that most, but not all subjects, formed two distinct natural clusters, termed "islands," in terms of likes and dislikes. We also found that people with more art exposure were less likely to belong to an island. If someone did belong to an island, their gender influenced which cluster they belonged to. We discuss alternate hypotheses, possible mechanisms for the occurrence of islands, and their possible social implications.

Predicting the aesthetics of dynamic generative artwork based on statistical image features: A time-dependent model

Several automated aesthetic assessment models were developed to assist artists in producing artwork with high aesthetic appeal. However, most of them focused on static visual art, such as photographs and paintings, and evaluations of dynamic art received less attention. Dynamic visual art, especially computer-based art, includes diverse forms of artistic expression and can enhance an audience's aesthetic experience. A model for evaluating dynamic visual art can provide valuable feedback and guidance for improving artistic skills and creativity, thereby benefiting audiences. In this study, we created eight generative artworks with dynamic art forms based on a commonly used method. We established a time-dependent model to predict the aesthetics based on visual features. We quantified the artworks according to selected image features and found that these features could effectively capture the characteristics of the changing visual forms during the generation process. To explore the effects of time-varying features on aesthetic appeal, we built a panel regression model and found that the aesthetic appeal of the generated artworks was significantly affected by their skewness of the luminance distribution, vertical symmetry, and mean hue value. Furthermore, our study demonstrated that the aesthetic appeal of dynamic generative artworks could be predicted by integrating image features into the temporal domain.

Systematic errors in the perception of rhythm

One hypothesis for why humans enjoy musical rhythms relates to their prediction of when each beat should occur. The ability to predict the timing of an event is important from an evolutionary perspective. Therefore, our brains have evolved internal mechanisms for processing the progression of time. However, due to inherent noise in neural signals, this prediction is not always accurate. Theoretical considerations of optimal estimates suggest the occurrence of certain systematic errors made by the brain when estimating the timing of beats in rhythms. Here, we tested psychophysically whether these systematic errors exist and if so, how they depend on stimulus parameters. Our experimental data revealed two main types of systematic errors. First, observers perceived the time of the last beat of a rhythmic pattern as happening earlier than actual when the inter-beat interval was short. Second, the perceived time of the last beat was later than the actual when the inter-beat interval was long. The magnitude of these systematic errors fell as the number of beats increased. However, with many beats, the errors due to long inter-beat intervals became more apparent. We propose a Bayesian model for these systematic errors. The model fits these data well, allowing us to offer possible explanations for how these errors occurred. For instance, neural processes possibly contributing to the errors include noisy and temporally asymmetric impulse responses, priors preferring certain time intervals, and better-early-than-late loss functions. We finish this article with brief discussions of both the implications of systematic errors for the appreciation of rhythm and the possible compensation by the brain’s motor system during a musical performance.

Does Amount of Information Support Aesthetic Values?

Obtaining information from the world is important for survival. The brain, therefore, has special mechanisms to extract as much information as possible from sensory stimuli. Hence, given its importance, the amount of available information may underlie aesthetic values. Such information-based aesthetic values would be significant because they would compete with others to drive decision-making. In this article, we ask, "What is the evidence that amount of information support aesthetic values?" An important concept in the measurement of informational volume is entropy. Research on aesthetic values has thus used Shannon entropy to evaluate the contribution of quantity of information. We review here the concepts of information and aesthetic values, and research on the visual and auditory systems to probe whether the brain uses entropy or other relevant measures, specially, Fisher information, in aesthetic decisions. We conclude that information measures contribute to these decisions in two ways: first, the absolute quantity of information can modulate aesthetic preferences for certain sensory patterns. However, the preference for volume of information is highly individualized, with information-measures competing with organizing principles, such as rhythm and symmetry. In addition, people tend to be resistant to too much entropy, but not necessarily, high amounts of Fisher information. We show that this resistance may stem in part from the distribution of amount of information in natural sensory stimuli. Second, the measurement of entropic-like quantities over time reveal that they can modulate aesthetic decisions by varying degrees of surprise given temporally integrated expectations. We propose that amount of information underpins complex aesthetic values, possibly informing the brain on the allocation of resources or the situational appropriateness of some cognitive models.

A Forward Bias in Human Profile-Oriented Portraits

The spatial composition of human portraits obeys historically changing cultural norms. We show that it is also affected by cognitive factors that cause greater spontaneous attention to what is in front rather in the back of an agent. Scenes with more space in front of a directed object are both more often produced and judged as more aesthetically pleasant. This leads to the prediction that, in profile-oriented human portraits, compositions with more space in front of depicted agents (a "forward bias") should be over-represented. By analyzing a large dataset (total N of 1,831 paintings by 582 unique identified European painters from the 15th to the 20th century), we found evidence of this forward bias: Painters tended to put more free space in front of, rather than behind, the sitters. Additionally, we found evidence that this forward bias became stronger when cultural norms of spatial composition favoring centering became less stringent.

Stochasticity, Nonlinear Value Functions, and Update Rules in Learning Aesthetic Biases

A theoretical framework for the reinforcement learning of aesthetic biases was recently proposed based on brain circuitries revealed by neuroimaging. A model grounded on that framework accounted for interesting features of human aesthetic biases. These features included individuality, cultural predispositions, stochastic dynamics of learning and aesthetic biases, and the peak-shift effect. However, despite the success in explaining these features, a potential weakness was the linearity of the value function used to predict reward. This linearity meant that the learning process employed a value function that assumed a linear relationship between reward and sensory stimuli. Linearity is common in reinforcement learning in neuroscience. However, linearity can be problematic because neural mechanisms and the dependence of reward on sensory stimuli were typically nonlinear. Here, we analyze the learning performance with models including optimal nonlinear value functions. We also compare updating the free parameters of the value functions with the delta rule, which neuroscience models use frequently, vs. updating with a new Phi rule that considers the structure of the nonlinearities. Our computer simulations showed that optimal nonlinear value functions resulted in improvements of learning errors when the reward models were nonlinear. Similarly, the new Phi rule led to improvements in these errors. These improvements were accompanied by the straightening of the trajectories of the vector of free parameters in its phase space. This straightening meant that the process became more efficient in learning the prediction of reward. Surprisingly, however, this improved efficiency had a complex relationship with the rate of learning. Finally, the stochasticity arising from the probabilistic sampling of sensory stimuli, rewards, and motivations helped the learning process narrow the range of free parameters to nearly optimal outcomes. Therefore, we suggest that value functions and update rules optimized for social and ecological constraints are ideal for learning aesthetic biases.

A Theoretical Framework for How We Learn Aesthetic Values

How do we come to like the things that we do? Each one of us starts from a relatively similar state at birth, yet we end up with vastly different sets of aesthetic preferences. These preferences go on to define us both as individuals and as members of our cultures. Therefore, it is important to understand how aesthetic preferences form over our lifetimes. This poses a challenging problem: to understand this process, one must account for the many factors at play in the formation of aesthetic values and how these factors influence each other over time. A general framework based on basic neuroscientific principles that can also account for this process is needed. Here, we present such a framework and illustrate it through a model that accounts for the trajectories of aesthetic values over time. Our framework is inspired by meta-analytic data of neuroimaging studies of aesthetic appraisal. This framework incorporates effects of sensory inputs, rewards, and motivational states. Crucially, each one of these effects is probabilistic. We model their interactions under a reinforcement-learning circuitry. Simulations of this model and mathematical analysis of the framework lead to three main findings. First, different people may develop distinct weighing of aesthetic variables because of individual variability in motivation. Second, individuals from different cultures and environments may develop different aesthetic values because of unique sensory inputs and social rewards. Third, because learning is stochastic, stemming from probabilistic sensory inputs, motivations, and rewards, aesthetic values vary in time. These three theoretical findings account for different lines of empirical research. Through our study, we hope to provide a general and unifying framework for understanding the various aspects involved in the formation of aesthetic values over time.

Evolution of Neuroaesthetic Variables in Portrait Paintings throughout the Renaissance

To compose art, artists rely on a set of sensory evaluations performed fluently by the brain. The outcome of these evaluations, which we call neuroaesthetic variables, helps to compose art with high aesthetic value. In this study, we probed whether these variables varied across art periods despite relatively unvaried neural function. We measured several neuroaesthetic variables in portrait paintings from the Early and High Renaissance, and from Mannerism. The variables included symmetry, balance, and contrast (chiaroscuro), as well as intensity and spatial complexities measured by two forms of normalized entropy. The results showed that the degree of symmetry remained relatively constant during the Renaissance. However, the balance of portraits decayed abruptly at the end of the Early Renaissance, that is, at the closing of the 15th century. Intensity and spatial complexities, and thus entropies, of portraits also fell in such manner around the same time. Our data also showed that the decline of complexity and entropy could be attributed to the rise of chiaroscuro. With few exceptions, the values of aesthetic variables from the top of artists of the Renaissance resembled those of their peers. We conclude that neuroaesthetic variables have flexibility to change in brains of artists (and observers).

Instagram Likes for Architectural Photos Can Be Predicted by Quantitative Balance Measures and Curvature

“3,058 people like this.” In the digital age, people very commonly indicate their preferences by clicking a Like button. The data generated on the photo-sharing platform Instagram potentially represents a vast, freely accessible resource for research in the field of visual experimental aesthetics. Therefore, we compiled a photo database using images of five different Instagram accounts that fullfil several criteria (e.g., large followership, consistent content). The final database consists of about 700 architectural photographs with the corresponding liking data generated by the Instagram community. First, we aimed at validating Instagram Likes as a potential measure of aesthetic appeal. Second, we checked whether previously studied low-level features of “good” image composition also account for the number of Instagram Likes that architectural photographs received. We considered two measures of visual balance and the preference for curvature over angularity. In addition, differences between images with “2D” vs. “3D” appearance became obvious. Our findings show that visual balance predicts Instagram Likes in more complex “3D” photographs, with more balance meaning more Likes. In the less complex “2D” photographs the relation is reversed, more balance led to fewer Likes. Moreover, there was a general preference for curvature in the Instagram database. Together, our study illustrates the potential of using Instagram Likes as a measure of aesthetic appeal and provides a fruitful methodological basis for future research.

A Statistical Analysis of the Relationship between Harmonic Surprise and Preference in Popular Music

Studies have shown that some musical pieces may preferentially activate reward centers in the brain. Less is known, however, about the structural aspects of music that are associated with this activation. Based on the music cognition literature, we propose two hypotheses for why some musical pieces are preferred over others. The first, the Absolute-Surprise Hypothesis, states that unexpected events in music directly lead to pleasure. The second, the Contrastive-Surprise Hypothesis, proposes that the juxtaposition of unexpected events and subsequent expected events leads to an overall rewarding response. We tested these hypotheses within the framework of information theory, using the measure of "surprise." This information-theoretic variable mathematically describes how improbable an event is given a known distribution. We performed a statistical investigation of surprise in the harmonic structure of songs within a representative corpus of Western popular music, namely, the McGill Billboard Project corpus. We found that chords of songs in the top quartile of the Billboard chart showed greater average surprise than those in the bottom quartile. We also found that the different sections within top-quartile songs varied more in their average surprise than the sections within bottom-quartile songs. The results of this study are consistent with both the Absolute- and Contrastive-Surprise Hypotheses. Although these hypotheses seem contradictory to one another, we cannot yet discard the possibility that both absolute and contrastive types of surprise play roles in the enjoyment of popular music. We call this possibility the Hybrid-Surprise Hypothesis. The results of this statistical investigation have implications for both music cognition and the human neural mechanisms of esthetic judgments.