Task-Dependent Eye-Movement Patterns in Viewing Art

Effectiveness of labels in digital art experience: psychophysiological and behavioral evidence

Introduction

Nowadays museums make large use of digital materials (e.g., virtual tours) to attract visitors. Therefore, it is worthwhile investigating which variables affect the engagement with art outside the museum, and whether digital reproductions of artworks are as effective as museum originals in producing a satisfying aesthetic experience.

Methods

Here we tested the effectiveness of introducing additional informative materials on the artistic enjoyment of contemporary paintings presented on a computer screen. Naïve observers were exposed to essential and descriptive labels before viewing artworks. We flanked traditional measurement methods - viewing times and questionnaires, with biometric parameters - pupil responses, eye movements, heart rate, and electrodermal activity. The results were then compared to our previous museum study that adopted the same experimental paradigm.

Results

Our behavioral and psychophysiological data lead to a complex pattern of results. As found in the museum setting, providing detailed descriptions decreases complexity, evokes more positive sensations, and induces pupil dilation but does not enhance aesthetic appreciation. These results suggested that informative labels improve understanding and emotions but have a limited impact on the hedonic evaluation of artworks in both contexts. However, other results do not mirror those found in the museum; in the laboratory setting, participants spend a similar amount of time, have a comparable gaze behavior, and their electrodermal activity and heart rate do not change when viewing artworks with different types of labels. The main difference between the lab and museum settings is the shorter time spent viewing digital reproductions vs. real paintings, although subjective ratings (e.g., liking, interest) are comparable.

Discussion

Overall, this study indicates that the environmental context does impact the aesthetic experience; although, some beneficial effects of introducing additional relevant content in labels accompanying artworks can also be acquainted through digital media outside of the museum.

The Effect of Prior Viewing Position and Spatial Scale on the Viewing of Paintings

The visual inspection of scenes is disrupted when participants are forced to begin inspection away from the centre of an image. The present study explored the effect of the starting point on the visual inspection of paintings. Eye movements were recorded while participants viewed paintings for later identification in a yes/no discrimination task. The viewing of each painting was preceded by the presentation of a pseudo-randomly positioned Navon figure. Participants were instructed using a cue to attend to either the local or global level of the Navon figure. Each painting was split into regions of interest (ROIs) defined by face, theme, and context to allow the analysis of eye movements. These data were directly compared with a subset of those initially reported in our previous study in which the same experiment was run but without the inclusion of the Navon figure. The inclusion of the Navon task lowered the discrimination accuracy in the yes/no discrimination task. More importantly, eye movements to the paintings were disrupted across the entire period over which they were viewed and not just in the period following the offset of the Navon figure. The results show the sensitivity of eye movements to the conditions present at the beginning of viewing. The results have implications for the viewing of paintings (and other images) in the real world, where the starting conditions for inspection cannot be controlled.

Eye Tracking and Visual Arts. Introduction to the Special Thematic Issue

There is no visual art without the eye, just like no music without the ear. Visual art does not happen in the eye, but it has to go through the eye. Even for artworks with little visual focus, as in Conceptual Art, we need eyes to create and receive them. In order to see we need to move our eyes. It is therefore not surprising that, for centuries, the eye and its movements have been a major topic of literature on art. It is equally unsurprising that along recent technological improvements of eye tracking, this technology has become prolific for studying visual arts. This special issue of the Journal of Eye Movement Research is the first platform that provides a broad picture of recent developments in this area. In this introduction we present a history of eye movement in art literature, followed by a sketch of some of the oculometric parameters used for studies of visual art. In the third section we showcase each contribution to this special issue.

Titles and Semantic Violations Affect Eye Movements When Viewing Contemporary Paintings

The role of titles in perception of visual art is a topic of interesting discussions that brings together artists, curators, and researchers. Titles provide contextual cues and guide perception. They can be particularly useful when paintings include semantic violations that make them challenging for viewers, especially viewers lacking expert knowledge. The aim of this study is to investigate the effects of titles and semantic violations on eye movements. A total of 127 participants without expertise in visual art viewed 40 paintings with and without semantic violations (20 each) in one of three conditions: untitled, consistent titles and inconsistent titles. After each painting was viewed participants also rated liking and understanding. Our results suggest that titles affect the way paintings are viewed: both titled conditions were associated with shorter first fixation duration, longer saccade durations, and amplitudes and higher dynamic entropy than the untitled conditions. Titles were fixated on more frequently (but only in the time window between 1,200 and 2,800 ms) when presented alongside paintings with semantic violations than paintings without violations, and the percentage of fixations to titles was particularly high in the case of paintings with double inconsistencies (inconsistent titles and semantic violations). Also, we found that semantic violations attracted attention early on (300–900 ms), whereas titles received attention later (average first fixation on title was at 936.28 ms) and inconsistencies in titles were processed even later (after 4,000 ms). Finally, semantic violations were associated with higher dynamic entropy than paintings without violations. Our results demonstrate the importance of titles for processing of artworks, especially artworks that present a challenge for the viewers.