ANS responses and facial expressions differentiate between the taste of commercial breakfast drinks

The relationship between charitable giving and emotional facial expressions: Results from affective computing

This study investigated the relationship between emotional states (valence, arousal, and six basic emotions) and donation size in pet charities, and it compared the effectiveness of affective computing and emotion self-report methods in assessing attractiveness. Using FaceReader software and self-report, we measured the emotional states of participants (N = 45) during the donation task. The results showed that sadness, happiness, and anger were significantly related to donation size. Sadness and anger increased donations, whereas happiness decreased them. Arousal was not significantly correlated with the willingness to donate. These results are supported by both methods, whereas the self-reported data regarding the association of surprise, fear, and disgust with donation size are inconclusive. Thus, unpleasant emotions increase donation size, and combining affective computing with self-reported data improves the prediction of the effectiveness of a charity appeal. This study contributes to the understanding of the relationship between emotions and charitable behavior toward pet charities and evaluates the effectiveness of marketing mix elements using affective computing. The limitations include the laboratory setting for this experiment and the lack of measurement of prolonged and repeated exposure to unpleasant charity appeals.

Predicting Perceived Hedonic Ratings through Facial Expressions of Different Drinks

Previous studies have established the utility of facial expressions as an objective assessment approach for determining the hedonics (overall pleasure) of food and beverages. This study endeavors to validate the conclusions drawn from preceding research, illustrating that facial expressions prompted by tastants possess the capacity to forecast the perceived hedonic ratings of these tastants. Facial expressions of 29 female participants, aged 18-55 years, were captured using a digital camera during their consumption of diverse concentrations of solutions representative of five basic tastes. Employing the widely employed facial expression analysis application FaceReader, the facial expressions were meticulously assessed, identifying seven emotions (surprise, happiness, scare, neutral, disgust, sadness, and anger) characterized by scores ranging from 0 to 1-a numerical manifestation of emotional intensity. Simultaneously, participants rated the hedonics of each solution, utilizing a scale spanning from -5 (extremely unpleasant) to +5 (extremely pleasant). Employing a multiple linear regression analysis, a predictive model for perceived hedonic ratings was devised. The model's efficacy was scrutinized by assessing emotion scores from 11 additional taste solutions, sampled from 20 other participants. The anticipated hedonic ratings demonstrated robust alignment and agreement with the observed ratings, underpinning the validity of earlier findings even when incorporating diverse software and taste stimuli across a varied participant base. We discuss some limitations and practical implications of our technique in predicting food and beverage hedonics using facial expressions.

Reactivity to food cues in spicy food cravers: Physiological and behavioral responses

In China, the rate of spicy food consumption is rising, and chili pepper is among the most popular spicy foods consumed nationwide. According to the 'cued overeating' model, visual and olfactory cues of food can lead to changes in physiological responses and increase the likelihood and amount of food intake. However, no studies have explored the role of spicy food cues in cue reactivity among spicy food cravers. The exploratory study aimed to investigate cue-induced physiological responses, subjective cravings, eating behaviors and their associations in spicy food cravers. A group of spicy cravers (n = 59) and a group of age- and sex-matched non-cravers (n = 60) were exposed to food cues that contained or did not contain chili, during which physiological responses and food consumption were measured. The results revealed that spicy food cravers showed increased salivation and heart rate in response to food cues that contained chili compared to cues without chili and consumed significantly more chili oil after chili exposure. For cravers, heart rate during chili exposure was positively correlated with changes in subjective spicy food craving, and increases in subjective spicy food craving during chili exposure positively predicted subsequent chili oil consumption. The current exploratory study confirms the 'cued overeating' model and extends previous findings on food cravings, showing that even though chili peppers can elicit aversive oral burns and pain, they share the same physiological mechanism underlying cue reactivity as other kinds of cravings.

Children's physiological and behavioural response evoked by the observation, olfaction, manipulation, and consumption of food textures. Part 1: Liquid products

Children are thought to prefer homogeneous and simple textures that are easy to manipulate in the mouth. Although scientific research has been done on children's acceptance for food textures, there is a lack of knowledge regarding the emotional response elicited by textures in this group of population. Physiological and behavioural methods could be an appropriate approach to measure food-evoked emotions in children since they require a low cognitive effort and allow a real-time measure. In this regard, a study that combined the measure of skin conductance response (SCR) and facial expressions was conducted: (i) to provide a first insight into food-evoked emotions induced by liquid food products that only vary in texture, (ii) to capture the emotional response evoked by the observation, olfaction, manipulation, and consumption of the products, and (iii) to overcome methodological drawbacks that are frequently associated to these methods. To achieve these goals, 50 children (5-12 yrs old) evaluated three liquids designed to only vary in texture (from slightly thick to extremely thick), following four sensory tasks: observation, olfaction, manipulation, and consumption. After each sample was tasted, children rated liking with a 7-pt hedonic scale. Facial expressions and SCR were monitored during the test, and they were analysed as action units (AUs) and basic emotions as well as changes in SCR. Results showed that the extremely thick liquid was less liked by the children and induced a more negative emotional response, whereas the slightly thick liquid was more liked and evoked a more positive emotional response. The combined method used in this study showed good discrimination ability among the three samples tested, obtaining the best discrimination during the manipulation task. The codification of the AUs located in the upper side of the face allowed us to measure the emotional response evoked by the consumption of the liquids, without the artifacts caused by the oral processing of the products. This study provides a child-friendly approach to be used during the sensory evaluation of food products in a broad range of sensory tasks minimising the methodological drawbacks.

Subjective-Physiological Coherence during Food Consumption in Older Adults

BACKGROUND

Subjective-physiological emotional coherence is thought to be associated with enhanced well-being, and a relationship between subjective-physiological emotional coherence and superior nutritional status has been suggested in older populations. However, no study has examined subjective-physiological emotional coherence among older adults while tasting food. Accordingly, the present study compared subjective-physiological emotional coherence during food consumption among older and younger adults.

METHODS

Participants consumed bite-sized gel-type foods with different flavors and provided their subjective ratings of the foods while their physiological responses (facial electromyography (EMG) of the corrugator supercilia, masseter, and suprahyoid, and other autonomic nervous system signals) were simultaneously measured.

RESULTS

Our primary findings were that (1) the ratings of liking, wanting, and valence were negatively correlated with corrugator EMG activity in older and young adult participants; (2) the positive association between masseter EMG activity and ratings of wanting/valence was weaker in the older than in the young adult group; and (3) arousal ratings were negatively correlated with corrugator EMG activity in the older group only.

CONCLUSIONS

These results demonstrate commonalities and differences in subjective-physiological emotional coherence during food intake between older and young adults.

Digital technologies to assess yoghurt quality traits and consumers acceptability

BACKGROUND

Sensory biometrics provide advantages for consumer tasting by quantifying physiological changes and the emotional response from participants, removing variability associated with self-reported responses. The present study aimed to measure consumers' emotional and physiological responses towards different commercial yoghurts, including dairy and plant-based yoghurts. The physiochemical properties of these products were also measured and linked with consumer responses.

RESULTS

Six samples (Control, Coconut, Soy, Berry, Cookies and Drinkable) were evaluated for overall liking by n = 62 consumers using a nine-point hedonic scale. Videos from participants were recorded using the Bio-Sensory application during tasting to assess emotions and heart rate. Physicochemical parameters Brix, pH, density, color (L, a and b), firmness and near-infrared (NIR) spectroscopy were also measured. Principal component analysis and a correlation matrix were used to assess relationships between the measured parameters. Heart rate was positively related to firmness, yaw head movement and overall liking, which were further associated with the Cookies sample. Two machine learning regression models were developed using (i) NIR absorbance values as inputs to predict the physicochemical parameters (Model 1) and (ii) the outputs from Model 1 as inputs to predict consumers overall liking (Model 2). Both models presented very high accuracy (Model 1: R = 0.98; Model 2: R = 0.99).

CONCLUSION

The presented methods were shown to be highly accurate and reliable with respect to their potential use by the industry to assess yoghurt quality traits and acceptability. © 2022 The Authors. Journal of The Science of Food and Agriculture published by John Wiley & Sons Ltd on behalf of Society of Chemical Industry.

Emotional responses to taste and smell stimuli: Self-reports, physiological measures, and a potential role for individual and genetic factors

Taste and olfaction elicit conscious feelings by direct connection with the neural circuits of emotions that affects physiological responses in the body (e.g., heart rate and skin conductance). While sensory attributes are strong determinants of food liking, other factors such as emotional reactions to foods may be better predictors of consumer choices even for products that are equally-liked. Thus, important insights can be gained for understanding the full spectrum of emotional reactions to foods that inform the activities of product developers and marketers, eating psychologist and nutritionists, and policy makers. Today, self-reported questionnaires and physiological measures are the most common tools applied to study variations in emotional perception. The present review discusses these methodological approaches, underlining their different strengths and weaknesses. We also discuss a small, emerging literature suggesting that individual differences and genetic variations in taste and smell perception, like the genetic ability to perceive the bitter compound PROP, may also play a role in emotional reactions to aromas and foods.

A preliminary study on the impact of contextual information regarding the origin of food on consumers’ judgments and skin conductance responses

Explicit and implicit responses to food and beverage are known to be modulated by expectations generated by contextual factors. Among these, labelling regarding the country of origin has been systematically shown to impact on consumers' evaluations of products. However, it is not clear yet whether the presence of food origin biases also affects humans’ physiological (i.e., implicit) responses, as well as whether different conditions of sensory appreciation of products are equally influenced. The present preliminary study investigated the psychophysiological responses to food samples paired to labels of declared (i.e., Italy, Spain/Germany, EU) or undeclared origins. Food items (i.e., olives and cracker) were presented in visual or taste conditions to thirty Italian participants, whose behavioral (i.e., liking, willingness to buy, and estimated cost) and physiological (i.e., skin conductance responses) responses were collected. The results indicated that the food samples elicited stronger liking and willingness to buy responses by participants and were estimated as more expensive, when being firstly experienced through vision than taste. No differences in the physiological arousal state were found as a function of food origin or sensory condition of presentation.

•

Explicit choices related to food are modulated by expectation generated by contextual factors.

•

Labelling regarding the country-of-origin impacts the consumer evaluations of products.

•

The study investigated the behavioral and psychophysiological responses to food products comparing different labelling.

•

Food items were presented in visual or taste conditions.

•

The sensory modalities and the labeling information affect the behavioral choice (but not the physiological response).

Reading Food Experiences from the Face: Effects of Familiarity and Branding of Soy Sauce on Facial Expressions and Video-Based RPPG Heart Rate

Food experiences are not only driven by the food's intrinsic properties, such as its taste, texture, and aroma, but also by extrinsic properties such as visual brand information and the consumers' previous experiences with the foods. Recent developments in automated facial expression analysis and heart rate detection based on skin color changes (remote photoplethysmography or RPPG) allow for the monitoring of food experiences based on video images of the face. RPPG offers the possibility of large-scale non-laboratory and web-based testing of food products. In this study, results from the video-based analysis were compared to the more conventional tests (scores of valence and arousal using Emojis and photoplethysmography heart rate (PPG)). Forty participants with varying degrees of familiarity with soy sauce were presented with samples of rice and three commercial soy sauces with and without brand information. The results showed that (1) liking and arousal were affected primarily by the specific tastes, but not by branding and familiarity. In contrast, facial expressions were affected by branding and familiarity, and to a lesser degree by specific tastes. (2) RPPG heart rate and PPG both showed effects of branding and familiarity. However, RPPG heart rate needs further development because it underestimated the heart rate compared to PPG and was less sensitive to changes over time and with activity (viewing of brand information and tasting). In conclusion, this study suggests that recording of facial expressions and heart rates may no longer be limited to laboratories but can be done remotely using video images, which offers opportunities for large-scale testing in consumer science.

Differences in Hedonic Responses, Facial Expressions and Self-Reported Emotions of Consumers Using Commercial Yogurts: A Cross-Cultural Study

Hedonic scale testing is a well-accepted methodology for assessing consumer perceptions but is compromised by variation in voluntary responses between cultures. Check-all-that-apply (CATA) methods using emotion terms or emojis and facial expression recognition (FER) are emerging as more powerful tools for consumer sensory testing as they may offer improved assessment of voluntary and involuntary responses, respectively. Therefore, this experiment compared traditional hedonic scale responses for overall liking to (1) CATA emotions, (2) CATA emojis and (3) FER. The experiment measured voluntary and involuntary responses from 62 participants of Asian (53%) versus Western (47%) origin, who consumed six divergent yogurt formulations (Greek, drinkable, soy, coconut, berry, cookies). The hedonic scales could discriminate between yogurt formulations but could not distinguish between responses across the cultural groups. Aversive responses to formulations were the easiest to characterize for all methods; the hedonic scale was the only method that could not characterize differences in cultural preferences, with CATA emojis displaying the highest level of discrimination. In conclusion, CATA methods, particularly the use of emojis, showed improved characterization of cross-cultural preferences of yogurt formulations compared to hedonic scales and FER.

Effect of Branding and Familiarity of Soy Sauces on Valence and Arousal as Determined by Facial Expressions, Physiological Measures, Emojis, and Ratings

Food experiences can be summarized along two main dimensions: valence and arousal, which can be measured explicitly with subjective ratings or implicitly with physiological and behavioral measures. Food experiences are not only driven by the food's intrinsic properties, such as its taste, texture, and aroma, but also by extrinsic properties such as brand information and the consumers' previous experiences with the foods. In this study, valence and arousal to intrinsic and extrinsic properties of soy sauce were measured in consumers that varied in their previous experience with soy sauce, using a combination of explicit (scores and emojis), implicit (heart rate and skin conductance), and behavioral measures (facial expressions). Forty participants, high- and low-frequency users, were presented with samples of rice and three commercial soy sauces without and with brand information that either matched or non-matched the taste of the soy sauce. In general, skin conductance and facial expressions showed relatively low arousal during exposure to the brand name and again lowest arousal during tasting. Heart rate was lowest during exposure to the brand name and increased during tasting probably resulting from the motor activity during chewing. Furthermore, the results showed that explicit liking and arousal scores were primarily affected by the taste of the specific soy sauce and by the participants' previous experience with soy sauces. These scores were not affected by branding information. In contrast, facial expressions, skin conductance, and heart rate were primarily affected by (1) the participants' level of experience with soy sauce, (2) whether or not branding information was provided, and (3) whether or not the branding information matched with the taste. In conclusion, this study suggests that liking scores may be most sensitive to the food's intrinsic taste properties, whereas implicit measures and facial expressions may be most sensitive to extrinsic properties such as brand information. All measures were affected by the consumers' previous food experiences.

The relationship between tendency to attend to detail, sensory sensitivity, and affective response to food cues - A registered report

Understanding the underlying drivers of food choice remains a challenge and has highlighted the need for measures that capture data over and above that offered by self-reporting tools. Consequently, a growing body of research has set out to interpret facial responses to food cues to offer a greater insight into the emotional responses that may drive food acceptance. However, interpreting facial responses is challenging, as there are numerous factors that may influence affective response to foods, including expectation, context, and individual differences. Existing findings suggest there is a link between autistic traits and sensory sensitivities; research highlights further links between sensory sensitivities and eating behaviour, and autistic traits and eating behaviour, with a body of research focusing on the autistic trait attention to detail (ATD). As such, the current study aimed to examine rapid facial activity in response to foods cues while capturing these individual differences present in the general population. This study found no evidence to suggest facial responses to food pictures were linked with attention to detail or hyper-sensitivity. The findings did support a general link between self-reported pleasantness ratings of viewed foods and activity of facial muscles. Post-hoc analyses suggested scoring on the social skills sub-scale of the Autism Quotient (AQ) was associated with levator activity while viewing pictures low in pleasantness. This study offers a greater understanding of variations, at the individual level, which are associated with affective response to foods, and may help to inform the development of tools that set out to predict food acceptance.

Analysis of facial expressions in response to basic taste stimuli using artificial intelligence to predict perceived hedonic ratings

Taste stimuli can induce a variety of physiological reactions depending on the quality and/or hedonics (overall pleasure) of tastants, for which objective methods have long been desired. In this study, we used artificial intelligence (AI) technology to analyze facial expressions with the aim of assessing its utility as an objective method for the evaluation of food and beverage hedonics compared with conventional subjective (perceived) evaluation methods. The face of each participant (10 females; age range, 21–22 years) was photographed using a smartphone camera a few seconds after drinking 10 different solutions containing five basic tastes with different hedonic tones. Each image was then uploaded to an AI application to achieve outcomes for eight emotions (surprise, happiness, fear, neutral, disgust, sadness, anger, and embarrassment), with scores ranging from 0 to 100. For perceived evaluations, each participant also rated the hedonics of each solution from –10 (extremely unpleasant) to +10 (extremely pleasant). Based on these, we then conducted a multiple linear regression analysis to obtain a formula to predict perceived hedonic ratings. The applicability of the formula was examined by combining the emotion scores with another 11 taste solutions obtained from another 12 participants of both genders (age range, 22–59 years). The predicted hedonic ratings showed good correlation and concordance with the perceived ratings. To our knowledge, this is the first study to demonstrate a model that enables the prediction of hedonic ratings based on emotional facial expressions to food and beverage stimuli.

Facial EMG Activity Is Associated with Hedonic Experiences but not Nutritional Values While Viewing Food Images

The physiological correlates of hedonic/emotional experiences to visual food stimuli are of theoretical and practical interest. Previous psychophysiological studies have shown that facial electromyography (EMG) signals were related to subjective hedonic ratings in response to food images. However, because other data showed positive correlations between hedonic ratings and objective nutritional values of food, whether the facial EMG reactions to food images could reflect the hedonic evaluation or nutritional assessment of food remains unknown. To address this issue, we measured subjective hedonic ratings (liking, wanting, valence, and arousal) and physiological signals (facial EMG of the corrugator supercilii, zygomatic major, masseter, and suprahyoid muscles, skin potential responses, and heart rates) while participants observed food images that had objective nutritional information (caloric, carbohydrate, fat, and protein contents). The results revealed that zygomatic major EMG activity was positively correlated with ratings of liking, wanting, and valence, but not with any objective nutritional value. These data indicate that facial EMG signals in response to food images reflect subjective hedonic experiences, but not objective nutritional values, associated with the food item.

A Multisensor Data Fusion Approach for Predicting Consumer Acceptance of Food Products

Sensory experiences play an important role in consumer response, purchase decision, and fidelity towards food products. Consumer studies when launching new food products must incorporate physiological response assessment to be more precise and, thus, increase their chances of success in the market. This paper introduces a novel sensory analysis system that incorporates facial emotion recognition (FER), galvanic skin response (GSR), and cardiac pulse to determine consumer acceptance of food samples. Taste and smell experiments were conducted with 120 participants recording facial images, biometric signals, and reported liking when trying a set of pleasant and unpleasant flavors and odors. Data fusion and analysis by machine learning models allow predicting the acceptance elicited by the samples. Results confirm that FER alone is not sufficient to determine consumers' acceptance. However, when combined with GSR and, to a lesser extent, with pulse signals, acceptance prediction can be improved. This research targets predicting consumer's acceptance without the continuous use of liking scores. In addition, the findings of this work may be used to explore the relationships between facial expressions and physiological reactions for non-rational decision-making when interacting with new food products.

The Facial Action Coding System for Characterization of Human Affective Response to Consumer Product-Based Stimuli: A Systematic Review

To characterize human emotions, researchers have increasingly utilized Automatic Facial Expression Analysis (AFEA), which automates the Facial Action Coding System (FACS) and translates the facial muscular positioning into the basic universal emotions. There is broad interest in the application of FACS for assessing consumer expressions as an indication of emotions to consumer product-stimuli. However, the translation of FACS to characterization of emotions is elusive in the literature. The aim of this systematic review is to give an overview of how FACS has been used to investigate human emotional behavior to consumer product-based stimuli. The search was limited to studies published in English after 1978, conducted on humans, using FACS or its action units to investigate affect, where emotional response is elicited by consumer product-based stimuli evoking at least one of the five senses. The search resulted in an initial total of 1,935 records, of which 55 studies were extracted and categorized based on the outcomes of interest including (i) method of FACS implementation; (ii) purpose of study; (iii) consumer product-based stimuli used; and (iv) measures of affect validation. Most studies implemented FACS manually (73%) to develop products and/or software (20%) and used consumer product-based stimuli that had known and/or defined capacity to evoke a particular affective response, such as films and/or movie clips (20%); minimal attention was paid to consumer products with low levels of emotional competence or with unknown affective impact. The vast majority of studies (53%) did not validate FACS-determined affect and, of the validation measures that were used, most tended to be discontinuous in nature and only captured affect as it holistically related to an experience. This review illuminated some inconsistencies in how FACS is carried out as well as how emotional response is inferred from facial muscle activation. This may prompt researchers to consider measuring the total consumer experience by employing a variety of methodologies in addition to FACS and its emotion-based interpretation guide. Such strategies may better conceptualize consumers' experience with products of low, unknown, and/or undefined capacity to evoke an affective response such as product prototypes, line extensions, etc.

The State of Automated Facial Expression Analysis (AFEA) in Evaluating Consumer Packaged Beverages

In the late 1970s, analysis of facial expressions to unveil emotional states began to grow and flourish along with new technologies and software advances. Researchers have always been able to document what consumers do, but understanding how consumers feel at a specific moment in time is an important part of the product development puzzle. Because of this, biometric testing methods have been used in numerous studies, as researchers have worked to develop a more comprehensive understanding of consumers. Despite the many articles on automated facial expression analysis (AFEA), literature is limited in regard to food and beverage studies. There are no standards to guide researchers in setting up materials, processing data, or conducting a study, and there are few, if any, compilations of the studies that have been performed to determine whether any methodologies work better than others or what trends have been found. Through a systematic Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) review, 38 articles were found that were relevant to the research goals. The authors identified AFEA study methods that have worked and those that have not been as successful and noted any trends of particular importance. Key takeaways include a listing of commercial AFEA software, experimental methods used within the PRISMA analysis, and a comprehensive explanation of the critical methods and practices of the studies analyzed. Key information was analyzed and compared to determine effects on the study outcomes. Through analyzing the various studies, suggestions and guidance for conducting and analyzing data from AFEA experiments are discussed.

Influences of sensory attribute intensity, emotional responses, and non-sensory factors on purchase intent toward mixed-vegetable juice products under informed tasting condition

Product-related sensory and non-sensory cues have been studied in the past to understand purchase behavior among consumers. However, there has been little research related to integrating emotional responses with such cues to achieve better prediction of consumer purchase behavior. This study aimed to determine the impacts of sensory attribute intensities (SAI), non-sensory factors (NSF), and emotions on purchase intent and consumer choice. Emotional responses were measured using a self-reported emotion questionnaire (EQ), facial expression analysis (FE), and autonomic nervous system responses (ANS). Sixty-nine adults were asked to view product labels, and look at, smell, and drink five commercially-available vegetable juice samples. For each sample, SAI, NSF, EQ, FE, ANS, and purchase intent ratings were measured. Participants were also asked to select the one they would be most likely to buy. Results showed that the five samples differed significantly with respect to SAI, NSF, and emotional responses measured by EQ and FEs. SAI (bitterness intensity) and NSF (brand liking) played an extremely important role in purchase-related behavior of vegetable juice products. Correlation analysis and a PLSR prediction model further revealed that products with higher ratings of purchase intent elicited lower levels of negative emotions and higher levels of positive emotions, as measured by EQ as well as FE. In conclusion, this study shows that NSF in combination with SAI and emotions measured using EQ and FE can modulate consumer purchase intent toward vegetable juice products under informed tasting conditions.

Electrodermal activity patient simulator

Electrodermal activity (EDA) is an electrical property of the human skin, correlated with person's psychological arousal. Nowadays, different types of EDA measuring devices are used in highly versatile fields-from research, health-care and education to entertainment industry. But despite their universal use the quality of their measuring function (their accuracy) is questioned or investigated very seldom. In this paper, we propose a concept of an EDA patient simulator-a device enabling metrological testing of EDA devices by means of a variable resistance. EDA simulator was designed based on a programmable light-controlled resistor with a wide resistance range, capable of simulating skin conductance levels (SCL) and responses (SCR) and was equipped with an artificial hand. The hand included electrically conductive fingers for attachment of EDA device electrodes. A minimal set of tests for evaluating an EDA device was identified, the simulator's functionality discussed and some testing results presented.

Emerging Technologies Based on Artificial Intelligence to Assess the Quality and Consumer Preference of Beverages

Beverages is a broad and important category within the food industry, which is comprised of a wide range of sub-categories and types of drinks with different levels of complexity for their manufacturing and quality assessment. Traditional methods to evaluate the quality traits of beverages consist of tedious, time-consuming, and costly techniques, which do not allow researchers to procure results in real-time. Therefore, there is a need to test and implement emerging technologies in order to automate and facilitate those analyses within this industry. This paper aimed to present the most recent publications and trends regarding the use of low-cost, reliable, and accurate, remote or non-contact techniques using robotics, machine learning, computer vision, biometrics and the application of artificial intelligence, as well as to identify the research gaps within the beverage industry. It was found that there is a wide opportunity in the development and use of robotics and biometrics for all types of beverages, but especially for hot and non-alcoholic drinks. Furthermore, there is a lack of knowledge and clarity within the industry, and research about the concepts of artificial intelligence and machine learning, as well as that concerning the correct design and interpretation of modeling related to the lack of inclusion of relevant data, additional to presenting over- or under-fitted models.

Explicit and Implicit Responses to Tasting Drinks Associated with Different Tasting Experiences

Probing food experience or liking through verbal ratings has its shortcomings. We compare explicit ratings to a range of (neuro)physiological and behavioral measures with respect to their performance in distinguishing drinks associated with different emotional experience. Seventy participants tasted and rated the valence and arousal of eight regular drinks and a “ground truth” high-arousal, low-valence vinegar solution. The discriminative power for distinguishing between the vinegar solution and the regular drinks was highest for sip size, followed by valence ratings, arousal ratings, heart rate, skin conductance level, facial expression of “disgust,” pupil diameter, and Electroencephalogram (EEG) frontal alpha asymmetry. Within the regular drinks, a positive correlation was found between rated arousal and heart rate, and a negative correlation between rated arousal and Heart Rate Variability (HRV). Most physiological measures showed consistent temporal patterns over time following the announcement of the drink and taking a sip. This was consistent over all nine drinks, but the peaks were substantially higher for the vinegar solution than for the regular drinks, likely caused by emotion. Our results indicate that implicit variables have the potential to differentiate between drinks associated with different emotional experiences. In addition, this study gives us insight into the physiological temporal response patterns associated with taking a sip.

Physiological Responses to Basic Tastes for Sensory Evaluation of Chocolate Using Biometric Techniques

Facial expressions are in reaction to basic tastes by the response to receptor stimulation. The objective of this study was to assess the autonomic nervous system responses to basic tastes in chocolates and to identify relationships between conscious and unconscious responses from participants. Panelists (n = 45) tasted five chocolates with either salt, citric acid, sugar, or monosodium glutamate, which generated four distinctive basic tastes plus bitter, using dark chocolate. An integrated camera system, coupled with the Bio-Sensory application, was used to capture infrared thermal images, videos, and sensory responses. Outputs were used to assess skin temperature (ST), facial expressions, and heart rate (HR) as physiological responses. Sensory responses and emotions elicited during the chocolate tasting were evaluated using the application. Results showed that the most liked was sweet chocolate (9.01), while the least liked was salty chocolate (3.61). There were significant differences for overall liking (p < 0.05) but none for HR (p = 0.75) and ST (p = 0.27). Sweet chocolate was inversely associated with angry, and salty chocolate positively associated with sad. Positive emotion-terms were associated with sweet samples and liking in self-reported responses. Findings of this study may be used to assess novel tastes of chocolate in the industry based on conscious and emotional responses more objectively.

Effects of Imagery as Visual Stimuli on the Physiological and Emotional Responses

Study of emotions has gained interest in the field of sensory and consumer research. Accurate information can be obtained by studying physiological behavior along with self-reported-responses. The aim was to identify physiological and self-reported-responses towards visual stimuli and predict self-reported-responses using biometrics. Panelists (N = 63) were exposed to 12 images (ten from Geneva Affective PicturE Database (GAPED), two based on common fears) and a questionnaire (Face scale and EsSense). Emotions from facial expressions (FaceReaderTM), heart rate (HR), systolic pressure (SP), diastolic pressure (DP), and skin temperature (ST) were analyzed. Multiple regression analysis was used to predict self-reported-responses based on biometrics. Results showed that physiological along with self-reported responses were able to separate images based on cluster analysis as positive, neutral, or negative according to GAPED classification. Emotional terms with high or low valence were predicted by a general linear regression model using biometrics, while calm, which is in the center of emotion dimensional model, was not predicted. After separating images, positive and neutral categories could predict all emotional terms, while negative predicted Happy, Sad, and Scared. Heart Rate predicted emotions in positive (R2 = 0.52 for Scared) and neutral (R2 = 0.55 for Sad) categories while ST in positive images (R2 = 0.55 for Sad, R2 = 0.45 for Calm).

Activity of frontal pole cortex reflecting hedonic tone of food and drink: fNIRS study in humans

Cognitive and hedonic aspects of taste have been studied using different neuroimaging techniques in humans. However, the methods used are unsuitable for easy monitoring of hedonics induced by intake of foods and beverages. Here we have tried to monitor changes in oxygenated hemoglobin (oxyHb) levels in the anterior prefrontal cortex (aPFC, frontopolar cortex, Brodmann area 10) in response to intake of hedonically different edibles in healthy adults. When subjects tasted sweet and bitter solutions freely without any particular instruction, cortical activation varied greatly among subjects and between the two stimuli, and no consistent results were obtained. Subjects then ate or drank preferred (hedonically positive) and disliked (hedonically negative) edibles. Although these stimuli differed among subjects, hedonically positive stimuli decreased oxyHb, whereas hedonically negative stimuli increased oxyHb, particularly in the ventral aPFC. When subjects tasted 4 kinds of jellies with different flavors and evaluated the degree of pleasantness, oxyHb level in the ventral region correlated negatively with pleasantness score. These results revealed that pleasant and unpleasant edibles tended to elicit decreased and increased oxyHb levels, respectively, within the ventral aPFC, suggesting that monitoring of oxyHb in this region may prove useful for objective evaluation of pleasantness of food and drink.

Cross-cultural effects of food product familiarity on sensory acceptability and non-invasive physiological responses of consumers

This research evaluated the effects of product familiarity on the sensory acceptability and physiological responses of consumers toward different food stimuli using two populations (Asian vs. Western). Two studies were conducted: (1) an online questionnaire and (2) a tasting session. For (1), n = 102 (60% Asians and 40% Westerners) evaluated 31 food items visually for familiarity and liking whereas for (2), participants (n = 60; 48% Asians and 52% Westerners) evaluated 10 different foods (tortoise jelly, chili slices, beef jerky, dried tofu, Vegemite®, durian cake, octopus chips, chocolate, corn chips, and wasabi coated peas) by tasting for familiarity and liking (visual/aroma/taste/texture/overall). A novel Android® app (Bio-sensory App) was used to capture sensory and non-invasive physiological responses (temperature, heart rate and facial expressions) of consumers. In (1), Asian and Western participants differed in their familiarity scores, visual liking ratings, and the selection of emotion terms for the stimuli. In (2), cultural differences affected familiarity and the liking scores of appearance, aroma, taste and texture of the products. While food stimuli marginally affected the physiological responses of consumers for both cultures, Asian participants elicited higher temperature values compared to those of Westerners. Both studies (1 and 2) showed that familiarity of food products was positively associated to sensory liking for both cultural groups. These findings are useful to understand consumers acceptability based on both sensory and physiological responses.

Development of a Biosensory Computer Application to Assess Physiological and Emotional Responses from Sensory Panelists

In sensory evaluation, there have been many attempts to obtain responses from the autonomic nervous system (ANS) by analyzing heart rate, body temperature, and facial expressions. However, the methods involved tend to be intrusive, which interfere with the consumers’ responses as they are more aware of the measurements. Furthermore, the existing methods to measure different ANS responses are not synchronized among them as they are measured independently. This paper discusses the development of an integrated camera system paired with an Android PC application to assess sensory evaluation and biometric responses simultaneously in the Cloud, such as heart rate, blood pressure, facial expressions, and skin-temperature changes using video and thermal images acquired by the integrated system and analyzed through computer vision algorithms written in Matlab^®, and FaceReader^TM. All results can be analyzed through customized codes for multivariate data analysis, based on principal component analysis and cluster analysis. Data collected can be also used for machine-learning modeling based on biometrics as inputs and self-reported data as targets. Based on previous studies using this integrated camera and analysis system, it has shown to be a reliable, accurate, and convenient technique to complement the traditional sensory analysis of both food and nonfood products to obtain more information from consumers and/or trained panelists.

Skiing and Thinking About It: Moment-to-Moment and Retrospective Analysis of Emotions in an Extreme Sport

Happiness is typically reported as an important reason for participating in challenging activities like extreme sport. While in the middle of the activity, however, participants do not seem particularly happy. So where does the happiness come from? The article proposes some answers from a study of facially expressed emotions measured moment-by-moment during a backcountry skiing event. Self-reported emotions were also assessed immediately after the skiing. Participants expressed lower levels of happiness while skiing, compared to when stopping for a break. Moment-to-moment and self-reported measures of emotions were largely unrelated. These findings are explained with reference to the Functional Wellbeing Approach (Vittersø, 2013), which argues that some moment-to-moment feelings are non-evaluative in the sense of being generated directly by the difficulty of an activity. By contrast, retrospective emotional feelings are more complex as they include an evaluation of the overall goals and values associated with the activity as a whole.

Methods for Evaluating Emotions Evoked by Food Experiences: A Literature Review

Besides sensory characteristics of food, food-evoked emotion is a crucial factor in predicting consumer's food preference and therefore in developing new products. Many measures have been developed to assess food-evoked emotions. The aim of this literature review is (i) to give an exhaustive overview of measures used in current research and (ii) to categorize these methods along measurement level (physiological, behavioral, and cognitive) and emotional processing level (unconscious sensory, perceptual/early cognitive, and conscious/decision making) level. This 3 × 3 categorization may help researchers to compile a set of complementary measures (“toolbox”) for their studies. We included 101 peer-reviewed articles that evaluate consumer's emotions and were published between 1997 and 2016, providing us with 59 different measures. More than 60% of these measures are based on self-reported, subjective ratings and questionnaires (cognitive measurement level) and assess the conscious/decision-making level of emotional processing. This multitude of measures and their overrepresentation in a single category hinders the comparison of results across studies and building a complete multi-faceted picture of food-evoked emotions. We recommend (1) to use widely applied, validated measures only, (2) to refrain from using (highly correlated) measures from the same category but use measures from different categories instead, preferably covering all three emotional processing levels, and (3) to acquire and share simultaneously collected physiological, behavioral, and cognitive datasets to improve the predictive power of food choice and other models.