1
|
Bress KS, Cascio CJ. Sensorimotor regulation of facial expression - An untouched frontier. Neurosci Biobehav Rev 2024; 162:105684. [PMID: 38710425 DOI: 10.1016/j.neubiorev.2024.105684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2024] [Revised: 04/16/2024] [Accepted: 04/18/2024] [Indexed: 05/08/2024]
Abstract
Facial expression is a critical form of nonverbal social communication which promotes emotional exchange and affiliation among humans. Facial expressions are generated via precise contraction of the facial muscles, guided by sensory feedback. While the neural pathways underlying facial motor control are well characterized in humans and primates, it remains unknown how tactile and proprioceptive information reaches these pathways to guide facial muscle contraction. Thus, despite the importance of facial expressions for social functioning, little is known about how they are generated as a unique sensorimotor behavior. In this review, we highlight current knowledge about sensory feedback from the face and how it is distinct from other body regions. We describe connectivity between the facial sensory and motor brain systems, and call attention to the other brain systems which influence facial expression behavior, including vision, gustation, emotion, and interoception. Finally, we petition for more research on the sensory basis of facial expressions, asserting that incomplete understanding of sensorimotor mechanisms is a barrier to addressing atypical facial expressivity in clinical populations.
Collapse
Affiliation(s)
- Kimberly S Bress
- Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, TN, USA; Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA.
| | - Carissa J Cascio
- Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, TN, USA; Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA; Vanderbilt Kennedy Center, Vanderbilt University Medical Center, Nashville, TN, USA
| |
Collapse
|
2
|
Mulier L, Slabbinck H, Vermeir I. Face your fears: direct and indirect measurement of responses to looming threats. Cogn Emot 2024; 38:187-197. [PMID: 37731376 DOI: 10.1080/02699931.2023.2258593] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2020] [Accepted: 07/09/2023] [Indexed: 09/22/2023]
Abstract
This study investigated the emotional and behavioural effects of looming threats using both recalled (self-reported valence) and real-time response measurements (facial expressions). The looming bias refers to the tendency to underestimate the time of arrival of rapidly approaching (looming) stimuli, providing additional time for defensive reactions. While previous research has shown negative emotional responses to looming threats based on self-reports after stimulus exposure, facial expressions offer valuable insights into emotional experiences and non-verbal behaviour during stimulus exposure. A face reading experiment examined responses to threats in motion, considering stimulus direction (looming versus receding motion) and threat strength (more versus less threatening stimuli). We also explored the added value of facial expression recognition compared to self-reported valence. Results indicated that looming threats elicit more negative facial expressions than receding threats, supporting previous findings on the looming bias. Further, more (vs. less) threatening stimuli evoked more negative facial expressions, but only when the threats were looming rather than receding. Interestingly, facial expressions of valence and self-reported valence showed opposing results, suggesting the importance of incorporating facial expression recognition to understand defensive responses to looming threats more comprehensively.
Collapse
Affiliation(s)
- Lana Mulier
- IESEG School of Management, Univ. Lille, CNRS, UMR 9221 - LEM - Lille Economie Management, Lille F-59000, France
| | - Hendrik Slabbinck
- Department of Marketing, Innovation, and Organisation, Faculty of Economics and Business Administration, Ghent University Ghent, Belgium
| | - Iris Vermeir
- Department of Marketing, Innovation, and Organisation, Faculty of Economics and Business Administration, Ghent University Ghent, Belgium
| |
Collapse
|
3
|
Ersöz S, Nissen A, Schütte R. Risk, Trust, and Emotion in Online Pharmacy Medication Purchases: Multimethod Approach Incorporating Customer Self-Reports, Facial Expressions, and Neural Activation. JMIR Form Res 2023; 7:e48850. [PMID: 38145483 PMCID: PMC10775049 DOI: 10.2196/48850] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2023] [Revised: 10/10/2023] [Accepted: 11/03/2023] [Indexed: 12/26/2023] Open
Abstract
BACKGROUND Online pharmacies are used less than other e-commerce sites in Germany. Shopping behavior does not correspond to consumption behavior, as online purchases are predominantly made for over-the-counter (OTC) medications. OBJECTIVE The objective of this study was to understand the purchasing experiences of online pharmacy customers in terms of critical factors for online pharmacy adoption. METHODS This study examined the perceived risk, perceived trust, and emotions related to purchasing medications online and, consequently, the purchase intention toward online pharmacies. In a within-subjects design (N=37 participants), 2 German online pharmacies with different perceptions of risk and trust were investigated for their main business, namely OTC and prescription drugs. The results of a preliminary study led to 1 online pharmacy with high and 1 with significantly low self-reported risk by the prestudy sample. Emotions were measured with a multimethod approach during and after the purchase situation as follows: (1) neural evaluation processes using functional near-infrared spectroscopy, (2) the automated direct motor response during the use of the online pharmacy via facial expression analysis (FaceReader), and (3) subjective evaluations through self-reports. Following the shopping experiences at both pharmacies for both product types, risk, trust, and purchase intention toward the pharmacies were assessed using self-assessments. RESULTS The 2 online pharmacies were rated differently in terms of risk, trust, emotions, and purchase intention. The high-risk pharmacy was also perceived as having lower trust and vice versa. Significantly stronger negative emotional expressions on customers' faces and different neural activations in the ventromedial prefrontal cortex and dorsomedial prefrontal cortex were measured when purchasing prescription drugs from the high-risk pharmacy than from the low-risk pharmacy, combined with OTC medications. In line with this, customers' self-ratings indicated higher negative emotions for the high-risk pharmacy and lower negative emotions for the low-risk pharmacy. Moreover, the ratings showed lower purchase intention for the high-risk pharmacy. CONCLUSIONS Using multimethod measurements, we showed that the preceding neural activation and subsequent verbal evaluation of online pharmacies are reflected in the customers' immediate emotional facial expressions. High-risk online pharmacies and prescription drugs lead to stronger negative emotional facial expressions and trigger neural evaluation processes that imply perceived loss. Low-risk online pharmacies and OTC medications lead to weaker negative emotional facial expressions and trigger neural evaluation processes that signify certainty and perceived reward. The results may provide an explanation for why OTC medications are purchased online more frequently than prescription medications.
Collapse
Affiliation(s)
- Semra Ersöz
- Institute for Marketing and Retail, Faculty of Economic Sciences, University of Duisburg-Essen, Essen, Germany
| | - Anika Nissen
- Institute for Business Administration, Faculty of Economic Sciences, University of Hagen, Hagen, Germany
| | - Reinhard Schütte
- Institute for Computer Science and Business Information Systems, Faculty of Economic Sciences, University of Duisburg-Essen, Essen, Germany
| |
Collapse
|
4
|
Matsufuji Y, Ueji K, Yamamoto T. Predicting Perceived Hedonic Ratings through Facial Expressions of Different Drinks. Foods 2023; 12:3490. [PMID: 37761199 PMCID: PMC10528552 DOI: 10.3390/foods12183490] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Revised: 09/07/2023] [Accepted: 09/18/2023] [Indexed: 09/29/2023] Open
Abstract
Previous studies have established the utility of facial expressions as an objective assessment approach for determining the hedonics (overall pleasure) of food and beverages. This study endeavors to validate the conclusions drawn from preceding research, illustrating that facial expressions prompted by tastants possess the capacity to forecast the perceived hedonic ratings of these tastants. Facial expressions of 29 female participants, aged 18-55 years, were captured using a digital camera during their consumption of diverse concentrations of solutions representative of five basic tastes. Employing the widely employed facial expression analysis application FaceReader, the facial expressions were meticulously assessed, identifying seven emotions (surprise, happiness, scare, neutral, disgust, sadness, and anger) characterized by scores ranging from 0 to 1-a numerical manifestation of emotional intensity. Simultaneously, participants rated the hedonics of each solution, utilizing a scale spanning from -5 (extremely unpleasant) to +5 (extremely pleasant). Employing a multiple linear regression analysis, a predictive model for perceived hedonic ratings was devised. The model's efficacy was scrutinized by assessing emotion scores from 11 additional taste solutions, sampled from 20 other participants. The anticipated hedonic ratings demonstrated robust alignment and agreement with the observed ratings, underpinning the validity of earlier findings even when incorporating diverse software and taste stimuli across a varied participant base. We discuss some limitations and practical implications of our technique in predicting food and beverage hedonics using facial expressions.
Collapse
Affiliation(s)
| | | | - Takashi Yamamoto
- Department of Nutrition, Faculty of Health Sciences, Kio University, 4-2-2 Umami-naka, Koryo, Kitakatsuragi, Nara 635-0832, Japan; (Y.M.); (K.U.)
| |
Collapse
|
5
|
da Quinta N, Baranda A, Ríos Y, Llorente R, Naranjo AB, Martinez de Marañón I. Children's physiological and behavioural response evoked by the observation, olfaction, manipulation, and consumption of food textures. Part 1: Liquid products. Food Res Int 2023; 165:112495. [PMID: 36869505 DOI: 10.1016/j.foodres.2023.112495] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Revised: 12/09/2022] [Accepted: 01/20/2023] [Indexed: 01/26/2023]
Abstract
Children are thought to prefer homogeneous and simple textures that are easy to manipulate in the mouth. Although scientific research has been done on children's acceptance for food textures, there is a lack of knowledge regarding the emotional response elicited by textures in this group of population. Physiological and behavioural methods could be an appropriate approach to measure food-evoked emotions in children since they require a low cognitive effort and allow a real-time measure. In this regard, a study that combined the measure of skin conductance response (SCR) and facial expressions was conducted: (i) to provide a first insight into food-evoked emotions induced by liquid food products that only vary in texture, (ii) to capture the emotional response evoked by the observation, olfaction, manipulation, and consumption of the products, and (iii) to overcome methodological drawbacks that are frequently associated to these methods. To achieve these goals, 50 children (5-12 yrs old) evaluated three liquids designed to only vary in texture (from slightly thick to extremely thick), following four sensory tasks: observation, olfaction, manipulation, and consumption. After each sample was tasted, children rated liking with a 7-pt hedonic scale. Facial expressions and SCR were monitored during the test, and they were analysed as action units (AUs) and basic emotions as well as changes in SCR. Results showed that the extremely thick liquid was less liked by the children and induced a more negative emotional response, whereas the slightly thick liquid was more liked and evoked a more positive emotional response. The combined method used in this study showed good discrimination ability among the three samples tested, obtaining the best discrimination during the manipulation task. The codification of the AUs located in the upper side of the face allowed us to measure the emotional response evoked by the consumption of the liquids, without the artifacts caused by the oral processing of the products. This study provides a child-friendly approach to be used during the sensory evaluation of food products in a broad range of sensory tasks minimising the methodological drawbacks.
Collapse
Affiliation(s)
- N da Quinta
- AZTI, Food Research, Basque Research and Technological Alliance (BRTA), Parque Tecnológico de Bizkaia, Astondo Bidea, Edificio 609, 48160 Derio, Bizkaia, Spain; University of the Basque Country (UPV/EHU), Facultad de Farmacia, Paseo de La Universidad, 7, 01006 Vitoria-Gasteiz, Spain.
| | - A Baranda
- AZTI, Food Research, Basque Research and Technological Alliance (BRTA), Parque Tecnológico de Bizkaia, Astondo Bidea, Edificio 609, 48160 Derio, Bizkaia, Spain
| | - Y Ríos
- AZTI, Food Research, Basque Research and Technological Alliance (BRTA), Parque Tecnológico de Bizkaia, Astondo Bidea, Edificio 609, 48160 Derio, Bizkaia, Spain
| | - R Llorente
- AZTI, Food Research, Basque Research and Technological Alliance (BRTA), Parque Tecnológico de Bizkaia, Astondo Bidea, Edificio 609, 48160 Derio, Bizkaia, Spain
| | - A B Naranjo
- AZTI, Food Research, Basque Research and Technological Alliance (BRTA), Parque Tecnológico de Bizkaia, Astondo Bidea, Edificio 609, 48160 Derio, Bizkaia, Spain
| | - I Martinez de Marañón
- AZTI, Food Research, Basque Research and Technological Alliance (BRTA), Parque Tecnológico de Bizkaia, Astondo Bidea, Edificio 609, 48160 Derio, Bizkaia, Spain
| |
Collapse
|
6
|
Mastinu M, Melis M, Yousaf NY, Barbarossa IT, Tepper BJ. Emotional responses to taste and smell stimuli: Self-reports, physiological measures, and a potential role for individual and genetic factors. J Food Sci 2022; 88:65-90. [PMID: 36169921 DOI: 10.1111/1750-3841.16300] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Revised: 06/24/2022] [Accepted: 07/26/2022] [Indexed: 11/30/2022]
Abstract
Taste and olfaction elicit conscious feelings by direct connection with the neural circuits of emotions that affects physiological responses in the body (e.g., heart rate and skin conductance). While sensory attributes are strong determinants of food liking, other factors such as emotional reactions to foods may be better predictors of consumer choices even for products that are equally-liked. Thus, important insights can be gained for understanding the full spectrum of emotional reactions to foods that inform the activities of product developers and marketers, eating psychologist and nutritionists, and policy makers. Today, self-reported questionnaires and physiological measures are the most common tools applied to study variations in emotional perception. The present review discusses these methodological approaches, underlining their different strengths and weaknesses. We also discuss a small, emerging literature suggesting that individual differences and genetic variations in taste and smell perception, like the genetic ability to perceive the bitter compound PROP, may also play a role in emotional reactions to aromas and foods.
Collapse
Affiliation(s)
- Mariano Mastinu
- Department of Biomedical Sciences, University of Cagliari, Monserrato, Italy.,Center for Sensory Sciences & Innovation & Department of Food Science, Rutgers University, New Brunswick, New Jersey, USA
| | - Melania Melis
- Department of Biomedical Sciences, University of Cagliari, Monserrato, Italy
| | - Neeta Y Yousaf
- Center for Sensory Sciences & Innovation & Department of Food Science, Rutgers University, New Brunswick, New Jersey, USA
| | | | - Beverly J Tepper
- Center for Sensory Sciences & Innovation & Department of Food Science, Rutgers University, New Brunswick, New Jersey, USA
| |
Collapse
|
7
|
Wakihira T, Morimoto M, Higuchi S, Nagatomi Y. Can facial expressions predict beer choices after tasting? A proof of concept study on implicit measurements for a better understanding of choice behavior among beer consumers. Food Qual Prefer 2022. [DOI: 10.1016/j.foodqual.2022.104580] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
|
8
|
Galler M, Grendstad ÅR, Ares G, Varela P. Capturing food-elicited emotions: Facial decoding of children’s implicit and explicit responses to tasted samples. Food Qual Prefer 2022. [DOI: 10.1016/j.foodqual.2022.104551] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
|
9
|
Jarutiene L, Adomaitiene V, Steibliene V, Juodeikiene G, Cernauskas D, Klupsaite D, Lele V, Milasauskiene E, Bartkiene E. Specifics of the Emotional Response of Patients Suffering From Major Depressive Disorder to Imagined Basic Tastes of Food. Front Psychol 2022; 13:820684. [PMID: 35197907 PMCID: PMC8860301 DOI: 10.3389/fpsyg.2022.820684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2021] [Accepted: 01/12/2022] [Indexed: 11/13/2022] Open
Abstract
Nowadays, the major depressive disorder (MDD) is a common disease that negatively affects the life quality of many people around the world. As MDD symptoms are closely related with the changes in food and eating, the relation between patients’ emotional responses and food tastes could be used as criteria for diagnostic. Until now, studies on the emotional response to different food tastes for patients affected by MDD have been poorly described in literature. Therefore, the aim of this study was to evaluate the emotional response of patients suffering from MDD to the imagined different food tastes and to compare the results with a control group. Emotional responses in tested participants were induced by using cards with words of basic food tastes such as “sweet,” “salty,” “bitter,” “sour,” and “neutral.” The assessment of emotional response was performed with FaceReader 6 software. The outcome of this study showed that participants with MDD expressed lower “happy” and “contempt” and higher “surprised” emotions, along with a higher negative valence mean, in comparison with controls for all tested basic tastes of food (p ≤ 0.05). When Likert scale was used, significant differences (p ≤ 0.001) in response were only found for “sour” and “salty” imaginary tastes between healthy group and patients with MDD. The findings of this study provide the additional data on food–associated emotion analysis of MDD patients and could be useful for the further development of the contactless method for early diagnosis of MDD.
Collapse
Affiliation(s)
- Laura Jarutiene
- Psychiatry Clinic, Lithuanian University of Health Sciences, Kaunas, Lithuania
| | | | - Vesta Steibliene
- Psychiatry Clinic, Lithuanian University of Health Sciences, Kaunas, Lithuania
| | - Grazina Juodeikiene
- Department of Food Science and Technology, Kaunas University of Technology, Kaunas, Lithuania
| | - Darius Cernauskas
- Department of Food Science and Technology, Kaunas University of Technology, Kaunas, Lithuania.,Food Institute, Kaunas University of Technology, Kaunas, Lithuania.,Institute of Animal Rearing Technologies, Faculty of Animal Sciences, Lithuanian University of Health Sciences, Kaunas, Lithuania
| | - Dovile Klupsaite
- Institute of Animal Rearing Technologies, Faculty of Animal Sciences, Lithuanian University of Health Sciences, Kaunas, Lithuania
| | - Vita Lele
- Institute of Animal Rearing Technologies, Faculty of Animal Sciences, Lithuanian University of Health Sciences, Kaunas, Lithuania.,Department of Food Safety and Quality, Veterinary Academy, Lithuanian University of Health Sciences, Kaunas, Lithuania
| | - Egle Milasauskiene
- Psychiatry Clinic, Lithuanian University of Health Sciences, Kaunas, Lithuania
| | - Elena Bartkiene
- Institute of Animal Rearing Technologies, Faculty of Animal Sciences, Lithuanian University of Health Sciences, Kaunas, Lithuania.,Department of Food Safety and Quality, Veterinary Academy, Lithuanian University of Health Sciences, Kaunas, Lithuania
| |
Collapse
|
10
|
Characteristics of Nutraceutical Chewing Candy Formulations Based on Fermented Milk Permeate, Psyllium Husk, and Apple By-Products. Foods 2021; 10:foods10040777. [PMID: 33916334 PMCID: PMC8065903 DOI: 10.3390/foods10040777] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2021] [Revised: 03/26/2021] [Accepted: 04/02/2021] [Indexed: 11/20/2022] Open
Abstract
The aim of this study was to develop nutraceutical chewing candy (CCN) formulations based on fermented milk permeate (MP) (source of galactooligosaccharides (GOS) and viable lactic acid bacteria (LAB)), psyllium husk (source of desirable hydrocolloids), and apple by-products (source of phenolic compounds). For CCN preparation, gelatin (Gel) and agar were tested; also, to provide CCN prepared using agar with a desirable hard texture, citric acid (cit) was changed to ascorbic acid. To select the optimal quantities of the ingredients, overall acceptability (OA) and emotions (EMs) induced in consumers by different CCN formulations were evaluated. Furthermore, viable LAB count during storage, texture, colour, and antioxidant characteristics were analysed. The highest OA (score 8.5) was shown for samples consisting of MP, psyllium husk (Ph), apple by-products (App), cit and xylitol (Xy); a very strong correlation was found between OA and the EM “happy” (r = 0.907**). After 14 days of storage, Gel+MP+Ph+App+cit samples showed a LAB count higher than 6.0 log10 CFU g−1; however, better antioxidant properties were found for the CCN prepared with agar. Finally, it can be stated that fermented MP, Ph, and App can be used for preparation of added-value CCN in a sustainable manner, and the recommended formulation is Gel+ MP+Ph+App+cit+Xy.
Collapse
|
11
|
Zhi R, Wang C, Hu X, Zhou C, Liu M, Zhao J, Zuo Y. Development of a deep multimodal hedonic recognition database for oral stimuli. Food Qual Prefer 2021. [DOI: 10.1016/j.foodqual.2020.104061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
12
|
Self-Reported Emotions and Facial Expressions on Consumer Acceptability: A Study Using Energy Drinks. Foods 2021; 10:foods10020330. [PMID: 33557127 PMCID: PMC7913797 DOI: 10.3390/foods10020330] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Revised: 01/25/2021] [Accepted: 01/29/2021] [Indexed: 02/01/2023] Open
Abstract
Emotional responses elicited by foods are of great interest for new product developers and marketing professionals, as consumer acceptance proved to be linked to the emotions generated by the product in the consumers. An emotional measurement is generally considered an appropriate tool to differentiate between the products of similar nutritional value, flavour, liking and packaging. Novel methods used to measure emotions include self-reporting verbal and visual measurements, and facial expression techniques. This study aimed to evaluate the explicit and implicit emotional response elicited during the tasting of two different brands (A and B) of energy drinks. The explicit response of consumers was assessed using liking (nine-point hedonic scale), and emotions (EsSense Profile®—Check-All-That-Apply questionnaire), and implicit emotional responses were evaluated by studying facial expressions using the Affectiva Affdex® software. The familiarity of the product and purchase intent were also assessed during the study. The hedonic rating shows a significant difference in liking between the two brands of energy drink during the tasting session. For the explicit emotional responses, participants elicited more positive emotions than the negative emotions for both energy drinks. However, participants expressed “happy”, “active” and “eager” emotions more frequently for energy drink A. On the other hand, the implicit emotional responses through facial expressions indicated a high level of involvement of the participants with energy drink B as compared to energy drink A. The study showed that overall liking and the explicit and implicit emotional measurements are weakly to moderately correlated.
Collapse
|
13
|
Zhi R, Hu X, Wang C, Liu S. Development of a direct mapping model between hedonic rating and facial responses by dynamic facial expression representation. Food Res Int 2020; 137:109411. [PMID: 33233098 DOI: 10.1016/j.foodres.2020.109411] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2019] [Revised: 06/02/2020] [Accepted: 06/03/2020] [Indexed: 11/17/2022]
Abstract
Consumer tests are one of the most important activities in product development. More evidence indicates that consumer emotions in real life are mostly driven by unconscious mechanisms, and implicit measurements are regarded as beneficial by an increasing number of sensory and consumer scientists. Nonverbal manner such as facial expression analysis is a supplement to the declarative method and brings very insightful results. Up until now, the facial expression analysis for consumers' acceptance identification is limited to investigate the relationship between hedonic rating and facial expression descriptors, such as facial coding system (FACS or MAX), discrete facial expressions (i.e. happiness, sadness, surprise, fear, anger, and disgust), and affective dimensional model (valence and activation). In this study, we attempt to develop a direct mapping model between the hedonic rating and facial responses evoked by various taste stimuli. Basic taste solutions (sourness, sweetness, bitterness, umami, and saltiness) with six levels, and five types of juice are used as stimuli. Firstly, the hedonic rating categories are defined based on the nine-point hedonic scale, with a coarse-to-fine division of scale levels based on two directions of like and dislike. Secondly, the facial dynamic optical flow method is employed to analyze facial characteristics of the subjects' facial responses evoked by taste stimuli. And the genetic algorithm is conducted to select facial regions that have high contribution to hedonic rating identification. It indicates that the texture changes of eye area, wrinkles at the nasal root, and mouth area can effectively reflect the facial reaction corresponding to hedonic rating. The research shows that it is feasible to establish a direct mapping model between hedonic rating and facial responses. The hedonic rating can be predicted through automatic facial reading technology, without extra transformation from predefined emotional models. In general, this is the first try to discuss the direct prediction of hedonic rating through facial expressions up to now, and it is a complex problem due to various influence factors.
Collapse
Affiliation(s)
- Ruicong Zhi
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, PR China; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing 100083, PR China.
| | - Xin Hu
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, PR China; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing 100083, PR China
| | - Chenyang Wang
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, PR China; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing 100083, PR China
| | - Shuai Liu
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, PR China; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing 100083, PR China
| |
Collapse
|
14
|
Halfon S, Doyran M, Türkmen B, Oktay EA, Salah AA. Multimodal affect analysis of psychodynamic play therapy. Psychother Res 2020; 31:402-417. [PMID: 33148118 DOI: 10.1080/10503307.2020.1839141] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/23/2022] Open
Abstract
Objective: We explore state of the art machine learning based tools for automatic facial and linguistic affect analysis to allow easier, faster, and more precise quantification and annotation of children's verbal and non-verbal affective expressions in psychodynamic child psychotherapy. Method: The sample included 53 Turkish children: 41 with internalizing, externalizing and comorbid problems; 12 in the non-clinical range. We collected audio and video recordings of 148 sessions, which were manually transcribed. Independent raters coded children's expressions of pleasure, anger, sadness and anxiety using the Children's Play Therapy Instrument (CPTI). Automatic facial and linguistic affect analysis modalities were adapted, developed, and combined in a system that predicts affect. Statistical regression methods (linear and polynomial regression) and machine learning techniques (deep learning, support vector regression and extreme learning machine) were used for predicting CPTI affect dimensions. Results: Experimental results show significant associations between automated affect predictions and CPTI affect dimensions with small to medium effect sizes. Fusion of facial and linguistic features work best for pleasure predictions; however, for other affect predictions linguistic analyses outperform facial analyses. External validity analyses partially support anger and pleasure predictions. Discussion: The system enables retrieving affective expressions of children, but needs improvement for precision.
Collapse
Affiliation(s)
| | - Metehan Doyran
- Department of Information and Computing Sciences, Utrecht University, Utrecht, the Netherlands
| | - Batıkan Türkmen
- Computer Engineering Department, Bogaziçi University, Bebek/İstanbul, Turkey
| | - Eda Aydın Oktay
- Khoury College of Computer Science, Northeastern University, Boston, MA, USA
| | - Ali Albert Salah
- Department of Information and Computing Sciences, Utrecht University, Utrecht, the Netherlands.,Computer Engineering Department, Bogaziçi University, Bebek/İstanbul, Turkey
| |
Collapse
|
15
|
Does the face show what the mind tells? A comparison between dynamic emotions obtained from facial expressions and Temporal Dominance of Emotions (TDE). Food Qual Prefer 2020. [DOI: 10.1016/j.foodqual.2020.103976] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
16
|
Lagast S, De Steur H, Gadeyne S, Hödl S, Staljanssens W, Vonck K, Boon P, Gellynck X, De Herdt V. Heart rate, electrodermal responses and frontal alpha asymmetry to accepted and non-accepted solutions and drinks. Food Qual Prefer 2020. [DOI: 10.1016/j.foodqual.2020.103893] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
|
17
|
Nath EC, Cannon PR, Philipp MC. Co-acting strangers but not friends influence subjective liking and facial affective responses to food stimuli. Food Qual Prefer 2020. [DOI: 10.1016/j.foodqual.2019.103865] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023]
|
18
|
The State of Automated Facial Expression Analysis (AFEA) in Evaluating Consumer Packaged Beverages. BEVERAGES 2020. [DOI: 10.3390/beverages6020027] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
In the late 1970s, analysis of facial expressions to unveil emotional states began to grow and flourish along with new technologies and software advances. Researchers have always been able to document what consumers do, but understanding how consumers feel at a specific moment in time is an important part of the product development puzzle. Because of this, biometric testing methods have been used in numerous studies, as researchers have worked to develop a more comprehensive understanding of consumers. Despite the many articles on automated facial expression analysis (AFEA), literature is limited in regard to food and beverage studies. There are no standards to guide researchers in setting up materials, processing data, or conducting a study, and there are few, if any, compilations of the studies that have been performed to determine whether any methodologies work better than others or what trends have been found. Through a systematic Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) review, 38 articles were found that were relevant to the research goals. The authors identified AFEA study methods that have worked and those that have not been as successful and noted any trends of particular importance. Key takeaways include a listing of commercial AFEA software, experimental methods used within the PRISMA analysis, and a comprehensive explanation of the critical methods and practices of the studies analyzed. Key information was analyzed and compared to determine effects on the study outcomes. Through analyzing the various studies, suggestions and guidance for conducting and analyzing data from AFEA experiments are discussed.
Collapse
|
19
|
Samant SS, Seo HS. Influences of sensory attribute intensity, emotional responses, and non-sensory factors on purchase intent toward mixed-vegetable juice products under informed tasting condition. Food Res Int 2020; 132:109095. [PMID: 32331675 DOI: 10.1016/j.foodres.2020.109095] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2019] [Revised: 02/06/2020] [Accepted: 02/09/2020] [Indexed: 12/24/2022]
Abstract
Product-related sensory and non-sensory cues have been studied in the past to understand purchase behavior among consumers. However, there has been little research related to integrating emotional responses with such cues to achieve better prediction of consumer purchase behavior. This study aimed to determine the impacts of sensory attribute intensities (SAI), non-sensory factors (NSF), and emotions on purchase intent and consumer choice. Emotional responses were measured using a self-reported emotion questionnaire (EQ), facial expression analysis (FE), and autonomic nervous system responses (ANS). Sixty-nine adults were asked to view product labels, and look at, smell, and drink five commercially-available vegetable juice samples. For each sample, SAI, NSF, EQ, FE, ANS, and purchase intent ratings were measured. Participants were also asked to select the one they would be most likely to buy. Results showed that the five samples differed significantly with respect to SAI, NSF, and emotional responses measured by EQ and FEs. SAI (bitterness intensity) and NSF (brand liking) played an extremely important role in purchase-related behavior of vegetable juice products. Correlation analysis and a PLSR prediction model further revealed that products with higher ratings of purchase intent elicited lower levels of negative emotions and higher levels of positive emotions, as measured by EQ as well as FE. In conclusion, this study shows that NSF in combination with SAI and emotions measured using EQ and FE can modulate consumer purchase intent toward vegetable juice products under informed tasting conditions.
Collapse
Affiliation(s)
- Shilpa S Samant
- Department of Food Science, University of Arkansas, 2650 North Young Avenue, Fayetteville, AR 72704, USA
| | - Han-Seok Seo
- Department of Food Science, University of Arkansas, 2650 North Young Avenue, Fayetteville, AR 72704, USA.
| |
Collapse
|
20
|
Facial responses of adult humans during the anticipation and consumption of touch and food rewards. Cognition 2020; 194:104044. [DOI: 10.1016/j.cognition.2019.104044] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2018] [Revised: 08/04/2019] [Accepted: 08/08/2019] [Indexed: 01/04/2023]
|
21
|
Brouwer AM, Hogervorst MA, van Erp JB, Grootjen M, van Dam E, Zandstra EH. Measuring cooking experience implicitly and explicitly: Physiology, facial expression and subjective ratings. Food Qual Prefer 2019. [DOI: 10.1016/j.foodqual.2019.103726] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
|
22
|
Nath EC, Cannon PR, Philipp MC. An unfamiliar social presence reduces facial disgust responses to food stimuli. Food Res Int 2019; 126:108662. [PMID: 31732049 DOI: 10.1016/j.foodres.2019.108662] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2019] [Revised: 09/05/2019] [Accepted: 09/09/2019] [Indexed: 01/21/2023]
Abstract
Consumers' emotional responses complement sensory and hedonic ratings in the prediction of food choice and consumption behaviour. The challenge with the measurement of consumption emotions is that emotions are highly context dependent. For emotion evaluations to bring greater insight to food research and development, it is essential that the influence of contextual variables on emotion are quantified. The present study contributes to the discussion with an investigation of the effect of an unfamiliar social presence on affective facial responses to visual food stimuli. Seventy participants (52 female and 18 male) viewed food images of varying acceptability either alone, or in the presence of the researcher. Subjective liking ratings were measured using a labelled affective magnitude scale, and facial muscle activity from zygomaticus major (contracted during smiling), corrugator supercilii (contracted during frowning) and levator labii superioris (contracted during nose wrinkling) were measured with an EMG recording system. Controlling for individual differences in facial expressivity and food image acceptability using linear mixed models, it was found that social context did not predict smiling or frowning muscle activity. Social context did predict the intensity of muscle activity indicative of a disgust response, with participants in the observed condition exhibiting less levator activity than participants in the alone condition. Regardless of social context, each muscle was found to have a relationship with subjective liking, with the direction of effects as expected. The results indicate that emotional stimuli and social context both influence food-evoked facial expression and provides support for the utility of facial EMG in measuring food-evoked emotion.
Collapse
Affiliation(s)
- Elizabeth C Nath
- School of Psychology, Massey University, Private Bag 11-222, Palmerston North 4442, New Zealand.
| | - Peter R Cannon
- School of Psychology, Massey University, Private Bag 11-222, Palmerston North 4442, New Zealand
| | - Michael C Philipp
- School of Psychology, Massey University, Private Bag 11-222, Palmerston North 4442, New Zealand
| |
Collapse
|
23
|
Implicit evaluation of the emotional response to premium organic herbal infusions through a temporal dominance approach: Development of the temporal dominance of facial emotions (TDFE). Food Qual Prefer 2019. [DOI: 10.1016/j.foodqual.2019.04.001] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
24
|
Physiological Responses to Basic Tastes for Sensory Evaluation of Chocolate Using Biometric Techniques. Foods 2019; 8:foods8070243. [PMID: 31284449 PMCID: PMC6679144 DOI: 10.3390/foods8070243] [Citation(s) in RCA: 23] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2019] [Revised: 07/02/2019] [Accepted: 07/03/2019] [Indexed: 01/18/2023] Open
Abstract
Facial expressions are in reaction to basic tastes by the response to receptor stimulation. The objective of this study was to assess the autonomic nervous system responses to basic tastes in chocolates and to identify relationships between conscious and unconscious responses from participants. Panelists (n = 45) tasted five chocolates with either salt, citric acid, sugar, or monosodium glutamate, which generated four distinctive basic tastes plus bitter, using dark chocolate. An integrated camera system, coupled with the Bio-Sensory application, was used to capture infrared thermal images, videos, and sensory responses. Outputs were used to assess skin temperature (ST), facial expressions, and heart rate (HR) as physiological responses. Sensory responses and emotions elicited during the chocolate tasting were evaluated using the application. Results showed that the most liked was sweet chocolate (9.01), while the least liked was salty chocolate (3.61). There were significant differences for overall liking (p < 0.05) but none for HR (p = 0.75) and ST (p = 0.27). Sweet chocolate was inversely associated with angry, and salty chocolate positively associated with sad. Positive emotion-terms were associated with sweet samples and liking in self-reported responses. Findings of this study may be used to assess novel tastes of chocolate in the industry based on conscious and emotional responses more objectively.
Collapse
|
25
|
Spinelli S, Jaeger SR. What do we know about the sensory drivers of emotions in foods and beverages? Curr Opin Food Sci 2019. [DOI: 10.1016/j.cofs.2019.06.007] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
26
|
Using both emotional responses and sensory attribute intensities to predict consumer liking and preference toward vegetable juice products. Food Qual Prefer 2019. [DOI: 10.1016/j.foodqual.2018.12.006] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
27
|
|
28
|
Samant SS, Seo HS. Personality traits affect the influences of intensity perception and emotional responses on hedonic rating and preference rank toward basic taste solutions. J Neurosci Res 2018; 97:276-291. [PMID: 30168860 DOI: 10.1002/jnr.24321] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2018] [Revised: 07/22/2018] [Accepted: 08/09/2018] [Indexed: 11/11/2022]
Abstract
This study aimed at determining, based on independent predictors of taste intensity and emotional response, whether individual personality traits could affect prediction models of overall liking and preference rank toward basic taste solutions. Sixty-seven participants rated taste intensities (TI) of four basic-taste solutions at both low and high concentrations, and of plain water. Emotional responses toward each sample were measured using a self-reported emotion questionnaire (SE), facial expressions (FE), and/or autonomic nervous system responses (ANS). Participants rated overall liking of the samples and ranked their preferences. Based on the results of a hierarchical cluster analysis of five personality traits measured using the Big Five Inventory, participants were classified into two clusters: cluster N (high neuroticism) and cluster E (high extraversion). Results showed that the SE measure for both clusters N and E was better than the TI, FE, and ANS measures in explaining variances of overall liking or preference rank. A measurement of effect size found that using FE and/or taste intensity measures, along with self-reported emotion measure, could enhance model predictability of overall liking or preference rank toward taste samples for cluster N, while the contribution to the prediction model for cluster E was minimal. ANS measures showed little contribution to the prediction model of overall liking for either cluster. In conclusion, this study shows that personality traits, in particular traits of extraversion and neuroticism, affect not only optimum measures of emotional responses, but also modulate predicting overall liking and preference rank toward basic taste solutions.
Collapse
Affiliation(s)
- Shilpa S Samant
- Department of Food Science, University of Arkansas, Fayetteville, Arkansas
| | - Han-Seok Seo
- Department of Food Science, University of Arkansas, Fayetteville, Arkansas
| |
Collapse
|
29
|
Automated facial expression analysis for emotional responsivity using an aqueous bitter model. Food Qual Prefer 2018. [DOI: 10.1016/j.foodqual.2018.04.004] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
30
|
Lopez FL, Mistry P, Batchelor HK, Bennett J, Coupe A, Ernest TB, Orlu M, Tuleu C. Acceptability of placebo multiparticulate formulations in children and adults. Sci Rep 2018; 8:9210. [PMID: 29907752 PMCID: PMC6003938 DOI: 10.1038/s41598-018-27446-6] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2018] [Accepted: 05/29/2018] [Indexed: 12/25/2022] Open
Abstract
Patient acceptability is an important consideration in the design of medicines for children. The aim of this study was to investigate acceptability of multiparticulates in healthy children and adults. A randomised, single-blind acceptability testing was performed involving 71 children (4-12 years) and 61 adults (18-37 years). Each participant received three 500 mg samples of microcrystalline cellulose pellets administered on a medicine spoon with water at 5-10 minutes intervals. Acceptability was measured based on voluntary intake of the samples, facial expressions, ratings on hedonic scales and reported willingness to take multiparticulates everyday as a medicine. Multiparticulates were voluntarily swallowed by 92% of children and 100% of adults. However, palatability issues were identified, with emphasis on textural aspects. Grittiness perception received negative ratings on hedonic scales by 60% of children and 51% of adults. Researcher observations revealed that 72% of children and 42% of adults displayed negative facial expressions towards the samples. Children reported their willingness to take multiparticulates as a medicine in 30% of the cases, compared to 74% in adults. This study demonstrates that multiparticulates may be a suitable formulation platform for children and adults, although palatability concerns have been highlighted. Additional work is required to define acceptability criteria and to standardise methodologies.
Collapse
Affiliation(s)
- Felipe L Lopez
- School of Pharmacy, University College London, London, United Kingdom
| | - Punam Mistry
- School of Pharmacy, Institute of Clinical Sciences, University of Birmingham, Birmingham, United Kingdom
| | - Hannah K Batchelor
- School of Pharmacy, Institute of Clinical Sciences, University of Birmingham, Birmingham, United Kingdom
| | | | | | | | - Mine Orlu
- School of Pharmacy, University College London, London, United Kingdom
| | - Catherine Tuleu
- School of Pharmacy, University College London, London, United Kingdom.
| |
Collapse
|
31
|
Kaneko D, Toet A, Brouwer AM, Kallen V, van Erp JBF. Methods for Evaluating Emotions Evoked by Food Experiences: A Literature Review. Front Psychol 2018; 9:911. [PMID: 29937744 PMCID: PMC6002740 DOI: 10.3389/fpsyg.2018.00911] [Citation(s) in RCA: 69] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2017] [Accepted: 05/18/2018] [Indexed: 12/01/2022] Open
Abstract
Besides sensory characteristics of food, food-evoked emotion is a crucial factor in predicting consumer's food preference and therefore in developing new products. Many measures have been developed to assess food-evoked emotions. The aim of this literature review is (i) to give an exhaustive overview of measures used in current research and (ii) to categorize these methods along measurement level (physiological, behavioral, and cognitive) and emotional processing level (unconscious sensory, perceptual/early cognitive, and conscious/decision making) level. This 3 × 3 categorization may help researchers to compile a set of complementary measures (“toolbox”) for their studies. We included 101 peer-reviewed articles that evaluate consumer's emotions and were published between 1997 and 2016, providing us with 59 different measures. More than 60% of these measures are based on self-reported, subjective ratings and questionnaires (cognitive measurement level) and assess the conscious/decision-making level of emotional processing. This multitude of measures and their overrepresentation in a single category hinders the comparison of results across studies and building a complete multi-faceted picture of food-evoked emotions. We recommend (1) to use widely applied, validated measures only, (2) to refrain from using (highly correlated) measures from the same category but use measures from different categories instead, preferably covering all three emotional processing levels, and (3) to acquire and share simultaneously collected physiological, behavioral, and cognitive datasets to improve the predictive power of food choice and other models.
Collapse
Affiliation(s)
- Daisuke Kaneko
- Kikkoman Europe R&D Laboratory B.V., Wageningen, Netherlands.,Microbiology and Systems Biology, TNO, Zeist, Netherlands
| | - Alexander Toet
- Perceptual and Cognitive Systems, TNO, Soesterberg, Netherlands
| | | | - Victor Kallen
- Microbiology and Systems Biology, TNO, Zeist, Netherlands
| | - Jan B F van Erp
- Perceptual and Cognitive Systems, TNO, Soesterberg, Netherlands.,Human Media Interaction, University of Twente, Enschede, Netherlands
| |
Collapse
|
32
|
Stasi A, Songa G, Mauri M, Ciceri A, Diotallevi F, Nardone G, Russo V. Neuromarketing empirical approaches and food choice: A systematic review. Food Res Int 2018; 108:650-664. [DOI: 10.1016/j.foodres.2017.11.049] [Citation(s) in RCA: 60] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2017] [Revised: 11/17/2017] [Accepted: 11/19/2017] [Indexed: 11/24/2022]
|
33
|
Persky S, Goldring MR, Turner SA, Cohen RW, Kistler WD. Validity of assessing child feeding with virtual reality. Appetite 2018; 123:201-207. [PMID: 29277518 PMCID: PMC5817019 DOI: 10.1016/j.appet.2017.12.007] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2017] [Revised: 11/28/2017] [Accepted: 12/04/2017] [Indexed: 01/17/2023]
Abstract
Assessment of parents' child feeding behavior is challenging, and there is need for additional methodological approaches. Virtual reality technology allows for the creation of behavioral measures, and its implementation overcomes several limitations of existing methods. This report evaluates the validity and usability of the Virtual Reality (VR) Buffet among a sample of 52 parents of children aged 3-7. Participants served a meal of pasta and apple juice in both a virtual setting and real-world setting (counterbalanced and separated by a distractor task). They then created another meal for their child, this time choosing from the full set of food options in the VR Buffet. Finally, participants completed a food estimation task followed by a questionnaire, which assessed their perceptions of the VR Buffet. Results revealed that the amount of virtual pasta served by parents correlated significantly with the amount of real pasta they served, rs = 0.613, p < .0001, as did served amounts of virtual and real apple juice, rs = 0.822, p < .0001. Furthermore, parents' perception of the calorie content of chosen foods was significantly correlated with observed calorie content (rs = 0.438, p = .002), and parents agreed that they would feed the meal they created to their child (M = 4.43, SD = 0.82 on a 1-5 scale). The data presented here demonstrate that parent behavior in the VR Buffet is highly related to real-world behavior, and that the tool is well-rated by parents. Given the data presented and the potential benefits of the abundant behavioral data the VR Buffet can provide, we conclude that it is a valid and needed addition to the array of tools for assessing feeding behavior.
Collapse
Affiliation(s)
- Susan Persky
- Social and Behavioral Research Branch, National Human Genome Research Institute, USA.
| | - Megan R Goldring
- Social and Behavioral Research Branch, National Human Genome Research Institute, USA
| | - Sara A Turner
- Clinical Center Nutrition Department, National Institutes of Health, USA
| | - Rachel W Cohen
- Social and Behavioral Research Branch, National Human Genome Research Institute, USA
| | - William D Kistler
- Social and Behavioral Research Branch, National Human Genome Research Institute, USA
| |
Collapse
|
34
|
Zhi R, Wan J, Zhang D, Li W. Correlation between hedonic liking and facial expression measurement using dynamic affective response representation. Food Res Int 2018; 108:237-245. [PMID: 29735053 DOI: 10.1016/j.foodres.2018.03.042] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2018] [Revised: 03/12/2018] [Accepted: 03/13/2018] [Indexed: 11/18/2022]
Abstract
Emotional reactions towards products play an essential role in consumers' decision making, and are more important than rational evaluation of sensory attributes. It is crucial to understand consumers' emotion, and the relationship between sensory properties, human liking and choice. There are many inconsistencies between Asian and Western consumers in the usage of hedonic scale, as well as the intensity of facial reactions, due to different culture and consuming habits. However, very few studies discussed the facial responses characteristics of Asian consumers during food consumption. In this paper, explicit liking measurement (hedonic scale) and implicit emotional measurement (facial expressions) were evaluated to judge the consumers' emotions elicited by five types of juices. The contributions of this study included: (1) Constructed the relationship model between hedonic liking and facial expressions analyzed by face reading technology. Negative emotions "sadness", "anger", and "disgust" showed noticeable high negative correlation tendency to hedonic scores. The "liking" hedonic scores could be characterized by positive emotion "happiness". (2) Several emotional intensity based parameters, especially dynamic parameter, were extracted to describe the facial characteristic in sensory evaluation procedure. Both amplitude information and frequency information were involved in the dynamic parameters to remain more information of the emotional responses signals. From the comparison of four types of emotional descriptive parameters, the maximum parameter and dynamic parameter were suggested to be utilized for representing emotional state and intensities.
Collapse
Affiliation(s)
- Ruicong Zhi
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, PR China; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing 100083, PR China.
| | - Jingwei Wan
- Department of Police Technology, Railway Police College, Zhengzhou, Henan 450003, PR China
| | - Dezheng Zhang
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, PR China; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing 100083, PR China
| | - Weiping Li
- Department of Police Technology, Railway Police College, Zhengzhou, Henan 450003, PR China.
| |
Collapse
|
35
|
Lopez F, Mistry P, Batchelor H, Bennett J, Ernest T, Gul MO, Tuleu C. Palatability and acceptability of multiparticulate formulations: Adults vs. children comparison. Int J Pharm 2018. [DOI: 10.1016/j.ijpharm.2017.08.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
36
|
Mistry P, Hodson J, Bennett J, Batchelor H. Evaluating the acceptability and mouthfeel of multiparticulates within a paediatric population. Int J Pharm 2018. [DOI: 10.1016/j.ijpharm.2017.08.032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
37
|
An evaluation of tools via patient-reported outcome measures to assess the acceptability of existing oral liquid medicines within a paediatric inpatient population. Int J Pharm 2018. [DOI: 10.1016/j.ijpharm.2017.08.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
38
|
Riccio MP, Franco C, Negri R, Ferrentino RI, Maresca R, D'alterio E, Greco L, Bravaccio C. Is food refusal in autistic children related to TAS2R38 genotype? Autism Res 2017; 11:531-538. [PMID: 29282878 DOI: 10.1002/aur.1912] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2017] [Revised: 11/01/2017] [Accepted: 12/06/2017] [Indexed: 12/26/2022]
Abstract
Several studies suggest that atypical eating behaviors, in particular food selectivity, are more frequent in children with autism spectrum disorder (ASD). A link between bitter taste perception, namely PROP/PTC sensitivity and food preferences is known in healthy children. The aim of this study is to investigate whether genetic variants of the TAS2R38 taste receptor responsible for different bitter sensitivity could affect foods preferences and consequently food refusal in ASD children. We recruited 43 children with ASD and 41 with normotypic development (TD) with or without food selectivity, aged between 2 and 11 years. Children were characterized for bitter sensitivity by means of PROP strips and FACS analysis and genotyped for TAS2R38 polymorphisms. Food selectivity was assessed by a validated food preference questionnaire filled by parents. A statistically significant correlation between PROP sensitivity and food refusal was observed. Furthermore, a prevalence of the PAV-sensitive haplotype compared to the AVI-insensitive one was seen in ASD children with food selectivity. In agreement with the initial hypothesis the results show that food refusal in ASD children is mediated by bitter taste sensitivity thus suggesting that the bitter sensitivity test may be used as a device to orientate tailored food proposals for the practical management of food selectivity in ASD. Autism Res 2018, 11: 531-538. © 2017 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY A variation of the gene TAS2R38, associated with bitter taste sensitivity, can cause a different perception of some foods. In particular, some children are hypersensitive to bitterness and show a more restricted repertoire of accepted foods. We evaluate bitter sensitivity in ASD children with or without food selectivity, through a simple bitter taste test with edible strips. The results show that food refusal in ASD children can be mediated by bitter taste sensitivity thus suggesting that the bitter sensitivity test may be used as a device to orientate tailored food proposals for the practical management of food selectivity in ASD.
Collapse
Affiliation(s)
- Maria Pia Riccio
- Department of Medical and Translational Sciences, Section of Child Psychiatry, University of Federico II Naples, Italy
| | - Chiara Franco
- Department of Medical and Translational Sciences, Section of Pediatrics, University of Naples Federico II, Naples, Italy
| | - Rossella Negri
- Department of Medical and Translational Sciences, Section of Pediatrics, University of Naples Federico II, Naples, Italy
| | - Roberta Ida Ferrentino
- Department of Mental and Physical Health and Preventive Medicine, Section of Child and Adolescent Psychiatry, University of Naples "L. Vanvitelli", Naples, Italy
| | - Roberta Maresca
- Department of Mental and Physical Health and Preventive Medicine, Section of Child and Adolescent Psychiatry, University of Naples "L. Vanvitelli", Naples, Italy
| | - Elisa D'alterio
- Department of Mental and Physical Health and Preventive Medicine, Section of Child and Adolescent Psychiatry, University of Naples "L. Vanvitelli", Naples, Italy
| | - Luigi Greco
- Department of Medical and Translational Sciences, Section of Pediatrics, University of Naples Federico II, Naples, Italy
| | - Carmela Bravaccio
- Department of Medical and Translational Sciences, Section of Child Psychiatry, University of Federico II Naples, Italy
| |
Collapse
|
39
|
Samant SS, Chapko MJ, Seo HS. Predicting consumer liking and preference based on emotional responses and sensory perception: A study with basic taste solutions. Food Res Int 2017; 100:325-334. [PMID: 28873694 DOI: 10.1016/j.foodres.2017.07.021] [Citation(s) in RCA: 40] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2017] [Revised: 06/26/2017] [Accepted: 07/07/2017] [Indexed: 11/19/2022]
Abstract
Traditional methods of sensory testing focus on capturing information about multisensory perceptions, but do not necessarily measure emotions elicited by these food and beverages. The objective of this study was to develop an optimum model of predicting overall liking (rating) and preference (choice) based on taste intensity and evoked emotions. One hundred and two participants (51 females) were asked to taste water, sucrose, citric acid, salt, and caffeine solutions. Their emotional responses toward each sample were measured by a combination of a self-reported emotion questionnaire (EsSense25), facial expressions, and autonomic nervous system (ANS) responses. In addition, their perceived intensity and overall liking were measured. After a break, participants re-tasted the samples and ranked them according to their preference. The results showed that emotional responses measured using self-reported emotion questionnaire and facial expression analysis along with perceived taste intensity performed best to predict overall liking as well as preference, while ANS measures showed limited contribution. Contrary to some previous research, this study demonstrated that not only negative emotions, but also positive ones could help predict consumer liking and preference. In addition, since there were subtle differences in the prediction models of overall liking and preference, both aspects should be taken into account to understand consumer behavior. In conclusion, combination of evoked emotions along with sensory perception could help better understand consumer acceptance as well as preference toward basic taste solutions.
Collapse
Affiliation(s)
- Shilpa S Samant
- Department of Food Science, University of Arkansas, 2650 North Young Avenue, Fayetteville, AR 72704, USA
| | - Matthew J Chapko
- Department of Food Science, University of Arkansas, 2650 North Young Avenue, Fayetteville, AR 72704, USA
| | - Han-Seok Seo
- Department of Food Science, University of Arkansas, 2650 North Young Avenue, Fayetteville, AR 72704, USA.
| |
Collapse
|
40
|
Beyts C, Chaya C, Dehrmann F, James S, Smart K, Hort J. A comparison of self-reported emotional and implicit responses to aromas in beer. Food Qual Prefer 2017. [DOI: 10.1016/j.foodqual.2017.02.006] [Citation(s) in RCA: 36] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
41
|
Madrelle J, Lange C, Boutrolle I, Valade O, Weenen H, Monnery-Patris S, Issanchou S, Nicklaus S. Development of a new in-home testing method to assess infant food liking. Appetite 2017; 113:274-283. [PMID: 28274649 DOI: 10.1016/j.appet.2017.03.002] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2016] [Revised: 02/27/2017] [Accepted: 03/03/2017] [Indexed: 01/17/2023]
Abstract
The objective of this study was to develop a new elaborate method to evaluate infants' liking of foods that could be applied at home and to compare the results of this elaborate method with those of a basic method. Mothers of infants aged 4 to 7 (n = 44) and 12-15 months (n = 46) participated in this study. For the basic method, mothers were asked to assess their infant's global liking at the end of a meal. Then, for the elaborate method, mothers received detailed instructions on how to feed their infant, how infants might express like/dislike and when to stop the meal. During the first nine spoons, they were asked to report the presence/absence of positive and negative behaviours after each spoon, and the infant's initial liking was reported after each triplet of spoons. They also assessed their infant's global liking at the end of the meal. Both methods were applied using three commercial familiar baby foods adapted to each age range. In 4-7-month-olds, the elaborate method showed a significant difference across products for liking, whereas the basic method did not show any difference. In 12-15-month-olds, the elaborate method showed more differences across products for liking than the basic method. In both age groups, negative behaviours, despite being less frequently reported, provided better liking discrimination than positive behaviours. In conclusion, the elaborate method produced better product liking discrimination than the basic method by focusing maternal attention on infants' eating behaviours since the first spoons.
Collapse
Affiliation(s)
- J Madrelle
- Centre des Sciences du Goût et de l'Alimentation, AgroSup Dijon, CNRS, INRA, Univ. Bourgogne Franche-Comté, F-21000 Dijon, France
| | - C Lange
- Centre des Sciences du Goût et de l'Alimentation, AgroSup Dijon, CNRS, INRA, Univ. Bourgogne Franche-Comté, F-21000 Dijon, France
| | - I Boutrolle
- Blédina SA, 383 rue Philippe Héron, BP 432, F-69654 Villefranche-sur-Saône Cedex, France
| | - O Valade
- Blédina SA, 383 rue Philippe Héron, BP 432, F-69654 Villefranche-sur-Saône Cedex, France
| | - H Weenen
- Danone Nutricia Research, Uppsalaan 12, 3584CT Utrecht, The Netherlands
| | - S Monnery-Patris
- Centre des Sciences du Goût et de l'Alimentation, AgroSup Dijon, CNRS, INRA, Univ. Bourgogne Franche-Comté, F-21000 Dijon, France
| | - S Issanchou
- Centre des Sciences du Goût et de l'Alimentation, AgroSup Dijon, CNRS, INRA, Univ. Bourgogne Franche-Comté, F-21000 Dijon, France
| | - S Nicklaus
- Centre des Sciences du Goût et de l'Alimentation, AgroSup Dijon, CNRS, INRA, Univ. Bourgogne Franche-Comté, F-21000 Dijon, France.
| |
Collapse
|
42
|
Non-verbal evaluation of acceptance of insect-based products using a simple and holistic analysis of facial expressions. Food Qual Prefer 2017. [DOI: 10.1016/j.foodqual.2016.01.008] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
43
|
Walsh AM, Duncan SE, Bell MA, O’Keefe S, Gallagher DL. Integrating implicit and explicit emotional assessment of food quality and safety concerns. Food Qual Prefer 2017. [DOI: 10.1016/j.foodqual.2016.11.002] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
44
|
Zhi R, Cao L, Cao G. Asians' Facial Responsiveness to Basic Tastes by Automated Facial Expression Analysis System. J Food Sci 2017; 82:794-806. [PMID: 28140464 DOI: 10.1111/1750-3841.13611] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2016] [Revised: 12/06/2016] [Accepted: 12/07/2016] [Indexed: 01/17/2023]
Abstract
Growing evidence shows that consumer choices in real life are mostly driven by unconscious mechanisms rather than conscious. The unconscious process could be measured by behavioral measurements. This study aims to apply automatic facial expression analysis technique for consumers' emotion representation, and explore the relationships between sensory perception and facial responses. Basic taste solutions (sourness, sweetness, bitterness, umami, and saltiness) with 6 levels plus water were used, which could cover most of the tastes found in food and drink. The other contribution of this study is to analyze the characteristics of facial expressions and correlation between facial expressions and perceptive hedonic liking for Asian consumers. Up until now, the facial expression application researches only reported for western consumers, while few related researches investigated the facial responses during food consuming for Asian consumers. Experimental results indicated that facial expressions could identify different stimuli with various concentrations and different hedonic levels. The perceived liking increased at lower concentrations and decreased at higher concentrations, while samples with medium concentrations were perceived as the most pleasant except sweetness and bitterness. High correlations were founded between perceived intensities of bitterness, umami, saltiness, and facial reactions of disgust and fear. Facial expression disgust and anger could characterize emotion "dislike," and happiness could characterize emotion "like," while neutral could represent "neither like nor dislike." The identified facial expressions agree with the perceived sensory emotions elicited by basic taste solutions. The correlation analysis between hedonic levels and facial expression intensities obtained in this study are in accordance with that discussed for western consumers.
Collapse
Affiliation(s)
- Ruicong Zhi
- School of Computer and Communication Engineering, Univ. of Science and Technology Beijing, Beijing, 100083, P. R., China
| | - Lianyu Cao
- Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing, 100083, P. R., China
| | - Gang Cao
- School of Computer Science, Communication University of China, Beijing, 100024, P. R. China
| |
Collapse
|
45
|
He W, de Wijk RA, de Graaf C, Boesveldt S. Implicit and Explicit Measurements of Affective Responses to Food Odors. Chem Senses 2016; 41:661-8. [PMID: 27340136 DOI: 10.1093/chemse/bjw068] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
One of the main functions of olfaction is to activate approach/avoidance behavior, toward or away from people, foods, or other odor sources. These behaviors are partly automated and therefore poorly accessible via introspection. Explicit tests need therefore be complemented by implicit tests to provide additional insights into the underlying processes of these behaviors. Affective responses to seven food odors plus one control nonodor were assessed in 28 female participants (18-30 years) using explicit tests [pleasantness, intensity, and non-verbal emotional ratings (PrEmo)] as well as implicit tests that reflect dynamic expressive emotional reactions (facial expressions) as well as behavioral-preparation responses (autonomic nervous system responses: heart rate, skin conductance, and skin temperature). Explicit tests showed significant differences in pleasantness (P < 0.05), and all PrEmo emotions (P < 0.05) except shame. Explicit emotional responses were summarized by valence (explaining 83% of the responses variance) and arousal (14%) as principal components. Early implicit facial and ANS responses (after 1s) seem to reflect the odors' arousal, whereas later ANS responses (after 3-4s) reflected the odors' valence. The results suggest that explicit measures primarily reflect the odors' valence, as result of from relatively long (conscious) processing, which may be less relevant for odor acceptance in the real world where fast and automated processes based on arousal may play a larger role.
Collapse
Affiliation(s)
- Wei He
- Consumer Science and Health, Food and Biobased Research, Wageningen University and Research Centre, PO Box 17, 6700 AA Wageningen, The Netherlands and Sensory Science and Eating Behaviour, Division of Human Nutrition, Wageningen University, PO Box 17, 6700 AA Wageningen, The Netherlands
| | - René A de Wijk
- Consumer Science and Health, Food and Biobased Research, Wageningen University and Research Centre, PO Box 17, 6700 AA Wageningen, The Netherlands and
| | - Cees de Graaf
- Sensory Science and Eating Behaviour, Division of Human Nutrition, Wageningen University, PO Box 17, 6700 AA Wageningen, The Netherlands
| | - Sanne Boesveldt
- Sensory Science and Eating Behaviour, Division of Human Nutrition, Wageningen University, PO Box 17, 6700 AA Wageningen, The Netherlands
| |
Collapse
|
46
|
Application and validation of the Feeding Infants: Behaviour and Facial Expression Coding System (FIBFECS) to assess liking and wanting in infants at the time of complementary feeding. Food Qual Prefer 2016. [DOI: 10.1016/j.foodqual.2015.09.012] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
|
47
|
Hetherington M, Madrelle J, Nekitsing C, Barends C, de Graaf C, Morgan S, Parrott H, Weenen H. Developing a novel tool to assess liking and wanting in infants at the time of complementary feeding – The Feeding Infants: Behaviour and Facial Expression Coding System (FIBFECS). Food Qual Prefer 2016. [DOI: 10.1016/j.foodqual.2015.09.010] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
|
48
|
He W, Boesveldt S, de Graaf C, de Wijk RA. The relation between continuous and discrete emotional responses to food odors with facial expressions and non-verbal reports. Food Qual Prefer 2016. [DOI: 10.1016/j.foodqual.2015.09.003] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
49
|
Research challenges and methods to study food preferences in school-aged children: A review of the last 15years. Food Qual Prefer 2015. [DOI: 10.1016/j.foodqual.2015.07.010] [Citation(s) in RCA: 59] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
50
|
Onwezen M. I did good, and we did bad: The impact of collective versus private emotions on pro-environmental food consumption. Food Res Int 2015. [DOI: 10.1016/j.foodres.2015.03.032] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|