1
|
Hunter SR, Lin C, Hannum ME, Bell K, Huang A, Joseph PV, Parma V, Dalton PH, Reed DR. Low to moderate genetic influences on the rapid smell test SCENTinel ™. medRxiv 2023:2023.05.14.23289965. [PMID: 37293001 PMCID: PMC10246041 DOI: 10.1101/2023.05.14.23289965] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
SCENTinel™ - a rapid, inexpensive smell test that measures odor detection, intensity, identification, and pleasantness - was developed for population-wide screening of smell function. SCENTinel™ was previously found to screen for multiple types of smell disorders. However, the effect of genetic variability on SCENTinel™ test performance is unknown, which could affect the test's validity. This study assessed performance of SCENTinel™ in a large group of individuals with a normal sense of smell to determine the test-retest reliability and the heritability of SCENTinel™ test performance. One thousand participants (36 [IQR 26-52] years old, 72% female, 80% white) completed a SCENTinel™ test at the 2021 and 2022 Twins Days Festivals in Twinsburg, OH, and 118 of those completed a SCENTinel™ test on each of the festival's two days. Participants comprised 55% percent monozygotic twins, 13% dizygotic twins, 0.4% triplets, and 36% singletons. We found that 97% of participants passed the SCENTinel™ test. Test-retest reliability ranged from 0.57 to 0.71 for SCENTinel™ subtests. Broad-sense heritability, based on 246 monozygotic and 62 dizygotic twin dyads, was low for odor intensity (r=0.03) and moderate for odor pleasantness (r=0.4). Together, this study suggests that SCENTinel™ is a reliable smell test with only moderate heritability effects, which further supports its utility for population-wide screening for smell function.
Collapse
Affiliation(s)
| | - Cailu Lin
- Monell Chemical Senses Center, Philadelphia, PA, United States of America
| | | | - Katherine Bell
- Monell Chemical Senses Center, Philadelphia, PA, United States of America
| | - Amy Huang
- Monell Chemical Senses Center, Philadelphia, PA, United States of America
| | - Paule V. Joseph
- National Institute of Alcohol Abuse and Alcoholism, Section of Sensory Science and Metabolism & National Institute of Nursing Research, Bethesda, MD, United States of America
| | - Valentina Parma
- Monell Chemical Senses Center, Philadelphia, PA, United States of America
| | - Pamela H. Dalton
- Monell Chemical Senses Center, Philadelphia, PA, United States of America
| | - Danielle R. Reed
- Monell Chemical Senses Center, Philadelphia, PA, United States of America
| |
Collapse
|
2
|
Hannum ME, Koch RJ, Ramirez VA, Marks SS, Toskala AK, Herriman RD, Lin C, Joseph PV, Reed DR. Taste loss as a distinct symptom of COVID-19: a systematic review and meta-analysis. Chem Senses 2023; 48:bjad043. [PMID: 38100383 DOI: 10.1093/chemse/bjad043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2023] Open
Abstract
Chemosensory scientists have been skeptical that reports of COVID-19 taste loss are genuine, in part because before COVID-19 taste loss was rare and often confused with smell loss. Therefore, to establish the predicted prevalence rate of taste loss in COVID-19 patients, we conducted a systematic review and meta-analysis of 376 papers published in 2020-2021, with 235 meeting all inclusion criteria. Drawing on previous studies and guided by early meta-analyses, we explored how methodological differences (direct vs. self-report measures) may affect these estimates. We hypothesized that direct measures of taste are at least as sensitive as those obtained by self-report and that the preponderance of evidence confirms taste loss is a symptom of COVID-19. The meta-analysis showed that, among 138,015 COVID-19-positive patients, 36.62% reported taste dysfunction (95% confidence interval: 33.02%-40.39%), and the prevalence estimates were slightly but not significantly higher from studies using direct (n = 15) versus self-report (n = 220) methodologies (Q = 1.73, df = 1, P = 0.1889). Generally, males reported lower rates of taste loss than did females, and taste loss was highest among middle-aged adults. Thus, taste loss is likely a bona fide symptom of COVID-19, meriting further research into the most appropriate direct methods to measure it and its underlying mechanisms.
Collapse
Affiliation(s)
- Mackenzie E Hannum
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, USA
| | - Riley J Koch
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, USA
| | - Vicente A Ramirez
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, USA
- Department of Public Health, University of California Merced, Merced, CA 95348, USA
| | - Sarah S Marks
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, USA
| | - Aurora K Toskala
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, USA
| | - Riley D Herriman
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, USA
| | - Cailu Lin
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, USA
| | - Paule V Joseph
- Division of Intramural Research, National Institute of Nursing Research, National Institutes of Health, Bethesda, MD, USA
- Division of Intramural Research, National Institute of Alcohol Abuse and Alcoholism, National Institutes of Health, Bethesda, MD, USA
| | - Danielle R Reed
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, USA
| |
Collapse
|
3
|
Hannum ME, Koch RJ, Ramirez VA, Marks SS, Toskala AK, Herriman RD, Lin C, Joseph PV, Reed DR. Reply: taste loss as a distinct symptom of COVID-19: a systematic review and meta-analysis. Chem Senses 2023; 48:bjad012. [PMID: 37503715 PMCID: PMC10653024 DOI: 10.1093/chemse/bjad012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/29/2023] Open
Affiliation(s)
- Mackenzie E Hannum
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, United States
| | - Riley J Koch
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, United States
| | - Vicente A Ramirez
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, United States
- Department of Public Health, University of California Merced, Merced, CA 95348, United States
| | - Sarah S Marks
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, United States
| | - Aurora K Toskala
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, United States
| | - Riley D Herriman
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, United States
| | - Cailu Lin
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, United States
| | - Paule V Joseph
- Division of Intramural Research, National Institute of Nursing Research, National Institutes of Health, Bethesda, MD, United States
- Division of Intramural Research, National Institute of Alcohol Abuse and Alcoholism, National Institutes of Health, Bethesda, MD, United States
| | - Danielle R Reed
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, United States
| |
Collapse
|
4
|
Hunter SR, Hannum ME, Pellegrino R, O’Leary MA, Rawson NE, Reed DR, Dalton PH, Parma V. Proof-of-concept: SCENTinel 1.1 rapidly discriminates COVID-19-related olfactory disorders. Chem Senses 2023; 48:bjad002. [PMID: 36796784 PMCID: PMC9935080 DOI: 10.1093/chemse/bjad002] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/18/2023] Open
Abstract
It is estimated that 20%-67% of those with COVID-19 develop olfactory disorders, depending on the SARS-CoV-2 variant. However, there is an absence of quick, population-wide olfactory tests to screen for olfactory disorders. The purpose of this study was to provide a proof-of-concept that SCENTinel 1.1, a rapid, inexpensive, population-wide olfactory test, can discriminate between anosmia (total smell loss), hyposmia (reduced sense of smell), parosmia (distorted odor perception), and phantosmia (odor sensation without a source). Participants were mailed a SCENTinel 1.1 test, which measures odor detection, intensity, identification, and pleasantness, using one of 4 possible odors. Those who completed the test (N = 287) were divided into groups based on their self-reported olfactory function: quantitative olfactory disorder only (anosmia or hyposmia, N = 135), qualitative olfactory disorder only (parosmia and/or phantosmia; N = 86), and normosmia (normal sense of smell; N = 66). SCENTinel 1.1 accurately discriminates quantitative olfactory disorders, qualitative olfactory disorders, and normosmia groups. When olfactory disorders were assessed individually, SCENTinel 1.1 discriminates between hyposmia, parosmia, and anosmia. Participants with parosmia rated common odors less pleasant than those without parosmia. We provide proof-of-concept that SCENTinel 1.1, a rapid smell test, can discriminate quantitative and qualitative olfactory disorders, and is the only direct test to rapidly discriminate parosmia.
Collapse
Affiliation(s)
| | | | | | | | - Nancy E Rawson
- Monell Chemical Senses Center, Philadelphia, PA, United States
| | - Danielle R Reed
- Monell Chemical Senses Center, Philadelphia, PA, United States
| | - Pamela H Dalton
- Monell Chemical Senses Center, Philadelphia, PA, United States
| | - Valentina Parma
- Monell Chemical Senses Center, Philadelphia, PA, United States
- Department of Psychology, Temple University, Philadelphia, PA, United States
| |
Collapse
|
5
|
Hunter SR, Hannum ME, Pellegrino R, O’Leary MA, Rawson NE, Reed DR, Dalton PH, Parma V. Proof-of-concept: SCENTinel 1.1 rapidly discriminates COVID-19 related olfactory disorders. medRxiv 2022:2022.03.23.22272807. [PMID: 35350197 PMCID: PMC8963695 DOI: 10.1101/2022.03.23.22272807] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
It is estimated that 20-67% of those with COVID-19 develop olfactory disorders, depending on the SARS-CoV-2 variant. However, there is an absence of quick, population-wide olfactory tests to screen for olfactory disorders. The purpose of this study was to provide a proof-of-concept that SCENTinel 1.1, a rapid, inexpensive, population-wide olfactory test, can discriminate between anosmia (total smell loss), hyposmia (reduced sense of smell), parosmia (distorted odor perception), and phantosmia (odor sensation without a source). Participants were mailed a SCENTinel 1.1 test, which measures odor detection, intensity, identification, and pleasantness, using one of four possible odors. Those who completed the test (N = 381) were divided into groups based on their self-reported olfactory function: quantitative olfactory disorder (anosmia or hyposmia, N = 135), qualitative olfactory disorder (parosmia and/or phantosmia; N = 86), and normosmia (normal sense of smell; N = 66). SCENTinel 1.1 accurately discriminates quantitative olfactory disorders, qualitative olfactory disorders, and normosmia groups. When olfactory disorders were assessed individually, SCENTinel 1.1 discriminates between hyposmia, parosmia and anosmia. Participants with parosmia rated common odors less pleasant than those without parosmia. We provide proof-of-concept that SCENTinel 1.1, a rapid smell test, can discriminate quantitative and qualitative olfactory disorders, and is the only direct test to rapidly discriminate parosmia.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | - Valentina Parma
- Monell Chemical Senses Center, Philadelphia, PA
- Department of Psychology, Temple University, Philadelphia, PA
- Correspondence: Valentina Parma, PhD, Monell Chemical Senses Center, 3500 Market Street, Philadelphia, PA 19143,
| |
Collapse
|
6
|
Hannum ME, Simons CT. Capturing high and low levels of participant engagement in sensory and consumer evaluations via a known groups design and an implicit correlate. Food Res Int 2022; 161:111786. [DOI: 10.1016/j.foodres.2022.111786] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2022] [Revised: 07/11/2022] [Accepted: 08/18/2022] [Indexed: 11/04/2022]
|
7
|
Ohla K, Veldhuizen MG, Green T, Hannum ME, Bakke AJ, Moein ST, Tognetti A, Postma EM, Pellegrino R, Hwang DLD, Albayay J, Koyama S, Nolden AA, Thomas-Danguin T, Mucignat-Caretta C, Menger NS, Croijmans I, Ã-ztà Rk L, YanÄ K H, Pierron D, Pereda-Loth V, Nunez-Parra A, Martinez Pineda AM, Gillespie D, Farruggia MC, Cecchetto C, Fornazieri MA, Philpott C, Voznessenskaya V, Cooper KW, Rohlfs Dominguez P, Calcinoni O, de Groot J, Boesveldt S, Bhutani S, Weir EM, Exten C, Joseph PV, Parma V, Hayes JE, Niv MY. A follow-up on quantitative and qualitative olfactory dysfunction and other symptoms in patients recovering from COVID-19 smell loss. Rhinology 2022; 60:207-217. [PMID: 35398877 PMCID: PMC11016179 DOI: 10.4193/rhin21.415] [Citation(s) in RCA: 30] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
BACKGROUND Sudden smell loss is a specific early symptom of COVID-19, which, prior to the emergence of Omicron, had estimated prevalence of ~40% to 75%. Chemosensory impairments affect physical and mental health, and dietary behavior. Thus, it is critical to understand the rate and time course of smell recovery. The aim of this cohort study was to characterize smell function and recovery up to 11 months post COVID-19 infection. METHODS This longitudinal survey of individuals suffering COVID-19-related smell loss assessed disease symptoms and gustatory and olfactory function. Participants (n=12,313) who completed an initial survey (S1) about respiratory symptoms, chemosensory function and COVID-19 diagnosis between April and September 2020, were invited to complete a follow-up survey (S2). Between September 2020 and February 2021, 27.5% participants responded (n=3,386), with 1,468 being diagnosed with COVID-19 and suffering co-occurring smell and taste loss at the beginning of their illness. RESULTS At follow-up (median time since COVID-19 onset ~200 days), ~60% of women and ~48% of men reported less than 80% of their pre-illness smell ability. Taste typically recovered faster than smell, and taste loss rarely persisted if smell recovered. Prevalence of parosmia and phantosmia was ~10% of participants in S1 and increased substantially in S2: ~47% for parosmia and ~25% for phantosmia. Persistent smell impairment was associated with more symptoms overall, suggesting it may be a key marker of long-COVID illness. The ability to smell during COVID-19 was rated slightly lower by those who did not eventually recover their pre-illness ability to smell at S2. CONCLUSIONS While smell ability improves for many individuals who lost it during acute COVID-19, the prevalence of parosmia and phantosmia increases substantially over time. Olfactory dysfunction is associated with broader persistent symptoms of COVID-19, and may last for many months following acute COVID-19. Taste loss in the absence of smell loss is rare. Persistent qualitative smell symptoms are emerging as common long-term sequelae; more research into treatment options is strongly warranted given that even conservative estimates suggest millions of individuals may experience parosmia following COVID-19. Healthcare providers worldwide need to be prepared to treat post COVID-19 secondary effects on physical and mental health.
Collapse
Affiliation(s)
- K Ohla
- Helmut-Schmidt-University, University of the Armed Forces Hamburg, Germany; Firmenich SA, Satigny, Switzerland; The Pennsylvania State University, USA
| | | | - T Green
- The Hebrew University of Jerusalem, Israel
| | - M E Hannum
- Monell Chemical Senses Center, Philadelphia, USA
| | - A J Bakke
- The Pennsylvania State University, USA
| | - S T Moein
- Institute for Research in Fundamental Sciences (IPM), Iran
| | - A Tognetti
- Karolinska Institutet, Stockholm, Sweden
| | - E M Postma
- Wageningen University and Research, the Netherlands
| | - R Pellegrino
- Monell Chemical Senses Center, Philadelphia, USA
| | | | | | | | - A A Nolden
- University of Massachusetts, Amherst, USA
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - S Boesveldt
- Wageningen University and Research, the Netherlands
| | | | - E M Weir
- The Pennsylvania State University, USA
| | - C Exten
- The Pennsylvania State University, USA
| | - P V Joseph
- National Institutes of Health, NINR, NIAAA, USA
| | - V Parma
- Monell Chemical Senses Center, Philadelphia, USA
| | - J E Hayes
- The Pennsylvania State University, USA
| | - M Y Niv
- The Hebrew University of Jerusalem, Israel
| |
Collapse
|
8
|
Weir EM, Hannum ME, Reed DR, Joseph PV, Munger SD, Hayes JE, Gerkin RC. The Adaptive Olfactory Measure of Threshold (ArOMa-T): A rapid test of olfactory function. medRxiv 2022:2022.03.08.22272086. [PMID: 35313597 PMCID: PMC8936104 DOI: 10.1101/2022.03.08.22272086] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Abstract
PURPOSE Many widely-used psychophysical tests of olfaction have limitations that can create barriers to adoption outside research settings. For example, tests that measure the ability to identify odors may confound sensory performance with memory recall, verbal ability, and past experience with the odor. Conversely, threshold-based tests typically avoid these issues, but are labor intensive. Additionally, many commercially available olfactory tests are slow and may require a trained administrator, making them impractical for use in a short wellness visit or other broad clinical assessment. METHODS We tested the performance of the Adaptive Olfactory Measure of Threshold (ArOMa-T) -- a novel odor detection threshold test that employs an adaptive Bayesian algorithm paired with a disposable odor-delivery card -- in a non-clinical sample of individuals (n=534) at the 2021 Twins Day Festival in Twinsburg, OH. RESULTS Participants successfully completed the test in under 3 min with a false alarm rate of 9.6% and a test-retest reliability of 0.61. Odor detection thresholds differed by sex (~3.2-fold) and between the youngest and oldest age groups (~8.7-fold), consistent with prior work. In an exploratory analysis, we failed to observe evidence of detection threshold differences between participants who reported a history of COVID-19 and matched controls who did not. We also found evidence for broad-sense heritability of odor detection thresholds. CONCLUSION Together, these data indicate the ArOMa-T can determine odor detection thresholds. The ArOMa-T may be particularly valuable in clinical or field settings where rapid and portable assessment of olfactory function is needed.
Collapse
Affiliation(s)
- Elisabeth M. Weir
- Sensory Evaluation Center, The Pennsylvania State University, University Park PA 16802
- Department of Food Science, College of Agricultural Sciences, The Pennsylvania State University, University Park PA 16802
| | | | | | - Paule V. Joseph
- Division of Intramural Clinical and Biological Research (DICBR), National Institute on Alcohol Abuse and Alcoholism, National Institutes of Health, Bethesda MD, 20892
- Division of Intramural Research, National Institute of Nursing Research, National Institutes of Health, Bethesda MD, 20892
| | - Steven D. Munger
- Department of Pharmacology and Therapeutics, University of Florida, Gainesville FL, 32610
- Department of Otolaryngology, College of Medicine, University of Florida, Gainesville FL, 32610
- Center for Smell and Taste, University of Florida, Gainesville FL, 32610
| | - John E. Hayes
- Sensory Evaluation Center, The Pennsylvania State University, University Park PA 16802
- Department of Food Science, College of Agricultural Sciences, The Pennsylvania State University, University Park PA 16802
| | | |
Collapse
|
9
|
Weir EM, Hannum ME, Reed DR, Joseph PV, Munger SD, Hayes JE, Gerkin RC. The Adaptive Olfactory Measure of Threshold (ArOMa-T): a rapid test of olfactory function. Chem Senses 2022; 47:bjac036. [PMID: 36469087 PMCID: PMC9798529 DOI: 10.1093/chemse/bjac036] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2022] [Indexed: 12/12/2022] Open
Abstract
Many widely used psychophysical olfactory tests have limitations that can create barriers to adoption. For example, tests that measure the ability to identify odors may confound sensory performance with memory recall, verbal ability, and prior experience with the odor. Conversely, classic threshold-based tests avoid these issues, but are labor intensive. Additionally, many commercially available tests are slow and may require a trained administrator, making them impractical for use in situations where time is at a premium or self-administration is required. We tested the performance of the Adaptive Olfactory Measure of Threshold (ArOMa-T)-a novel odor detection threshold test that employs an adaptive Bayesian algorithm paired with a disposable odorant delivery card-in a non-clinical sample of individuals (n = 534) at the 2021 Twins Day Festival in Twinsburg, OH. Participants successfully completed the test in under 3 min with a false alarm rate of 7.5% and a test-retest reliability of 0.61. Odor detection thresholds differed by sex (~3.2-fold lower for females) and age (~8.7-fold lower for the youngest versus the oldest age group), consistent with prior studies. In an exploratory analysis, we failed to observe evidence of detection threshold differences between participants who reported a history of COVID-19 and matched controls who did not. We also found evidence for broad-sense heritability of odor detection thresholds. Together, this study suggests the ArOMa-T can determine odor detection thresholds. Additional validation studies are needed to confirm the value of ArOMa-T in clinical or field settings where rapid and portable assessment of olfactory function is needed.
Collapse
Affiliation(s)
- Elisabeth M Weir
- Sensory Evaluation Center, College of Agricultural Sciences, The Pennsylvania State University, University Park, PA 16802, United States
- Department of Food Science, College of Agricultural Sciences, The Pennsylvania State University, University Park, PA 16802, United States
| | | | - Danielle R Reed
- Monell Chemical Senses Center, Philadelphia, PA 19104, United States
| | - Paule V Joseph
- Division of Intramural Clinical and Biological Research (DICBR), National Institute on Alcohol Abuse and Alcoholism, National Institutes of Health, Bethesda, MD 20892, United States
- Division of Intramural Research, National Institute of Nursing Research, National Institutes of Health, Bethesda, MD 20892, United States
| | - Steven D Munger
- Department of Pharmacology and Therapeutics, College of Medicine, University of Florida, Gainesville, FL 32610, United States
- Department of Otolaryngology, College of Medicine, University of Florida, Gainesville, FL 32610, United States
- Center for Smell and Taste, University of Florida, Gainesville, FL 32610, United States
| | - John E Hayes
- Sensory Evaluation Center, College of Agricultural Sciences, The Pennsylvania State University, University Park, PA 16802, United States
- Department of Food Science, College of Agricultural Sciences, The Pennsylvania State University, University Park, PA 16802, United States
| | - Richard C Gerkin
- School of Life Sciences, Arizona State University, Tempe, AZ 85287, United States
| |
Collapse
|
10
|
Hannum ME, Koch RJ, Ramirez VA, Marks SS, Toskala AK, Herriman RD, Lin C, Joseph PV, Reed DR. Taste loss as a distinct symptom of COVID-19: a systematic review and meta-analysis. Chem Senses 2022; 47:bjac001. [PMID: 35171979 PMCID: PMC8849313 DOI: 10.1093/chemse/bjac001] [Citation(s) in RCA: 26] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Chemosensory scientists have been skeptical that reports of COVID-19 taste loss are genuine, in part because before COVID-19 taste loss was rare and often confused with smell loss. Therefore, to establish the predicted prevalence rate of taste loss in COVID-19 patients, we conducted a systematic review and meta-analysis of 376 papers published in 2020-2021, with 241 meeting all inclusion criteria. Drawing on previous studies and guided by early meta-analyses, we explored how methodological differences (direct vs. self-report measures) may affect these estimates. We hypothesized that direct measures of taste are at least as sensitive as those obtained by self-report and that the preponderance of evidence confirms taste loss is a symptom of COVID-19. The meta-analysis showed that, among 138,897 COVID-19-positive patients, 39.2% reported taste dysfunction (95% confidence interval: 35.34%-43.12%), and the prevalence estimates were slightly but not significantly higher from studies using direct (n = 18) versus self-report (n = 223) methodologies (Q = 0.57, df = 1, P = 0.45). Generally, males reported lower rates of taste loss than did females, and taste loss was highest among middle-aged adults. Thus, taste loss is likely a bona fide symptom of COVID-19, meriting further research into the most appropriate direct methods to measure it and its underlying mechanisms.
Collapse
Affiliation(s)
- Mackenzie E Hannum
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, USA
| | - Riley J Koch
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, USA
| | - Vicente A Ramirez
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, USA
- Department of Public Health, University of California Merced, Merced, CA 95348, USA
| | - Sarah S Marks
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, USA
| | - Aurora K Toskala
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, USA
| | - Riley D Herriman
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, USA
| | - Cailu Lin
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, USA
| | - Paule V Joseph
- Division of Intramural Research, National Institute of Nursing Research, National Institutes of Health, Bethesda, MD, USA
- Division of Intramural Research, National Institute of Alcohol Abuse and Alcoholism, National Institutes of Health, Bethesda, MD, USA
| | - Danielle R Reed
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104, USA
| |
Collapse
|
11
|
Hannum ME, Koch RJ, Ramirez VA, Marks SS, Toskala AK, Herriman RD, Lin C, Joseph PV, Reed DR. Taste loss as a distinct symptom of COVID-19: A systematic review and meta-analysis. medRxiv 2021:2021.10.09.21264771. [PMID: 34671775 PMCID: PMC8528083 DOI: 10.1101/2021.10.09.21264771] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
Chemosensory scientists have been skeptical that reports of COVID-19 taste loss are genuine, in part because before COVID-19, taste loss was rare and often confused with smell loss. Therefore, to establish the predicted prevalence rate of taste loss in COVID-19 patients, we conducted a systematic review and meta-analysis of 376 papers published in 2020-2021, with 241 meeting all inclusion criteria. Additionally, we explored how methodological differences (direct vs. self-report measures) may affect these estimates. We hypothesized that direct prevalence measures of taste loss would be the most valid because they avoid the taste/smell confusion of self-report. The meta-analysis showed that, among 138,897 COVID-19-positive patients, 39.2% reported taste dysfunction (95% CI: 35.34-43.12%), and the prevalence estimates were slightly but not significantly higher from studies using direct (n = 18) versus self-report (n = 223) methodologies (Q = 0.57, df = 1, p = 0.45). Generally, males reported lower rates of taste loss than did females and taste loss was highest in middle-aged groups. Thus, taste loss is a bona fide symptom COVID-19, meriting further research into the most appropriate direct methods to measure it and its underlying mechanisms.
Collapse
Affiliation(s)
| | - Riley J Koch
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104
| | - Vicente A Ramirez
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104
- Department of Public Health, University of California Merced, Merced, CA 95348
| | - Sarah S Marks
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104
| | - Aurora K Toskala
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104
| | - Riley D Herriman
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104
| | - Cailu Lin
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104
| | - Paule V Joseph
- Division of Intramural Research, National Institute of Nursing Research, National Institutes of Health, Bethesda, MD, USA
- Division of Intramural Research, National Institute of Alcohol Abuse and Alcoholism, National Institutes of Health, Bethesda, MD, USA
| | - Danielle R Reed
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104
| |
Collapse
|
12
|
Hannum ME, Lin C, Bell K, Toskala A, Koch R, Galaniha T, Nolden A, Reed DR, Joseph P. The genetics of eating behaviors: research in the age of COVID-19. bioRxiv 2021:2021.09.03.458854. [PMID: 34518838 DOI: 10.1101/2021.04.03.438340] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
How much pleasure we take in eating is more than just how much we enjoy the taste of food. Food involvement - the amount of time we spend on food beyond the immediate act of eating and tasting - is key to the human food experience. We took a biological approach to test whether food-related behaviors, together capturing food involvement, have genetic components and are partly due to inherited variation. We collected data via an internet survey from a genetically informative sample of 419 adult twins (114 monozygotic twin pairs, 31 dizygotic twin pairs, and 129 singletons). Because we conducted this research during the pandemic, we also ascertained how many participants had experienced COVID-19-associated loss of taste and smell. Since these respondents had previously participated in research in person, we measured their level of engagement to evaluate the quality of their online responses. Additive genetics explained 16-44% of the variation in some measures of food involvement, most prominently various aspects of cooking, suggesting some features of the human food experience may be inborn. Other features reflected shared (early) environment, captured by respondents' twin status. About 6% of participants had a history of COVID-19 infection, many with transitory taste and smell loss, but all but one had recovered before the survey. Overall, these results suggest that people may have inborn as well as learned variations in their involvement with food. We also learned to adapt to research during a pandemic by considering COVID-19 status and measuring engagement in online studies of human eating behavior.
Collapse
|
13
|
Hannum ME, Lin C, Bell K, Toskala A, Koch R, Galaniha T, Nolden A, Reed DR, Joseph P. The genetics of eating behaviors: research in the age of COVID-19. bioRxiv 2021:2021.09.03.458854. [PMID: 34518838 PMCID: PMC8437311 DOI: 10.1101/2021.09.03.458854] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
How much pleasure we take in eating is more than just how much we enjoy the taste of food. Food involvement - the amount of time we spend on food beyond the immediate act of eating and tasting - is key to the human food experience. We took a biological approach to test whether food-related behaviors, together capturing food involvement, have genetic components and are partly due to inherited variation. We collected data via an internet survey from a genetically informative sample of 419 adult twins (114 monozygotic twin pairs, 31 dizygotic twin pairs, and 129 singletons). Because we conducted this research during the pandemic, we also ascertained how many participants had experienced COVID-19-associated loss of taste and smell. Since these respondents had previously participated in research in person, we measured their level of engagement to evaluate the quality of their online responses. Additive genetics explained 16-44% of the variation in some measures of food involvement, most prominently various aspects of cooking, suggesting some features of the human food experience may be inborn. Other features reflected shared (early) environment, captured by respondents' twin status. About 6% of participants had a history of COVID-19 infection, many with transitory taste and smell loss, but all but one had recovered before the survey. Overall, these results suggest that people may have inborn as well as learned variations in their involvement with food. We also learned to adapt to research during a pandemic by considering COVID-19 status and measuring engagement in online studies of human eating behavior.
Collapse
Affiliation(s)
| | - Cailu Lin
- Monell Chemical Senses Center, 3500 Market St, Philadelphia, PA, USA
| | - Katherine Bell
- Monell Chemical Senses Center, 3500 Market St, Philadelphia, PA, USA
| | - Aurora Toskala
- Monell Chemical Senses Center, 3500 Market St, Philadelphia, PA, USA
| | - Riley Koch
- Monell Chemical Senses Center, 3500 Market St, Philadelphia, PA, USA
| | - Tharaka Galaniha
- Department of Food Science, University of Massachusetts, Amherst, MA, USA
| | - Alissa Nolden
- Department of Food Science, University of Massachusetts, Amherst, MA, USA
| | - Danielle R Reed
- Monell Chemical Senses Center, 3500 Market St, Philadelphia, PA, USA
| | - Paule Joseph
- National Institute on Alcohol Abuse and Alcoholism, Bethesda, MD, USA
- National Institute of Nursing Research, Bethesda, MD, USA
| |
Collapse
|
14
|
Hannum ME, Fryer JA, Simons CT. Non-food odors and the duality of smell: Impact of odorant delivery pathway and labeling convention on olfactory perception. Physiol Behav 2021; 238:113480. [PMID: 34058218 DOI: 10.1016/j.physbeh.2021.113480] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2021] [Revised: 05/15/2021] [Accepted: 05/25/2021] [Indexed: 01/19/2023]
Abstract
The olfactory system encompasses two perceptual pathways (orthonasal and retronasal) that activate the same receptors in the olfactory epithelium yet are thought to elicit different perceptions. Presently, a novel matching paradigm was employed using a non-food flavor set with low retronasal familiarity (honeysuckle, lavender, rose, and jasmine) to evaluate the effect of odor type on the Duality of Smell. Additionally, the influence of cognitive strategies used by subjects was assessed by manipulating the naming convention seen by the subjects: familiar (Honeysuckle, Lavender, Rose, Jasmine), unfamiliar (Inodora, Pedunculata, Beggeriana, Didymum), and generic (A, B, C, D). Subjects were presented with a reference, either in a vial (orthonasal delivery, ON) or a 2 oz. cup (retronasal delivery, RN) and instructed to match the same aroma from four unknowns, evaluated either by the same delivery route (congruent, e.g., ON-ON, RN-RN) or different route (incongruent, e.g., ON-RN, RN-ON) than the reference evaluation. All possible combinations of orthonasal and retronasal delivery for the reference and unknowns (e.g. ON-ON, RN-RN, ON-RN, RN-ON) were assessed by all subjects. Matching performance and signal detection measures indicated that, on average, subjects performed significantly better in the congruent conditions than in the incongruent conditions. These results suggest perceptual quality of aromas is route dependent and extend the Duality of Smell hypothesis to samples with low retronasal familiarity such as non-food odors. Labeling convention also had an impact on performance but, surprisingly, not in the direction anticipated. Indeed, as the information contained in the label decreased from familiar to generic reference names, performance increased. Moreover, depending on the labeling convention used, certain aromas were easier to match than others. The present research suggests odorant matching is a function of stimulus quality, cognitive strategy, and labeling convention.
Collapse
Affiliation(s)
- Mackenzie E Hannum
- Department of Food Science & Technology, The Ohio State University, 2015 Fyffe Rd., Columbus, OH 43210-1007
| | - Jenna A Fryer
- Department of Food Science & Technology, The Ohio State University, 2015 Fyffe Rd., Columbus, OH 43210-1007
| | - Christopher T Simons
- Department of Food Science & Technology, The Ohio State University, 2015 Fyffe Rd., Columbus, OH 43210-1007.
| |
Collapse
|
15
|
Hannum ME, Forzley S, Popper R, Simons CT. Application of the Engagement Questionnaire (EQ) to compare methodological differences in sensory and consumer testing. Food Res Int 2021; 140:110083. [PMID: 33648301 DOI: 10.1016/j.foodres.2020.110083] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Revised: 12/22/2020] [Accepted: 12/25/2020] [Indexed: 10/22/2022]
Abstract
Understanding the panelist experience in sensory and consumer testing is a critical step in methodological development that improves data reliability. Therefore, the Engagement Questionnaire (EQ) was recently developed to characterize consumer engagement during sensory and consumer testing and to provide a novel and translatable metric for researchers to compare methodologies. Presently, we assessed whether relatively minor methodological manipulations to common consumer testing paradigms impact panelist engagement. Specifically, panelist engagement was measured in three scenarios: over the course of a two-day consumer hedonic evaluation (Experiment 1), with differing Just-About-Right (JAR) questionnaire formats in an evaluation (Experiment 2), and with a time pressure element imposed during a consumer acceptability test (Experiment 3). In Experiment 1, subjects remained actively involved in the evaluation across both days of testing, however, they found more purpose and affective value in the task after the second day. In Experiment 2, changing the structure of JAR questions did not impact subject's level of active involvement with the task, yet certain JAR question structures did elicit higher purposeful intent and affective value in subjects. Surprisingly, in Experiment 3, subjects were less actively involved in the time-pressure condition; purposeful intent and affective value were consistent across both conditions. Overall, the EQ was able to resolve differences in panelists' perceived level of engagement across all the experimental manipulations, aiding in discussion regarding the effect even minor manipulations might have on consumer panelists. The EQ is a valuable asset to methodological development and enables comparisons of differing sensory and consumer methodologies.
Collapse
Affiliation(s)
- Mackenzie E Hannum
- Department of Food Science & Technology, The Ohio State University, 2015 Fyffe Rd, Columbus, OH 43210-1007, United States
| | - Sheri Forzley
- P&K Research, 6323 North Avondale Avenue, Chicago, IL 60631, United States
| | - Richard Popper
- P&K Research, 6323 North Avondale Avenue, Chicago, IL 60631, United States
| | - Christopher T Simons
- Department of Food Science & Technology, The Ohio State University, 2015 Fyffe Rd, Columbus, OH 43210-1007, United States.
| |
Collapse
|
16
|
Abstract
Commercially available smell tests are primarily used in research or in-depth clinical evaluations and are too costly and time-consuming for population surveillance in health emergencies like COVID-19. To address this need, we developed the SCENTinel 1.0 test, which rapidly evaluates 3 olfactory functions: detection, intensity, and identification. We tested whether self-administering the SCENTinel 1.0 test discriminates between individuals with self-reported smell loss and those with average smell ability (normosmic individuals) and provides performance comparable to the validated and standardized NIH Toolbox Odor Identification Test in normosmic individuals. Using Bayesian linear models and prognostic classification algorithms, we compared the SCENTinel 1.0 performance of a group of self-reported anosmic individuals (N = 111, 47 ± 13 years old, F = 71%) and normosmic individuals (N = 154, 47 ± 14 years old, F = 74%) as well as individuals reporting other smell disorders (such as hyposmia or parosmia; N = 42, 55 ± 10 years old, F = 67%). Ninety-four percent of normosmic individuals met our SCENTinel 1.0 accuracy criteria compared with only 10% of anosmic individuals and 64% of individuals with other smell disorders. Overall performance on SCENTinel 1.0 predicted belonging to the normosmic group better than identification or detection alone (vs. anosmic: AUC = 0.95, specificity = 0.94). Odor intensity provided the best single-feature predictor to classify normosmic individuals. Among normosmic individuals, 92% met the accuracy criteria at both SCENTinel 1.0 and the NIH Toolbox Odor Identification Test. SCENTinel 1.0 is a practical test able to discriminate individuals with smell loss and will likely be useful in many clinical situations, including COVID-19 symptom screening.
Collapse
Affiliation(s)
- Valentina Parma
- Department of Psychology, Temple University, 1701 N 13th Street, Philadelphia, PA, USA
- Monell Chemical Senses Center, 3500 Market Street, 19104, Philadelphia, PA, USA
| | - Mackenzie E Hannum
- Monell Chemical Senses Center, 3500 Market Street, 19104, Philadelphia, PA, USA
| | - Maureen O’Leary
- Monell Chemical Senses Center, 3500 Market Street, 19104, Philadelphia, PA, USA
| | - Robert Pellegrino
- Monell Chemical Senses Center, 3500 Market Street, 19104, Philadelphia, PA, USA
| | - Nancy E Rawson
- Monell Chemical Senses Center, 3500 Market Street, 19104, Philadelphia, PA, USA
| | - Danielle R Reed
- Monell Chemical Senses Center, 3500 Market Street, 19104, Philadelphia, PA, USA
| | - Pamela H Dalton
- Monell Chemical Senses Center, 3500 Market Street, 19104, Philadelphia, PA, USA
| |
Collapse
|
17
|
Hannum ME, Ramirez VA, Lipson SJ, Herriman RD, Toskala AK, Lin C, Joseph PV, Reed DR. Objective Sensory Testing Methods Reveal a Higher Prevalence of Olfactory Loss in COVID-19-Positive Patients Compared to Subjective Methods: A Systematic Review and Meta-Analysis. Chem Senses 2020; 45:865-874. [PMID: 33245136 PMCID: PMC7543258 DOI: 10.1093/chemse/bjaa064] [Citation(s) in RCA: 73] [Impact Index Per Article: 18.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2020] [Indexed: 11/13/2022] Open
Abstract
Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which causes coronavirus disease 2019 (COVID-19), has currently infected over 6.5 million people worldwide. In response to the pandemic, numerous studies have tried to identify the causes and symptoms of the disease. Emerging evidence supports recently acquired anosmia (complete loss of smell) and hyposmia (partial loss of smell) as symptoms of COVID-19, but studies of olfactory dysfunction show a wide range of prevalence from 5% to 98%. We undertook a search of Pubmed/Medline and Google Scholar with the keywords "COVID-19," "smell," and/or "olfaction." We included any study that quantified smell loss (anosmia and hyposmia) as a symptom of COVID-19. Studies were grouped and compared based on the type of method used to measure smell loss-subjective measures, such as self-reported smell loss, versus objective measures using rated stimuli-to determine if prevalence differed by method type. For each study, 95% confidence intervals (CIs) were calculated from point estimates of olfactory disturbances. We identified 34 articles quantifying anosmia as a symptom of COVID-19 (6 objective and 28 subjective), collected from cases identified from January 16 to April 30, 2020. The pooled prevalence estimate of smell loss was 77% when assessed through objective measurements (95% CI of 61.4-89.2%) and 44% with subjective measurements (95% CI of 32.2-57.0%). Objective measures are a more sensitive method to identify smell loss as a result of infection with SARS-CoV-2; the use of subjective measures, while expedient during the early stages of the pandemic, underestimates the true prevalence of smell loss.
Collapse
Affiliation(s)
| | - Vicente A Ramirez
- Monell Chemical Senses Center, Philadelphia, PA
- Department of Public Health, University of California Merced, Merced, CA
| | | | | | | | - Cailu Lin
- Monell Chemical Senses Center, Philadelphia, PA
| | - Paule V Joseph
- Division of Intramural Research, National Institute of Nursing Research, National Institutes of Health, Bethesda, MD, USA
- Division of Intramural Research, National Institute of Nursing Research & National Institute of Alcohol Abuse and Alcoholism, National Institutes of Health, Bethesda, MD, USA
| | | |
Collapse
|
18
|
Hannum ME, Forzley S, Popper R, Simons CT. Further validation of the engagement questionnaire (EQ): Do immersive technologies actually increase consumer engagement during wine evaluations? Food Qual Prefer 2020. [DOI: 10.1016/j.foodqual.2020.103966] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
19
|
Hannum ME, Ramirez VA, Lipson SJ, Herriman RD, Toskala AK, Lin C, Joseph PV, Reed DR. Objective sensory testing methods reveal a higher prevalence of olfactory loss in COVID-19-positive patients compared to subjective methods: A systematic review and meta-analysis. medRxiv 2020:2020.07.04.20145870. [PMID: 32676608 PMCID: PMC7359533 DOI: 10.1101/2020.07.04.20145870] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which causes coronavirus disease 2019 (COVID-19), has currently infected over 6.5 million people worldwide. In response to the pandemic, numerous studies have tried to identify causes and symptoms of the disease. Emerging evidence supports recently acquired anosmia (complete loss of smell) and hyposmia (partial loss of smell) as symptoms of COVID-19, but studies of olfactory dysfunction show a wide range of prevalence, from 5% to 98%. We undertook a search of Pubmed/Medline and Google Scholar with the keywords "COVID-19," "smell," and/or "olfaction." We included any study that quantified olfactory loss as a symptom of COVID-19. Studies were grouped and compared based on the type of method used to measure smell loss-subjective measures such as self-reported smell loss versus objective measures using rated stimuli-to determine if prevalence rate differed by method type. For each study, 95% confidence intervals (CIs) were calculated from point estimates of olfactory disturbance rates. We identified 34 articles quantifying anosmia as a symptom of COVID-19, collected from cases identified from January 16 to April 30, 2020. The pooled prevalence estimate of smell loss was 77% when assessed through objective measurements (95% CI of 61.4-89.2%) and 45% with subjective measurements (95% CI of 31.1-58.5%). Objective measures are a more sensitive method to identify smell loss as a result of infection with SARS-CoV-2; the use of subjective measures, while expedient during the early stages of the pandemic, underestimates the true prevalence of smell loss.
Collapse
Affiliation(s)
| | | | - Sarah J. Lipson
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104
| | - Riley D. Herriman
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104
| | - Aurora K. Toskala
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104
| | - Cailu Lin
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104
| | - Paule V. Joseph
- Division of Intramural Research, National Institute of Nursing Research, National Institutes of Health, Bethesda, MD, USA
- Division of Intramural Research, National Institute of Nursing Research & National Institute of Alcohol Abuse and Alcoholism, National Institutes of Health, Bethesda, MD, USA
| | - Danielle R. Reed
- Monell Chemical Senses Center, 3500 Market St, Philadelphia PA 19104
| |
Collapse
|
20
|
Hannum ME, Simons CT. Development of the engagement questionnaire (EQ): A tool to measure panelist engagement during sensory and consumer evaluations. Food Qual Prefer 2020. [DOI: 10.1016/j.foodqual.2019.103840] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|