Determination of Chewing Count from Video Recordings Using Discrete Wavelet Decomposition and Low Pass Filtration

Rule-based systems to automatically count bites from meal videos

Eating behavior is a key factor for nutritional intake and plays a significant role in the development of eating disorders and obesity. The standard methods to detect eating behavior events (i.e., bites and chews) from video recordings rely on manual annotation, which lacks objective assessment and standardization. Yet, video recordings of eating episodes provide a non-invasive and scalable source for automation. Here, we present a rule-based system to count bites automatically from video recordings with 468 3D facial key points. We tested the performance against manual annotation in 164 videos from 15 participants. The system can count bites with 79% accuracy when annotation is available, and 71.4% when annotation is unavailable. The system showed consistent performance across varying food textures. Eating behavior researchers can use this automated and objective system to replace manual bite count annotation, provided the system's error is acceptable for the purpose of their study. Utilizing our approach enables real-time bite counting, thereby promoting interventions for healthy eating behaviors. Future studies in this area should explore rule-based systems and machine learning methods with 3D facial key points to extend the automated analysis to other eating events while providing accuracy, interpretability, generalizability, and low computational requirements.

Assessment Methods for Problematic Eating Behaviors in Children and Adolescents With Autism Spectrum Disorder

Autism spectrum disorder (ASD) can be associated with eating problems. However, currently, there is a lack of established guidelines for assessing and addressing eating behaviors in individuals with ASD. This gap in research exists due to the challenges associated with using traditional assessment methods, which may lead to discrepancies in responses and unintentional potential biases from caregivers. In this review, we provided a comprehensive overview of various eating behaviors commonly observed in individuals with ASD. These behaviors include 1) food neophobia, 2) selective eating, 3) binge eating, 4) food avoidance, 5) chewing and swallowing problems, 6) pica, 7) rumination, 8) rituals, and 9) problematic behaviors. Furthermore, we provide a perspective of utilizing digital tools: 1) augmentative and alternative communication; 2) ecological momentary assessment; and 3) video analysis, behavioral analysis, and facial expression analysis. This review explores existing assessment methods and suggests novel assessment aiding together.

Capturing Eating Behavior from Video Analysis: A Systematic Review

Current methods to detect eating behavior events (i.e., bites, chews, and swallows) lack objective measurements, standard procedures, and automation. The video recordings of eating episodes provide a non-invasive and scalable source for automation. Here, we reviewed the current methods to automatically detect eating behavior events from video recordings. According to PRISMA guidelines, publications from 2010-2021 in PubMed, Scopus, ScienceDirect, and Google Scholar were screened through title and abstract, leading to the identification of 277 publications. We screened the full text of 52 publications and included 13 for analysis. We classified the methods in five distinct categories based on their similarities and analyzed their accuracy. Facial landmarks can count bites, chews, and food liking automatically (accuracy: 90%, 60%, 25%). Deep neural networks can detect bites and gesture intake (accuracy: 91%, 86%). The active appearance model can detect chewing (accuracy: 93%), and optical flow can count chews (accuracy: 88%). Video fluoroscopy can track swallows but is currently not suitable beyond clinical settings. The optimal method for automated counts of bites and chews is facial landmarks, although further improvements are required. Future methods should accurately predict bites, chews, and swallows using inexpensive hardware and limited computational capacity. Automatic eating behavior analysis will allow the study of eating behavior and real-time interventions to promote healthy eating behaviors.

Special Issue "Computer Aided Diagnosis Sensors"

Sensors used to diagnose, monitor or treat diseases in the medical domain are known as medical sensors [...].