A Novel Chewing Detection System Based on PPG, Audio, and Accelerometry

Vasileios Papapanagiotou, Christos Diou, Lingchuan Zhou, Janet van den Boer, Monica Mars, Anastasios Delopoulos

Research output: Contribution to journalArticleAcademicpeer-review

57 Citations (Scopus)


In the context of dietary management, accurate monitoring of eating habits is receiving increased attention. Wearable sensors, combined with the connectivity and processing of modern smartphones, can be used to robustly extract objective and real-time measurements of human behavior. In particular, for the task of chewing detection, several approaches based on an in-ear microphone can be found in the literature, while other types of sensors have also been reported, such as strain sensors. In this paper, performed in the context of the SPLENDID project, we propose to combine an in-ear microphone with a photoplethysmography (PPG) sensor placed in the ear concha, in a new high accuracy and low sampling rate prototype chewing detection system. We propose a pipeline that initially processes each sensor signal separately, and then fuses both to perform the final detection. Features are extracted from each modality, and support vector machine (SVM) classifiers are used separately to perform snacking detection. Finally, we combine the SVM scores from both signals in a late-fusion scheme, which leads to increased eating detection accuracy. We evaluate the proposed eating monitoring system on a challenging, semifree living dataset of 14 subjects, which includes more than 60 h of audio and PPG signal recordings. Results show that fusing the audio and PPG signals significantly improves the effectiveness of eating event detection, achieving accuracy up to 0.938 and class-weighted accuracy up to 0.892.
Original languageEnglish
Article number7736096
Pages (from-to)607-618
JournalIEEE Journal of Biomedical and Health Informatics
Issue number3
Publication statusPublished - 2017


  • Acoustic sensors
  • acoustic signal processing
  • bioinformatics
  • biomedical informatics
  • optical sensors
  • optical signal processing


Dive into the research topics of 'A Novel Chewing Detection System Based on PPG, Audio, and Accelerometry'. Together they form a unique fingerprint.

Cite this