Automatic Classification and Shift Detection of Facial Expressions in Event-Aware Smart Environments
Document Type
Article
Department or Administrative Unit
Computer Science
Publication Date
6-23-2018
Abstract
Affective application developers often face a challenge in integrating the output of facial expression recognition (FER) software in interactive systems: although many algorithms have been proposed for FER, integrating the results of these algorithms into applications remains difficult. Due to inter- and within-subject variations further post-processing is needed. Our work addresses this problem by introducing and comparing three post-processing classification algorithms for FER output applied to an event-based interaction scheme to pinpoint the affective context within a time window. Our comparison is based on earlier published experiments with an interactive cycling simulation in which participants were provoked with game elements and their facial expression responses were analysed by all three algorithms with a human observer as reference. The three post-processing algorithms we investigate are mean fixed-window, matched filter, and Bayesian changepoint detection. In addition, we introduce a novel method for detecting fast transition of facial expressions, which we call emotional shift. The proposed detection pattern is suitable for affective applications especially in smart environments, wherever users' reactions can be tied to events.
Recommended Citation
Bernin, Arne; Müller, Larissa; Ghose, Sobin; Grecos, Christos; Wang, Qi; Jettke, Ralf; von Luck, Kai; and Vogt, Florian, "Automatic Classification and Shift Detection of Facial Expressions in Event-Aware Smart Environments" (2018). All Faculty Scholarship for the College of the Sciences. 121.
https://digitalcommons.cwu.edu/cotsfac/121
Journal
PETRA '18: Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference
Rights
© 2018 Copyright held by the author(s).
Comments
This is a draft version of a paper that was presented at the 2018 Proceedings of the 11th Pervasive Technologies Related to Assistive Environments (PETRA) Conference, June 23–26, 2018, Corfu Island, Greece. The version of record can be downloaded from the publisher website, here.