Document Type

Article

Department or Administrative Unit

Computer Science

Publication Date

6-23-2018

Abstract

Affective application developers often face a challenge in integrating the output of facial expression recognition (FER) software in interactive systems: although many algorithms have been proposed for FER, integrating the results of these algorithms into applications remains difficult. Due to inter- and within-subject variations further post-processing is needed. Our work addresses this problem by introducing and comparing three post-processing classification algorithms for FER output applied to an event-based interaction scheme to pinpoint the affective context within a time window. Our comparison is based on earlier published experiments with an interactive cycling simulation in which participants were provoked with game elements and their facial expression responses were analysed by all three algorithms with a human observer as reference. The three post-processing algorithms we investigate are mean fixed-window, matched filter, and Bayesian changepoint detection. In addition, we introduce a novel method for detecting fast transition of facial expressions, which we call emotional shift. The proposed detection pattern is suitable for affective applications especially in smart environments, wherever users' reactions can be tied to events.

Comments

This is a draft version of a paper that was presented at the 2018 Proceedings of the 11th Pervasive Technologies Related to Assistive Environments (PETRA) Conference, June 23–26, 2018, Corfu Island, Greece. The version of record can be downloaded from the publisher website, here.

Journal

PETRA '18: Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference

Rights

© 2018 Copyright held by the author(s).

Download

Share

COinS