Facial expression analysis with AFFDEX and FACET: A validation study

Abstract

The goal of this study was to validate AFFDEX and FACET, two algorithms classifying emotions from facial ex- pressions, in iMotions’s software suite. In Study 1, pictures of standardized emotional facial expressions from three data- bases, the Warsaw Set of Emotional Facial Expression Pictures (WSEFEP), the Amsterdam Dynamic Facial Expression Set (ADFES), and the Radboud Faces Database (RaFD), were classified with both modules. Accuracy (Matching Scores) was computed to assess and compare the classification quality. Results show a large variance in accura- cy across emotions and databases, with a performance advan- tage for FACET over AFFDEX. In Study 2, 110 participants’ facial expressions were measured while being exposed to emotionally evocative pictures from the International Affective Picture System (IAPS), the Geneva Affective Picture Database (GAPED) and the Radboud Faces Database (RaFD). Accuracy again differed for distinct emo- tions, and FACET performed better. Overall, iMotions can achieve acceptable accuracy for standardized pictures of prototypical (vs. natural) facial expressions, but performs worse for more natural facial expressions. We discuss poten- tial sources for limited validity and suggest research directions in the broader context of emotion research.

Publication
Behavior research methods