Exploring Temporal Patterns of spontaneous smiles when delighted and frustrated


Figure 1. Four participants, each smiling while being in either a (i) frustrated or (ii) delighted state. Can you tell which smile is in which state?
**Answers are provided at the end.


Is it possible for people to smile under negative situations? In our study, more than 90% of the people smiled while being exposed to a frustrated stimuli. Is there a difference between people smiling under frustration as opposed to being genuinely delighted? How well do humans do in  correctly labeling smiles elicited under frustrated and delighted situations? Can we develop automated systems to distinguish between frustrated and delighted smiles that perform better or as good as their human counterpart? This paper attempts to answer all these questions through a series of studies.






M. E. Hoque, D. J. McDuff, R. W Picard, Exploring Temporal Patterns towards Classifying Frustrated and Delighted Smiles, IEEE Transactions on Affective Computing, 2012. 

M. E. Hoque, R. W. Picard, Acted vs. natural frustration and delight: Many people smile in natural frustration, 9th IEEE International Conference on Automatic Face and Gesture Recognition (FG'11), Santa Barbara, CA, USA, March 2011. 


Selected Press:












**Figure 1 (a), (d), (f), (h) are taken from instances of frustration; (b), (c), (e), (g) are from instances of delight.