A Dynamic Model for Identification of Emotional Expressions

 

Rafael A.M. Gonçalves, Diego R. Cueva, Marcos R. Pereira–Barretto, and Fabio G. Cozman

 

Decision Making Lab of the Mechatronics Department, University of São Paulo, São Paulo, Brasil. Electronic correspondence regarding this article should be sent to Prof. Dr. Marcos R. Pereira–Barretto to mpbarre@usp.br.

 

Manuscript received June 10, 2011.
Manuscript accepted for publication September 14, 2011.

 

Abstract

This paper discusses the dynamics of emotion recognition on faces, layering basic capabilities of an emotion sensor. It also introduces a model for the recognition of the overall conveyed emotion during a human–machine interaction, based on the emotional trajectory over an emotional surface.

Key words: Emotion dynamics, emotion recognition, emotional surface, Kalman filtering.

 

DESCARGAR ARTÍCULO EN FORMATO PDF

 

NOTA

This work is supported by the Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq), FAPESP, under research project 2008/03995–5 and the University of São Paulo.

 

REFERENCES

[1] R.W. Piccard, Affective Computing, MIT Press, 1997.         [ Links ]

[2] P. Ekman and W.V. Friesen, Unmasking the face, Malor Books, 2003.         [ Links ]

[3] P. Ekman and W.V. Friesen, Facial Action Coding System: a technique for the measurement of facial movement, Consulting Psychologists Press, 1978.         [ Links ]

[4] M. Pantic and L.J.M. Rothkrantz, "Automatic analysis of facial expressions: state of art," IEEE Trans. On Pattern Analysis and Machine Intelligence, vol. 22 no. 12, 2000.         [ Links ]

[5] A. Azcarate, F. Hageloh, K. Sande, and R. Valenti, Automatic facial emotion recognition, Universiteit van Amsterdam, 2005.         [ Links ]

[6] Fraunhofer Facedetect. http://www.iis.fraunhofer.de/en/bf/bv/ks/gpe/demo Accessed 07/04/2001.         [ Links ]

[7] R. Cooper, Quantification and Syntactic Theory, D. Reidel Publishing Company; 1983.         [ Links ]

[8] I.J. Roseman and C.A. Smith, "Appraisal Theory – Overview, Assumptions, Varieties, Controversies," Appraisal Processes in Emotion – Theory, Methods, Research, edited by K. Scherer, A. Schorr, and T. Johnstone, Oxford University Press, 2001.         [ Links ]

[9] R.R. Scherer, "Appraisal considered as a process of multilevel sequential checking," Appraisal Processes in Emotion – Theory, Methods, Research, edited by K. Scherer, A. Schorr, and T. Johnstone, Oxford University Press, 2001.         [ Links ]

[10] E.C. Zeeman, "Catastrophe theory," Scientific American, vol.4 no.254 pages 65–83, 1976.         [ Links ]

[11] I.N. Stewart and P.L. Peregoy, "Catastrophe theory modeling in Psychology," Psychological Bulletin, vol. 94, no. 2, pp. 336–362, 1983.         [ Links ]

[12] K. Scherer, "Emotions as episodes of subsystem synchronization driven by nonlinear appraisal processes," Dynamic Systems Approaches to Emotional Development, ed. by M.D. Lewis and I. Granic, Cambridge Press, 2000.         [ Links ]

[13] H.L.J. van der Maas and P.C.M. Molenaar, "Stagewise cognitive development: an application of Catastrophe Theory," Psychological Review, vol.99, no.2, pp. 395–417, 1992.         [ Links ]

[14] D. Sander, D. Grandjean, and K.R. Scherer, "A systems approach to appraisal mechanisms in emotion," Neural Networks, vol. 18, pp. 317–352, 2005.         [ Links ]

[15] H. Gunes and M. Piccardi, "Observer Annotation of Affective Display and Evaluation of Expressivity: Face vs. Face–and–Body," in HCSNet Workshop on the Use of Vision in HCI (VisHCI 2006), Canberra, Australia, 2006.         [ Links ]