IVML  
  about | r&d | publications | courses | people | links
   

A. Raouzaiou, N. Tsapatsoulis, K. Karpouzis and S. Kollias,
Parameterized facial expression synthesis based on MPEG-4
Eurasip Journal on Applied Signal Processing, Vol. 2002, No 10, pp. 1021-1038, 2002
ABSTRACT
In the framework of MPEG-4 hybrid coding of natural and synthetic data streams, one can include teleconferencing and tele-presence applications, where a synthetic proxy or a virtual agent is capable of substituting the actual user. Such agents can interact with each other, analyzing input textual data entered by the user, as well as multi-sensory data, including human emotions, facial expressions and non-verbal speech. This not only enhances interactivity, by replacing single media representations with dynamic multimedia renderings, but also assists human-computer interaction issues, letting the system become accustomed to the current needs and feelings of the user. Actual application of this technology is expected in educational environments, 3D video conferencing and collaborative workplaces, online shopping and gaming, virtual communities and interactive entertainment. Facial expression synthesis and animation has gained much interest within the MPEG-4 framework; explicit Facial Animation Parameters (FAPs) have been dedicated to this purpose. However, FAP implementation is an open research area. In this paper we describe a method for generating emotionally-enriched human computer interaction, focusing on analysis and synthesis of primary and intermediate facial expressions . To achieve this goal we utilize both MPEG-4 Facial Definition Parameters (FDPs) and FAPs. The contribution of the work is two-fold: it proposes a way of modeling primary expressions using FAPs and it describes a rule-based technique for analysis and synthesis of intermediate expressions. A relation between FAPs and the activation parameter proposed in classical psychological studies is established, extending the archetypal expression studies that the computer society has concentrated on. The overall scheme leads to a parameterized approach to facial expression analysis and synthesis that is compatible with the MPEG-4 standard.
31 October , 2002
A. Raouzaiou, N. Tsapatsoulis, K. Karpouzis and S. Kollias,, "Parameterized facial expression synthesis based on MPEG-4 ", Eurasip Journal on Applied Signal Processing, Vol. 2002, No 10, pp. 1021-1038, 2002
[ save PDF] [ BibTex] [ Print] [ Back]

© 00 The Image, Video and Multimedia Systems Laboratory - v1.12