Face Modeling and Animation Language for MPEG-4 XMT Framework
Inhaltsverzeichnis
Reference
Arya A, Steve DiPaola: Face Modeling and Animation Language for MPEG-4 XMT Framework. IEEE Transactions on Multimedia, Vol 9, No 6, pp 1137-1146, 2007.
DOI
http://dx.doi.org/10.1109/TMM.2007.902862
Abstract
This paper proposes FML, an XML-based face modeling and animation language. FML provides a structured content description method for multimedia presentations based on face animation. The language can be used as direct input to compatible players, or be compiled within MPEG-4 XMT framework to create MPEG-4 presentations. The language allows parallel and sequential action description, decision-making and dynamic event-based scenarios, model configuration, and behavioral template definition. Facial actions include talking, expressions, head movements, and low-level MPEG-4 FAPs. The ShowFace and iFACE animation frameworks are also reviewed as example FML-based animation systems.
Extended Abstract
Bibtex
Used References
P. Ekman and W. V. Friesen Facial Action Coding System, 1978 :Consulting Psychologists Press
S. Battista , F. Casalino and C. Lande "MPEG-4: A multimedia standard for the third millennium", IEEE Multimedia, vol. 6, 7, no. 4, 1, pp.74 -83 1999 2000
I. S. Pandzic and R. Forchheimer MPEG-4 Facial Animation: The Standard, Implementation and Applications, 2002 :New York: Wiley
A. Arya and B. Hamidzadeh "Personalized face animation in ShowFace system", Int. J. Image Graph., Special Issue on Virtual Reality and Virtual Environments, vol. 3, no. 2, pp.345 -363 2003
A. Arya and B. Hamidzadeh "FIX: Feature-based image transformations for face animation", Proc. IEEE Conf IT in Research and Technology (ITRE), 2003 http://dx.doi.org/10.1109/ITRE.2003.1270680
A. Arya and B. Hamidzadeh "ShowFace MPEG-4 compatible face animation framework", IASTED Int. Conf Computer Graphics and Imaging (CGIM), 2002 http://dx.doi.org/10.1109/TMM.2007.902862
A. Arya , S. DiPaola , L. Jefferies and J. T. Enns "Socially communicative characters for interactive applications", Proc. 14th Int. Conf. Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG-2006), 2006
S. DiPaola and A. Arya "Socially expressive communication agents: A face-centric approach", Proc. Eur. Conf. Electronic Imaging and the Visual Arts, EVA-2005, 2005 [online] Available: http://img.csit.carleton.ca/iface/fml.html
J. Ankeney "Non-linear editing comes of age", TV Technol., 1995
T. D. C. Little J. F. K. Buford Multimedia Systems, 1994 :ACM Press
F. Nack and A. T. Lindsay "Everything you wanted to know about MPEG-7", IEEE Multimedia, vol. 6, no. 3, pp.65 -77 1999 http://dx.doi.org/10.1109/93.790612
W. S. Lee , M. Escher , G. Sannier and N. Magnenat-Thalmann "MPEG-4 compatible faces from orthogonal photos", Proc. IEEE Conf Computer Animation, 1999 http://dx.doi.org/10.1109/CA.1999.781211
I. S. Pandzic "A web-based MPEG-4 facial animation system", Proc. Int. Conf. Augmented Virtual Reality and 3D Imaging, 2001
T. Ezzat and T. Poggio "MikeTalk: A talking facial display based on morphing visemes", Proc. IEEE Conf. Computer Animation, 1998 http://dx.doi.org/10.1109/CA.1998.681913
N. Hirzalla , B. Falchuk and A. Karmouch "A temporal model for interactive multimedia scenarios", IEEE Multimedia, vol. 2, no. 3, pp.24 -31 1995 http://dx.doi.org/10.1109/93.410508
D. Bulterman "SMIL-2", IEEE Multimedia, vol. 8, no. 4, pp.82 -88 2001 http://dx.doi.org/10.1109/93.959106
M. Kim , S. Wood and L. T. Cheok "Extensible MPEG-4 textual format (XMT)", Proc. ACM Conf Multimedia, 2000
Y. Arafa , K. Kamyab , E. Mamdani , S. Kshirsagar , N. Magnenat-Thalmann , A. Guye-Vuillème and D. Thalmann "Two approaches to scripting character animation", Proc. 1st Int. Conf. Autonomous Agents and Multi-Agent Systems, Workshop on Embodied Conversational Agents, 2002
B. DeCarolis , M. Bilvi and C. Pelachaud "APML, a markup language for believable behaviour generation", Proc. 1st Int. Conf Autonomous Agents & Multi-Agent Systems, Workshop on Embodied Conversational Agents, 2002
A. Marriott and J. Stallo "VHML: Uncertainties and problems. A discussion", Proc. 1st Int. Conf Autonomous Agents & Multi-Agent Systems, Workshop on Embodied Conversational Agents, 2002
H. Prendinger , S. Descamps and M. Ishizuka "Scripting affective communication with life-like characters in web-based interaction systems", Appl. Artif. Intell., vol. 16, no. 7–8, 2002 http://dx.doi.org/10.1080/08839510290030381
J. Cassell , H. H. Vilhjálmsson and T. Bickmore "BEAT: The behavior expression animation toolkit", Proc. ACM SIGGRAPH, 2001
J. Funge , X. Tu and D. Terzopoulos "Cognitive modeling: Knowledge, reasoning, and planning for intelligent characters", Proc. ACM SIGGRAPH, 1999
M. Kallmann and D. Thalmann "A behavioral interface to simulate agent-object interactions in real time", Proc. IEEE Conf Computer Animation, 1999 http://dx.doi.org/10.1109/CA.1999.781207
G. Lawton "Video streaming", IEEE Comput., vol. 33, no. 7, pp.120 -122 2000 http://dx.doi.org/10.1109/MC.2012.47
V. Blanz and T. Vetter "A morphable model for the synthesis of 3D faces", Proc. ACM SIGGRAPH, 1999 http://dx.doi.org/10.1145/311535.311556
F. I. Parke and K. Waters Computer Facial Animation, 2000 :A. K. Peters http://dx.doi.org/10.1109/CA.1999.781198
C. Bregler , M. Covell and M. Slaney "Video rewrite: Driving visual speech with audio", ACM Comput. Graph., 1997
H. P. Graf , E. Cosatto and T. Ezzat "Face analysis for the synthesis of photo-realistic talking heads", Proc. IEEE Conf Automatic Face and Gesture Recognition, 2000 http://dx.doi.org/10.1109/AFGR.2000.840633
[online] Available: http://img.csit.carleton.ca/iface
Links
Full Text
http://ivizlab.sfu.ca/papers/ieeemm2007.pdf
