Face Poser:
Interactive Modeling of 3D Facial Expressions Using Facial Priors

Manfred Lau       Jinxiang Chai       Ying-Qing Xu       Harry Shum




Abstract

This article presents an intuitive and easy-to-use system for interactively posing 3D facial expressions. The user can model and edit facial expressions by drawing freeform strokes, by specifying distances between facial points, by incrementally editing curves on the face, or by directly dragging facial points in 2D screen space. Designing such an interface for 3D facial modeling and editing is challenging because many unnatural facial expressions might be consistent with the user's input. We formulate the problem in a maximum a posteriori framework by combining the user's input with priors embedded in a large set of facial expression data. Maximizing the posteriori allows us to generate an optimal and natural facial expression that achieves the goal specified by the user. We evaluate the performance of our system by conducting a thorough comparison of our method with alternative facial modeling techniques. To demonstrate the usability of our system, we also perform a user study of our system and compare with state-of-the-art facial expression modeling software (Poser 7).



Publication

The first one is the newer journal version of our work, and the second one is the conference version. This work was done when the first author was an intern at Microsoft Research Asia and a student at Carnegie Mellon University.

Manfred Lau, Jinxiang Chai, Ying-Qing Xu, and Harry Shum. 2009. Face Poser: Interactive Modeling of 3D Facial Expressions Using Facial Priors. ACM Transactions on Graphics (to be presented at SIGGRAPH 2010), 29(1), 3.

Manfred Lau, Jinxiang Chai, Ying-Qing Xu, and Harry Shum. 2007. Face Poser: Interactive Modeling of 3D Facial Expressions Using Model Priors. ACM SIGGRAPH / Eurographics Symposium on Computer Animation (SCA), 161-170.



Video


ToG version: MOV (with audio, 51 MB)
SCA version: AVI (with audio, 17 MB)