Content Retargeting Using Parameter-Parallel Facial Layers
| Kholgade | Natasha | Matthews | Iain | Sheikh | Yaser |
Proc. ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2011)
Facial motion retargeting approaches often transfer expressions by establishing correspondences between shared units of motion, such as action units, or spatial correspondences of landmarks between the source actor and target character faces. When the actor and character are structurally dissimilar, shared units of motion or spatial landmarks may not exist, and subtle styles of performance may differ. We present a method to deconstruct the content of an s facial expression into three layers using an additive composition function, transfer the content to parameter-parallel layers for the character, and reconstruct the s expression using the same composition function. Our algorithm uses a parameter-parallel layered model of facial expression for both the actor and character, separating the content of facial expressions into emotion, speech, and eye-blink layers. Facial motion in each layer is embedded in simplicial bases, each of which encodes semantically significant configurations of the face. We show the transfer of facial motion capture and video-based tracking of the eyes and mouth of an actor to a number of faces with dissimilar facial structure and expressive disposition.
Kholgade, Natasha, Matthews, Iain, Sheikh, Yaser (2011). Content Retargeting Using Parameter-Parallel Facial Layers. Proc. ACM SIGGRAPH/Eurographics Symposium on Computer Animation.
@inproceedings{Kholgade2011:Parallel,
Author = {Kholgade, Natasha and Matthews, Iain and Sheikh, Yaser},
booktitle = "Proc. ACM SIGGRAPH/Eurographics Symposium on Computer Animation",
Month = aug,
Title = {Content Retargeting Using Parameter-Parallel Facial Layers},
Year = {2011},
}
