Face modeling and adaptive texture mapping for model based video coding

Abstract

3D facial synthesis has been frequently used in model based video coding applications and became popular in various multimedia applications. In this paper a 3D face model, its adaptation algorithm and a texture mapping method using two orthogonal photos are presented to solve several 3D estimation problems in model based video coding. We are successfully estimating the frames between the front and the side views of the face. The experimental results show that the proposed Rotation Adaptive Texture Mapping (RATM) technique increases the visual quality of the synthesized face during rotations of the head, while achieving a PSNR value up to 33dB.