Mesh Deformation Based 3D Facial Modeling From Images

High quality 3D facial modeling from images is an important problem in computer vision and graphics.Unlike traditional narrow-baseline multi-view geometry and data driven shape blending facial modeling from images,we propose a new technique for high quality facial modeling from images by deforming a template mesh model using Laplacian mesh deformation and color consistency metric defined by all input images.Given a few facial images taken from different viewpoints,we first do sparse stereo matching from matched robust image feature points to recover camera extrinsic parameters and a few 3D matched points.Then an image based mesh deforming process is employed to deform a 3D facial template to make the color intensities of visible images consistent.Template based deformation avoids the difficulty due to the occlusion in images.In addition,the robust estimation technique reduces the influence of image noise,outliers and surface highlights.Multi-stage nonlinear optimization improves the quality of facial modeling.Experimental results using synthetic and real images show that our method provides stable and quality facial reconstruction results from wide-baseline images.