Construction of Facial Shape with Details from Single Image

This paper proposes a coarse-to-fine method to reconstruct a detailed facial model from a single image. Based on detected feature points from the image, our method starts by solving a rigid head pose and a coarse expression using multiple initials. Then we correct the 3D shape using 2D feature points. This step is combined with a non-rigid ICP method and a Laplacian deformation method. Finally, we generate detailed geometry from the coarse shape using a shape-from-shading method. In this step, our method uses a constant hypothesis to solve the boundary problem. Experimental results demonstrate that the method can reconstruct an accurate facial shape with details even when the head swings significantly. Our method does not need camera calibration nor any pre-processing like per-user training or manual preparation. In addition, the method can achieve good results under poor lighting conditions or in a variegated background.