Joint Optimization for Deblurring and 3D Reconstruction of Blurry Face Image

We propose a joint optimization method for both face deblurring and 3D face reconstruction.With a single blur-ry face image as input, repeat following steps: (1) Apply 3D face reconstruction on the face image, update 3D face model; (2) Deblur the face image by Res-UNet, with re-rendered image and 3DMM coefficients of 3D face model as assist input, and origin blurry face image as correction input, update face image. After repeating above steps for proper number of times, output both deblurred face image and 3D face model. Compared with the ex-isting methods, results of our method get significantly improved.