Virtual View Rendering Based on Depth Map Preprocessing and Image Inpainting

Depth-image-based-rendering(DIBR)is an effective method for virtual view synthesis.To solve the problems in single view rendering such as hole,crack and pixel overlap,a virtual view rendering method based on depth map preprocessing and image inpainting is proposed.Firstly,the depth map is preprocessed based on the transformation direction.The sharp depth transition from foreground to background is mitigated and disocclusion regions are divided into several small holes.Secondly,the DIBR process is modified by combining the one-to-four algorithm and Z-buffer algorithm.Finally,the depth information is used to guide the image inpainting algorithm,so that the hole filling starts from the background side and the background texture is preferred.In the Matlab environment,the 3D image sequences provided by Microsoft Research are used to generate the virtual view,and the algorithm is evaluated by comparing the similarity between the virtual view and the real target view.Experimental results show that the average PSNR of proposed method is 27.4747dB,which is 5.65%higher than Criminisi algorithm and 2.97%higher than recursive line-based algorithm.The average SSIM is 0.7708,1.22%and 0.80%higher than the two existing algorithms,respectively.