Dynamic Object Removal and Image Inpainting for 3D Panoramic Tour

The high-realistic 3D panoramic tour usually requires an accurate 3D model of the scene,but existing technologies still have many difficulties and challenges in the high-quality 3D modeling of irregular areas and facilities in complex industrial scenes.To solve the problem of the 3D panoramic tour for complex industrial scenes,a 3D panoramic tour system based on virtual view synthesis is proposed.First,it takes a panoramic video as input and utilizes the multi-view and depth information provided by the 3D scene reconstruction to synthesize the virtual views of the panoramic tour,resulting in enhancing the reality of viewpoint switching during the tour.Secondly,aiming at the quality problem of some artifacts caused by moving people and holes on the synthesized virtual views,a method based on instance segmentation and multi-viewpoint information is proposed to remove dynamic interference objects and restore the viewpoint.The experimental results in both indoor and outdoor scenes indicate that the proposed panoramic tour system and the inpainting method do not need high-precision 3D reconstruction of the scene and can take advantage of the multi-view information to synthesize high-quality virtual views,which can effectively improve the customer experience for the panoramic tour in the irregular and complex industrial scenes such as power grid.