高级检索
姬晓鹏, 任鑫芳, 周震震, 黄贻煜, 甄佳楠, 周黎, 周晓巍, 章国锋. 三维全景漫游中的动态物体消除与视图修补方法[J]. 计算机辅助设计与图形学学报, 2022, 34(8): 1147-1159. DOI: 10.3724/SP.J.1089.2022.19142
引用本文: 姬晓鹏, 任鑫芳, 周震震, 黄贻煜, 甄佳楠, 周黎, 周晓巍, 章国锋. 三维全景漫游中的动态物体消除与视图修补方法[J]. 计算机辅助设计与图形学学报, 2022, 34(8): 1147-1159. DOI: 10.3724/SP.J.1089.2022.19142
Ji Xiaopeng, Ren Xinfang, Zhou Zhenzhen, Huang Yiyu, Zhen Jianan, Zhou Li, Zhou Xiaowei, Zhang Guofeng. Dynamic Object Removal and Image Inpainting for 3D Panoramic Tour[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(8): 1147-1159. DOI: 10.3724/SP.J.1089.2022.19142
Citation: Ji Xiaopeng, Ren Xinfang, Zhou Zhenzhen, Huang Yiyu, Zhen Jianan, Zhou Li, Zhou Xiaowei, Zhang Guofeng. Dynamic Object Removal and Image Inpainting for 3D Panoramic Tour[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(8): 1147-1159. DOI: 10.3724/SP.J.1089.2022.19142

三维全景漫游中的动态物体消除与视图修补方法

Dynamic Object Removal and Image Inpainting for 3D Panoramic Tour

  • 摘要: 高真实感的三维全景漫游通常需要对场景进行精准的三维建模,但目前技术对复杂工业场景下非规整区域及设施进行高质量的三维建模仍存在很多困难和挑战.为解决复杂工业场景下的三维全景漫游问题,提出一套基于虚拟视点合成的三维全景漫游系统.首先以全景视频为输入,利用三维场景重建提供的多视点和深度信息合成全景漫游中的虚拟视点图像,增强三维全景漫游中视点切换的临场感;其次针对虚拟视点合成结果中存在的移动人体、空洞等质量问题,提出一种动态干扰物体的消除与视点修补方法,基于实例分割结果和多视点信息对缺陷区域进行修补得到目标视图.在室内外场景的实验结果表明,所提方法不依赖于高精度的三维重建结果,且可以有效地利用多视点信息合成高质量的虚拟视点图像,提升电网系统等非规则复杂工业场景下的全景漫游体验.

     

    Abstract: The high-realistic 3D panoramic tour usually requires an accurate 3D model of the scene,but existing technologies still have many difficulties and challenges in the high-quality 3D modeling of irregular areas and facilities in complex industrial scenes.To solve the problem of the 3D panoramic tour for complex industrial scenes,a 3D panoramic tour system based on virtual view synthesis is proposed.First,it takes a panoramic video as input and utilizes the multi-view and depth information provided by the 3D scene reconstruction to synthesize the virtual views of the panoramic tour,resulting in enhancing the reality of viewpoint switching during the tour.Secondly,aiming at the quality problem of some artifacts caused by moving people and holes on the synthesized virtual views,a method based on instance segmentation and multi-viewpoint information is proposed to remove dynamic interference objects and restore the viewpoint.The experimental results in both indoor and outdoor scenes indicate that the proposed panoramic tour system and the inpainting method do not need high-precision 3D reconstruction of the scene and can take advantage of the multi-view information to synthesize high-quality virtual views,which can effectively improve the customer experience for the panoramic tour in the irregular and complex industrial scenes such as power grid.

     

/

返回文章
返回