高级检索

基于三维高斯泼溅的动态场景重建研究综述

A Review of Dynamic Scene Reconstruction Based on 3D Gaussian Splatting

  • 摘要: 作为计算机图形学与视觉领域的重点研究方向, 动态场景重建的核心目标是从单目或多视角的二维图像序列或视频中精确地捕获并恢复动态场景的三维几何结构及其时变外观属性. 三维高斯泼溅(3D Gaussian splatting, 3DGS)是一种基于三维高斯体的场景重建和渲染技术, 高斯体的参数化特性使其既可以显式地表示场景元素又可以隐式地优化局部细节, 从而高效地模拟场景中的光线传播和散射, 最终实现实时渲染. 文中对基于3DGS的动态场景重建方法进行梳理, 并将其分为3大类. 首先介绍3DGS的基本原理和优势, 并简述相关的应用; 然后总结基于变形场、时空四维高斯体和帧间动态传递3类方法, 并围绕场景表示、运动建模、训练策略等维度展开描述, 通过对比分析了每类方法的优缺点; 最后回顾该领域的发展现状, 指出未来可能的研究方向, 包括时空数据结构的设计、稀疏视角下的动态重建, 以及大规模动态场景的实时重建.

     

    Abstract: Dynamic scene reconstruction, a key research direction in computer graphics and vision, aims to accurately capture and recover the three-dimensional geometric structure and time-varying appearance of dynamic scenes from monocular or multi-view two-dimensional image sequences or videos. 3D Gaussian splatting (3DGS) is a scene reconstruction and rendering technique based on three-dimensional Gaussian volumes. The parameterized nature of Gaussian volumes allows them to both explicitly represent scene elements and implicitly optimize local details, effectively simulating light propagation and scattering in the scene, ultimately enabling real-time rendering. This article reviews dynamic scene reconstruction methods based on 3DGS and categorizes them into three main categories. First, the basic principles and advantages of 3DGS are introduced, and related applications are briefly described. Second, three categories of methods are summarized: deformation fields, spatiotemporal four-dimensional Gaussian volumes, and inter-frame dynamic transfer. Various works are described, focusing on scene representation, motion modeling, and training strategies. The advantages and disadvantages of each category are compared and analyzed. Finally, the current status of development in this field is reviewed, and potential future research directions are identified. This includes the design of spatiotemporal data structures, dynamic reconstruction under sparse viewports, and real-time reconstruction of large-scale dynamic scenes.

     

/

返回文章
返回