神经辐射场技术及应用综述
Overview of NeRF Technology and Applications
-
摘要: 神经辐射场(NeRF)是一种基于神经网络的三维重建技术,它将场景定义为位置和观察视角的五维辐射场函数,并通过隐式的神经网络来表示.该技术仅需要单个场景在不同视角下的二维图像,结合体渲染方程,可以通过深度学习的方式训练得到该场景的神经辐射场模型,利用该模型可以合成出高质量的新视角图像.文中对NeRF的现有工作进行调查和分类,从相参位姿估计、视图集合标准、渲染过程优化等方面介绍各种方法的基本原理及优势,重点阐明不同方法之间的相似性和差异,帮助理解它们之间的关系;还讨论了各种受益于NeRF合成机理的应用场景;最后通过对现有方法优势和局限性的分析,对未来研究的趋势进行展望.Abstract: NeRF(neural radiance fields) is a neural network-based 3D reconstruction technology. It defines a scene as a five-dimensional radiance field function of position and viewing angle, represented through an implicit neural network. This technique only requires two-dimensional images of a single scene from different perspectives. Coupled with volume rendering equations, a neural radiance field model of the scene can be trained through deep learning. This model can be used to synthesize high-quality images from new perspectives. This paper surveys and categorizes existing work on NeRF, mainly introducing the basic principles and advantages of various methods from aspects such as relative pose estimation, view aggregation standards, and rendering process optimization. The focus is to elucidate the similarities and differences between different methods to help understand their relationship. The paper also discusses various application scenarios that benefit from the NeRF synthesis mechanism. Through the analysis of the advantages and limitations of existing methods, the paper provides a perspective on future research trends.