高级检索

面向逆渲染的室内场景光源建模

Modeling Emitters in Indoor Scenes for Inverse Rendering

  • 摘要: 近年来的神经逆渲染方法使用神经网络表示物体几何形状和表面材质,通过基于物理的渲染过程从多视图图像学习网络参数.然而,这些方法通常假设光源位于无限远处,在具有复杂光照条件的室内场景中,这种假设很少成立.为解决该问题,提出一种基于点云的光照表示方法,用于建模室内场景中的随空间坐标变化的高频光照效果;在输入的多视图图像中检测二维光源掩模,通过三维重建方法得到三维光源点;在基于物理的渲染过程中显式引入所提出的光照表示,提高了渲染模型表达镜面反射效果的能力,有效地减轻逆向渲染过程中的歧义性.在真实和合成数据集上的实验结果表明,所提方法达到了逆渲染的优异性能,并能够产生逼真的重光照结果.

     

    Abstract: Recent neural inverse rendering methods represent object geometry and materials with neural networks and learn network parameters from multi-view images through physically based rendering. However, these methods typically assume that the light source is located at an infinite distance, which seldomly holds in indoor scenarios that exhibit complex illumination. To address this issue, we propose a point cloud-based lighting representation method to model the spatially-varying and high-frequency lighting effects in indoor scenes. Our method first detects 2D light source masks in the input multi-view images, and then obtains a set of emitters through 3D reconstruction algorithm. We explicitly incorporate emitters in the Monte Carlo sampling, which improves the ability to model the specular effects, thus effectively alleviating the ambiguity in the inverse rendering process. Experiments on real and synthetic datasets demonstrate that the proposed method achieves the best performance in inverse rendering and can produce realistic relighting results.

     

/

返回文章
返回