高级检索

高度真实感表面材质逆向恢复方法综述

A Survey of Inverse Recovery Methods of Highly Realistic Surface Materials

  • 摘要: 大规模复杂三维场景的真实感渲染是三维动画、数字人、虚拟现实、虚拟仿真、数字孪生、视频游戏等领域中的关键技术之一, 而具备高度真实感的表面材质是三维渲染的重要基石, 其参数贴图的准确性和精细程度决定了渲染结果的逼真程度. 文中根据使用设备和材质表示形式的不同, 将相关工作划分为精密仪器测量、过程式节点图材质制作和轻量级设备恢复3大类, 总结了表面材质逆向恢复方法的评估指标和能力. 首先介绍了基于精密仪器的测量方法, 对专业设备与材质表示模型发展的相关性进行分析; 然后简述了基于过程式节点图的材质重建和生成方法, 对相关软件的特点进行总结, 重点分析了基于风格损失优化的过程式材质逆向方法的发展现状及面临的问题; 再回顾了基于轻量级设备的材质高效重建和生成方法, 阐述了轻量级设备采集的标准, 并从提取材质隐空间特征、估计材质自相似性、抑制高光对材质恢复的影响、材质自监督训练设计、多模态引导材质生成等方面, 对比和分析了多种深度学习方法的优劣; 最后对高度真实感表面材质逆向恢复的研究现状进行了归纳和总结, 指出了现阶段表面材质逆向恢复任务仍面临采集条件严苛、清漆和闪烁等复杂材质恢复困难、网络训练成本高且极易受到强高光影响的问题; 未来将围绕特殊类别材质建模、强高光的软遮罩预测与区域重绘、三维物体材质提取以及精准材质编辑等方向展开.

     

    Abstract: Realistic rendering of large-scale complex 3D scenes is one of the key technologies in the fields of 3D animation, digital humans, virtual reality, virtual simulation, digital twins, video games, etc. Surface materials with a high degree of realism are the cornerstones of 3D rendering, and the accuracy and fineness of their parametric maps determine the degree of realism of the rendering results. In this paper, according to the different equipment and material representations, the related work is classified into three categories: precision equipment measurement, procedural node graph material creation, and lightweight equipment-based recovery. The evaluation indexes and capabilities of surface material inverse recovery methods are also summarized. Firstly, this paper introduces the measurement methods based on precision equipment and analyzes the correlation between professional equipment and the development of material representation models. Then, material reconstruction and generation methods based on procedural node graphs are briefly described, the characteristics of related software are summarized, and the development status and problems of procedural material inversion methods based on style loss optimization are highlighted. In addition, this paper reviews the efficient reconstruction and generation of materials based on lightweight equipment, describes the criteria for lightweight equipment acquisition, and compares and analyzes the advantages and disadvantages of various deep learning methods in terms of extracting latent spatial features of materials, estimating self-similarity of materials, suppressing the effect of highlights on material recovering, designing self-supervised training of materials, and generating materials by multimodal guided generation. Finally, the state of the art in inverse recovery of highly realistic surface materials is summarized. This paper pointed out that the current surface material recovery task still faces the problems of harsh acquisition conditions, difficulties in recovering complex materials such as clear coatings and glints, high cost of network training, and susceptibility to strong highlights. Future work will focus on the modeling of special classes of materials, soft-mask prediction, and region redrawing for strong highlights, material extraction from 3D objects, and accurate material editing.

     

/

返回文章
返回