高级检索
李健, 韩超远, 王泽震. 改进的PF-AFN在虚拟试衣中的应用[J]. 计算机辅助设计与图形学学报.
引用本文: 李健, 韩超远, 王泽震. 改进的PF-AFN在虚拟试衣中的应用[J]. 计算机辅助设计与图形学学报.
Application of Improved PF-AFN in Virtual Try-on[J]. Journal of Computer-Aided Design & Computer Graphics.
Citation: Application of Improved PF-AFN in Virtual Try-on[J]. Journal of Computer-Aided Design & Computer Graphics.

改进的PF-AFN在虚拟试衣中的应用

Application of Improved PF-AFN in Virtual Try-on

  • 摘要: 针对PF-AFN中预测外观流精度欠缺和网络泛化能力较差的问题, 提出改进的虚拟试衣网络. 首先增加目标人体预测模块, 通过预测目标人体解析图像解耦形状与纹理; 然后依据仿射变换的共线特性增加共线性损失项以约束形变过程, 根据外观流的特性添加距离损失, 弥补PF-AFN对局部区域约束不足的缺陷; 最后将生成的人体解析图像与原输入按通道拼接作为图像生成网络的输入, 使用基于ResNet的类UNet++图像生成网络得到最终的试衣图像. 基于VITON数据集, 与其他4种最新方法进行对比实验, 结果表明, 所提方法在图像相似度评价(SSIM、FID和LPIPS)方面分别较其中最优方法提升1.2%, 11.1%和5.8%, 图像清晰度和多样性评价(IS)与当前最优方法相当. 整体来看, 所提方法改善了原网络中存在的问题, 并取得较好的视觉效果.

     

    Abstract: An improved virtual try-on method is proposed to solve the problems of insufficient accuracy of the appearance flow predicted and poor generalization ability in PF-AFN. Firstly, to decouple the shape and style of clothing, we synthesize a human parsing map aligned with the human in target clothes by a human body prediction module. Then, based on the collinearity of the affine transformation and the characteristics of the appearance flow, the collinearity loss term and the distance loss term are added to constrain the deformation process and on local regions accordingly. Finally, the human parsing map and the original input are concated by channel as the input of the generation network and the UNet++-like generation network based on ResNet is used to obtain the ultimate virtual try-on images. A comparative experiment is executed on the VITON dataset with other 4 state-of-the-art methods. It shows that the method proposed improves the SSIM, FID and LPIPS by 1.2%, 11.1% and 5.8% respectively compared with the optimal method. The IS is comparable to the current state-of-the-art methods. On the whole, the proposed method solves the original problems and achieves a better results.

     

/

返回文章
返回