高级检索
毛琳, 王萌, 杨大伟. 内容特征一致性风格迁移网络[J]. 计算机辅助设计与图形学学报, 2022, 34(6): 892-900. DOI: 10.3724/SP.J.1089.2022.19026
引用本文: 毛琳, 王萌, 杨大伟. 内容特征一致性风格迁移网络[J]. 计算机辅助设计与图形学学报, 2022, 34(6): 892-900. DOI: 10.3724/SP.J.1089.2022.19026
Mao Lin, Wang Meng, Yang Dawei. Content Consistency Preserving Style Transfer Network[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(6): 892-900. DOI: 10.3724/SP.J.1089.2022.19026
Citation: Mao Lin, Wang Meng, Yang Dawei. Content Consistency Preserving Style Transfer Network[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(6): 892-900. DOI: 10.3724/SP.J.1089.2022.19026

内容特征一致性风格迁移网络

Content Consistency Preserving Style Transfer Network

  • 摘要: 针对编解码风格迁移网络在内容特征传递和跨域特征融合过程中易产生误差的问题,提出一种内容特征一致性风格迁移网络.将源域和目标域图像输入编码模块分别提取内容和风格特征;双链路特征传递模块在内容编码和解码模块间构建同级特征映射,利用特征增强和前馈参考链路并行处理内容特征;内容和风格特征在解码模块中融合并输出风格迁移结果.在多模态无监督图像转换(MUNIT)网络的基础上进行仿真测试,该网络对于低光照环境中目标模糊和目标与背景反差小的情况迁移效果提升明显.在BDD100K数据集上的实验结果表明,与MUNIT网络相比,所提网络的FID和IS指标分别平均下降3.2%和提升8.6%,能够实现图像内容一致、风格精确的图像变换,适用于无人驾驶等应用场景.

     

    Abstract: For the problem that it will generate errors in the process of content feature transfer and cross-domain feature fusion caused by encoder-decoder style transfer networks,a content consistency preserving style transfer network is proposed.Source and target images are input to the encoding module for extracting content and style features respectively.Dual-chain feature transfer module constructs the same depth feature mapping with content encoder and decoder,and processes content feature parallelly by feature enhancement and feed-forward reference chains.Content and style features are fused in decoder and output style transfer result.With the simulation test based on multimodal unsupervised image-to-image translation(MUNIT),the style transfer effect of proposed network on vague objects and low contrast between the objects and background in low light environment is significantly increased.The experiment results on BDD100K dataset show that FID and IS are decreased by 3.2%and increased by 8.6%on average than MUNIT respectively,the proposed network can achieve content consistently and style accurately image trans-formation,which is able to application autonomous vehicle systems.

     

/

返回文章
返回