高级检索
江卓燊, 刘博生, 唐忆滨, 武继刚. 面向3D生成对抗网络的频域加速器设计[J]. 计算机辅助设计与图形学学报.
引用本文: 江卓燊, 刘博生, 唐忆滨, 武继刚. 面向3D生成对抗网络的频域加速器设计[J]. 计算机辅助设计与图形学学报.
Zhuoshen Jiang, Bosheng Liu, Yibin Tang, Jigang Wu. Frequency-domain Acceleration for 3D Generative Adversarial Networks[J]. Journal of Computer-Aided Design & Computer Graphics.
Citation: Zhuoshen Jiang, Bosheng Liu, Yibin Tang, Jigang Wu. Frequency-domain Acceleration for 3D Generative Adversarial Networks[J]. Journal of Computer-Aided Design & Computer Graphics.

面向3D生成对抗网络的频域加速器设计

Frequency-domain Acceleration for 3D Generative Adversarial Networks

  • 摘要: 三维生成对抗网络(3D generative adversarial networks, 3D GANs)广泛应用于模型预测、对象生成等领域. 针对当前3D GANs加速器存在计算开销高、访存能耗高问题, 提出一种新颖的基于快速傅里叶变换(fast Fourier transforms, FFTs)的3D GANs频域加速器设计(简称为FAG). 首先, 针对3D GANs加速器计算开销高问题, 提出支持频域3D GANs计算的硬件架构, 利用频域低计算复杂度特性和频域反卷积中的零值模式以减少计算开销. 其次, 针对加速器访存开销高问题, 提出支持3D卷积和反卷积计算的频域映射调度流, 利用频域共轭对称特性和反卷积中的零值模式减少访存开销. 最后, 基于ModelNet数据集和三种3D GAN模型(3DGAN, 3D-IWGAN和3D-PhysNet)的评估结果表明, 与具有代表性的频域加速器相比, FAG可使性能提高76%, 能效提高141%; 与具有代表性的空间域加速器相比, 性能提高了6倍, 能效提高了46倍

     

    Abstract: 3D generative adversarial networks (3D GANs) are widely utilized in model prediction and object generation. To address the challenges of massive computation and significant energy consumption in accelerating 3D GANs, a novel fast Fourier transform based frequency-domain accelerator (called FAG) is proposed. Firstly, FAG provides a frequency-domain hardware architecture, which utilizes the compact computation complexity and the zero repeat pattern in deconvolution, to reduce the computation overhead in 3D GANs accelerators. Secondly, FAG exploits the frequency-domain characteristic of Hermitian symmetry and the zero repeat pattern of deconvolution to significantly reduce data movements, and it utilizes the repeat pattern in deconvolution to significantly reduce data movements. Finally, comprehensive evaluations based on the ModelNet dataset and three 3D GAN models (3DGAN, 3D-IWGAN and 3D-PhysNet) show that, the performance and the energy efficiency can be improved by 76% and 141%, respectively, compared with the frequency-domain baseline; FAG achieves 6× higher performance and 46× better energy efficiency compared with the spatial baseline.

     

/

返回文章
返回