高级检索
杨淼, 樊庆楠, 王玉洁, 段岳圻, 陈宝权. 图神经网络下的生成式室内家具摆放[J]. 计算机辅助设计与图形学学报, 2021, 33(3): 457-464. DOI: 10.3724/SP.J.1089.2021.18457
引用本文: 杨淼, 樊庆楠, 王玉洁, 段岳圻, 陈宝权. 图神经网络下的生成式室内家具摆放[J]. 计算机辅助设计与图形学学报, 2021, 33(3): 457-464. DOI: 10.3724/SP.J.1089.2021.18457
Yang Miao, Fan Qingnan, Wang Yujie, Duan Yueqi, Chen Baoquan. Graph Neural Network for Generative Furniture Arrangement[J]. Journal of Computer-Aided Design & Computer Graphics, 2021, 33(3): 457-464. DOI: 10.3724/SP.J.1089.2021.18457
Citation: Yang Miao, Fan Qingnan, Wang Yujie, Duan Yueqi, Chen Baoquan. Graph Neural Network for Generative Furniture Arrangement[J]. Journal of Computer-Aided Design & Computer Graphics, 2021, 33(3): 457-464. DOI: 10.3724/SP.J.1089.2021.18457

图神经网络下的生成式室内家具摆放

Graph Neural Network for Generative Furniture Arrangement

  • 摘要: 自动的室内家具摆放在家居设计、动态场景生成等应用中具有显著的意义.传统算法往往通过显式的空间、语义和功能性上物体之间的关系来理解场景的内部结构,并进一步辅助室内场景的生成.随着大规模室内场景数据集的出现,提出将零散的输入家具编码进图结构,并利用图神经网络中迭代的消息传递隐式地学习场景的分布先验.为了满足家具摆放的多样性,提出将图神经网络融合进条件式变分自编码器.通过一个编码器将输入场景嵌入到一个符合高斯分布的隐变量,并通过一个生成器将从隐变量采样的场景先验用于条件式的新场景生成.在Fu-floor数据集上的实验结果表明,与基准算法相比,该算法在生成结果的评价指标最小匹配距离上表现更优.该算法对于未来实现场景补全、基于场景图的室内家具摆放等实际应用也具有显式的意义和价值.

     

    Abstract: Autonomous furniture arrangement plays an important role in many computer vision and graphics applications,such as indoor scene design and dynamic scene generation.The traditional approaches leverage the common spatial,semantical and functional object-object relationships to understand the inner structure of the indoor scene and facilitate the scene generation task.Benefited from the large-scale indoor scene dataset,we propose to embed the unstructured furniture into the graph structure,and leverage the graph neural network to iteratively learn the distribution of scene layout.In order to satisfy the diversity of furniture arrangement,we propose to incorporate the graph neural network into a conditional variational autoencoder.It leverages an encoder to input the scene information into a latent vector that represent the Gaussian distribution,and employ a generator to decode the scene layout from the sampled Gaussian noise for conditional new scene generation.Experimentally,we observe better quality of our algorithm compared to various baselines via the minimum matching distance on the public Fu-floor benchmark.The proposed algorithm is important for many practical applications,including scene completion,interior design based on scene graph and so on.

     

/

返回文章
返回