高级检索
孙清华, 邓程, 顾振宇. 结合词向量和自注意力机制的设计素材推荐系统[J]. 计算机辅助设计与图形学学报, 2024, 36(1): 63-72. DOI: 10.3724/SP.J.1089.2024.19823
引用本文: 孙清华, 邓程, 顾振宇. 结合词向量和自注意力机制的设计素材推荐系统[J]. 计算机辅助设计与图形学学报, 2024, 36(1): 63-72. DOI: 10.3724/SP.J.1089.2024.19823
Sun Qinghua, Deng Cheng, Gu Zhenyu. Design Resources Recommendation Based on Word Vectors and Self-Attention Mechanisms[J]. Journal of Computer-Aided Design & Computer Graphics, 2024, 36(1): 63-72. DOI: 10.3724/SP.J.1089.2024.19823
Citation: Sun Qinghua, Deng Cheng, Gu Zhenyu. Design Resources Recommendation Based on Word Vectors and Self-Attention Mechanisms[J]. Journal of Computer-Aided Design & Computer Graphics, 2024, 36(1): 63-72. DOI: 10.3724/SP.J.1089.2024.19823

结合词向量和自注意力机制的设计素材推荐系统

Design Resources Recommendation Based on Word Vectors and Self-Attention Mechanisms

  • 摘要: 当设计师使用文本在设计库中检索素材时,基于词匹配的搜索无法有效地识别文本中的设计意图并推荐合适的素材.对此,提出一个结合词向量和自注意力机制的设计素材推荐系统.首先从预训练词向量模型中获取文本的词向量表征;然后利用自注意力机制学习文本中不同词的权重以及文本与设计语义间的映射关系;最后基于模型输出与向量相似,检索并重排序设计素材形成推荐.所提系统还能检索带有不同语义标签的素材数据,通过计算其语义与设计语义的词相似作为权重,转换其数据维度与模型输出维度一致.基于1 300个电商设计案例和200种字体进行实验的结果表明,用户评估推荐结果的有效率分别为55%和57.3%,处于同类工作中上水平;验证了该系统的可行性及有效性.

     

    Abstract: When designers utilize text prompts to retrieve resources in a design repository, the keyword-matching approach usually fails to capture the real design semantics in the text and recommends irrelevant design resources. To address this problem, this paper proposes a design material recommendation system exploiting word vectors and self-attention mechanisms. First, the model segments the text into tokens and takes the token word vectors from the pre-trained word vector model as input. Then, we exploit the self-attention mechanism to learn the weight of tokens and the mapping function between tokens and design semantics. Finally, we retrieve and sort the design resources by computing the vector similarity between the model output and annotated resource data. The system can retrieve other design resources with different semantic tags as well by unifying the similarity between the different semantics into weight vectors and converting the data dimension to be consistent with the model output. With 1 300 e-commerce design cases and 200 fonts, the efficiency of user-assessed recommendation results is 55% and 57.3%, respectively, which are above average for similar works and validate the feasibility and effectiveness of the proposed system.

     

/

返回文章
返回