高级检索
章思远, 肖世明, 张蓬, 黄伟. 图像生成和深度度量学习的身份感知面部表情识别方法[J]. 计算机辅助设计与图形学学报, 2021, 33(5): 724-732. DOI: 10.3724/SP.J.1089.2021.18462
引用本文: 章思远, 肖世明, 张蓬, 黄伟. 图像生成和深度度量学习的身份感知面部表情识别方法[J]. 计算机辅助设计与图形学学报, 2021, 33(5): 724-732. DOI: 10.3724/SP.J.1089.2021.18462
Zhang Siyuan, Xiao Shiming, Zhang Peng, Huang Wei. Identity-Aware Facial Expression Recognition Method Based on Synthesized Images and Deep Metric Learning[J]. Journal of Computer-Aided Design & Computer Graphics, 2021, 33(5): 724-732. DOI: 10.3724/SP.J.1089.2021.18462
Citation: Zhang Siyuan, Xiao Shiming, Zhang Peng, Huang Wei. Identity-Aware Facial Expression Recognition Method Based on Synthesized Images and Deep Metric Learning[J]. Journal of Computer-Aided Design & Computer Graphics, 2021, 33(5): 724-732. DOI: 10.3724/SP.J.1089.2021.18462

图像生成和深度度量学习的身份感知面部表情识别方法

Identity-Aware Facial Expression Recognition Method Based on Synthesized Images and Deep Metric Learning

  • 摘要: 为解决面部表情识别中不同图像的背景信息和身份特征会干扰分类准确率的问题,提出一种将图像合成技术和深度度量学习相结合的身份感知人脸表情识别方法,通过在面部表情识别任务中创建相同身份下的表情组,对人脸图像特征进行比较分类.其结构中对抗生成网络,目标在于学习表情信息并生成表情组;特征提取网络用于将图像转化成为可进行度量学习的特征向量;马氏度量学习网络能够有效地对一对特征值进行比较与分类.该方法在常用面部表情识别数据集CK+和Oulu-CASIA上取得了98.6532%和99.8248%的平均分类准确率,并在Oulu-CASIA数据集上超过当前最好方法10%以上.通过与目前最新方法的比较,证实了该方法在面部表情识别中的有效性和进步性.

     

    Abstract: Facial expression recognition(FER)is a challenging task because the external environment and identity characteristics could affect the classification results directly.To settle down the above-mentioned challenges,this paper proposed an identity-aware facial expression recognition method which combined images synthesis techniques and deep metric learning,and made facial images features compared then classified by creating expression groups under the same identity in FER task.There are three parts in our method.The first part is a generative adversarial network,which aims to learn expression information and synthesis the expression groups.the second part is the feature extraction network,which transforms the image into feature vectors that could be used for metric learning.The third part is Mahalanobis metric learning network that could compare and classify a pair of feature values effectively.The average accuracy of proposed method reached 98.6532%and 99.8248%on two well-known FER dataset named CK+and Oulu-CASIA,with more than 10%higher than the method proposed currently.By comparing with several state-of-the-art methods,the experimental results confirmed that the proposed-method was effective and progressive in FER task.

     

/

返回文章
返回