高级检索
洪居兴, 田媚, 黄雅平. 不确定性感知与类别均衡的表情识别模型[J]. 计算机辅助设计与图形学学报, 2023, 35(10): 1532-1540. DOI: 10.3724/SP.J.1089.2023.19701
引用本文: 洪居兴, 田媚, 黄雅平. 不确定性感知与类别均衡的表情识别模型[J]. 计算机辅助设计与图形学学报, 2023, 35(10): 1532-1540. DOI: 10.3724/SP.J.1089.2023.19701
Hong Juxing, Tian Mei, Huang Yaping. Uncertainty-Aware and Class-Balanced Facial Expression Recognition[J]. Journal of Computer-Aided Design & Computer Graphics, 2023, 35(10): 1532-1540. DOI: 10.3724/SP.J.1089.2023.19701
Citation: Hong Juxing, Tian Mei, Huang Yaping. Uncertainty-Aware and Class-Balanced Facial Expression Recognition[J]. Journal of Computer-Aided Design & Computer Graphics, 2023, 35(10): 1532-1540. DOI: 10.3724/SP.J.1089.2023.19701

不确定性感知与类别均衡的表情识别模型

Uncertainty-Aware and Class-Balanced Facial Expression Recognition

  • 摘要: 为解决真实场景下人脸表情识别不确定性和数据不均衡问题, 提出不确定性感知与类别均衡的表情识别模型. 首先设计标签分布生成网络, 以更好地体现人脸表情分布特性, 并提出基于标签分布的重要性加权损失函数, 使用重要性值对输出结果进行加权, 促进模型对不确定性的抑制; 然后使用距离约束损失函数, 扩大不同重要性值分组之间的平均重要性值的差值, 使用重标记模块, 依据样本类别预测向量发现, 纠正不确定性引起的噪声标签; 最后为解决数据不均衡问题, 提出基于标签分布的类别均衡损失函数, 依据难易样本数量自适应地分配各个样本的权重, 加强模型对难样本的学习. 在 RAF 数据集中的实验结果表明, 所提模型识别准确率达到 88.36%, 性能优于其他表情识别模型, 证明了该模型的有效性.

     

    Abstract: Facial expression recognition (FER) is a challenging task because of the uncertainty and data imbalance in the real wild. In order to address the above-mentioned challenges, an uncertainty-aware and class-balanced model for FER is proposed. Firstly, the label distribution generation network is designed to represent the characteristics of facial expression distribution comprehensively. The importance of weighting loss based on label distribution is proposed to suppress uncertainty for the model by utilizing the important values to reweight the output results. Secondly, the distance constraint loss is exploited to expand the distance value of the average importance values between groups of different importance values. The relabeling module detects and corrects noisy labels caused by uncertainty based on the sample category prediction vector. Finally, class-balanced loss based on label distribution is proposed to address data imbalance. The learning of difficult samples is enhanced by assigning the weight of samples according to the number of difficult and easy samples. The experimental results show that the proposed model achieves 88.36% accuracy on the RAF dataset. Its performance outperformed the most of FER models and proved the effectiveness of the proposed model.

     

/

返回文章
返回