高级检索
甘霖, 刘骊, 刘利军, 付晓东, 黄青松. 结合边缘轮廓和姿态特征的人体精确解析模型[J]. 计算机辅助设计与图形学学报, 2021, 33(9): 1428-1439. DOI: 10.3724/SP.J.1089.2021.18683
引用本文: 甘霖, 刘骊, 刘利军, 付晓东, 黄青松. 结合边缘轮廓和姿态特征的人体精确解析模型[J]. 计算机辅助设计与图形学学报, 2021, 33(9): 1428-1439. DOI: 10.3724/SP.J.1089.2021.18683
Gan Lin, Liu Li, Liu Lijun, Fu Xiaodong, Huang Qingsong. Accurate Human Parsing Model by Edge Contour and Pose Feature[J]. Journal of Computer-Aided Design & Computer Graphics, 2021, 33(9): 1428-1439. DOI: 10.3724/SP.J.1089.2021.18683
Citation: Gan Lin, Liu Li, Liu Lijun, Fu Xiaodong, Huang Qingsong. Accurate Human Parsing Model by Edge Contour and Pose Feature[J]. Journal of Computer-Aided Design & Computer Graphics, 2021, 33(9): 1428-1439. DOI: 10.3724/SP.J.1089.2021.18683

结合边缘轮廓和姿态特征的人体精确解析模型

Accurate Human Parsing Model by Edge Contour and Pose Feature

  • 摘要: 针对着装场景中由于人体姿态、边缘轮廓、服装配饰的复杂性以及着装部位关节点被遮挡等因素导致人体解析精度较低的问题,提出一种结合边缘轮廓和姿态特征的人体精确解析模型.首先采用残差网络ResNet-101作为主干网络表征输入人体图像进行初步人体解析,得到粗解析特征;然后构建边缘轮廓模块,结合上采样后的全局和局部特征得到人体边缘轮廓;再基于着装姿态定义着装姿态损失函数,通过姿态估计模块提取人体姿态特征;最后联合粗解析特征、边缘轮廓和姿态特征,并定义结构损失和人体解析损失的组合函数输出精确的解析结果.在多个数据集上的实验结果表明,该模型的mIoU评测指标提高了1.96%,在人体的着装姿态和部位遮挡等方面获得了更准确的语义分割结果,能有效地提高着装人体解析的精度.

     

    Abstract: To address the problem of low accuracy and precision of human parsing due to human pose,edge contour,complexity of clothing accessories and occlusions of human pose joints in dressing scenes,an ac-curate human parsing model with edge contour and pose features is proposed for dressed human.Firstly,the backbone network based on ResNet-101 is used to represent input human body images and extract the coarse parsing features.Secondly,the edge contour module combining the global and local features after upsam-pling is constructed to obtain the edge contour of human body.Then,the defined human pose loss function based on human pose is added into pose estimation module to acquire pose features.Finally,coarse parsing feature,edge contour and pose features are integrated into accuracy parsing module,and the accurate human parsing results are output by the combined function of structure loss function and human parsing loss func-tion.The experimental results show that the proposed model can effectively improve 1.96%of mIoU and accuracy on human datasets with more accurate segmentation results for different poses and occlusions of the human body parts.

     

/

返回文章
返回