高级检索
郭彤颖, 薛亚栋, 吴俊卓. 多感知机制融合的家居物品检测方法[J]. 计算机辅助设计与图形学学报, 2023, 35(2): 213-220. DOI: 10.3724/SP.J.1089.2023.20035
引用本文: 郭彤颖, 薛亚栋, 吴俊卓. 多感知机制融合的家居物品检测方法[J]. 计算机辅助设计与图形学学报, 2023, 35(2): 213-220. DOI: 10.3724/SP.J.1089.2023.20035
Guo Tongying, Xue Yadong, Wu Junzhuo. Household Items Detection Method Based on Multi-Sensory Mechanism Fusion[J]. Journal of Computer-Aided Design & Computer Graphics, 2023, 35(2): 213-220. DOI: 10.3724/SP.J.1089.2023.20035
Citation: Guo Tongying, Xue Yadong, Wu Junzhuo. Household Items Detection Method Based on Multi-Sensory Mechanism Fusion[J]. Journal of Computer-Aided Design & Computer Graphics, 2023, 35(2): 213-220. DOI: 10.3724/SP.J.1089.2023.20035

多感知机制融合的家居物品检测方法

Household Items Detection Method Based on Multi-Sensory Mechanism Fusion

  • 摘要: 家居物品检测是家庭服务机器人执行目标抓取任务的关键,针对日常家居场景背景复杂、家居物品密集、小目标物品类型多而导致检测难度较大的问题,提出一种基于多感知机制融合的家居物品检测方法.首先,在YOLOX的颈部网络部分加入坐标注意力机制模块,减少繁杂信息带来的影响;其次,采用基于多感知融合的dynamic head对YOLOX的检测头进行改进,提升对小目标物品的检测精度;最后,在损失函数中加入focal loss,减小因正负样本数量不平衡而带来的误差.在PyTorch环境下,使用自制的家居物品数据集对改进后的YOLOX算法进行消融实验,并与其他6种目标检测算法进行对比实验.实验结果表明,所提方法对家居物品检测的mAP为58.34%,帧速为45.35帧/s,在满足算法检测实时性的同时,有效地提高了对家居物品的检测精度.

     

    Abstract: Household items detection is the key of home service robots to perform target grasping tasks. In order to solve the problem of difficult detection due to the complex background of daily household scenes, dense household items, and many types of small target, we propose a method of household objects detection based on the fusion of multi-sensory mechanism. Firstly, the coordinate attention mechanism module is added to the neck part of YOLOX to reduce the influence of complicated information. Secondly, the dynamic head based on multi-sensory fusion is used to improve the detection head of YOLOX to enhance the detection accuracy of small target items. Finally, focal loss is added to the loss function to reduce the error caused by the imbalance of positive and negative samples. In PyTorch environment, the improved YOLOX algorithm was used to perform ablation experiments on a self-made household items dataset and compared with six other object detection algorithms. The experimental results show that the proposed method achieves 58.34% mAP and frame rate of 45.35 frames per second for the detection of household items, which effectively improves the detection accuracy of household items while ensuring the real-time detection of the algorithm.

     

/

返回文章
返回