人机协同决策的异质多智能体路径规划
Heterogeneous Multi-Agent Path Planning with Human-Machine Collaborative Decision-Making
-
摘要: 针对路径规划研究中智能体的异质性和人的经验与认知注入考虑不足的问题, 提出了一种混合现实场景下的人机协同决策异质多智能体路径规划方法. 首先, 设计了基于危险度引导点和RVO(reciprocal velocity obstacles)局部避碰的异质多智能体深度强化学习方法, 根据智能体的异质性进行全局引导和局部指导, 设置适用于异质智能体的奖励函数, 解决了稀疏奖励问题; 然后, 在基于混合现实的虚实智能体交互过程中, 融入人的经验修正智能算法规划出的路径, 增强人的指导, 实现人机协同决策路径规划, 弥补了智能算法的不足. 最后, 本文在2D、3D和混合现实场景下进行实验, 实验结果表明, 该方法不仅适用于异质多智能体路径规划, 还能在混合现实场景下实现人机协同决策规划, 在成功率、收敛性、路径长度、拐点数等评价指标均优于基准算法.Abstract: Addressing the insufficient consideration of agent heterogeneity and the injection of human experience and cognition in path planning research, this paper proposes a method for heterogeneous multi-agent path planning with human-machine collaborative decision-making in mixed reality scenarios. Firstly, we designed a heterogeneous multi-agent deep reinforcement learning method based on danger-guided point selection and local collision avoidance using Reciprocal Velocity Obstacles (RVO). By considering the heterogeneity of agents, we utilized both global guidance and local instructions to set up a reward function suitable for heterogeneous intelligent agents, effectively addressing the sparse reward problem. Secondly, in the context of mixed reality-based virtual and real agent interaction, human experience is integrated to refine paths planned by the intelligent algorithm, enhancing human guidance and achieving human-machine collaborative decision-making in path planning, thereby compensating for the limitations of the intelligent algorithm. Finally, experiments conducted in 2D, 3D, and mixed reality environments demonstrate that the proposed method not only applies to heterogeneous multi-agent path planning but also achieves human-machine collaborative decision-making planning in mixed reality scenarios. The results show that the proposed method outperforms baseline algorithms in terms of success rate, convergence, path length, number of turning points, and other evaluation metrics.