高级检索

红外-点云的高精度注册及其微服务数字孪生系统应用

High-Precision Registration of Infrared and Point Clouds Applied in a Microservice-Based Digital Twin System

  • 摘要: 红外相机在智能电网的布局优化、设备监测和故障诊断方面得到广泛应用, 红外图像与点云的融合技术在电力行业也备受瞩目. 将其与现有系统有效结合成为亟待解决的关键问题. 为了实现单幅红外图像与点云的高效融合与显示, 同时确保服务器的灵活部署并解耦与现有系统功能, 提出了红外-点云的高精度注册及其微服务数字孪生系统. 该系统采用了在服务器端进行计算和优化数据更新策略的方法. 首先, 通过红外与点云图像配准算法计算匹配特征点, 在点云场景中计算出红外图像特征点的三维坐标; 其次, 利用 PnP 算法计算红外相机的位姿, 确保红外图像与点云场景的准确对齐; 最后, 通过光栅化算法获取投影信息, 将红外图像的红外值映射到三维点云上, 实现高效的融合. 该系统应用于电力设备红外监测系统, 在真实的大规模室外场景经实验证明, 特征匹配的正确率大于96.17%, 正确匹配的平均投影误差小于 7 个像素.

     

    Abstract: Thermal cameras have widespread applications in smart grid layout optimization, equipment monitoring, and fault diagnosis. The fusion technology of thermal images and point clouds has attracted attention in the power industry. However, effectively integrating it with existing systems remains a critical issue that needs to be addressed. To efficiently fuse and display a single thermal image and point cloud while ensuring flexible server deployment and decoupling from existing system functions, this paper proposes a high-precision infrared and point cloud registration applied in a microservice-based digital twin system. The system performs calculations and optimizes the data update strategy on the server side. First, the matching feature points are calculated using the thermal and point cloud registration algorithm, followed by determining the three-dimensional coordinates of the thermal image feature points within the point cloud scene. Subsequently, the PnP algorithm is utilized to calculate the pose of the infrared camera, ensuring precise alignment of the thermal image with the point cloud scene. Finally, projection information is calculated using the rasterization algorithm, and the thermal values from the the thermal image are mapped onto the three-dimensional point cloud, enabling efficient fusion. The system is employed in infrared monitoring systems for power equipment. Real large-scale outdoor experiments have demonstrated that the accuracy of feature matching exceeds 96.17%, and the average projection error of correct matching is less than 7 pixels.

     

/

返回文章
返回