高级检索

RASP-Net: 基于残差块和高相似传递注意力的图像去雪网络

RASP-Net: Residual Block with High Similarity Pass Attention for Image Desnowing

  • 摘要: 在冬季或高海拔的雪地细节拍摄的照片中, 大量的雪花覆盖在图像上, 严重影响图像的质量. 针对当前图像去雪算法中侧重提取海量特征检测并去除多尺度雪花, 缺少特征甄别筛选机制的问题, 为了提取相关性强的雪花特征, 提出基于残差块和高相似传递注意力的图像去雪网络RASP-Net. 首先将残差块和空间注意力机制相结合, 动态地增强样本有用特征、抑制无用雪花特征; 然后使用高相似性传递注意力和软阈值处理技术动态地判断雪花特征; 最后通过循环结构细化特征提取和雪花去除, 提升模型的去雪性能和鲁棒性. 在Snow100K, SRRS和CSD数据集上的大量实验结果表明, RASP-Net在合成和真实世界两种数据集的去雪效果均优于当前先进的方法, 其中, Snow100K数据集的峰值信噪比达到了35.51dB, 可精准重建因雪花遮挡而丢失的图像细节.

     

    Abstract: In photographs taken in snowy environments during winter or at high altitudes, a large number of snowflakes obscure the images, severely degrading their quality. Current image desnowing algorithms mainly focus on extracting massive features to detect and remove multi-scale snowflakes, but they lack an effective mechanism for feature discrimination and selection. To address this issue and extract snowflake features with stronger relevance, we propose an image desnowing network called RASP-Net, which is based on residual blocks and high-similarity propagation attention. First, residual blocks are combined with a spatial attention mechanism to dynamically enhance useful features while suppressing irrelevant snowflake features. Then, high-similarity propagation attention and soft-thresholding techniques are employed to adaptively identify snowflake features. Finally, a recurrent structure is introduced to refine feature extraction and snowflake removal, thereby improving the desnowing performance and robustness of the model. Extensive experiments on the Snow100K, SRRS, and CSD datasets demonstrate that RASP-Net achieves superior desnowing results on both synthetic and real-world datasets compared to state-of-the-art methods. In particular, on the Snow100K dataset, RASP-Net achieves a peak signal-to-noise ratio (PSNR) of 35.51 dB, and can accurately reconstruct image details lost due to snowflake occlusion.

     

/

返回文章
返回