手工 LBP 特征增强的无参考图像质量评价
Boosting No-Reference Image Quality Assessment Using Handcrafted LBP Features
-
摘要: 针对现有无参考图像质量评价方法主要基于深度神经网络进行特征学习, 未能有效利用包含领域专业知识的手工特征的问题, 提出了基于手工局部二值模式(local binary pattern, LBP)特征增强的无参考图像质量评价模型. 通过引入LBP特征, 提升无参考图像质量评价模型的性能; 首先, 从输入RGB图像中提取对应的LBP图; 其次, 使用双分支网络分别对RGB图和LBP图进行特征表征学习, 提取感知相关的深层次特征; 然后, 通过加权特征融合模块自适应整合双分支的特征表示; 最后, 将融合后的特征送入回归模块, 预测图像的质量评分. 在6个公开数据集上的实验结果表明, 所提方法的整体性能优于对比方法, 且模型具有良好的泛化能力; 与不引入LBP特征的基线模型相比, 引入手工特征策略后模型的性能有了较大的提升, 特别是在LIVE, CSIQ和BID数据集上, 与基线模型相比, SRCC和PLCC指标提升约5%~8%的, 验证了通过手工特征帮助提升模型性能策略的有效性.Abstract: Aiming at the problem that the existing no-reference image quality assessment methods are mainly based on deep neural network for feature learning, and fail to effectively use the hand-crafted features containing domain expertise, a no-reference image quality assessment model based on hand-crafted local binary pattern (LBP) feature enhancement was proposed. The performance of the no-reference image quality assessment model was improved by introducing the LBP feature. Firstly, the corresponding LBP map was extracted from the input RGB image. Secondly, the dual-branch network was used to learn the feature representation of RGB image and LBP image respectively, and the deep features related to perception were extracted. Then, the dual-branch feature representation was adaptively integrated through the weighted feature fusion module. Finally, the fused features were fed into the regression module to predict the quality score of the image. The experimental results on six public datasets show that the overall performance of the proposed method is better than that of the comparison methods, and the model has good generalization ability. Compared with the baseline model without introducing LBP features, the performance of the model after introducing the manual feature strategy has been greatly improved, especially on the LIVE, CSIQ and BID datasets, compared with the baseline model, the SRCC and PLCC indicators are improved by about 5% to 8%, which verifies the effectiveness of the strategy of improving the performance of the model through manual features.