高级检索
方帅, 朱向东, 曹风云. 基于类解混的高光谱和多光谱图像融合算法[J]. 计算机辅助设计与图形学学报, 2020, 32(1): 54-67. DOI: 10.3724/SP.J.1089.2020.17887
引用本文: 方帅, 朱向东, 曹风云. 基于类解混的高光谱和多光谱图像融合算法[J]. 计算机辅助设计与图形学学报, 2020, 32(1): 54-67. DOI: 10.3724/SP.J.1089.2020.17887
Fang Shuai, Zhu Xiangdong, Cao Fengyun. Hyperspectral and Multispectral Image Fusion Based on Unmixing-Like[J]. Journal of Computer-Aided Design & Computer Graphics, 2020, 32(1): 54-67. DOI: 10.3724/SP.J.1089.2020.17887
Citation: Fang Shuai, Zhu Xiangdong, Cao Fengyun. Hyperspectral and Multispectral Image Fusion Based on Unmixing-Like[J]. Journal of Computer-Aided Design & Computer Graphics, 2020, 32(1): 54-67. DOI: 10.3724/SP.J.1089.2020.17887

基于类解混的高光谱和多光谱图像融合算法

Hyperspectral and Multispectral Image Fusion Based on Unmixing-Like

  • 摘要: 基于解混合的图像融合算法存在的2个问题:(1)用低分辨率高光谱图像(low-resolution hyperspectral image,LR-HSI)的光谱特征重建高分辨率高光谱图像(high-resolution hyperspectral image,HR-HSI),而LR-HSI的空间降质会导致光谱的精度损失;(2)基于非负矩阵解混的算法由于目标函数非凸性,其求解对初始值敏感,导致端元和丰度值不稳定.为解决此问题,提出基于类解混的高光谱图像融合算法.首先,利用模糊c均值算法对图像聚类,以距离聚类中心最近的像素代替解混端元,避开了直接解混导致的解不稳定问题.其次,为每类地物分别学习基于广义回归神经网络(general regression neural network,GRNN)的相同场景HR-HSI和LR-HSI在光谱域的非线性映射关系,弥补由于空间降质导致的端元光谱精度损失.文中借鉴解混合思想,由低分辨率高光谱图像的端元重建高分辨率高光谱图像的端元,将其与高分辨率多光谱图像(high-resolution multispectral image,HR-MSI)的稀疏系数结合得到HR-HSI.在4组数据集上验证本算法性能,与多种融合算法比较.实验表明,Salinas数据的实验结果在SAM,RMSE和ERGAS指标与次优的方法相比,它们的数值分别降低了5.5%,5.5%和1.6%;在Cuprite数据上数值降低了1.3%,3.9%和3.8%;在Indian Pines数据上数值分别降低了1.7%,4.0%和3.9%;在Pavia Center数据上,采用双三次插值时在SAM和ERGAS指标上与次优的方法相比数值分别降低了2.9%和8.5%;采用双线性插值时数值分别降低了3.5%和3.4%.所以,文中算法在有效地提升空间分辨率的同时,很好地保持了光谱信息.

     

    Abstract: The unmixing-based fusion methods mainly has the following two shortcomings.First,the high-resolution hyperspectral image(HR-HSI)is reconstructed using low-resolution hyperspectral spectral features(LR-HSI),and LR-HSI is the spatial degradation of the HR-HSI,which will lead to spectral distortion.Second,in the fusion method based on non-negative matrix decomposition,the solution of the objective function is sensitive to the initial value due to its non-convexity,which leads to the instability of the endmembers and the abundances.For these two problems,a hyperspectral image and multispectral image fusion method based on unmixing-like is proposed in this paper.Firstly,fuzzy c-means(FCM)is used to cluster the images,and the pixels closest to the cluster center are used as endmembers,which avoids the problem of solution instability caused by unmixing.Secondly,general regression neural network(GRNN)is used to learning the nonlinear relationship between HR-HSI and LR-HSI of the same scene in the spectral domain,which compensates for the endmember spectral distortion caused by spatial degradation.Finally,since the training data cannot cover all the spectrum types of the test data,the model output is optimized according to the test data.In this paper,the idea of unmixing-based fusion method is used and the endmembers of the LR-HSI is used to reconstruct the endmembers of HR-HSI.The reconstructed endmembers is combined with the sparse coefficient to obtain a high-spatial resolution image.The experiments used three sets of experiment data and the proposed fusion method is suitable for many datasets and achieved good robustness.The experiments show that the experimental results of Salinas data are 5.5%,5.5%and 1.6%lower in SAM,RMSE and ERGAS indexes compared with the sub-optimal method.In the Cuprite data,the values decrease by 1.3%,3.9%and 3.8%.In Indian Pines,they are down 1.7%,4.0%and 3.9%respectively.With respect to Pavia Center data,the indexes of SAM and ERGAS are reduced by 2.9%and 8.5%respectively in the case of bicubic interpolation.When bilinear interpolation is used,the values are reduced by 3.5%and 3.4%respectively.Therefore,the algorithm in this paper can effectively improve the spatial resolution and maintain the spectral information at the same time.

     

/

返回文章
返回