基于近端策略优化的联邦对比降维算法
Federated Contrastive Dimensionality Reduction based on Proximal Policy Optimization
-
摘要: 对比降维算法因其卓越的视觉聚类分离性能以及准确的邻域结构保持能力, 在视觉聚类分析领域具有重要的应用价值. 然而在联邦学习场景下, 各客户端持有的训练数据往往呈现非独立同分布特征, 导致客户端在进行对比降维模型的更新时存在本地偏差. 为了缓解这一问题, 提出一种联邦对比降维算法. 首先通过协同客户端的本地模型训练, 提升全局模型在视觉聚类任务中的泛化性; 然后通过将模型间的对比损失引入本地目标函数, 矫正因数据非独立同分布引起的视觉聚类偏差; 最后设计了一种基于近端策略优化的自适应温度调节智能体, 进一步增强模型对不同数据分布的适应能力. 在三个公开数据集上的定量实验结果表明, 在邻居命中率和k近邻分类准确率上, 所提算法分别优于基线算法16%和9%Abstract: Contrastive Dimensionality Reduction (CDR) has demonstrated significant value in visual cluster analysis due to its exceptional capabilities in cluster separation and neighborhood structure preservation. However, in the context of Federated Learning (FL), the training data held by each client often exhibits non-independent and identically distributed (non-IID) phenomenon, which will lead to local bias when clients update the CDR model. To alleviate this problem, we propose a Federated Contrastive Dimensional-ity Reduction algorithm (FedCDR). First, collaborative training across multiple client models is employed to improve the generalization capability of the model in visual clustering tasks. Second, a model contras-tive loss is introduced into the local objective function to mitigate visual clustering bias caused by non-IID data. Finally, an adaptive temperature regulation agent based on proximal policy optimization is designed to further enhance the model's adaptability to different data distributions. Quantitative experiments on three public datasets demonstrate that Federated Contrastive Dimensionality Reduction outperforms base-lines by 16% in neighbor hit and 9% in k-NN classifier accuracy.