Blockchain-Based Swarm Learning for the Mitigation of Gradient Leakage in Federated Learning

【Author】 Madni, Hussain Ahmad; Umer, Rao Muhammad; Foresti, Gian Luca

【Source】IEEE ACCESS

【影响因子】3.476

【Abstract】Federated Learning (FL) is a machine learning technique in which collaborative and distributed learning is performed, while the private data reside locally on the client. Rather than the data, only gradients are shared among all collaborative nodes with the help of a central server. To ensure the data privacy, the gradients are prone to the deformation, or the representation is perturbed before sharing, ultimately reducing the performance of the model. Recent studies show that the original data can still be recovered using latent space (i.e., gradient leakage problem) by Generative Adversarial Network and different optimization algorithms such as Bayesian and Covariance Matrix Adaptation Evolution Strategy. To address the issues of data privacy and gradient leakage, in this paper, we train deep neural networks by exploiting the blockchain-based Swarm Learning (SL) framework. In the SL scheme, instead of sharing perturbed or noisy gradients to the central server, we share the original gradients among authenticated (i.e., blockchain-based smart contract) training nodes. To demonstrate the effectiveness of the SL approach, we evaluate the proposed approach using the standard CIFAR10 and MNIST benchmark datasets and compare it with the other existing methods.

【Keywords】Data models; Particle swarm optimization; Peer-to-peer computing; Blockchains; Servers; Federated learning; Smart contracts; Blockchain; data privacy; federated learning; gradient leakage; model privacy; Swarm Learning

【发表时间】2023

【收录时间】2023-03-27

【文献类型】实证数据

【主题类别】

区块链技术-协同技术-联邦学习