Abstract
With the explosive growth of personal data in the era of big data, federated learning has broader application prospects, in order to solve the problem of data island and preserve user data privacy, a federated learning model based on differential privacy (DP) is proposed. Participants share the parameters after adding noise to the central server for parameter aggregation by training local data. However, there are two problems in this model: on the one hand, the data information in the process of broadcasting parameters by the central server is still compromised, with the risk of user privacy leakage; on the other hand, adding too much noise to parameters will reduce the quality of parameter aggregation and affect the model accuracy of federated learning finally. Therefore, a novel federated learning approach with bidirectional adaptive differential privacy (FedBADP) is proposed, it can adaptively add noise to the gradients transmitted by participants and central server, and protects data security without affecting model accuracy. In addition, considering the performance limitations of the participants’ hardware devices, this model samples their gradients to reduce communication overhead, and uses RMSprop to accelerate the convergence of the model on the participants and central server to improve the ac-curacy of the model. Experiments show that our novel model can not only obtain better results in accuracy, but also enhance user privacy preserving while reducing communication overhead.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Jiang, J.F., Kantarci, B.S., Oktug, S.F.T.: Federated learning in smart city sensing: challenges and opportunities. Sensors 20(21), 6230 (2020)
Xu, J.F., Glicksberg, B.S.S., Su, C.T.: Federated learning for healthcare informatics. J. Healthcare Inform Res. 5, 1–19 (2021)
Chen, J.F., Sun, C.S., Zhou, X.T.: Local privacy protection for power data prediction model based on federated learning and homomorphic encryption. Inf. Secur. Res. 9(03), 228–234 (2023)
Su, Y.F., Liu, W.S.: Secure protection method for federated learning model based on secure shuffling and differential privacy. Inf. Secur. Res. 8(03), 270–276 (2022)
Mcmahan, H.B.F., Moore, E.S., Ramage, D.T.: Communication-efficient learning of deep networks from decentralized data. In: Artificial Intelligence and Statistics. PMLR, pp. 1273–1282 (2017)
Konen, J.F., Mcmahan, H.B.S., Yu, F.X.T.: Federated Learning: Strategies for Improving Communication Efficiency. arXiv preprint, arXiv:1610.05492 (2016)
Li, T.F., Sahu, A.K.S., Zaheer, M.T.: Federated Optimization in Heterogeneous Networks. arXiv preprint, arXiv:1812.06127 (2018)
Melis, L.F., Song, C.S., Cristofaro, E.D.T.: Inference Attacks Against Collaborative Learning. CoRR abs, 1805.04049 (2018)
Abadi, M.F., Chu, A.S.: Deep learning with differential privacy. In: Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security, pp. 308–318 (2016)
Wei, K.F., Li, J.S., Ding, M.T.: Federated learning with differential privacy: algorithms and performance analysis. IEEE Trans. Inf. Forensics Secur. PP(99), 1–1 (2020)
Wei, K.F., Li, J.S., Ding, M.T.: User-level privacy-preserving federated learning: analysis and performance optimization. IEEE Trans. Mob. Comput. 21(9), 3388–3401 (2022)
Xu, Z.F., Shi, S.S., Liu, A.X.T.: An adaptive and fast convergent approach to differentially private deep learning. In: Proceedings of the IEEE INFOCOM, pp. 1867–1876 (2020)
Geyer, R.C.F., Klein, T.S., Nabi, M.T.: Differentially Private Federated Learning: A Client Level Perspective. arXiv preprint, arXiv:1712.07557 (2017)
Xiang, L.F., Yang, J.S., Li, B.T.: Differentially-private deep learning from an optimization perspective. In: Proceedings of the IEEE Conference on Computer Communications, pp. 559–5672015 (2019)
Acknowledgement
This research is funded by the 2022 Central University of Finance and Economics Education and Teaching Reform Fund (No. 2022ZXJG35), Emerging Interdisciplinary Project of CUFE, the National Natural Science Foundation of China (No. 61906220) and Ministry of Education of Humanities and Social Science project (No. 19YJCZH178).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Li, Y., Xu, J., Zhu, J., Wang, Y. (2023). A Novel Federated Learning with Bidirectional Adaptive Differential Privacy. In: Yu, Z., et al. Data Science. ICPCSEE 2023. Communications in Computer and Information Science, vol 1879. Springer, Singapore. https://doi.org/10.1007/978-981-99-5968-6_23
Download citation
DOI: https://doi.org/10.1007/978-981-99-5968-6_23
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-5967-9
Online ISBN: 978-981-99-5968-6
eBook Packages: Computer ScienceComputer Science (R0)