Jian Hou
Abstract
Recent advances of consensus control have made it significant in multi-agent systems such as in distributed machine learning, distributed multi-vehicle cooperative systems. However, during its application it is crucial to achieve resilience and privacy; specifically, when there are adversary/faulty nodes in a general topology structure, normal agents can also reach consensus while keeping their actual states unobserved.
In this article, we modify the state-of-the-art Q-consensus algorithm by introducing predefined noise or well-designed cryptography to guarantee the privacy of each agent state. In the former case, we add specified noise on agent state before it is transmitted to the neighbors and then gradually decrease the value of noise so the exact agent state cannot be evaluated. In the latter one, the Paillier cryptosystem is applied for reconstructing reward function in two consecutive interactions between each pair of neighboring agents. Therefore, multi-agent privacy-preserving resilient consensus (MAPPRC) can be achieved in a general topology structure. Moreover, in the modified version, we reconstruct reward function and credibility function so both convergence rate and stability of the system are improved.
The simulation results indicate the algorithms’ tolerance for constant and/or persistent faulty agents as well as their protection of privacy. Compared with the previous studies that consider both resilience and privacy-preserving requirements, the proposed algorithms in this article greatly relax the topological conditions. At the end of the article, to verify the effectiveness of the proposed algorithms, we conduct two sets of experiments, i.e., a smart-car hardware platform consisting of four vehicles and a distributed machine learning platform containing 10 workers and a server.
- [1] . 2019. Trust is the cure to distributed consensus with adversaries. In Proceedings of the 27th Mediterranean Conference on Control and Automation (MED). 195–202.Google Scholar
Cross Ref
- [2] . 2012. The MNIST database of handwritten digit images for machine learning research. IEEE Sig. Process. Mag. 29, 6 (2012), 141–142.Google ScholarCross Ref
- [3] . 2017. Resilient consensus of second-order agent networks: Asynchronous update rules over robust graphs. Automatica 81 (2017), 123–132.Google ScholarCross Ref
- [4] . 2017. Distributed formation control of multiple quadrotor aircraft based on nonsmooth consensus algorithms. IEEE Trans. Cyber. 49, 1 (2017), 342–353.Google ScholarCross Ref
- [5] . 2021. Secure and privacy preserving consensus for second-order systems based on paillier encryption. Syst. Contr. Lett. 148 (2021), 104869.Google ScholarCross Ref
- [6] . 2019. Resilient and private consensus in multi-agent systems. In Proceedings of the European Control Conference. IEEE, 3478–3483.Google ScholarCross Ref
- [7] . 2019. Resilient consensus for multi-agent systems subject to differential privacy requirements. Automatica 106 (2019), 18–26.Google ScholarDigital Library
- [8] 2020. Privacy-preserving distributed averaging via homomorphically encrypted ratio consensus. IEEE Trans. Automat. Cont. 65, 9 (2020), 3887–3894.Google ScholarCross Ref
- [9] . 2015. Approximate byzantine consensus in faulty asynchronous networks. In Proceedings of the American Control Conference. IEEE, 1591–1596.Google ScholarCross Ref
- [10] . 2015. Convergence rate analysis of a fault-tolerant distributed consensus algorithm. In Proceedings of the Conference on Decision and Control. IEEE, 5111–5116.Google ScholarCross Ref
- [11] . 2019. Consensus-based data-privacy preserving data aggregation. IEEE Trans. Automat. Contr. 64, 12 (2019), 5222–5229.Google ScholarCross Ref
- [12] . 2019. Privacy-preserving average consensus: Privacy analysis and algorithm design. IEEE Trans. Sig. Inf. Process. Netw. 5, 1 (2019), 127–138.Google ScholarCross Ref
- [13] . 2021. Reinforcement learning based multi-agent resilient control: From deep neural networks to an adaptive law. In Proceedings of the AAAI Conference on Artificial Intelligence. IEEE, 7737–7745.Google ScholarCross Ref
- [14] . 2018. Distributed randomized algorithms for PageRank computation: Recent advances. Uncertainty in complex networked systems. In Honor of Roberto Tempo (2018), 419–447.Google Scholar
- [15] . 2018. On privacy vs. cooperation in multi-agent systems. Int. J. Contr. 91, 7 (2018), 1693–1707.Google ScholarCross Ref
- [16] . 2014. Secure multi-party consensus gossip algorithms. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 7406–7410.Google ScholarCross Ref
- [17] . 2011. Consensus in networked multi-agent systems with adversaries. In Proceedings of the 14th International Conference on Hybrid Systems: Computation and Control. 281–290.Google ScholarDigital Library
- [18] . 2012. Low complexity resilient consensus in networked multi-agent systems with adversaries. In Proceedings of the 15th ACM International Conference on Hybrid Systems: Computation and Control. 5–14.Google ScholarDigital Library
- [19] . 1998. Gradient-based learning applied to document recognition. Proc. IEEE 86, 11 (1998), 2278–2324.Google ScholarCross Ref
- [20] . 2019. POET: Privacy on the edge with bidirectional data transformations. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications. IEEE, 1–10.Google ScholarCross Ref
- [21] . 2021. Engineering secure self-adaptive systems with Bayesian games. Fundam. Approach. Softw. Eng. 12649 (2021), 130–151.Google ScholarDigital Library
- [22] . 2015. Asynchronous parallel stochastic gradient for nonconvex optimization. In Advances in Neural Information Processing Systems 28. IEEE, Montreal, Quebec, Canada, 2737–2745.Google Scholar
- [23] . 2017. A game-theoretic decision-making framework for engineering self-protecting software systems. In Proceedings of the IEEE/ACM International Conference on Software Engineering Companion. IEEE, 449–452.Google Scholar
- [24] . 2013. Privacy-preserving asymptotic average consensus. In Proceedings of the European Control Conference. IEEE, 760–765.Google ScholarCross Ref
- [25] . 2012. Trust method for multi-agent consensus. In Proceedings of the Conference on Unmanned Systems Technology. 1–15.Google ScholarCross Ref
- [26] . 2016. Privacy preserving average consensus. IEEE Trans. Automat. Control 62, 2 (2016), 753–765.Google ScholarCross Ref
- [27] . 2022. Federated learning for COVID-19 detection with generative adversarial networks in edge cloud computing. IEEE Internet Things J. 9, 12 (2022), 10257–10271.Google ScholarCross Ref
- [28] . 2017. Distributed optimization for multiagent systems: An edge-based fixed-time consensus approach. IEEE Trans. Cyber. 49, 1 (2017), 122–132.Google ScholarCross Ref
- [29] . 2020. Justinian’s GAAvernor: Robust distributed learning with gradient aggregation agent. In Proceedings of the USENIX Security Symposium. IEEE, 1641–1658.Google Scholar
- [30] . 2022. General resilient consensus algorithms. Internat. J. Control 95, 6 (2022), 1482–1496.Google ScholarCross Ref
- [31] . 2017. Secure and privacy-preserving average consensus. In Proceedings of the Workshop on Security and Privacy in Cyber-Physical Systems. IEEE, 123–129.Google ScholarDigital Library
- [32] . 2019. Secure and privacy-preserving consensus. IEEE Trans. Automat. Control 64, 10 (2019), 4035–4049.Google ScholarCross Ref
- [33] . 2017. Resilient flocking for mobile robot teams. IEEE Robot. Automat. Lett. 2, 2 (2017), 1039–1046.Google ScholarCross Ref
- [34] . 2019. Resilience against misbehaving nodes in asynchronous networks. Automatica 104 (2019), 26–33.Google ScholarDigital Library
- [35] . 2011. Distributed function calculation via linear iterative strategies in the presence of malicious agents. IEEE Trans. Automat. Contr. 56, 7 (2011), 1495–1508.Google ScholarCross Ref
- [36] . 2019. ByRDiE: Byzantine-resilient distributed coordinate descent for decentralized learning. IEEE Trans. Sig. Inf. Process. Netw. 5, 4 (2019), 611–627.Google ScholarCross Ref
- [37] . 2012. Robustness of information diffusion algorithms to locally bounded adversaries. In Proceedings of the American Control Conference. 5855–5861.Google Scholar
- [38] . 2021. Privacy security in control systems. Sci. China Inf. Sci. 64 (2021), 176201.Google ScholarCross Ref
Index Terms
- Privacy-preserving Resilient Consensus for Multi-agent Systems in a General Topology Structure
Recommendations
Resilient consensus for multi-agent systems subject to differential privacy requirements
AbstractWe consider multi-agent systems interacting over directed network topologies where a subset of agents is adversary/faulty and where the non-faulty agents have the goal of reaching consensus, while fulfilling a differential privacy ...
A Plan Based Coalition Formation Model for Multi-agent Systems
WI-IAT '11: Proceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Volume 02This article addresses the coalition formation problem in a multi-agent context where agents plan their activities dynamically and use these plans to coordinate their actions and form suitable coalitions. In most coalition formation methods, when ...
Resilient cluster consensus for discrete-time high-order multi-agent systems against malicious adversaries
AbstractThis paper studies the problem of resilient cluster consensus for discrete-time high-order multi-agent systems in the presence of malicious adversaries. Based on a decomposition form of the system matrices, a high-order resilient cluster ...
Comments