Abstract
In this paper, a novel distributed adaptive neurodynamic approach (DANA) based on proportional integral technique is proposed to solve distributed optimization problem on multi-agent systems. The goal is that all agents reach consensus in finite time and converge to the optimal solution of the global objective function in fixed time. In the proposed approach, the proportional technique drives all agents to reach consensus, and the integral technique is used to offset the influence of the gradient term of the objective function. On the other hand, in order to avoid the prior estimation of gain parameter and the global gradient information, as the main contribution of this paper, the adaptive idea is considered into proportional integral technique. The results show that the adaptive integral technique can automatically adjust the gain according to the maximum consensus error between agents, so as to ensure that agents can achieve consensus in finite time. Then the theoretical results are applied to voltage distribution and logistic regression. Numerical simulation verifies the effectiveness of DANA.
Similar content being viewed by others
Data availability
The authors declare that data supporting the findings of this study are available within the article, the figures are concrete expression.
References
Cui Y, Liu X (2022) Adaptive consensus tracking control of strict-feedback nonlinear multi-agent systems with unknown dynamic leader. Neural Comput Appl 34(8):6215–6226
Olivares DE, Mehrizi-Sani A, Etemadi AH, Cañizares CA, Iravani R, Kazerani M, Hajimiragha AH, Gomis-Bellmunt O, Saeedifard M, Palma-Behnke R et al (2014) Trends in microgrid control. IEEE Trans Smart Grid 5(4):1905–1919
Wen X, Wang Y, Qin S (2021) A nonautonomous-differential-inclusion neurodynamic approach for nonsmooth distributed optimization on multi-agent systems. Neural Comput Appl 33(20):13909–13920
Jia W, Liu N, Qin S (2021) An adaptive continuous-time algorithm for nonsmooth convex resource allocation optimization. IEEE Trans Autom Control 67(11):6038–6044
Jiang X, Qin S, Xue X (2020) A penalty-like neurodynamic approach to constrained nonsmooth distributed convex optimization. Neurocomputing 377:225–233
Boyd S, Parikh N, Chu E, Peleato B, Eckstein J et al (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn 3(1):1–122
Chen Jianing, Qian Sichen, Qin Sitian (2023) An adaptive generalized Nash equilibrium seeking algorithm under high-dimensional input dead-zone. Inform Sci 626:354
Sundhar Ram S, Nedić A, Veeravalli Venugopal V (2012) A new class of distributed optimization algorithms: Application to regression of distributed data. Optim Methods Softw 27(1):71–88
Liu N, Qin S (2018) A novel neurodynamic approach to constrained complex-variable pseudoconvex optimization. IEEE Trans Cybern 49(11):3946–3956
Nedic A, Ozdaglar A (2009) Distributed subgradient methods for multi-agent optimization. IEEE Trans Autom Control 54(1):48–61
Nedic Angelia, Ozdaglar Asuman, Parrilo Pablo A (2010) Constrained consensus and optimization in multi-agent networks. IEEE Trans Autom Control 55(4):922–938
Zhu M, Martinez S (2011) On distributed convex optimization under inequality and equality constraints. IEEE Trans Autom Control 57(1):151–164
Chang T-H, Nedić A, Scaglione A (2014) Distributed constrained optimization by consensus-based primal-dual perturbation method. IEEE Trans Autom Control 59(6):1524–1538
Wang X, Hong Y, Ji H (2015) Distributed optimization for a class of nonlinear multiagent systems with disturbance rejection. IEEE Trans Cybern 46(7):1655–1666
Zhao Yu, Liu Y, Wen G, Chen G (2017) Distributed optimization for linear multiagent systems: edge-and node-based adaptive designs. IEEE Trans Autom Control 62(7):3602–3609
Yang Z, Zhang Q, Chen Z (2019) Adaptive distributed convex optimization for multi-agent and its application in flocking behavior. J Franklin Inst 356(2):1038–1050
Wang J, Elia N (2011) A control perspective for centralized and distributed convex optimization. In: 2011 50th IEEE Conference on decision and control and European control conference. pp 3800–3805. IEEE
Gharesifard B, Cortés J (2013) Distributed continuous-time convex optimization on weight-balanced digraphs. IEEE Trans Autom Control 59(3):781–786
Haghnegahdar L, Wang Y (2020) A whale optimization algorithm-trained artificial neural network for smart grid cyber intrusion detection. Neural Comput Appl 32(13):9427–9441
Bo Yu, Haibo D, Ding L, Di W, Li H (2022) Neural network-based robust finite-time attitude stabilization for rigid spacecraft under angular velocity constraint. Neural Comput Appl 34(7):5107–5117
Lin P, Ren W, Farrell JA (2016) Distributed continuous-time optimization: Nonuniform gradient gains, finite-time convergence, and convex constraint set. IEEE Trans Autom Control 62(5):2239–2253
Zhao T, Ding Z (2017) Distributed finite-time optimal resource management for microgrids based on multi-agent framework. IEEE Trans Ind Electron 65(8):6571–6580
Song Y, Chen W (2016) Finite-time convergent distributed consensus optimisation over networks. IET Control Theory Appl 10(11):1314–1318
Zilun H, Yang J (2018) Distributed finite-time optimization for second order continuous-time multiple agents systems with time-varying cost function. Neurocomputing 287:173–184
Ye H, Song Y (2022) Prescribed-time control for linear systems in canonical form via nonlinear feedback. IEEE Trans Syst Man Cybern Syst 53(2):1126–1135
Liu Q, Yang S, Wang J (2016) A collective neurodynamic approach to distributed constrained optimization. IEEE Trans Neural Netw Learn Syst 28(8):1747–1758
Che H, Wang J (2018) A two-timescale duplex neurodynamic approach to biconvex optimization. IEEE Trans Neural Netw Learn Syst 30(8):2503–2514
Luan L, Wen X, Qin S (2022) Distributed neurodynamic approaches to nonsmooth optimization problems with inequality and set constraints. Complex Intell Syst 8(6):5511–5530
Che H, Wang J (2020) A two-timescale duplex neurodynamic approach to mixed-integer optimization. IEEE Trans Neural Netw Learn Syst 32(1):36–48
Zhang R, Wang J, Li H, Li Z, Ding Z (2018) Robust finite-time guidance against maneuverable targets with unpredictable evasive strategies. Aerosp Sci Technol 77:534–544
Sarhadi P, Noei AR, Khosravi A (2016) Adaptive integral feedback controller for pitch and yaw channels of an AUV with actuator saturations. ISA Trans 65:284–295
Shi W, Ling Q, Gang W, Yin W (2015) A proximal gradient algorithm for decentralized composite optimization. IEEE Trans Signal Process 63(22):6013–6023
Alghunaim SA, Ryu EK, Yuan K, Sayed AH (2021) Decentralized proximal gradient algorithms with linear convergence rates. IEEE Trans Autom Control 66(6):2787–2794
Jie Lu and Choon Yik Tang (2012) Zero-gradient-sum algorithms for distributed convex optimization: the continuous-time case. IEEE Trans Autom Control 57(9):2348–2354
Geng H, Wang Z, Mousavi A, Alsaadi FE, Cheng Y (2022) Outlier-resistant filtering with dead-zone-like censoring under try-once-discard protocol. IEEE Trans Signal Process 70:714–728
Zuo Z, Tian B, Defoort M, Ding Z (2017) Fixed-time consensus tracking for multiagent systems with high-order integrator dynamics. IEEE Trans Autom Control 63(2):563–570
Shuanghe Yu, Long X (2015) Finite-time consensus for second-order multi-agent systems with disturbances by integral sliding mode. Automatica 54:158–165
Yang S, Liu Q, Wang J (2017) A multi-agent system with a proportional-integral protocol for distributed constrained optimization. IEEE Trans Autom Control 62(7):3461–3467
Li Z, Ding Z, Sun J, Li Z (2018) Distributed adaptive convex optimization on directed graphs via continuous-time algorithms. IEEE Trans Autom Control 63(5):1434–1441
Wang X, Mou S, Anderson BD (2022) Consensus-based distributed optimization enhanced by integral-feedback. IEEE Trans Autom Control 68:1894
Clarke FH (1983) Optimization and nonsmooth analysis. Wiley
Wang L, Xiao F (2010) Finite-time consensus problems for networks of dynamic agents. IEEE Trans Autom Control 55(4):950–955
Hendrickx JM, Shi G, Johansson KH (2015) Finite-time consensus using stochastic matrices with positive diagonals. IEEE Trans Autom Control 60(4):1070–1073
Zhao T, Ding Z (2018) Distributed finite-time optimal resource management for microgrids based on multi-agent framework. IEEE Trans Ind Electron 65(8):6571–6580
Guerrero JM, Loh PC, Lee TL, Chandorkar M (2012) Advanced control architectures for intelligent microgrids-part II: power quality, energy storage, and AC/DC microgrids. IEEE Trans Ind Electron 60(4):1263–1270
Cherukuri A, Cortés J (2016) Initialization-free distributed coordination for economic dispatch under varying loads and generator commitment. Automatica 74:183–193
Cherukuri A, Cortés J (2015) Distributed generator coordination for initialization and anytime optimization in economic dispatch. IEEE Trans Control Netw Syst 2(3):226–237
Acknowledgements
This research is supported by the Doctoral Fund of Heilongjiang Institute of Technology (Grant No. 2017BJ26), the National Natural Science Foundation of China (Grant No. 62176073, No. 61773136), and the Natural Scientific Research Innovation Foundation in Harbin Institute of Technology.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
We declare that we have no financial and personal relationships with other people or organizations that can inappropriately influence our work, there is no professional or other personal interest of any nature or kind in any product, service and/or company that could be construed as influencing the position presented in, or the review of, the manuscript entitled “An Adaptive Finite-Time Neurodynamic Approach to Distributed Consensus-Based Optimization Problem.”
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Li, Q., Wang, M., Sun, H. et al. An adaptive finite-time neurodynamic approach to distributed consensus-based optimization problem. Neural Comput & Applic 35, 20841–20853 (2023). https://doi.org/10.1007/s00521-023-08794-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-023-08794-5