Distributed Online Constrained Optimization With Feedback Delays

• Published in: IEEE transaction on neural networks and learning systems Vol. 35; no. 2; pp. 1708 - 1720
• Main Authors: Wang, Cong, Xu, Shengyuan
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.02.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Constrained optimization; Constraints; Convex analysis; Convex functions; Convexity; Cost function; Delays; distributed online convex optimization; Feedback; feedback delays; Heuristic algorithms; Internet; Iterative methods; Multi-agent systems; Multiagent systems; Optimization; Subpoenas; Sums; time-varying directed network topology; Timing; Topology
• ISSN: 2162-237X; 2162-2388; 2162-2388
• DOI: 10.1109/TNNLS.2022.3184957

We investigate multiagent distributed online constrained convex optimization problems with feedback delays, where agents make sequential decisions before being aware of the cost and constraint functions. The main purpose of the distributed online constrained convex optimization problem is to cooperatively minimize the sum of time-varying local cost functions subject to time-varying coupled inequality constraints. The feedback information of the distributed online optimization problem is revealed to agents with time delays, which is common in practice. Every node in the system can interact with neighbors through a time-varying sequence of directed communication topologies, which is uniformly strongly connected. The distributed online primal-dual bandit push-sum algorithm that generates primal and dual variables with delayed feedback is used for the presented problem. Expected regret and expected constraint violation are proposed for measuring the performance of the algorithm, and both of them are shown to be sublinear with respect to the total iteration span <inline-formula> <tex-math notation="LaTeX">T </tex-math></inline-formula> in this article. In the end, the optimization problem for the power grid is simulated to justify the proposed theoretical results.