Distributed Optimization with Finite Bit Adaptive Quantization for Efficient Communication and Precision Enhancement
2024 (English)In: 2024 IEEE 63rd Conference on Decision and Control, CDC 2024, Institute of Electrical and Electronics Engineers (IEEE) , 2024, p. 2531-2537Conference paper, Published paper (Refereed)
Abstract [en]
In realistic distributed optimization scenarios, individual nodes possess only partial information and communicate over bandwidth constrained channels. For this reason, the development of efficient distributed algorithms is essential. In our paper we addresses the challenge of unconstrained distributed optimization. In our scenario each node's local function exhibits strong convexity with Lipschitz continuous gradients. The exchange of information between nodes occurs through 3-bit bandwidth-limited channels (i.e., nodes exchange messages represented by a only 3 -bits). Our proposed algorithm respects the network's bandwidth constraints by leveraging zoom-in and zoom-out operations to adjust quantizer parameters dynamically. We show that during our algorithm's operation nodes are able to converge to the exact optimal solution. Furthermore, we show that our algorithm achieves a linear convergence rate to the optimal solution. We conclude the paper with simulations that highlight our algorithm's unique characteristics.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2024. p. 2531-2537
National Category
Telecommunications Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-361772DOI: 10.1109/CDC56724.2024.10886815Scopus ID: 2-s2.0-86000666500OAI: oai:DiVA.org:kth-361772DiVA, id: diva2:1948039
Conference
63rd IEEE Conference on Decision and Control, CDC 2024, Milan, Italy, Dec 16 2024 - Dec 19 2024
Note
Part of ISBN 9798350316339
QC 20250331
2025-03-272025-03-272025-03-31Bibliographically approved