Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Differentially Private Dual Gradient Tracking for Distributed Resource Allocation (2403.18275v1)

Published 27 Mar 2024 in eess.SY and cs.SY

Abstract: This paper investigates privacy issues in distributed resource allocation over directed networks, where each agent holds a private cost function and optimizes its decision subject to a global coupling constraint through local interaction with other agents. Conventional methods for resource allocation over directed networks require all agents to transmit their original data to neighbors, which poses the risk of disclosing sensitive and private information. To address this issue, we propose an algorithm called differentially private dual gradient tracking (DP-DGT) for distributed resource allocation, which obfuscates the exchanged messages using independent Laplacian noise. Our algorithm ensures that the agents' decisions converge to a neighborhood of the optimal solution almost surely. Furthermore, without the assumption of bounded gradients, we prove that the cumulative differential privacy loss under the proposed algorithm is finite even when the number of iterations goes to infinity. To the best of our knowledge, we are the first to simultaneously achieve these two goals in distributed resource allocation problems over directed networks. Finally, numerical simulations on economic dispatch problems within the IEEE 14-bus system illustrate the effectiveness of our proposed algorithm.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (32)
  1. A distributed algorithm for economic dispatch over time-varying directed networks with delays. IEEE Transactions on Industrial Electronics, 64(6):5095–5106, 2016.
  2. Simultaneous routing and resource allocation via dual decomposition. IEEE Transactions on Communications, 52(7):1136–1144, 2004.
  3. Power Generation, Operation, and Control. John Wiley & Sons, 2013.
  4. An algorithm for combined heat and power economic dispatch. IEEE Transactions on Power Systems, 11(4):1778–1784, 1996.
  5. Convergence analysis of the incremental cost consensus algorithm under different communication network topologies in a smart grid. IEEE Transactions on Power Systems, 27(4):1761–1768, 2012.
  6. Initialization-free distributed algorithms for optimal resource allocation with feasibility constraints and application to economic dispatch of power systems. Automatica, 74:259–269, 2016.
  7. Distributed dual gradient tracking for resource allocation in unbalanced networks. IEEE Transactions on Signal Processing, 68:2186–2198, 2020.
  8. Distributed computing over encrypted data. In 54th Annual Allerton Conference on Communication, Control, and Computing, pages 1116–1122, 2016.
  9. Cynthia Dwork. Differential privacy. In International colloquium on automata, languages, and programming, pages 1–12. Springer, 2006.
  10. A differentially private method for distributed optimization in directed networks via state decomposition. IEEE Transactions on Control of Network Systems, 2023.
  11. Tailoring gradient methods for differentially-private distributed optimization. IEEE Transactions on Automatic Control, 2023.
  12. Differential privacy in distributed optimization with gradient tracking. IEEE Transactions on Automatic Control, 2024.
  13. Differentially private distributed constrained optimization. IEEE Transactions on Automatic Control, 62(1):50–64, 2016.
  14. Differentially private distributed resource allocation via deviation tracking. IEEE Transactions on Signal and Information Processing over Networks, 7:222–235, 2021.
  15. Differentially private distributed mismatch tracking algorithm for constraint-coupled resource allocation problems. In IEEE 61st Conference on Decision and Control, pages 3965–3970, 2022.
  16. Dimitri P Bertsekas. Nonlinear programming. Journal of the Operational Research Society, 48(3):334–334, 1997.
  17. Xingyu Zhou. On the fenchel duality between strong convexity and lipschitz continuous gradient. arXiv preprint arXiv:1803.06573, 2018.
  18. Convex Optimization. Cambridge University Press, 2004.
  19. Push–pull gradient methods for distributed optimization in networks. IEEE Transactions on Automatic Control, 66(1):1–16, 2020.
  20. Push-sum distributed dual averaging for convex optimization. In IEEE 51st Conference on Decision and Control, pages 5453–5458, 2012.
  21. Dextra: A fast algorithm for optimization over directed graphs. IEEE Transactions on Automatic Control, 62(10):4980–4993, 2017.
  22. Differentially private distributed optimization. In Proceedings of the 16th International Conference on Distributed Computing and Networking, pages 1–10, 2015.
  23. Distributed robust economic dispatch in power systems: A consensus+ innovations approach. In IEEE Power and Energy Society General Meeting, pages 1–8, 2012.
  24. Privacy protection decentralized economic dispatch over directed networks with accurate convergence. IEEE Transactions on Emerging Topics in Computational Intelligence, 2023.
  25. Quantization enabled privacy protection in decentralized stochastic optimization. IEEE Transactions on Automatic Control, 68(7):4038–4052, 2023.
  26. The fundamental price of secure aggregation in differentially private federated learning. In International Conference on Machine Learning, pages 3056–3089, 2022.
  27. Shi Pu. A robust gradient tracking method for distributed optimization over directed networks. In 59th IEEE Conference on Decision and Control, pages 2335–2341, 2020.
  28. Differentially private distributed optimization via state and direction perturbation in multiagent systems. IEEE Transactions on Automatic Control, 67(2):722–737, 2021.
  29. Matrix Analysis. Cambridge University Press, 2012.
  30. The future renewable electric energy delivery and management (FREEDM) system: the energy internet. Proceedings of the IEEE, 99(1):133–148, 2010.
  31. Consensus based approach for economic dispatch problem in a smart grid. IEEE Transactions on Power Systems, 28(4):4416–4426, 2013.
  32. A convergence theorem for nonnegative almost supermartingales and some applications. In Optimizing Methods in Statistics, pages 233–257. 1971.

Summary

We haven't generated a summary for this paper yet.