Large Language Model-aided Edge Learning in Distribution System State Estimation (2405.06999v2)
Abstract: Distribution system state estimation (DSSE) plays a crucial role in the real-time monitoring, control, and operation of distribution networks. Besides intensive computational requirements, conventional DSSE methods need high-quality measurements to obtain accurate states, whereas missing values often occur due to sensor failures or communication delays. To address these challenging issues, a forecast-then-estimate framework of edge learning is proposed for DSSE, leveraging LLMs to forecast missing measurements and provide pseudo-measurements. Firstly, natural language-based prompts and measurement sequences are integrated by the proposed LLM to learn patterns from historical data and provide accurate forecasting results. Secondly, a convolutional layer-based neural network model is introduced to improve the robustness of state estimation under missing measurement. Thirdly, to alleviate the overfitting of the deep learning-based DSSE, it is reformulated as a multi-task learning framework containing shared and task-specific layers. The uncertainty weighting algorithm is applied to find the optimal weights to balance different tasks. The numerical simulation on the Simbench case is used to demonstrate the effectiveness of the proposed forecast-then-estimate framework.
- A. Primadianto and C.-N. Lu, “A review on distribution system state estimation,” IEEE Transactions on Power Systems, vol. 32, no. 5, pp. 3875–3883, 2016.
- A. P. Yadav, J. Nutaro, B. Park, J. Dong, B. Liu, S. B. Yoginath, H. Yin, J. Dong, Y. Dong, Y. Liu, T. Kuruganti, and Y. Xue, “Review of emerging concepts in distribution system state estimation: Opportunities and challenges,” IEEE Access, vol. 11, pp. 70 503–70 515, 2023.
- M. Göl and A. Abur, “Lav based robust state estimation for systems measured by pmus,” IEEE Transactions on Smart Grid, vol. 5, no. 4, pp. 1808–1814, 2014.
- M. Huang, Z. Wei, J. Zhao, R. A. Jabr, M. Pau, and G. Sun, “Robust ensemble kalman filter for medium-voltage distribution system state estimation,” IEEE Transactions on Instrumentation and Measurement, vol. 69, no. 7, pp. 4114–4124, 2019.
- J. Zhao and L. Mili, “Robust unscented kalman filter for power system dynamic state estimation with unknown noise statistics,” IEEE Transactions on Smart Grid, vol. 10, no. 2, pp. 1215–1224, 2017.
- S. Bhela, V. Kekatos, and S. Veeramachaneni, “Enhancing observability in distribution grids using smart meter data,” IEEE Transactions on Smart Grid, vol. 9, no. 6, pp. 5953–5961, 2017.
- B. Azimian, R. S. Biswas, S. Moshtagh, A. Pal, L. Tong, and G. Dasarathy, “State and topology estimation for unobservable distribution systems using deep neural networks,” IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1–14, 2022.
- L. Zhang, G. Wang, and G. B. Giannakis, “Real-Time Power System State Estimation and Forecasting via Deep Unrolled Neural Networks,” IEEE Transactions on Signal Processing, vol. 67, no. 15, pp. 4069–4077, Aug. 2019. [Online]. Available: https://ieeexplore.ieee.org/document/8754766/
- K. R. Mestav, J. Luengo-Rozas, and L. Tong, “State estimation for unobservable distribution systems via deep neural networks,” in 2018 IEEE Power & Energy Society General Meeting (PESGM), 2018, pp. 1–5.
- N. Bhusal, R. M. Shukla, M. Gautam, M. Benidris, and S. Sengupta, “Deep Ensemble Learning-based Approach to Real-time Power System State Estimation,” Jan. 2021, arXiv:2101.03457 [cs, eess]. [Online]. Available: http://arxiv.org/abs/2101.03457
- H. Wu, Z. Xu, and M. Wang, “Unrolled spatiotemporal graph convolutional network for distribution system state estimation and forecasting,” IEEE Transactions on Sustainable Energy, vol. 14, no. 1, pp. 297–308, 2022.
- A. S. Zamzam and N. D. Sidiropoulos, “Physics-Aware Neural Networks for Distribution System State Estimation,” IEEE Transactions on Power Systems, vol. 35, no. 6, pp. 4347–4356, Nov. 2020. [Online]. Available: https://ieeexplore.ieee.org/document/9072507/
- L. Pagnier and M. Chertkov, “Physics-Informed Graphical Neural Network for Parameter & State Estimations in Power Systems,” Feb. 2021, arXiv:2102.06349 [physics]. [Online]. Available: http://arxiv.org/abs/2102.06349
- L. Wang, Q. Zhou, and S. Jin, “Physics-guided Deep Learning for Power System State Estimation,” Journal of Modern Power Systems and Clean Energy, vol. 8, no. 4, pp. 607–615, 2020. [Online]. Available: https://ieeexplore.ieee.org/document/9126036
- B. Habib, E. Isufi, W. V. Breda, A. Jongepier, and J. L. Cremer, “Deep Statistical Solver for Distribution System State Estimation,” IEEE Transactions on Power Systems, pp. 1–12, 2023. [Online]. Available: https://ieeexplore.ieee.org/document/10167837/
- Q.-H. Ngo, B. L. Nguyen, T. V. Vu, J. Zhang, and T. Ngo, “Physics-informed graphical neural network for power system state estimation,” Applied Energy, vol. 358, p. 122602, 2024.
- W. Xu, Z. Yang, D. W. K. Ng, M. Levorato, Y. C. Eldar, and M. Debbah, “Edge learning for b5g networks with distributed signal processing: Semantic communication, edge computing, and wireless sensing,” IEEE Journal of Selected Topics in Signal Processing, vol. 17, no. 1, pp. 9–39, 2023.
- J. Lin, M. Tu, H. Hong, C. Lu, and W. Song, “Spatiotemporal Graph Convolutional Neural Network Based Forecasting-Aided State Estimation Using Synchrophasors,” IEEE Internet of Things Journal, pp. 1–1, 2024. [Online]. Available: https://ieeexplore.ieee.org/document/10384705/
- T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell et al., “Language models are few-shot learners,” Advances in neural information processing systems, vol. 33, pp. 1877–1901, 2020.
- A. Chowdhery, S. Narang, J. Devlin, M. Bosma, G. Mishra, A. Roberts, P. Barham, H. W. Chung, C. Sutton, S. Gehrmann et al., “Palm: Scaling language modeling with pathways,” Journal of Machine Learning Research, vol. 24, no. 240, pp. 1–113, 2023.
- J. W. Rae, S. Borgeaud, T. Cai, K. Millican, J. Hoffmann, F. Song, J. Aslanides, S. Henderson, R. Ring, S. Young et al., “Scaling language models: Methods, analysis & insights from training gopher,” arXiv preprint arXiv:2112.11446, 2021.
- L. Ouyang, J. Wu, X. Jiang, D. Almeida, C. Wainwright, P. Mishkin, C. Zhang, S. Agarwal, K. Slama, A. Ray et al., “Training language models to follow instructions with human feedback,” Advances in neural information processing systems, vol. 35, pp. 27 730–27 744, 2022.
- A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, I. Sutskever et al., “Language models are unsupervised multitask learners.”
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in neural information processing systems, vol. 30, 2017.
- A. Kendall, Y. Gal, and R. Cipolla, “Multi-task learning using uncertainty to weigh losses for scene geometry and semantics,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2018.
- S. Meinecke, D. Sarajlić, S. R. Drauz, A. Klettke, L.-P. Lauven, C. Rehtanz, A. Moser, and M. Braun, “Simbench—a benchmark dataset of electric power systems to compare innovative solutions based on power flow analysis,” Energies, vol. 13, no. 12, 2020. [Online]. Available: https://www.mdpi.com/1996-1073/13/12/3290
- L. Thurner, A. Scheidler, F. Schäfer, J.-H. Menke, J. Dollichon, F. Meier, S. Meinecke, and M. Braun, “pandapower—an open-source python tool for convenient modeling, analysis, and optimization of electric power systems,” IEEE Transactions on Power Systems, vol. 33, no. 6, pp. 6510–6521, 2018.