Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Adaptive time series forecasting with markovian variance switching (2402.14684v1)

Published 22 Feb 2024 in stat.ML, cs.LG, and math.PR

Abstract: Adaptive time series forecasting is essential for prediction under regime changes. Several classical methods assume linear Gaussian state space model (LGSSM) with variances constant in time. However, there are many real-world processes that cannot be captured by such models. We consider a state-space model with Markov switching variances. Such dynamical systems are usually intractable because of their computational complexity increasing exponentially with time; Variational Bayes (VB) techniques have been applied to this problem. In this paper, we propose a new way of estimating variances based on online learning theory; we adapt expert aggregation methods to learn the variances over time. We apply the proposed method to synthetic data and to the problem of electricity load forecasting. We show that this method is robust to misspecification and outperforms traditional expert aggregation.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (31)
  1. Kalman recursions aggregated online. Statistical Papers, pages 1–36, 2023.
  2. Variational inference and learning of piecewise linear dynamical systems. IEEE Transactions on Neural Networks and Learning Systems, 33(8):3753–3764, 2021.
  3. An on-line variational bayesian model for multi-person tracking from cluttered scenes. Computer Vision and Image Understanding, 153:64–76, 2016.
  4. D Bunn and E Dillon Farmer. Comparative models for electrical load forecasting. 1985.
  5. Prediction, learning, and games. Cambridge university press, 2006.
  6. Peter J Brockwell Richard A Davis. Introduction to time series and forecasting. springer publication, 2016.
  7. State-space models for online post-covid electricity load forecasting competition. IEEE Open Access Journal of Power and Energy, 9:192–201, 2022.
  8. Stochastic online optimization using kalman recursion. The Journal of Machine Learning Research, 22(1):10173–10227, 2021.
  9. Viking: Variational bayesian variance tracking. arXiv preprint arXiv:2104.10777, 2021.
  10. Time series analysis by state space methods, volume 38. OUP Oxford, 2012.
  11. Multivariate statistical modelling based on generalized linear models, volume 425. Springer, 1994.
  12. Day-ahead electricity demand forecasting competition: Post-covid paradigm. IEEE Open Access Journal of Power and Energy, 9:185–191, 2022.
  13. Forecasting electricity consumption by aggregating experts; how to design a good set of experts. In Modeling and stochastic learning for forecasting in high dimensions, pages 95–115. Springer, 2015.
  14. Tracking the best expert. Machine learning, 32:151–178, 1998.
  15. Global energy forecasting competition 2012, 2014.
  16. A novel adaptive kalman filter with inaccurate process and measurement noise covariance matrices. IEEE transactions on Automatic Control, 63(2):594–601, 2017.
  17. A slide window variational adaptive kalman filter. IEEE Transactions on Circuits and Systems II: Express Briefs, 67(12):3552–3556, 2020.
  18. IEA. Year-on-year change in weekly electricity demand, weather corrected, in selected countries. https://www.iea.org/data-and-statistics/charts/year-on-year-change-in-weekly-electricity-demand-weather-corrected-in-selected-countries-january-december-2020, 2020.
  19. Rudolph Emil Kalman. A new approach to linear filtering and prediction problems. 1960.
  20. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
  21. Probabilistic load forecasting using post-processed weather ensemble predictions. Journal of the Operational Research Society, 74(3):1008–1020, 2023.
  22. Raman Mehra. On the identification of variances and adaptive kalman filtering. IEEE Transactions on automatic control, 15(2):175–184, 1970.
  23. Efficient tracking of a growing number of experts. In International Conference on Algorithmic Learning Theory, pages 517–539. PMLR, 2017.
  24. Kevin P Murphy. Switching kalman filters. 1998.
  25. Adaptive methods for short-term electricity load forecasting during covid-19 lockdown in france. IEEE transactions on power systems, 36(5):4754–4763, 2021.
  26. Yann Ollivier. Online natural gradient as a kalman filter. 2018.
  27. The variational Bayes method in signal processing. Springer Science & Business Media, 2006.
  28. Vladimir Vovk. Derandomizing stochastic prediction strategies. In Proceedings of the tenth annual conference on Computational learning theory, pages 32–44, 1997.
  29. Vladimir G Vovk. A game of prediction with expert advice. In Proceedings of the eighth annual conference on Computational learning theory, pages 51–60, 1995.
  30. Eric A Wan and Rudolph Van Der Merwe. The unscented kalman filter for nonlinear estimation. In Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No. 00EX373), pages 153–158. Ieee, 2000.
  31. Variational bayes under model misspecification. Advances in Neural Information Processing Systems, 32, 2019.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets