Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
98 tokens/sec
GPT-4o
8 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Deep Learning for Multivariate Time Series Imputation: A Survey (2402.04059v3)

Published 6 Feb 2024 in cs.LG and cs.AI

Abstract: Missing values are ubiquitous in multivariate time series (MTS) data, posing significant challenges for accurate analysis and downstream applications. In recent years, deep learning-based methods have successfully handled missing data by leveraging complex temporal dependencies and learned data distributions. In this survey, we provide a comprehensive summary of deep learning approaches for multivariate time series imputation (MTSI) tasks. We propose a novel taxonomy that categorizes existing methods based on two key perspectives: imputation uncertainty and neural network architecture. Furthermore, we summarize existing MTSI toolkits with a particular emphasis on the PyPOTS Ecosystem, which provides an integrated and standardized foundation for MTSI research. Finally, we discuss key challenges and future research directions, which give insight for further MTSI research. This survey aims to serve as a valuable resource for researchers and practitioners in the field of time series analysis and missing data imputation tasks.A well-maintained MTSI paper and tool list are available at https://github.com/WenjieDu/Awesome_Imputation.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (58)
  1. Diffusion-based time series imputation and forecasting with structured state space models. Transactions on Machine Learning Research, 2023.
  2. GluonTS: Probabilistic and Neural Time Series Modeling in Python. Journal of Machine Learning Research, 21(116):1–6, 2020.
  3. Naomi S Altman. An introduction to kernel and nearest-neighbor nonparametric regression. The American Statistician, 46(3):175–185, 1992.
  4. Missing data imputation using fuzzy-rough methods. Neurocomputing, 205(1):152–164, 2016.
  5. Forecasting economic time series using targeted predictors. Journal of Econometrics, 146(2):304–317, 2008.
  6. Missing value imputation on multidimensional time series. In VLDB, 2021.
  7. David J Bartholomew. Time series analysis forecasting and control. Journal of the Operational Research Society, 22(2):199–201, 1971.
  8. Modeling temporal data as continuous functions with stochastic process diffusion. In ICML, 2023.
  9. Brits: Bidirectional recurrent imputation for time series. NeurIPS, 2018.
  10. Recurrent neural networks for multivariate time series with missing values. Scientific Reports, 8(1), Apr 2018.
  11. Provably convergent schrödinger bridge with applications to probabilistic time series imputation. In ICML, 2023.
  12. Filling the g_ap_s: Multivariate time series imputation by graph neural networks. In ICLR, 2022.
  13. SAITS: Self-Attention-based Imputation for Time Series. Expert Systems with Applications, 219:119619, 2023.
  14. Wenjie Du. PyPOTS: a Python toolbox for data mining on Partially-Observed Time Series. In SIGKDD workshop on Mining and Learning from Time Series, 2023.
  15. Real-valued (medical) time series generation with recurrent conditional gans. ArXiv Preprint ArXiv:1706.02633, 2017.
  16. Time series data imputation: A survey on deep learning approaches. arXiv preprint arXiv:2011.11347, 2020.
  17. GP-VAE: Deep probabilistic time series imputation. In AISTATS, 2020.
  18. Missing value imputation for multi-view urban statistical data via spatial correlation learning. IEEE Transactions on Knowledge and Data Engineering, 2021.
  19. Efficiently modeling long sequences with structured state spaces. In ICLR, 2022.
  20. Coşkun Hamzaçebi. Improving artificial neural networks’ performance in seasonal time series forecasting. Information Sciences, 178(23):4550–4559, 2008.
  21. Missing data in clinical studies: issues and methods. Journal of clinical oncology, 2012.
  22. Large models for time series and spatio-temporal data: A survey and outlook. arXiv preprint arXiv:2310.10196, 2023.
  23. Time-LLM: Time series forecasting by reprogramming large language models. In ICLR, 2024.
  24. Mind the gap: an experimental evaluation of imputation of missing values techniques in time series. In VLDB, 2020.
  25. Temporal Belief Memory: Imputing missing data during rnn training. In IJCAI, 2018.
  26. Probabilistic imputation for time-series classification with missing data. In ICML, 2023.
  27. Miracle: Causally-aware imputation via learning missing data mechanisms. In NeurIPS, 2021.
  28. Data imputation for sparse radio maps in indoor positioning. In ICDE, 2023.
  29. Statistical analysis with missing data, volume 793. John Wiley & Sons, 2019.
  30. Naomi: Non-autoregressive multiresolution sequence imputation. In NeurIPS, 2019.
  31. Multivariate time-series imputation with disentangled temporal representations. 2022.
  32. Pristi: A conditional diffusion framework for spatiotemporal imputation. arXiv preprint arXiv:2302.09746, 2023.
  33. sktime: A unified interface for machine learning with time series. arXiv preprint arXiv:1909.07872, 2019.
  34. Repaint: Inpainting using denoising diffusion probabilistic models. In CVPR, 2022.
  35. Multivariate time series imputation with generative adversarial networks. In NeurIPS, 2018.
  36. E22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPTGAN: End-to-end generative adversarial network for multivariate time series imputation. In IJCAI, 2019.
  37. CDSA: cross-dimensional self-attention for multivariate, geo-tagged time series imputation. arXiv preprint arXiv:1905.09904, 2019.
  38. Learning to reconstruct missing data from spatiotemporal graphs with sparse observations. NeurIPS, 2022.
  39. Generative semi-supervised learning for multivariate time series imputation. In AAAI, 2021.
  40. Variational inference for discriminative learning with generative modeling of feature incompletion. In ICLR, 2021.
  41. imputeTS: Time Series Missing Value Imputation in R. The R Journal.
  42. Uncertainty-aware variational-recurrent imputation network for clinical time series. IEEE Transactions on Cybernetics, 52(9):9684–9694, 2021.
  43. Shinichi Nakagawa. Missing data: mechanisms, methods and messages. pages 81–105. Oxford University Press Oxford, UK, 2015.
  44. Donald B. Rubin. Inference and missing data. Biometrika, 63(3):581–592, 12 1976.
  45. Enhancing missing data imputation of non-stationary signals with harmonic decomposition. arXiv preprint arXiv:2309.04630, 2023.
  46. Nrtsi: Non-recurrent time series imputation. In ICASSP, 2023.
  47. Predicting in-hospital mortality of icu patients: The physionet/computing in cardiology challenge 2012. Computing in cardiology, 39:245, 2012.
  48. CSDI: Conditional score-based diffusion models for probabilistic time series imputation. In NeurIPS, 2021.
  49. mice: Multivariate imputation by chained equations in r. Journal of statistical software, 45:1–67, 2011.
  50. Attention is all you need. In NeurIPS, 2017.
  51. An observed value consistent diffusion model for imputing missing values in multivariate time series. In SIGKDD, 2023.
  52. Transformers in time series: A survey. In International Joint Conference on Artificial Intelligence(IJCAI), 2023.
  53. TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysis. In ICLR, 2023.
  54. Differentiable and scalable generative adversarial models for data imputation. IEEE Transactions on Knowledge and Data Engineering, 2023.
  55. Density-aware temporal attentive step-wise diffusion model for medical time series imputation. In CIKM, 2023.
  56. Estimating missing data in temporal data streams using multi-directional recurrent neural networks. IEEE Trans. on Biomedical Engineering, 2019.
  57. Cautionary tales on air-quality improvement in beijing. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 473, 2017.
  58. Informer: Beyond efficient transformer for long sequence time-series forecasting. In AAAI, 2021.
Citations (21)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now