Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Learning Individual Interactions from Population Dynamics with Discrete-Event Simulation Model (2205.02332v3)

Published 4 May 2022 in cs.LG

Abstract: The abundance of data affords researchers to pursue more powerful computational tools to learn the dynamics of complex system, such as neural networks, engineered systems and social networks. Traditional machine learning approaches capture complex system dynamics either with dynamic Bayesian networks and state space models, which is hard to scale because it is non-trivial to prescribe the dynamics with a sparse graph or a system of differential equations; or a deep neural networks, where the distributed representation of the learned dynamics is hard to interpret. In this paper, we will explore the possibility of learning a discrete-event simulation representation of complex system dynamics assuming multivariate normal distribution of the state variables, based on the observation that many complex system dynamics can be decomposed into a sequence of local interactions, which individually change the system state only minimally but in sequence generate complex and diverse dynamics. Our results show that the algorithm can data-efficiently capture complex network dynamics in several fields with meaningful events.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (32)
  1. Kernels for vector-valued functions: A review. Foundations and Trends® in Machine Learning, 4(3):195–266, 2012.
  2. Interaction networks for learning about objects, relations and physics. In Advances in neural information processing systems, pages 4502–4510, 2016.
  3. Relational inductive biases, deep learning, and graph networks. arXiv preprint arXiv:1806.01261, 2018.
  4. Automated reverse engineering of nonlinear dynamical systems. Proceedings of the National Academy of Sciences, 104(24):9943–9948, 2007.
  5. Multi-task gaussian process prediction. In Advances in neural information processing systems, pages 153–160, 2008.
  6. Andrei Borshchev. The big book of simulation modeling: multimethod modeling with AnyLogic 6. AnyLogic North America Chicago, 2013.
  7. Discovering governing equations from data by sparse identification of nonlinear dynamical systems. Proceedings of the national academy of sciences, 113(15):3932–3937, 2016.
  8. A compositional object-based approach to learning physical dynamics. arXiv preprint arXiv:1612.00341, 2016.
  9. Bayesian nonparametric covariance regression. The Journal of Machine Learning Research, 16(1):2501–2542, 2015.
  10. Daniel T Gillespie. Stochastic simulation of chemical kinetics. Annu. Rev. Phys. Chem., 58:35–55, 2007.
  11. A. Golightly and D. J. Wilkinson. Bayesian inference for nonlinear multivariate diffusion models observed with error. Computational Statistics and Data Analysis, 2007.
  12. Bayesian parameter inference for stochastic biochemical network models using particle markov chain monte carlo. Interface focus, 1(6):807–820, 2011.
  13. Few-shot learning via dirichlet tessellation ensemble. In International Conference on Learning Representations, 2022.
  14. Modelling with generalized stochastic Petri nets. John Wiley & Sons, Inc., 1994.
  15. MATSim development team (ed.). MATSIM-T: Aims, approach and implementation. Technical report, IVT, ETH Zürich, Zürich, 2007.
  16. Recurrent gaussian processes. arXiv preprint arXiv:1511.06644, 2015.
  17. Continuous time bayesian networks. In Proceedings of the Eighteenth conference on Uncertainty in artificial intelligence, pages 378–387. Morgan Kaufmann Publishers Inc., 2002.
  18. Variational inference for markov jump processes. In Advances in Neural Information Processing Systems, pages 1105–1112, 2008.
  19. Anthony O’Hagan. Bayesian analysis of computer code outputs: A tutorial. Reliability Engineering & System Safety, 91(10-11):1290–1300, 2006.
  20. How to construct deep recurrent neural networks. arXiv preprint arXiv:1312.6026, 2013.
  21. Maziar Raissi. Deep hidden physics models: Deep learning of nonlinear partial differential equations. The Journal of Machine Learning Research, 19(1):932–955, 2018.
  22. Fast mcmc sampling for markov jump processes and extensions. Journal of Machine Learning Research, 14(1):3295–3320, 2013.
  23. Clustering correlated, sparse data streams to estimate a localized housing price index. The Annals of Applied Statistics, 11(2):808–839, 2017.
  24. Data-driven discovery of partial differential equations. Science Advances, 3(4):e1602614, 2017.
  25. Distilling free-form natural laws from experimental data. science, 324(5923):81–85, 2009.
  26. Semiparametric latent factor models. In AISTATS 2005-Proceedings of the 10th International Workshop on Artificial Intelligence and Statistics, pages 333–340, 2005.
  27. Deep and hierarchical implicit models. CoRR, abs/1702.08896, 2017.
  28. Dirk Veestraeten. The conditional probability density function for a reflected brownian motion. Computational Economics, 24(2):185–207, 2004.
  29. Towards physics-informed deep learning for turbulent flow prediction. arXiv preprint arXiv:1911.08655, 2019.
  30. Darren J Wilkinson. Stochastic modelling for systems biology. CRC press, 2011.
  31. Using social dynamics to make individual predictions: variational inference with a stochastic kinetic model. In Advances in Neural Information Processing Systems, pages 2783–2791, 2016.
  32. Collapsed variational bayes for markov jump processes. In Advances in Neural Information Processing Systems, pages 3749–3757, 2017.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets