Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
166 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Dynamic Ranking and Translation Synchronization (2207.01455v4)

Published 4 Jul 2022 in math.ST, stat.ML, and stat.TH

Abstract: In many applications, such as sport tournaments or recommendation systems, we have at our disposal data consisting of pairwise comparisons between a set of $n$ items (or players). The objective is to use this data to infer the latent strength of each item and/or their ranking. Existing results for this problem predominantly focus on the setting consisting of a single comparison graph $G$. However, there exist scenarios (e.g., sports tournaments) where the the pairwise comparison data evolves with time. Theoretical results for this dynamic setting are relatively limited and is the focus of this paper. We study an extension of the \emph{translation synchronization} problem, to the dynamic setting. In this setup, we are given a sequence of comparison graphs $(G_t){t\in \mathcal{T}}$, where $\mathcal{T} \subset [0,1]$ is a grid representing the time domain, and for each item $i$ and time $t\in \mathcal{T}$ there is an associated unknown strength parameter $z*{t,i}\in \mathbb{R}$. We aim to recover, for $t\in\mathcal{T}$, the strength vector $z_t=(z^{t,1},\dots,z*{t,n})$ from noisy measurements of $z_{t,i}-z^_{t,j}$, where ${i,j}$ is an edge in $G_t$. Assuming that $z*_t$ evolves smoothly in $t$, we propose two estimators -- one based on a smoothness-penalized least squares approach and the other based on projection onto the low frequency eigenspace of a suitable smoothness operator. For both estimators, we provide finite sample bounds for the $\ell_2$ estimation error under the assumption that $G_t$ is connected for all $t\in \mathcal{T}$, thus proving the consistency of the proposed methods in terms of the grid size $|\mathcal{T}|$. We complement our theoretical findings with experiments on synthetic and real data.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (44)
  1. Tightness of the maximum likelihood semidefinite relaxation for angular synchronization. Mathematical Programming, 163(1):145–167, 2017.
  2. Nonparametric estimation in the dynamic Bradley-Terry model. In International Conference on Artificial Intelligence and Statistics, pages 3317–3326, 2020.
  3. Rank analysis of incomplete block designs: I. The method of paired comparisons. Biometrika, 39(3/4):324–345, 1952.
  4. Spectra of graphs. Springer Science & Business Media, 2011.
  5. Learning to rank: From pairwise approach to listwise approach. In Proceedings of the 24th International Conference on Machine Learning, page 129–136, 2007.
  6. Cellprofiler: image analysis software for identifying and quantifying cell phenotypes. Genome biology, 7(10):1–11, 2006.
  7. Dynamic Bradley–Terry modelling of sports tournaments. Journal of the Royal Statistical Society: Series C (Applied Statistics), 62(1):135–150, 2013.
  8. S. Chatterjee. Matrix estimation by universal singular value thresholding. The Annals of Statistics, 43(1):177–214, 2015.
  9. Partial recovery for top-k ranking: Optimality of MLE and Sub-Optimality of the spectral method. The Annals of Statistics, 50(3):1618 – 1652, 2022.
  10. Spectral method and regularized MLE are both optimal for top-k𝑘kitalic_k ranking. The Annals of Statistics, 47(4):2204–2235, 2019.
  11. M. Cucuringu. Sync-rank: Robust ranking, constrained ranking and rank aggregation via eigenvector and SDP synchronization. IEEE Transactions on Network Science and Engineering, 3(1):20–36, 2016.
  12. Ranking and synchronization from pairwise measurements via SVD. J. Mach. Learn. Res., 22:19:1–19:63, 2021.
  13. Epiousios(https://math.stackexchange.com/users/451957/epiousios). Positive definiteness of difference of inverse matrices. Mathematics Stack Exchange. URL https://math.stackexchange.com/q/3018669. URL:https://math.stackexchange.com/q/3018669 (version: 2020-11-20).
  14. L. Fahrmeir and G. Tutz. Dynamic stochastic models for time-dependent ordered paired comparison systems. Journal of the American Statistical Association, 89(428):1438–1449, 1994.
  15. A. Giridhar and P. Kumar. Distributed clock synchronization over wireless networks: Algorithms and analysis. Proceedings of the 45th IEEE Conference on Decision and Control, pages 4915–4920, 2006.
  16. Rank aggregation via nuclear norm minimization. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, page 60–68, 2011.
  17. A state-space model for national football league scores. Journal of the American Statistical Association, 93(441):25–35, 1998.
  18. Graph resistance and learning from pairwise comparisons. In Proceedings of the 36th International Conference on Machine Learning, pages 2702–2711, 2019.
  19. Minimax rate for learning from pairwise comparisons in the BTL model. In International Conference on Machine Learning, pages 4193–4202, 2020.
  20. A tail inequality for quadratic forms of subgaussian random vectors. Electronic Communications in Probability, 17:1–6, 2012.
  21. Translation synchronization via truncated least squares. Advances in neural information processing systems, 30, 2017.
  22. P.-E. Jabin and S. Junca. A continuous model for ratings. SIAM Journal on Applied Mathematics, 75(2):420–442, 2015.
  23. Recommender systems—beyond matrix completion. Communications of the ACM, 59(11):94–102, 2016.
  24. Statistical ranking and combinatorial hodge theory. Mathematical Programming, 127(1):203–244, 2011.
  25. jlewk (https://math.stackexchange.com/users/484640/jlewk). Is it true that a≥b𝑎𝑏a\geq bitalic_a ≥ italic_b implies b†≥a†superscript𝑏†superscript𝑎†b^{\dagger}\geq a^{\dagger}italic_b start_POSTSUPERSCRIPT † end_POSTSUPERSCRIPT ≥ italic_a start_POSTSUPERSCRIPT † end_POSTSUPERSCRIPT for singular positive semi-definite matrices? Mathematics Stack Exchange. URL https://math.stackexchange.com/q/3682798. URL:https://math.stackexchange.com/q/3682798 (version: 2020-05-20).
  26. E. Karlé and H. Tyagi. Dynamic ranking with the btl model: A nearest neighbor based rank centrality method. arXiv preprint arXiv:2109.13743, 2021.
  27. Optimal and global time synchronization in sensornets. Technical report, Center for Embedded Networked Sensing, University of California, Los Angeles, 2003.
  28. S. Li and M. B. Wakin. Recovery guarantees for time-varying pairwise comparison matrices with non-transitivity. arXiv preprint arXiv:2106.09151, 2021.
  29. S. Ling. Solving orthogonal group synchronization via convex and low-rank optimization: Tightness and landscape analysis. arxiv:2006.00902, 2020.
  30. How often does the best team win? a unified approach to understanding randomness in north american sport. The Annals of Applied Statistics, 12(4):2483–2516, 2018.
  31. R. D. Luce. Individual Choice Behavior: A Theoretical Analysis. Wiley, 1959.
  32. Minimax rates and efficient algorithms for noisy sorting. In Proceedings of Algorithmic Learning Theory, pages 821–847, 2018.
  33. Pairwise comparisons with flexible time-dynamics. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 1236–1246, 2019.
  34. Solving SDPs for synchronization and maxcut problems via the grothendieck inequality. In Conference on Learning Theory, volume 65, pages 1476–1515, 2017.
  35. S. Motegi and N. Masuda. A network-based dynamical ranking system for competitive sports. Scientific reports, 2(1):1–7, 2012.
  36. Rank centrality: Ranking from pairwise comparisons. Operations Research, 65(1):266–287, 2017.
  37. A. Nemirovski. Topics in non-parametric statistics. Ecole d’Eté de Probabilités de Saint-Flour, 28:85, 2000.
  38. Worst-case versus average-case design for estimation from partial pairwise comparisons. The Annals of Statistics, 48(2):1072 – 1097, 2020.
  39. Total variation classes beyond 1d: Minimax rates, and the limitations of linear smoothers. Advances in Neural Information Processing Systems, 29:3521–3529, 2016.
  40. Stochastically transitive models for pairwise comparisons: Statistical and computational issues. In International Conference on Machine Learning, pages 11–20, 2016.
  41. Simple, robust and optimal ranking from pairwise comparisons. The Journal of Machine Learning Research, 18(1):7246–7283, 2017.
  42. A. Singer. Angular synchronization by eigenvectors and semidefinite programming. Appl. Comput. Harmon. Anal., 1(30):20–36, 2011.
  43. L. L. Thurstone. A law of comparative judgment. Psychological review, 34(4):273, 1927.
  44. R. Vershynin. Introduction to the non-asymptotic analysis of random matrices, page 210–268. Cambridge University Press, 2012.
Citations (3)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets