On the Convergence of Learning Algorithms in Bayesian Auction Games (2311.15398v2)
Abstract: Equilibrium problems in Bayesian auction games can be described as systems of differential equations. Depending on the model assumptions, these equations might be such that we do not have a rigorous mathematical solution theory. The lack of analytical or numerical techniques with guaranteed convergence for the equilibrium problem has plagued the field and limited equilibrium analysis to rather simple auction models such as single-object auctions. Recent advances in equilibrium learning led to algorithms that find equilibrium under a wide variety of model assumptions. We analyze first- and second-price auctions where simple learning algorithms converge to an equilibrium. The equilibrium problem in auctions is equivalent to solving an infinite-dimensional variational inequality (VI). Monotonicity and the Minty condition are the central sufficient conditions for learning algorithms to converge to an equilibrium in such VIs. We show that neither monotonicity nor pseudo- or quasi-monotonicity holds for the respective VIs. The second-price auction's equilibrium is a Minty-type solution, but the first-price auction is not. However, the Bayes--Nash equilibrium is the unique solution to the VI within the class of uniformly increasing bid functions, which ensures that gradient-based algorithms attain the equilibrium in case of convergence, as also observed in numerical experiments.
- Abreu D, Rubinstein A (1988) The structure of nash equilibrium in repeated games with finite automata. Econometrica 56(6):1259–1281.
- Anagnostides I, Sandholm T (2023) On the interplay between social welfare and tractability of equilibria. arXiv preprint arXiv:2310.16976 .
- Brown GW (1951) Iterative solution of games by fictitious play. Activity Analysis of Production and Allocation 13(1):374–376.
- Carbonell-Nicolau O, McLean RP (2018) On the existence of Nash equilibrium in Bayesian games. Mathematics of Operations Research 43(1):100–129.
- Chen X, Peng B (2023) Complexity of equilibria in first-price auctions under general tie-breaking rules. arXiv preprint arXiv:2303.16388 .
- Fibich G, Gavish N (2011) Numerical simulations of asymmetric first-price auctions. Games and Economic Behavior 73(2):479–495.
- Foster DP, Vohra RV (1997) Calibrated learning and correlated equilibrium. Games and Economic Behavior 21(1-2):40.
- Glicksberg IL (1952) A further generalization of the kakutani fixed point theorem, with application to nash equilibrium points. Proceedings of the American Mathematical Society 3(1):170–174.
- Green J, Laffont JJ (1977) Characterization of satisfactory mechanisms for the revelation of preferences for public goods. Econometrica 45(2):427–438.
- Harsanyi JC (1967) Games with incomplete information played by “bayesian” players, i–iii part i. the basic model. Management science 14(3):159–182.
- Hart S, Mas-Colell A (2000) A simple adaptive procedure leading to correlated equilibrium. Econometrica 68(5):1127–1150.
- Hart S, Mas-Colell A (2003) Uncoupled dynamics do not lead to nash equilibrium. American Economic Review 93(5):1830–1836.
- Huang K, Zhang S (2023) Beyond monotone variational inequalities: Solution methods and iteration complexities. arXiv preprint arXiv:2304.04153 .
- Jackson MO, Swinkels JM (2005) Existence of equilibrium in single and double private value auctions. Econometrica 73(1):93–139.
- Khanh PD (2016) A modified extragradient method for infinite-dimensional variational inequalities. Acta Mathematica Vietnamica 41(2):251–263.
- Kinderlehrer D, Stampacchia G (2000) An Introduction to Variational Inequalities and Their Applications (SIAM).
- Krishna V (2009) Auction Theory (Academic Press).
- Nash JF, et al. (1950) Equilibrium points in n-person games. Proceedings of the National Academy of Sciences 36(1):48–49.
- Nemirovski A (2004) Prox-method with rate of convergence o (1/t) for variational inequalities with lipschitz continuous monotone operators and smooth convex-concave saddle point problems. SIAM Journal on Optimization 15(1):229–251.
- Nesterov Y (2007) Dual extrapolation and its applications to solving variational inequalities and related problems. Mathematical Programming 109(2-3):319–344.
- Ouyang Y, Xu Y (2021) Lower complexity bounds of first-order methods for convex-concave bilinear saddle-point problems. Mathematical Programming 185(1-2):1–35.
- Papadimitriou CH, Vishnoi NK (2015) On the computational complexity of limit cycles in dynamical systems. arXiv preprint arXiv:1511.07605 .
- Roughgarden T (2015) Intrinsic robustness of the price of anarchy. Journal of the ACM (JACM) 62(5):1–42.
- Stoltz G, Lugosi G (2007) Learning correlated equilibria in games with compact sets of strategies. Games and Economic Behavior 59(1):187–208.
- Tseng P (1995) On linear convergence of iterative methods for the variational inequality problem. Journal of Computational and Applied Mathematics 60(1-2):237–252.
- Ye M (2022) An infeasible projection type algorithm for nonmonotone variational inequalities. Numerical Algorithms 89(4):1723–1742.
- Young HP (2004) Strategic learning and its limits (OUP Oxford).