One-Shot Strategic Classification Under Unknown Costs (2311.02761v3)
Abstract: The goal of strategic classification is to learn decision rules which are robust to strategic input manipulation. Earlier works assume that these responses are known; while some recent works handle unknown responses, they exclusively study online settings with repeated model deployments. But there are many domains$\unicode{x2014}$particularly in public policy, a common motivating use case$\unicode{x2014}$where multiple deployments are infeasible, or where even one bad round is unacceptable. To address this gap, we initiate the formal study of one-shot strategic classification under unknown responses, which requires committing to a single classifier once. Focusing on uncertainty in the users' cost function, we begin by proving that for a broad class of costs, even a small mis-estimation of the true cost can entail trivial accuracy in the worst case. In light of this, we frame the task as a minimax problem, aiming to minimize worst-case risk over an uncertainty set of costs. We design efficient algorithms for both the full-batch and stochastic settings, which we prove converge (offline) to the minimax solution at the rate of $\tilde{\mathcal{O}}(T{-\frac{1}{2}})$. Our analysis reveals important structure stemming from strategic responses, particularly the value of dual norm regularization with respect to the cost function.
- The strategic perceptron. In Proceedings of the 22nd ACM Conference on Economics and Computation, pages 6–25, 2021.
- Information discrepancy in strategic learning. In Proceedings of the 39th International Conference on Machine Learning, volume 162 of Proceedings of Machine Learning Research, pages 1691–1715. PMLR, 17–23 Jul 2022.
- Dimitri P Bertsekas. Nonlinear programming. Journal of the Operational Research Society, 48(3):334–334, 1997.
- Nash equilibria of static prediction games. In Advances in neural information processing systems, pages 171–179, 2009.
- Static prediction games for adversarial learning problems. The Journal of Machine Learning Research, 13(1):2617–2654, 2012.
- Linear classifiers that encourage constructive adaptation. Transactions on Machine Learning Research, 2023.
- Goodhart’s law: its origins, meaning and implications for monetary policy. Central banking, monetary theory and practice: Essays in honour of Charles Goodhart, 1:221–243, 2003.
- Strategic classification from revealed preferences. In Proceedings of the 2018 ACM Conference on Economics and Computation, pages 55–70, 2018.
- Learning models with uniform performance via distributionally robust optimization. The Annals of Statistics, 49(3):1378–1406, 2021.
- Strategic classification with graph neural networks. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net, 2023.
- Lewis Elton. Goodhart’s law and performance indicators in higher education. Evaluation & Research in Education, 18(1-2):120–128, 2004.
- Over-optimization of academic publishing metrics: observing goodhart’s law in action. GigaScience, 8(6):giz053, 2019.
- Strategic classification in the dark. In Proceedings of the 38th International Conference on Machine Learning (ICML), 2021.
- Charles AE Goodhart. Problems of monetary management: The UK experience. In Papers in Monetary Economics, vol. I. Reserve Bank of Australia, 1975.
- Bayesian games for adversarial regression problems. In International Conference on Machine Learning, pages 55–63, 2013.
- Strategic classification. In Proceedings of the 2016 ACM conference on innovations in theoretical computer science, pages 111–122, 2016.
- Strategic apple tasting. In Advances in Neural Information Processing Systems, volume 36, 2023.
- Causal strategic classifiaction. In International Conference on Machine Learning. PMLR, 2023.
- Alternative microfoundations for strategic classification. In International Conference on Machine Learning, pages 4687–4697. PMLR, 2021.
- Learning losses for strategic classification. In Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI, pages 7337–7344. AAAI Press, 2022.
- Strategic classification with unknown user manipulations. In International Conference on Machine Learning. PMLR, 2023.
- Strategic classification made practical. In Proceedings of the 38th International Conference on Machine Learning (ICML), 2021.
- Generalized strategic classification and the case of aligned incentives. In Proceedings of the 39th International Conference on Machine Learning (ICML), 2022.
- Plug-in performative optimization. arXiv preprint arXiv:2305.18728, 2023.
- Anticipating performativity by predicting from predictions. Advances in Neural Information Processing Systems, 35:31171–31185, 2022.
- Strategic classification is causal modeling in disguise. In International Conference on Machine Learning, pages 6917–6926. PMLR, 2020.
- The social cost of strategic classification. In Proceedings of the Conference on Fairness, Accountability, and Transparency, pages 230–239, 2019.
- Stochastic gradient methods for distributionally robust optimization with f-divergences. Advances in neural information processing systems, 29, 2016.
- Robust stochastic approximation approach to stochastic programming. SIAM Journal on optimization, 19(4):1574–1609, 2009.
- Performative prediction. In International Conference on Machine Learning, pages 7599–7609. PMLR, 2020.
- An online learning approach to interpolation and extrapolation in domain generalization. In International Conference on Artificial Intelligence and Statistics, pages 2641–2657. PMLR, 2022.
- Strategic classification under unknown personalized manipulation. In Advances in Neural Information Processing Systems, volume 36, 2023.
- PAC-learning for strategic classification. In International Conference on Machine Learning, pages 9978–9988. PMLR, 2021.
- On the value of out-of-distribution testing: An example of goodhart’s law. Advances in neural information processing systems, 33:407–417, 2020.
- Incentive-aware PAC learning. In Proceedings of the AAAI Conference on Artificial Intelligence, 2021.