Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
166 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

One-Shot Strategic Classification Under Unknown Costs (2311.02761v3)

Published 5 Nov 2023 in cs.LG, cs.GT, and stat.ML

Abstract: The goal of strategic classification is to learn decision rules which are robust to strategic input manipulation. Earlier works assume that these responses are known; while some recent works handle unknown responses, they exclusively study online settings with repeated model deployments. But there are many domains$\unicode{x2014}$particularly in public policy, a common motivating use case$\unicode{x2014}$where multiple deployments are infeasible, or where even one bad round is unacceptable. To address this gap, we initiate the formal study of one-shot strategic classification under unknown responses, which requires committing to a single classifier once. Focusing on uncertainty in the users' cost function, we begin by proving that for a broad class of costs, even a small mis-estimation of the true cost can entail trivial accuracy in the worst case. In light of this, we frame the task as a minimax problem, aiming to minimize worst-case risk over an uncertainty set of costs. We design efficient algorithms for both the full-batch and stochastic settings, which we prove converge (offline) to the minimax solution at the rate of $\tilde{\mathcal{O}}(T{-\frac{1}{2}})$. Our analysis reveals important structure stemming from strategic responses, particularly the value of dual norm regularization with respect to the cost function.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (35)
  1. The strategic perceptron. In Proceedings of the 22nd ACM Conference on Economics and Computation, pages 6–25, 2021.
  2. Information discrepancy in strategic learning. In Proceedings of the 39th International Conference on Machine Learning, volume 162 of Proceedings of Machine Learning Research, pages 1691–1715. PMLR, 17–23 Jul 2022.
  3. Dimitri P Bertsekas. Nonlinear programming. Journal of the Operational Research Society, 48(3):334–334, 1997.
  4. Nash equilibria of static prediction games. In Advances in neural information processing systems, pages 171–179, 2009.
  5. Static prediction games for adversarial learning problems. The Journal of Machine Learning Research, 13(1):2617–2654, 2012.
  6. Linear classifiers that encourage constructive adaptation. Transactions on Machine Learning Research, 2023.
  7. Goodhart’s law: its origins, meaning and implications for monetary policy. Central banking, monetary theory and practice: Essays in honour of Charles Goodhart, 1:221–243, 2003.
  8. Strategic classification from revealed preferences. In Proceedings of the 2018 ACM Conference on Economics and Computation, pages 55–70, 2018.
  9. Learning models with uniform performance via distributionally robust optimization. The Annals of Statistics, 49(3):1378–1406, 2021.
  10. Strategic classification with graph neural networks. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net, 2023.
  11. Lewis Elton. Goodhart’s law and performance indicators in higher education. Evaluation & Research in Education, 18(1-2):120–128, 2004.
  12. Over-optimization of academic publishing metrics: observing goodhart’s law in action. GigaScience, 8(6):giz053, 2019.
  13. Strategic classification in the dark. In Proceedings of the 38th International Conference on Machine Learning (ICML), 2021.
  14. Charles AE Goodhart. Problems of monetary management: The UK experience. In Papers in Monetary Economics, vol. I. Reserve Bank of Australia, 1975.
  15. Bayesian games for adversarial regression problems. In International Conference on Machine Learning, pages 55–63, 2013.
  16. Strategic classification. In Proceedings of the 2016 ACM conference on innovations in theoretical computer science, pages 111–122, 2016.
  17. Strategic apple tasting. In Advances in Neural Information Processing Systems, volume 36, 2023.
  18. Causal strategic classifiaction. In International Conference on Machine Learning. PMLR, 2023.
  19. Alternative microfoundations for strategic classification. In International Conference on Machine Learning, pages 4687–4697. PMLR, 2021.
  20. Learning losses for strategic classification. In Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI, pages 7337–7344. AAAI Press, 2022.
  21. Strategic classification with unknown user manipulations. In International Conference on Machine Learning. PMLR, 2023.
  22. Strategic classification made practical. In Proceedings of the 38th International Conference on Machine Learning (ICML), 2021.
  23. Generalized strategic classification and the case of aligned incentives. In Proceedings of the 39th International Conference on Machine Learning (ICML), 2022.
  24. Plug-in performative optimization. arXiv preprint arXiv:2305.18728, 2023.
  25. Anticipating performativity by predicting from predictions. Advances in Neural Information Processing Systems, 35:31171–31185, 2022.
  26. Strategic classification is causal modeling in disguise. In International Conference on Machine Learning, pages 6917–6926. PMLR, 2020.
  27. The social cost of strategic classification. In Proceedings of the Conference on Fairness, Accountability, and Transparency, pages 230–239, 2019.
  28. Stochastic gradient methods for distributionally robust optimization with f-divergences. Advances in neural information processing systems, 29, 2016.
  29. Robust stochastic approximation approach to stochastic programming. SIAM Journal on optimization, 19(4):1574–1609, 2009.
  30. Performative prediction. In International Conference on Machine Learning, pages 7599–7609. PMLR, 2020.
  31. An online learning approach to interpolation and extrapolation in domain generalization. In International Conference on Artificial Intelligence and Statistics, pages 2641–2657. PMLR, 2022.
  32. Strategic classification under unknown personalized manipulation. In Advances in Neural Information Processing Systems, volume 36, 2023.
  33. PAC-learning for strategic classification. In International Conference on Machine Learning, pages 9978–9988. PMLR, 2021.
  34. On the value of out-of-distribution testing: An example of goodhart’s law. Advances in neural information processing systems, 33:407–417, 2020.
  35. Incentive-aware PAC learning. In Proceedings of the AAAI Conference on Artificial Intelligence, 2021.
Citations (5)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com