2000 character limit reached
Measuring AI Systems Beyond Accuracy (2204.04211v1)
Published 7 Apr 2022 in cs.SE, cs.AI, and cs.LG
Abstract: Current test and evaluation (T&E) methods for assessing ML system performance often rely on incomplete metrics. Testing is additionally often siloed from the other phases of the ML system lifecycle. Research investigating cross-domain approaches to ML T&E is needed to drive the state of the art forward and to build an AI engineering discipline. This paper advocates for a robust, integrated approach to testing by outlining six key questions for guiding a holistic T&E strategy.
Collections
Sign up for free to add this paper to one or more collections.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.