arXiv: Beyond Success Rate: Cost-Aware Evaluation of Offensive and Defensive Security Agents

This publication introduces a new evaluation framework for AI safety, moving beyond simple success rates to incorporate cost-aware metrics for both offensive and defensive security agents. The paper argues that traditional benchmarks fail to capture the real-world resource trade-offs, such as computational expense, time, and operational risk, that are critical when assessing AI-driven cyber threats and defenses. It proposes a methodology to measure the efficiency and sustainability of security AI systems, not just their effectiveness.

This regulatory change is most relevant to organizations developing or deploying autonomous AI agents for cybersecurity, including financial services, critical infrastructure operators, cloud service providers, and any sector subject to the EU AI Act’s high-risk classification. Compliance teams in these sectors must now consider whether their AI security tools are being evaluated solely on attack or defense success rates, which could lead to underestimating systemic risks or resource waste.

Compliance teams should immediately review their internal AI risk assessment frameworks to ensure they incorporate cost-aware metrics as part of their conformity assessments. They should also update their documentation for AI system audits, particularly for high-risk security agents, to include efficiency and resource trade-off analyses. Finally, teams should monitor the EU AI Office’s guidance for potential alignment with this cost-aware approach in future regulatory technical standards.