arXiv: Securing People and their Machines Against Major Faults

This paper, published on arXiv, presents a new framework called AI_SAFETY, which proposes a structured approach to preventing catastrophic failures in AI systems that control physical machinery, such as autonomous vehicles, industrial robots, or critical infrastructure. While not a binding regulation, it represents a significant technical standard that regulators may reference in future guidance. The framework introduces a taxonomy of fault types and a set of safety assurance requirements, including real-time monitoring, fail-safe mechanisms, and human oversight protocols for high-risk AI applications.

The primary affected organizations are those deploying AI in safety-critical sectors, including manufacturing, transportation, energy, and healthcare. Compliance teams in these industries should review the paper’s proposed fault categories and assurance levels against their existing risk management frameworks. The document signals a shift toward more granular, machine-specific safety obligations, particularly for systems that could cause physical harm.

As a next step, compliance teams should conduct a gap analysis between their current AI safety practices and the AI_SAFETY framework’s recommendations. They should also monitor the European Commission’s AI Office for any alignment with this standard, as it may inform future delegated acts under the EU AI Act for high-risk systems. Proactive adoption of these technical controls can reduce regulatory risk and demonstrate due diligence.