arXiv: Agree on the Model, Verify the Inference: GKR Protocols for HND-Based Transformer Inference

This paper, published on arXiv, proposes a technical method for verifying the integrity of AI model inference using GKR (Goldwasser-Kalai-Rothblum) protocols, specifically applied to transformer models using HND (Hierarchical Non-linear Decomposition). It does not represent a new regulation or binding legal change, but rather a novel cryptographic approach to ensure that a deployed AI model is running the exact computation it claims, without revealing the model’s internal parameters. This is relevant to the EU AI Act’s requirements for transparency and robustness, particularly for high-risk AI systems.

The primary affected organizations are developers and deployers of large language models and other transformer-based AI systems, especially those operating in regulated sectors like finance, healthcare, and critical infrastructure. Compliance teams at these firms, as well as third-party auditors and certification bodies, should take note because this method could become a technical standard for proving model behavior without exposing proprietary weights. It may also impact future regulatory guidance on model verification and auditability.

Compliance teams should monitor this research as it matures, as it may inform future technical standards under the EU AI Act. They should begin assessing whether their current model verification processes could be enhanced by such cryptographic proofs, and engage with technical teams to understand the feasibility of integrating GKR protocols into their deployment pipelines. Proactively, teams should document their current inference verification methods to prepare for potential future requirements that mandate independent, cryptographic proof of model behavior.