arXiv: Maverick: Private and Verifiable LLM Inference Made Practical via Matrix-Vector Multiplication Delegation

A new arXiv paper proposes Maverick, a practical system for private and verifiable large language model inference using matrix-vector multiplication delegation. The work addresses a key trust gap in outsourced AI: organizations that send prompts to third-party model providers currently cannot confirm that the provider ran the correct model or protected the input data. Maverick aims to make cryptographic privacy and verifiable computation feasible at production scale, rather than only in theory.

This development is relevant to any organization deploying LLMs through external providers, including financial services, healthcare, legal, and public sector bodies, as well as cloud and AI vendors that supply inference services. It intersects with EU obligations around data protection, ICT third-party risk, and emerging AI transparency and accountability requirements, particularly where sensitive data or high-risk AI systems are involved.

Compliance teams should monitor this research but not treat it as an approved standard. Practical next steps are to map which AI workloads depend on external inference, review vendor contracts for confidentiality, audit, and subprocessor commitments, and ask providers whether verifiable or confidential computing options are on their roadmap. Any adoption should await peer review, security assessment, and confirmation of alignment with GDPR and the EU AI Act.