A new academic paper published on arXiv, titled "The Rise and Fall of Google's Privacy Sandbox," provides a critical retrospective analysis of Google's initiative to phase out third-party cookies in…
arXiv: SoK: Attack and Defense Landscape of Mobile On-device AI Systems
AI_SAFETY. Sourced from arxiv_cscr, summarised by Matproof.
AI Analysis
What changed and what to do.
This publication is a systematic academic review, not a regulatory change. It surveys the security and privacy vulnerabilities of on-device AI systems, such as those running on smartphones, wearables, and IoT devices. The paper categorizes attack vectors, including model extraction, data poisoning, and adversarial inputs, alongside existing defense mechanisms. It does not introduce new legal obligations but provides a technical landscape that may inform future regulatory guidance under the EU AI Act and related frameworks.
Organizations deploying on-device AI in consumer electronics, healthcare, automotive, or financial services should take note. Compliance teams in these sectors must consider how these documented threats could affect their AI system’s risk classification, transparency obligations, and conformity assessments under the AI Act. The paper highlights that on-device processing, while privacy-preserving in principle, introduces unique attack surfaces that may require additional technical safeguards.
Compliance teams should review their AI risk management processes to ensure they account for on-device threats, particularly model integrity and data confidentiality. Engage engineering teams to map the paper’s attack taxonomy against your deployed systems. Update internal documentation and, where relevant, prepare for potential regulatory scrutiny by documenting mitigation measures. Monitor the European Commission’s guidance on AI security for any alignment with these findings.
This summary is AI-generated for orientation purposes. For regulatory action, always consult the original source linked above.
More AI_SAFETY updates
Latest in AI_SAFETY.
This publication from arXiv, dated July 1, 2026, presents a technical paper detailing new hardware accelerators for Post-Quantum Cryptography (PQC). The paper describes a method to significantly…
This publication, a pre-print from arXiv dated July 2026, presents a novel vulnerability in multimodal AI systems. It demonstrates that individual benign images, when processed together by a model,…
This paper, published on arXiv, introduces a new technical framework called HARC, which addresses a critical vulnerability in large language models (LLMs). The research demonstrates that current…
Map this to your controls
Connect regulatory changes to your compliance work.
Matproof maps every regulator update directly to your controls and surfaces the ones that affect your organisation — across 21 frameworks.