arXiv: The Implications of Linguistic Illegibility for LLM Security

A new research paper, published on arXiv, examines how deliberately confusing or illegible language can be used to bypass security controls in large language models. The study, titled "The Implications of Linguistic Illegibility for LLM Security," demonstrates that adversarial inputs using non-standard grammar, mixed scripts, or unusual phonetic spellings can evade current safety filters and prompt-injection defenses. This is not a regulatory update but a technical finding with direct implications for AI governance under emerging EU rules, particularly the AI Act’s requirements for robust and secure foundation models.

The primary affected parties are developers and deployers of LLM-based systems in high-risk sectors such as finance, healthcare, legal services, and public administration, where automated text processing is common. Also impacted are cloud providers offering model-as-a-service and any organization using third-party chatbots for customer interaction. Compliance teams in these areas must recognize that standard red-teaming and safety evaluations may be insufficient if they only test with well-formed language inputs.

For immediate action, compliance teams should review their existing AI risk assessments and update threat models to include linguistic obfuscation attacks. They should require technical teams to test models against adversarial examples that mimic illegible language, and document these tests as part of their conformity assessments. Additionally, they should monitor model updates and patches from vendors, and consider adding input normalization or language-detection layers as mitigation. Finally, given the paper’s findings, it is prudent to include this vulnerability class in any ongoing incident reporting procedures, as it may affect the safety case required by regulators.