arXiv: ECLIPSE: Self-Evolving Stealthy Prompt Injection Attack against Long-Horizon Agentic Systems

This publication details a novel cyberattack method targeting advanced AI systems, specifically those designed to handle long, multi-step tasks. The attack, named ECLIPSE, is a self-evolving prompt injection technique that can stealthily manipulate an AI agent into performing unintended actions over an extended period. Unlike simpler attacks, ECLIPSE adapts its strategy during the interaction, making it harder to detect with standard safety filters. The paper demonstrates a significant escalation in the sophistication of AI-specific threats, moving beyond single-instruction manipulation to persistent, goal-directed subversion.

The primary impact is on any organization deploying large language model (LLM) based agents for complex workflows, such as financial analysis, customer service automation, supply chain management, or internal knowledge retrieval. Sectors with high regulatory scrutiny, including banking, healthcare, and critical infrastructure, are particularly at risk because a compromised agent could generate false reports, execute unauthorized transactions, or leak sensitive data. Compliance teams must recognize that existing AI governance frameworks focused on data privacy and bias are insufficient to address this new class of operational security risk.

Compliance teams should immediately initiate a risk assessment of all AI systems that have access to external data sources or can trigger consequential actions. They must require technical teams to implement robust input validation, output filtering, and human-in-the-loop checkpoints for high-impact decisions. Furthermore, they should update internal AI usage policies to explicitly prohibit agent autonomy for irreversible actions without secondary verification. Finally, they should monitor AI security advisories and incorporate adversarial testing, including prompt injection simulations, into their regular system validation and audit procedures.