← Back to digest
AI Security

CAITLYN: can agents synthesise their own injection defenses?

What's this about?

Prompt injection attacks work by getting malicious instructions into external text an agent retrieves. CAITLYN asks whether LLM agents can autonomously synthesise defenses against *emerging* injection attacks — ones not in their training data and not covered by an existing filter.

Why does "emerging" carry the weight in that sentence?

Because defending against known attacks is a lookup problem, and every filter does it. The hard case is the attack invented yesterday. Human security teams handle this by understanding the mechanism and generalising; the open question is whether an agent can do the same rather than pattern-matching to the nearest thing it has seen. If it can, defence scales with the attack surface. If it cannot, every new injection technique needs a human in the loop, and injections are cheap to invent.

Why does this matter to you?

  1. It is the automation question underneath the collective cyberdefense letter's "empower defenders with cyber-capable AI".
  2. Synthesised defenses need the same scrutiny as synthesised code — a defense that looks right and does nothing is worse than none.
  3. Read alongside RedEvoAgent below: one paper automates the attack side, one the defense side, published the same day.
← When tool outputs become commandsA human-anchored security benchmark for LLM-generated Infrastructure-as-Code →