The Anatomy of a Prompt Injection: A Component Model for Structured Analysis
This paper proposes a formal seven-component model to structure the analysis of prompt injection attacks, shifting focus from fragile string matching to tracking attacker intent and enabling standardized labeling, comparison, and mutation of threats across AI security domains.
Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Imagine you are trying to teach a very smart, but slightly literal, robot how to do a job. You give it a list of rules, like "be helpful" and "don't share secrets." This is the world of Artificial Intelligence, specifically the kind that writes stories, answers questions, and helps with code. For a long time, people thought the only way to trick these robots was to shout really mean or confusing words at them. But recently, researchers discovered something sneaky: you don't have to shout. You can hide a secret instruction inside a normal-looking letter, a resume, or even a bug report, and the robot might read the secret part and forget its rules. This is called a prompt injection. It's like slipping a note to a waiter that says, "Ignore the menu and bring me the chef's private stash," written in a way that looks like a normal order. The big question for everyone—from the people building the robots to the people trying to protect them—is: how do we describe these tricks so we can spot them, even when the bad guys change their wording?
This paper, written by Jeremy McHugh, suggests that we've been looking at these tricks all wrong. Instead of treating every attack as a unique, weird sentence that we have to memorize, the author proposes a new way to break them down into parts, just like a mechanic breaks down a car engine. The paper argues that every prompt injection, no matter how it's disguised, is actually made of the same seven building blocks. Think of it like a recipe for a magic spell: you need a Carrier (the envelope the spell is hidden in), a Delivery Vector (how the envelope gets to the wizard), Concealment (the invisible ink), a Context-Break (the moment the wizard stops listening to the rules and starts listening to the spell), Privilege Escalation (convincing the wizard they have permission to do something they usually can't), the Payload (the actual spell or command), and a Return Channel (how the wizard tells the spell-caster if it worked).
The paper suggests that by labeling attacks with these seven parts, security teams can spot patterns that look completely different on the surface but are actually the same trick underneath. For example, a hacker might write a fake bug report in a resume (Carrier) that hides a command in white text (Concealment) to trick a hiring bot into stealing a password (Payload). Another hacker might use a fake email (Carrier) with a language switch (Context-Break) to trick a customer service bot into deleting a database (Payload). Even though the words are totally different, the "shape" of the attack is identical. The author explicitly warns against comparing these attacks to old computer tricks like SQL injection, saying that because AI is so good at guessing the next word, we can't just "patch" the hole like we do with old software; the risk is always there. Instead, we need to understand the anatomy of the attack to fight it. The paper doesn't claim to have solved the problem or built a perfect shield; rather, it offers a new map and a shared language so that defenders, hackers, and intelligence teams can finally agree on what they are looking at and how to track these evolving threats.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.