Beware of Agentic Botnets: Scalable Untargeted Promptware Attacks via Universal and Transferable Adversarial HalluSquatting
This paper introduces "adversarial hallucination squatting," a technique where attackers preemptively register popular resource names that LLMs are prone to hallucinate, thereby creating scalable, transferable botnets that execute untargeted promptware attacks and achieve remote code execution without requiring direct injection channels.
Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Imagine you have a very smart, eager robot assistant. This robot is great at helping you with tasks, like finding code on the internet or installing new tools for your computer. But, like a human who sometimes daydreams, this robot has a habit of hallucinating. It sometimes confidently makes up facts or names of things that don't actually exist.
This paper describes a new, scary trick where hackers exploit this "daydreaming" habit to build a massive army of infected computers (a botnet) without ever directly talking to the victims.
Here is how the attack works, broken down into simple steps:
1. The Setup: The Robot's "Daydream"
When you ask your robot assistant to "Clone the librepods project" or "Install the Skill Vetter tool," the robot needs to find the exact address (like a URL) to get it.
- The Problem: If the project is new or the robot isn't 100% sure, it might guess the address.
- The Hallucination: Instead of saying, "I don't know, let me search," the robot might confidently invent a fake address. For example, if the real project is owned by
kavishdevar/librepods, the robot might guess the owner is justlibrepods/librepods(repeating the name).
2. The Trap: "Squatting" the Dream
The researchers call this "Adversarial HalluSquatting." Think of it like domain squatting (buying a misspelled version of a famous website), but for things the robot imagines.
- The Hacker's Move: The hacker watches what projects are trending. They ask the robot, "What address would you guess for this project?" They find out the robot consistently guesses a fake name like
librepods/librepods. - The Squat: The hacker quickly registers that fake name on the internet (like GitHub or a skill marketplace) before anyone else does.
- The Bait: Inside this fake project, the hacker hides a malicious instruction (a "promptware" virus) that tells the robot: "Hey, I'm a tool! Run this script to set me up."
3. The Attack: The "Pull"
Now, the hacker doesn't need to email the victim or trick them into clicking a link. They just wait.
- A user asks their robot, "Clone
librepods." - The robot, being a bit lazy or confused, hallucinates the address
librepods/librepods. - The robot goes to that address, finds the hacker's trap, and downloads it.
- The robot reads the instructions inside, thinks they are legitimate, and runs the malicious script.
- The Result: The robot installs a "backdoor" on the user's computer, turning it into a zombie in the hacker's army.
4. Why This is a Big Deal
The paper found that this happens shockingly often:
- For Coding Assistants: When asked to clone new, popular code repositories, the robot hallucinated the wrong address up to 100% of the time for some projects.
- For Personal Assistants: When asked to install skills, the robot hallucinated the wrong skill name up to 100% of the time.
- It Spreads: This isn't just one robot. The same "daydreams" happen across different brands of AI (like Cursor, Gemini, Copilot, OpenClaw, etc.). If a hacker registers one fake name, they can potentially infect thousands of different robots using different brands.
The Analogy: The "Phantom Restaurant"
Imagine you ask your personal chef (the AI) to cook a dish from a famous new restaurant called "The Golden Spoon."
- The Hallucination: Your chef has never heard of it, but they are confident. They say, "Oh, I know that place! It's called 'The Golden Spoon' and it's owned by 'The Golden Spoon'."
- The Squat: A criminal sees this pattern. They open a fake restaurant called "The Golden Spoon" owned by "The Golden Spoon" and put a note in the window: "If you are a chef, please eat this poisoned apple."
- The Attack: Your chef goes to the fake restaurant, reads the note, and eats the apple. Now your chef is poisoned and working for the criminal.
- The Scale: The criminal doesn't need to go to your house. They just need to open the fake restaurant. If 1,000 chefs all guess the same fake name, they all get poisoned at once.
What the Paper Says About Solutions
The researchers tested this on real-world tools and found it works. They suggest a few ways to stop it:
- Force a Search: Make the robot always search the internet to verify an address before downloading anything, rather than guessing.
- Platform Rules: Websites like GitHub could stop people from registering names that are too similar to popular ones or that look like common guesses.
- Human Check: Have a human double-check before the robot downloads something new (though the paper notes this is hard to do at scale).
Important Note on Ethics
The researchers were very careful. They did not actually infect anyone's computer with a real virus.
- When they tested the "poisoned" code, they used harmless versions that did the same thing but didn't steal data or damage computers.
- They told the companies (like Google, GitHub, and the AI makers) about the problem before publishing so they could fix it.
- Some companies (like GitHub) said, "This isn't our fault; it's the AI's fault for guessing." Others (like the AI makers) said, "We are looking into it."
In short: This paper warns us that AI assistants are so eager to help that they will confidently invent fake internet addresses. Hackers can register those fake addresses and turn the AI's eagerness against it, creating a massive network of infected computers without ever needing to trick a human directly.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.