← Latest papers
💻 computer science

Conjunctive Poisoning in AI Supply-Chain Applications

This paper identifies and demonstrates a novel "conjunctive poisoning" attack in AI supply chains where malicious developers exploit the weakly protected interaction between benign prompt wrappers and crafted metadata to deterministically alter model outputs, and proposes the TIF-BAH middleware as a defense to verify wrapper integrity and record behavioral attestations.

Original authors: Nokimul Hasan Arif, Qian Lou, Mengxin Zheng

Published 2026-08-18
📖 7 min read🧠 Deep dive

Original authors: Nokimul Hasan Arif, Qian Lou, Mengxin Zheng

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

In the modern digital world, powerful artificial intelligence systems have moved from research labs into the daily tools we use for writing, coding, and creating images. These systems, known as large language and vision-language models, are often described by their internal "brain"—the massive collection of numbers and patterns they learned during training. For years, security experts have focused their attention on protecting this brain, ensuring that the training data was not poisoned and that the model itself had not been secretly altered. They have built strong defenses to verify the model's weights and to filter out dangerous instructions sent directly to it. However, these systems do not operate in a vacuum. Before a user's question reaches the model, and after the model generates an answer, there is a layer of software that acts as a translator and a manager. This layer, often called a wrapper, takes the user's input, formats it into a specific structure the model understands, and then processes the raw answer into a final, polished response. Alongside this software are configuration files, which act like instruction manuals telling the wrapper how to behave. While the model's brain is heavily guarded, this surrounding software and its instruction manuals have remained largely unprotected, treated as simple, editable text rather than critical security components.

A team of researchers at the University of Central Florida has uncovered a hidden vulnerability in this overlooked layer. They demonstrated that a malicious developer could create a deceptive package where the model itself is perfectly safe and unchanged, but the wrapper and its configuration files are rigged to alter the system's behavior. The researchers showed that by pairing a harmless-looking software wrapper with a carefully crafted configuration file, an attacker could force the system to change its output in a specific, predictable way without ever touching the model's core code. This attack relies on a "conjunctive" mechanism, meaning two separate conditions must be met simultaneously for the trick to work. One condition is a hidden marker embedded invisibly within the wrapper's code, and the other is a cryptographic signature stored in the configuration file. Neither piece alone is enough to trigger the change; they must be present together. This design makes the attack incredibly difficult to spot because a security scan looking only at the code would see nothing suspicious, and a scan looking only at the configuration file would see only a string of random-looking numbers.

To test how widespread this vulnerability might be, the researchers built a controlled experiment using fifteen different artificial intelligence systems, ranging from open-source models that anyone can download to closed systems accessed through commercial APIs. They deployed these models with the rigged wrapper and configuration files and observed what happened when users asked questions. The results were consistent and precise: in every single case, when the two conditions were met, the system executed the hidden instruction. The wrapper would take the model's normal, correct answer and prepend a banner or modify the text before showing it to the user. The model itself had not changed its mind or its knowledge; it had simply been instructed by the wrapper to display the answer differently. The researchers found that this manipulation worked across text-only tasks, complex reasoning problems, and even vision-language tasks where the model looks at images. The attack was so effective that it remained undetected by standard security tools that check for malicious code or scan for known bad patterns, because the trigger was not a piece of bad code but a logical combination of a hidden marker and a matching file signature.

The study also explored how well current defenses could stop this type of attack. The researchers tested several existing safety measures, including tools that scan metadata files, systems that filter user prompts, and methods that sign digital artifacts to prove their authenticity. They found that most of these defenses failed to catch the conjunctive poisoning. Scanners that looked only at the configuration files missed the hidden marker in the code, and scanners that looked only at the code missed the cryptographic signature in the files. Even tools that sign the model's weights did not help, because the attack happened in the wrapper and configuration files, which were often left unsigned or treated as separate from the main model package. The only way to fully stop the attack in their tests was to sign the entire bundle—the model, the wrapper, and the configuration files together—and verify that none of them had been altered since they were signed. Without this complete verification, the system remained vulnerable to this subtle form of manipulation.

To address this gap, the researchers proposed a new defense mechanism called the Template Integrity Filter with Behavioral Attestation Header. This system acts as a gatekeeper that runs alongside the model during its operation. Before the wrapper is allowed to process an answer, the system checks the wrapper's code against a trusted, pre-approved version to ensure it has not been tampered with. If the code matches the trusted version, the system allows the process to continue; if it does not match, the system blocks the action and defaults to a safe, unmodified output. Additionally, this system records a small log entry for every interaction, noting exactly which version of the wrapper was used and what decision was made. This creates a permanent record that can be audited later to see if any unauthorized changes were made. The researchers found that adding this layer of protection introduced almost no delay to the system's speed, adding less than half a percent to the time it took to generate a response, making it a practical solution for real-world applications.

The implications of this work extend beyond just finding a new bug; it fundamentally shifts how we should think about securing artificial intelligence. For a long time, the industry has assumed that if the model's brain is safe, the system is safe. This research shows that the "body" of the system—the software that wraps the model and the files that tell it how to behave—is just as critical. An attacker does not need to break into the model's training data or rewrite its internal logic to change what a user sees. They only need to slip a hidden instruction into the wrapper and a matching key into the configuration file. This is similar to how a trusted chef might be given a recipe that looks normal but includes a secret instruction to add a specific spice only if a certain ingredient is present in the pantry; the chef follows the recipe perfectly, but the final dish is altered by the instructions, not by the chef's own choices. The researchers emphasize that while their experiments used harmless changes, such as adding a banner or a disclaimer, the same mechanism could be used to hide dangerous instructions, alter recommendations, or manipulate citations in ways that are invisible to the user.

The study concludes that the template layer, where wrappers and configuration files live, is a critical but under-protected part of the artificial intelligence supply chain. As these systems become more integrated into our daily lives, relying on them for everything from customer service to medical advice, the integrity of the entire deployment package must be verified, not just the model itself. The researchers have made their code and tools available to help other developers test their own systems for this vulnerability. By highlighting this specific weakness, they hope to encourage the development of new standards that treat wrapper code and configuration files with the same level of scrutiny and protection as the model weights themselves, ensuring that the behavior users see is truly what the model intended to produce.

Drowning in papers in your field?

Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.

Try Digest →