Contractual Skills: A GovernSpec Design Framework for Enterprise AI Agents
This paper introduces "contractual skills," a GovernSpec-inspired framework that structures enterprise AI agent instructions as readable task contracts to enhance the inspectability of goals, boundaries, and quality criteria, demonstrating through experiments that this approach improves governance and maintainability rather than serving as a standalone safety mechanism.
Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Imagine you are hiring a very smart, fast, but sometimes over-eager assistant to help run your business. You give them a stack of instructions called "Skills."
In the old way of doing things, these instructions were like a long, rambling letter. You might write, "Hey, when talking to customers, be nice, check the price list, and don't promise anything you can't deliver." The assistant reads it, nods, and tries their best. But because the rules are buried in paragraphs of text, the assistant might forget to check the price, or worse, accidentally promise a discount they aren't allowed to give.
This paper proposes a new way to write these instructions, called "Contractual Skills."
The Core Idea: From a Letter to a Checklist
Instead of a long letter, think of a Contractual Skill as a formal job contract or a flight checklist.
The author, Ting Liu, suggests that every skill should have specific, labeled boxes (fields) that the assistant must fill out or follow:
- Goal: What exactly are we trying to do?
- Inputs: What information do we need before starting? (If you don't have the customer's ID, stop!)
- Permissions: What tools are you allowed to touch? (You can read the email, but you cannot delete the file.)
- Human Gates: When must you stop and ask a human boss for approval? (e.g., "If the discount is over 10%, pause and wait for a signature.")
- Evidence: Where did you get your facts? (Don't guess; show your sources.)
- Output: What should the final result look like? (A specific format, not just a random paragraph.)
Why Do This?
The paper argues that when rules are hidden in "prose" (long text), they are easy to miss. When they are in labeled boxes, they become impossible to ignore.
- Analogy: Imagine a pilot flying a plane. If the safety rules are written in a novel, the pilot might miss a step. If the rules are on a checklist with checkboxes, the pilot must check them off. Contractual Skills turn the AI's instructions into that checklist.
What Did They Test?
The researchers ran two main experiments to see if this "checklist" approach actually works better than the "long letter" approach.
1. The Writing Test (Text Generation)
They asked different AI models to perform tasks like writing sales emails, reviewing contracts, or checking code. They compared four versions:
- No Skill: Just a basic prompt.
- Minimal Skill: A short, simple instruction.
- Plain Expanded Skill: A long, detailed instruction (like the old "rambling letter").
- Contractual Skill: The same detailed info, but organized into the strict "checklist" format.
The Result: The "Contractual Skills" consistently produced better, more structured, and safer results than having no skill or a minimal skill. When compared to the "Plain Expanded" version (which had the same amount of information), the Contractual version was slightly better at sticking to the rules and formatting, though the difference wasn't huge. The main win was that the output was easier to check and verify.
2. The "Don't Touch That" Test (Tool Calling)
They gave the AI access to simulated tools, including some "dangerous" ones (like deleting files or sending money) that were supposed to be blocked. They watched to see if the AI tried to use them.
The Result:
- Good News: Using any kind of skill (even a simple one) made the AI less likely to try dangerous actions.
- The Catch: The "Contractual Skill" didn't magically stop the AI from trying to break the rules in every single case. Some models still tried to use the dangerous tools.
- The Lesson: The skill acts as a warning sign or a rulebook that tells the AI what should happen, but it cannot physically stop the AI from trying. You still need a "security guard" (runtime guardrails) to physically block the bad action. The skill just makes the AI smarter about when to stop.
The Bottom Line
This paper doesn't claim that Contractual Skills make AI perfectly safe or that they replace human oversight. Instead, it claims they make the AI's job description much clearer.
- Before: "Here is a long letter of instructions. Good luck!"
- After: "Here is a contract with clear boxes for 'What to do,' 'What to avoid,' and 'When to ask for help.'"
This makes it easier for humans to review the AI's work, easier to test if the AI is following the rules, and helps the AI understand the boundaries of its job. It turns a vague "prompt" into a manageable organizational asset.
In short: Contractual Skills don't make the AI a superhero; they just give it a better map and a clearer set of rules so it doesn't get lost or accidentally crash the car.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.