← Latest papers
🤖 AI

Post-Training on Office Work Improves Software Engineering: A Behavioral Account of Cross-Domain Transfer

This paper demonstrates that post-training a large language model on long-horizon office workflows significantly improves its software engineering performance by strengthening four core goal-directed execution behaviors—goal selection, state construction, fidelity maintenance, and verification—that transfer effectively across domains.

Original authors: Logan Ritchie, Sushant Mehta, Liudas Panavas, Edwin Chen

Published 2026-08-04
📖 8 min read🧠 Deep dive

Original authors: Logan Ritchie, Sushant Mehta, Liudas Panavas, Edwin Chen

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

Imagine you are teaching a robot to be a master chef. You might think the best way to do this is to feed it millions of recipes, show it how to chop onions, and let it practice making soufflés. But what if the secret to becoming a great chef isn't just about knowing recipes? What if it's about the way you think? What if the real skill is knowing how to break a giant, scary dinner party into small, manageable steps, keeping track of all the ingredients you've gathered, remembering the host's dietary restrictions while you're busy chopping, and actually tasting the food to make sure it's done before you serve it?

This is the world of "agentic" AI—computer programs that don't just answer questions but actually do things, like browsing the web, editing files, or running tests. For a long time, scientists thought these robots needed to be trained on the exact job they would eventually do. If you wanted a robot to fix computer code, you had to teach it with millions of examples of fixing computer code. But this new paper asks a wild question: What if we taught the robot to be a master office worker instead? What if we taught it to organize spreadsheets, schedule meetings, and manage documents, and then asked it to fix software? Would the skills of being a good office worker help it become a better software engineer?

The researchers at Surge AI decided to test this idea. They took a very smart AI model and gave it a crash course in "long-horizon" office work. These weren't simple tasks like "send an email." They were complex, multi-step adventures where the AI had to juggle many tools, keep a mental map of what it was doing, and make sure it didn't lose track of the big picture while getting lost in the details. They trained the AI on 363 of these office tasks, but here is the kicker: none of the training tasks had anything to do with software or coding.

The result? When they tested the AI on a famous software engineering challenge called SWE-Bench Pro, it got significantly better. It improved its success rate by 5.8 percentage points. The paper suggests that by learning how to manage complex, multi-step office workflows, the AI learned a universal "muscle" for goal-directed execution. It learned how to set a goal, build a mental picture of the situation, stick to the original plan even when things got messy, and double-check its work. These skills, the authors argue, are like a Swiss Army knife: once you learn how to use them to organize a filing cabinet, you can use them to debug a computer program, even though the two jobs look completely different on the surface.

The Secret Sauce: The "Goal Loop"

To understand how this works, imagine the AI is an explorer navigating a giant, branching maze. The paper calls the AI's strategy "Goal-Directed Execution" (GDE). Think of this as a four-step dance the AI performs over and over again, like a loop in a video game:

  1. Goal Formation: The AI asks, "What is the very next thing I need to do to get closer to the finish line?"
  2. State Construction: It looks around and says, "Okay, what do I know right now? What did I just find out?" It builds a mental map of the current situation.
  3. Goal Stability: It checks its compass. "Am I still heading toward the main treasure, or did I get distracted by a shiny rock?" It makes sure the small steps it's taking don't forget the big goal.
  4. Verification: Finally, it asks, "Did I actually do it? Do I have proof?" It doesn't just guess; it checks the evidence.

The paper argues that complex tasks—whether they are organizing a company's budget or fixing a bug in a video game—are all made of these same loops. Sometimes the loops are nested inside each other, like Russian dolls. You have a big goal (fix the app), which breaks down into smaller goals (find the bug), which breaks down into even smaller goals (read this specific file).

The Experiment: From Spreadsheets to Software

The researchers took a massive AI model (Qwen3.5-122B-A10B) and gave it a special training diet. Instead of feeding it code, they fed it 363 realistic office scenarios. Imagine the AI acting as a virtual intern. It had to:

  • Search through documents and spreadsheets.
  • Use web browsers to research things.
  • Plan schedules and manage files.
  • Coordinate between different digital tools.

These tasks were designed to be tricky. They required the AI to keep track of many things at once, switch between different tools, and make sure it didn't lose the thread of the story. The AI practiced these tasks until it got really good at them. Crucially, the training data contained zero software engineering tasks. The AI never saw a line of code during its training.

Then came the test. The researchers asked the trained AI to solve problems on SWE-Bench Pro, a benchmark that tests how well an AI can fix real-world software bugs. They compared this trained AI to the same model before it learned the office skills.

The Results: A Universal Skill

The trained AI was a star. Its success rate on the software engineering test jumped from 20.5% to 26.3%. That's a 5.8 percentage point improvement.

But the most interesting part wasn't just the score; it was how the AI changed. The researchers looked closely at the AI's "thought process" (its trajectory) and found that the trained AI was doing the four-step dance much better than the untrained one, in both office tasks and software tasks.

Here is what changed, using the paper's examples:

  • Better Goal Formation: The untrained AI often picked a "locally plausible" goal that was actually wrong. For example, in a software task, it might try to rewrite a whole function when a simple helper tool already existed. The trained AI, having learned to pick the right next step in office tasks, realized, "Hey, there's a tool for that already," and used it.
  • Better State Construction: The untrained AI would often throw away important information. In one office task, it saw a spreadsheet cell with a formula and thought, "That's not a number, I'll ignore it." But the trained AI realized, "Wait, that formula calculates the number I need," and kept the data. It learned to build a better mental map of the situation.
  • Better Goal Stability: This is about not losing the big picture. In a software task, the untrained AI saw a test that failed and changed the code to make the test pass, even though that broke the original requirement. The trained AI remembered the "parent goal" (the original requirement) and didn't let the local problem distract it. It was like a project manager who remembers the deadline even when a printer jams.
  • Better Verification: The untrained AI often checked its work superficially. It might say, "I exported the file, so I'm done." The trained AI was more thorough. It checked if the file actually contained the right data and if the changes affected other parts of the system. It didn't just check the box; it checked the reality.

The Big Picture

The paper suggests that by training the AI on complex, long-horizon office tasks, they strengthened its ability to organize its thoughts and actions. The AI didn't learn how to code; it learned how to learn and how to execute complex plans. The skills of managing a spreadsheet, keeping track of multiple files, and verifying a report turned out to be surprisingly similar to the skills needed to debug a program.

The authors are careful to say this is a "behavioral account." They aren't claiming the AI has a literal "goal stack" inside its brain like a human. Instead, they are observing that the AI's behavior looks like it is using these four capabilities. The data shows that when the AI gets better at these behaviors in one domain (office work), it gets better at them in another (software), even without any direct training on the second domain.

It's a bit like training a gymnast. You might train them on the balance beam, and while they aren't practicing the vault, their core strength, balance, and focus improve. When they finally step onto the vault, they perform better because their underlying "gymnastics skills" have been sharpened. In this case, the "gymnastics" is the ability to manage long, complex tasks without losing your way.

The paper doesn't claim this is a magic bullet that solves all AI problems, nor does it say this is the only way to improve AI. But it offers a fascinating new perspective: maybe we don't need to teach AI every single job in the world. Maybe we just need to teach it how to be a good, organized, goal-oriented worker, and it will figure out the rest.

Drowning in papers in your field?

Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.

Try Digest →