OpenResearcher: A Fully Open Pipeline for Long-Horizon Deep Research Trajectory Synthesis
OpenResearcher introduces a fully open, reproducible, and offline pipeline that synthesizes over 97,000 long-horizon deep research trajectories from a 15M-document corpus, enabling a 30B-A3B model to achieve a 34-point accuracy improvement on BrowseComp-Plus while providing a controlled environment for analyzing agent design strategies.
Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Imagine you want to teach a robot how to be a world-class detective. To do this, you need to show it thousands of examples of how to solve complex mysteries: how to ask the right questions, how to visit different libraries, how to read specific pages, and how to find the tiny clue that solves the case.
The problem? In the real world, doing this is expensive, chaotic, and impossible to repeat. If you send a robot to the actual internet to practice, you have to pay for every search, the websites might change or disappear, and you can't be sure if the robot found the answer because it was smart or because it got lucky.
Enter "OpenResearcher."
Think of OpenResearcher as a massive, self-contained "Detective Training Simulator." Instead of sending the robot out into the messy, expensive real world, the researchers built a perfect, offline replica of the internet inside their computer.
Here is how they did it, broken down into simple steps:
1. Building the "Library of Everything" (The Offline Corpus)
Imagine you want to train a detective, but you don't have a library. So, you go out, buy 10,000 specific books that contain the answers to your practice questions, and then you go to a massive warehouse and grab 15 million other random books to fill the shelves.
- The Real World: You'd have to pay a fee every time you ask a librarian for a book.
- OpenResearcher: They built a local library with 15 million documents. Once it's built, it's free to use forever. No fees, no internet connection needed.
2. The "Teacher" and the "Student"
- The Teacher (GPT-OSS-120B): This is a super-smart AI that acts like a master detective. It knows how to solve the hard questions.
- The Student (The 30B Model): This is the smaller AI they want to train. It's like a rookie detective.
The researchers let the Teacher solve the questions using their offline library. The Teacher doesn't just guess; it has to follow a strict set of rules:
- Search: Ask the librarian for a list of books.
- Open: Walk over and read the full book (not just the summary).
- Find: Use Ctrl+F to find the exact sentence inside the book that proves the answer.
The Teacher writes down its entire thought process: "I searched for X, found Y, opened the book, scrolled to page 5, found the word 'Z', and now I know the answer is A."
3. The "Training Montage"
The researchers recorded 97,000 of these detective stories. Some were short and easy (5 steps), while others were incredibly long and difficult (over 100 steps!).
- The Analogy: It's like recording 97,000 hours of a master chef cooking, from chopping onions to plating the dessert.
- They then fed these recordings to the Student (the rookie detective). The student studied these recordings to learn how to think, not just what the answer was.
4. The Results: From Rookie to Pro
After studying these recordings, the Student became amazing.
- Before training: The student was like a person guessing answers, getting about 20% right.
- After training: The student got 54.8% right on very hard tests.
- The Magic: The student was trained only on the offline simulator, yet it performed better than many expensive, proprietary systems that rely on the real internet.
Why is this a Big Deal? (The "Aha!" Moments)
The paper also discovered some cool secrets about how these AI detectives work:
- The "Search vs. Read" Trap: If you only let the AI "Search" (look at book titles and summaries), it fails. It's like trying to solve a murder mystery by only reading the book blurbs on the back cover. You must let the AI "Open" the book and "Find" the specific text.
- Finding the Clue isn't Enough: Just because the AI found the right book (the "Gold Document") doesn't mean it got the right answer. It still has to read the page and understand the logic. Sometimes, the AI finds the answer but misinterprets the table or the sentence.
- More Steps = Better Results (Up to a point): The best detectives took a long time. They didn't rush. They searched, opened, read, and searched again. The training showed that letting the AI take 100+ steps was often necessary to solve the hardest puzzles.
The Bottom Line
OpenResearcher is a game-changer because it democratizes deep research.
- Before: Only rich companies with millions of dollars could train AI to be deep researchers because they could afford the real internet search fees.
- Now: Anyone can download this "offline library," run the simulation, and train their own AI detective for free. It's like giving everyone a private, infinite library and a master detective to learn from, without ever needing to leave their house.
It proves that you don't need a live, expensive internet connection to teach an AI how to think deeply; you just need a good map, a big library, and a smart teacher.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.