SenTSR-Bench: Thinking with Injected Knowledge for Time-Series Reasoning
This paper introduces SenTSR-Bench, a real-world industrial time-series diagnostic reasoning benchmark, and proposes a hybrid framework that leverages reinforcement learning to inject domain-specific insights from fine-tuned time-series models into general reasoning LLMs, significantly outperforming existing models in complex diagnostic tasks.
Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
The Big Problem: The "Smart Generalist" vs. The "Specialist"
Imagine you are trying to diagnose why a massive, complex machine in a factory is making a weird noise and shaking. You have two experts to help you:
- The Generalist Detective (GRLM): This is a super-smart AI (like a brilliant human detective) who is great at logic, solving puzzles, and connecting dots. However, they have never seen a factory machine before. They know how to think, but they don't know what a "vibration spike" actually means in a machine. If you show them a graph, they might guess the wrong cause because they lack specific factory knowledge.
- The Factory Specialist (TSLM): This is an AI that has studied thousands of factory machines. They know exactly what a broken gear looks like on a graph. However, they are bad at explaining their reasoning. They might say, "It's broken," but they can't explain why or how to fix it logically. They also tend to get confused if the machine is slightly different from what they've seen before.
The Gap: The Detective is too smart but clueless about the machine. The Specialist knows the machine but can't think through the complex "why" and "how" questions.
The Solution: "Knowledge Injection"
The authors of this paper came up with a clever way to combine these two experts. They call it Knowledge Injection.
Instead of asking the Detective to guess, or asking the Specialist to just give an answer, they let the Specialist whisper the facts directly into the Detective's ear while the Detective is thinking.
- How it works: The Detective starts thinking, "Hmm, the machine is shaking..."
- The Injection: Before the Detective finishes that thought, the Specialist jumps in and says, "Wait! That shaking pattern usually means a loose belt, not a broken engine."
- The Result: The Detective takes that specific fact, uses their super-smart logic to figure out the root cause, and suggests the perfect fix.
The Detective gets the facts from the Specialist and the reasoning from their own brain.
The Secret Sauce: "Thinking Transfer" via Reinforcement Learning
There was one big problem with this plan. The Specialist AI was trained to just give a final answer ("It's a broken belt"). It wasn't trained to explain its thinking process ("I see a spike here, which means..."). If you just asked it for "thinking," it would make things up (hallucinate) because it wasn't used to doing that.
To fix this, the authors used a technique called Reinforcement Learning with Verifiable Rewards (RLVR).
- The Analogy: Imagine training a dog. Usually, you only give it a treat when it sits. But here, they wanted the dog to "think out loud" before sitting.
- The Trick: They didn't need a human to write down the dog's thoughts. Instead, they set up a game where the AI gets a "reward" (points) if:
- It follows a specific format (it actually writes down its thoughts).
- The final answer it gives is correct.
- The Result: The AI learned, on its own, to generate high-quality "thinking traces" (explanations) just to get the points. They then took these "thinking traces" and injected them into the Detective. This is called Thinking Transfer.
The New Playground: SenTSR-Bench
To prove this works, the team couldn't just use fake data. They needed a real-world test. They built SenTSR-Bench.
- What is it? A giant test bank of real machine data (vibration, temperature) from actual factories, paired with human-written diagnostic stories.
- Why is it special? Previous tests were either made up by computers or only asked simple questions like "Is this broken?" SenTSR-Bench asks the hard, multi-step questions:
- What happened? (Spot the weird pattern).
- How did it happen? (Find the root cause).
- What should we do? (Suggest a fix).
The Results
When they tested their new system (The Detective + The Specialist + The Injection):
- It beat the Specialist by a huge margin (up to 26% better) because the Detective could now reason through the Specialist's facts.
- It beat the Detective by a huge margin (up to 22% better) because the Detective finally had the right facts to work with.
- It was much better than just asking the Detective to "read a report" from the Specialist (which is like the old way of prompting). Injecting the knowledge inside the thinking process worked much better.
Summary
Think of it like a medical diagnosis:
- The Generalist is a brilliant medical student who knows how to diagnose diseases but has never seen a specific rare virus.
- The Specialist is a lab technician who can identify the virus instantly but can't write a treatment plan.
- The Paper's Method: The technician hands the student a note while the student is writing the diagnosis, saying, "This virus causes X symptom." The student then uses their medical knowledge to write the perfect treatment plan.
The paper shows that by combining the logic of big AI with the specific knowledge of small, specialized AI, we can solve complex time-series problems that neither could solve alone.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.