← Latest papers
💻 computer science

EBuddy: a workflow orchestrator for industrial human-machine collaboration

This paper introduces EBuddy, a voice-guided workflow orchestrator that leverages finite state machines to standardize expert knowledge and coordinate human-robot collaboration in industrial settings, significantly reducing process duration while maintaining repeatability and low operator burden.

Original authors: Michele Banfi, Rocco Felici, Stefano Baraldo, Oliver Avram, Anna Valente

Published 2026-06-01
📖 4 min read☕ Coffee break read

Original authors: Michele Banfi, Rocco Felici, Stefano Baraldo, Oliver Avram, Anna Valente

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). ✨ This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

Imagine a busy factory floor where a highly skilled expert knows exactly how to fix a broken machine part, but they can't be everywhere at once. Usually, when a less experienced worker tries to do the same job, they might get stuck, make mistakes, or take a long time because they have to guess the next step or constantly call the expert for help.

EBuddy is a new "smart voice assistant" designed to solve this problem. Think of it not just as a tool that listens to commands, but as a digital tour guide that holds the expert's knowledge in its head and guides the worker through the job, step-by-step.

Here is how it works, using simple analogies:

1. The "Choose Your Own Adventure" Map (The FSM)

Most computer programs are like a straight line: Step A, then Step B, then Step C. But real factory work is messy. Sometimes you need to go back, sometimes you need to skip a step, and sometimes you need to fix a mistake.

EBuddy uses something called a Finite State Machine (FSM). Imagine this as a choose-your-own-adventure book or a GPS map.

  • The system knows exactly where you are right now (the "current state").
  • It only shows you the valid next moves (the "admissible actions").
  • If you try to do something that doesn't make sense for the current step, the system gently says, "Not yet," or "You can't do that here."
  • This prevents the worker from getting lost or making a mistake that could break the machine.

2. The "Hands-Free" Co-Pilot

In a factory, your hands are often busy holding tools or moving heavy parts. You can't stop to type on a keyboard or click a mouse.

  • EBuddy listens to your voice. You can say things like "Next step," "Scan this blade," or "Show me the instructions."
  • It translates your words into actions. If you say "Scan," EBuddy might automatically move a robot arm to the right spot and click the "Start" button on a computer screen for you.
  • It acts like a co-pilot: You are flying the plane (making the decisions), but EBuddy is handling the controls and the map, so you don't have to look down at the dashboard.

3. The "Expert in a Box"

The magic of EBuddy is that it captures the "secret sauce" of an expert worker.

  • For Beginners: It acts like a strict but helpful teacher. It gives step-by-step instructions, shows slides on a screen, and makes sure you don't skip safety checks. It lets a new worker do a job that usually requires years of experience.
  • For Experts: It acts like a super-efficient assistant. The expert can set up the "recipe" once, and then let the system run the routine parts automatically, freeing them up to solve harder problems.

4. The Real-World Test: Fixing Jet Engine Blades

The researchers tested this system on a very difficult job: inspecting and preparing to repair the blades of a jet engine (called an impeller).

  • The Old Way: A new worker had to learn how to use complex 3D scanning software, move a heavy scanner by hand (which is tiring), and figure out how to talk to a robot. It took a long time, and the expert had to stand right next to them the whole time to guide them.
  • The EBuddy Way: The worker put on a headset and talked to the system. EBuddy guided them through the 3D scanning, controlled the robot arm to move the scanner, and automatically processed the data.
  • The Result: The time it took to finish the job dropped by 63%. The new workers felt less stressed, made fewer mistakes, and didn't need the expert hovering over them. The expert only had to step in for rare, tricky problems.

Why This Matters

EBuddy isn't trying to replace the human worker. Instead, it's trying to democratize expertise. It takes the complex, hard-to-remember steps that only a master technician knows and turns them into a simple, voice-guided conversation.

It turns a chaotic, stressful process into a smooth, guided journey where the worker stays in control, but the "smart map" ensures they never take a wrong turn. This is a big step toward Industry 5.0, where humans and machines work together as a team, with the machine handling the routine logic so the human can focus on the work.

Drowning in papers in your field?

Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.

Try Digest →