HORUS: A Mixed Reality Interface for Managing Teams of Mobile Robots
This paper introduces HORUS, a Mixed Reality interface designed for the holistic management of mobile robot teams, which combines mini-map monitoring, real-time sensor visualization, and flexible teleoperation modes to effectively support multi-robot coordination in dynamic environments like search and rescue.
Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Imagine you are the commander of a small squad of robot scouts sent into a mysterious, maze-like building to find hidden clues. In the old days, you would have to stare at a bunch of flat computer screens, trying to mentally stitch together what each robot sees, where it is, and what it's doing. It's like trying to drive a car while looking at a map, a rearview mirror, and a radio all at once, without being able to touch the steering wheel directly.
This paper introduces HORUS, a new "Mixed Reality" (MR) tool designed to make managing a team of robots feel like playing a high-tech strategy video game.
What is HORUS?
Think of HORUS as a magic, floating "mini-map" that exists right in front of your eyes. Instead of looking at a 2D screen on a desk, you wear a headset (like the Meta Quest 3) and see a 3D holographic map of the room. On this map, you see little digital models of your robots moving around in real-time.
The system is built on the idea of giving you a "God's eye view" while still letting you zoom in to take direct control when things get tricky.
How Does It Work?
The interface is organized around a "Robot Manager Panel" that pops up whenever you tap on a robot on your mini-map. It's like a control dashboard for each robot with four main buttons:
- Status Check: A quick glance to see if the robot's battery is low, how fast it's going, or if it's stuck.
- Data Vision: You can toggle "X-ray vision." This lets you see what the robot's sensors are seeing, like a laser scan of the walls or a live video feed. You can choose to see the video floating above the robot or projected directly from the robot's "eyes."
- Mission Control: Instead of steering the robot inch-by-inch, you can drop a "goal marker" on the map. The robot then drives itself there. You can also draw a specific path for it to follow or label spots on the map (like "Danger Zone" or "Clue Found").
- Teleoperation (Direct Control): If the robot gets stuck in a tight corner, you can switch modes.
- Mini-Map Mode: You steer the robot like an RC car from the top-down view using controllers.
- Semi-Immersive Mode: You get a big, flat screen view (like a TV) right in front of you, showing exactly what the robot sees, allowing for precise driving through narrow hallways.
The "Search and Rescue" Test
To see if this actually works, the researchers ran a test. They asked two groups of people to find five hidden tags (like digital treasure) hidden in a building using two robots.
- Group A (The HORUS Team): Used the new mixed-reality system. They could assign goals, see the whole map, and switch to direct control when needed.
- Group B (The Old School Team): Used a standard system where they just had to manually steer the robots with joysticks, switching between video feeds, with no map or goal-setting features.
What Did They Find?
The results were clear, much like a race where one runner has a GPS and the other is guessing directions:
- Faster Completion: The HORUS team finished the mission about 23% faster. Because they could set goals and let the robots drive themselves most of the time, they didn't waste time manually steering through every hallway.
- Easier to Use: Even though the HORUS system had more features, the users rated it as "excellent" and much easier to use than the basic joystick system. They felt more confident and less frustrated.
- Better Teamwork: The HORUS users naturally split up the work, sending one robot to the left side of the building and the other to the right. The joystick group tended to focus on one robot at a time, missing parts of the building.
- No "Motion Sickness": The users didn't feel sick or dizzy, meaning the system is comfortable to use for long periods.
The Bottom Line
The paper concludes that while learning to use HORUS takes a little more time (about 18 minutes of training vs. 7 minutes for the simple system), the payoff is huge. It turns the chaotic job of managing a robot team into a smooth, intuitive experience.
The researchers say this is a big step forward for human-robot teamwork. They plan to test it with different types of robots (like walking robots or drones) and in more complex scenarios like disaster zones or construction sites in the future. But for now, they've proven that giving operators a "magic map" makes finding clues—and managing robot teams—much faster and less stressful.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.