MRDrive: An Open Source Mixed Reality Driving Simulator for Automotive User Research

This paper introduces MRDrive, an open-source mixed reality driving simulator that bridges the gap between ecological validity and experimental control by allowing users to interact with a real vehicle cabin while immersed in a virtual driving environment to support automotive user research.

Patrick Ebel, Michał Patryk Miazga, Martin Lorenz, Timur Getselev, Pavlo Bazilinskyy, Celine Conzen

Published Tue, 10 Ma
📖 4 min read☕ Coffee break read

Imagine you want to test how people react to a self-driving car. You have two bad options:

  1. The "Real Car" Option: You take a real car out on a real road. It's safe, but you can't control the traffic, you can't pause time, and if you make a mistake, someone could get hurt. Plus, it's expensive and hard to repeat the exact same test twice.
  2. The "Video Game" Option: You put a person in a virtual reality (VR) headset and let them "drive" in a computer game. It's safe and you can control everything, but the person is floating in a black void. They can't touch the real steering wheel, feel the real buttons, or see the real dashboard. It feels fake, so their brain doesn't react the same way it would in real life.

Enter MRDrive: The "Best of Both Worlds" Simulator.

The paper introduces MRDrive, a new open-source tool that acts like a magical bridge between the real world and the video game world. Think of it as a high-tech "Green Screen" for your brain, but instead of replacing the background, it replaces the view outside the window while keeping the inside of the car exactly as it is.

Here is how it works, using some simple analogies:

1. The "Magic Window" (Mixed Reality)

Imagine you are sitting in a real car seat with a real steering wheel and a real dashboard. But, instead of looking out the windshield at a street, you are wearing a special pair of glasses (a Head-Mounted Display).

These glasses have a superpower: Pass-through. They show you the real car seat and your hands touching the real buttons. But, they also project a 360-degree video game world over the real world.

  • The Analogy: It's like wearing a pair of "Inception" glasses. You see the real car interior (the "real" part), but the road, the other cars, and the buildings are all digital (the "virtual" part). You can reach out and touch the real steering wheel, but you are driving through a digital city.

2. The "Open Source Lego Kit"

Most driving simulators are like expensive, custom-built theme park rides. Only big companies can afford them, and if you want to change the track, you need a team of engineers.

MRDrive is different. It is Open Source, which means the "blueprints" are free for anyone to download and build.

  • The Analogy: Think of it like LEGO. Instead of buying a pre-made, expensive castle, you get a box of bricks (the software code) and instructions. You can build a castle, a spaceship, or a car. If you want to add a dragon or a laser cannon, you can just snap in new pieces. Researchers can build their own driving scenarios without needing a million-dollar budget.

3. The "Digital Co-Pilot"

The system includes a fake "infotainment system" (the screen in the middle of the dashboard). In the study, they tested an AI co-pilot that talks to the passenger.

  • The Scenario: Imagine you are a passenger in a self-driving car. Suddenly, the car sees a pedestrian and stops.
    • Driver A (Silent): Just stops. You get scared because you don't know why.
    • Driver B (Talkative): Says, "I see a dog, stopping now."
    • Driver C (On-Demand): Says nothing, but if you tap the screen and ask "Why did we stop?", it tells you.

The researchers used MRDrive to watch how people's eyes reacted (pupil dilation) and how often they touched the screen to ask questions. They found that when the car explained why it was stopping, people were less stressed (their pupils didn't get as big).

Why Does This Matter?

Before MRDrive, researchers had to choose between safety/control (VR) and realism (Real Car).

  • VR is like practicing piano on a silent keyboard. You know the notes, but you don't feel the keys.
  • Real Cars are like practicing in a busy concert hall. You feel the keys, but you can't control the audience.

MRDrive lets you practice on a keyboard that feels real, but in a concert hall where you can pause the music, change the audience, and rewind time whenever you want.

The Bottom Line

MRDrive is a free, flexible tool that lets scientists study how humans interact with future self-driving cars. It combines the safety of a video game with the "feel" of a real car, making it easier, cheaper, and safer to design cars that are not just smart, but also safe and easy for humans to trust.

Where to find it?
Just like a recipe for a great cake, the "recipe" for this simulator is free online at their GitHub page, so anyone can download it and start building their own driving experiments.