What does immersive virtual reality actually teach? A performance–knowledge dissociation in a blinded cluster randomized trial of catheterization skills in nursing students

Imagine you are trying to learn how to drive a car. You could sit in a real car with a steering wheel, or you could strap on a headset and drive in a hyper-realistic video game. For years, educators have debated which method is better. Does the video game make you a better driver, or does it just make you better at playing the game? This question sits at the heart of a field called "simulation-based education," where teachers try to figure out if practicing in a fake environment actually helps you perform real tasks later. The big mystery is whether the skills you learn in the simulation transfer to the real world, or if you are just memorizing the specific steps of the game without truly understanding the mechanics. If the game is too perfect, you might get an A+ on the test but fail when you have to deal with a real, messy car.

This is exactly what a team of researchers from Spain set out to investigate using nursing students and a very specific medical task: inserting catheters (tubes used to drain urine, feed the stomach, or clean the rectum). They wanted to know if putting students in an immersive Virtual Reality (VR) headset made them better at the procedure than using traditional, low-tech plastic models. But they didn't just want to know if VR worked; they wanted to know how it worked. Did it teach the students everything, or did it only teach them the specific parts of the procedure that the VR game happened to show them?

The Great Catheter Challenge: VR vs. The Real Deal

To find the answer, the researchers organized a massive, high-stakes experiment involving 442 second-year nursing students. They split the class into two groups, but with a twist: they didn't just pick random students; they picked entire teaching subgroups (like whole classes) to ensure a fair fight. One group got to train using a high-tech VR headset (the Meta Quest Pro), where they stepped into a digital world to practice three types of catheterization: urinary, nasogastric (stomach), and rectal. The other group practiced the exact same procedures using traditional, low-tech plastic models and physical guides.

Crucially, both groups got the exact same amount of time to practice, and both groups attended the same lecture one week later before taking their final test. This setup was designed to isolate the VR experience as the only difference between the two teams. The final test was a "blind" exam, meaning the people grading the students didn't know which group they were from. The students had to perform the procedures on mannequins while being watched by two independent judges who checked off a long list of 11 specific steps, from washing their hands to documenting the procedure.

The Results: A Superpower with a Catch

The results were dramatic, but they came with a very important "but." The students who trained in VR absolutely crushed the exam. Their average score was 87.33 out of 100, compared to 70.70 for the students who used the plastic models. That is a huge gap. In fact, if you picked a random student from the VR group and a random student from the control group, the VR student would beat the other student 97% of the time.

However, the study discovered that this "superpower" wasn't magic; it was very specific. When the researchers broke down the exam into its 11 individual steps, they found that the VR students were amazing at the steps the VR game had rehearsed them on. They were significantly better at:

• Documentation: Writing down what they did.
• Positioning: Laying the patient (mannequin) in the right spot.
• Verification: Checking that the tube was in the right place.
• Asepsis: Keeping everything sterile and clean.

These are all steps that a VR headset can show you perfectly. You can see the virtual patient, the virtual tube, and the virtual checklist.

But here is the twist: on the one step that VR cannot simulate, the traditional group won. That step was material preparation. In the real world, this means physically picking up the sterile kit, opening the packages, and handling the equipment. In the VR world, you just click a button or look at a menu. The students who used the plastic models were significantly better at physically preparing the materials (scoring 0.84 vs. 0.73 for the VR group).

This finding is like a video game player who is a master at the controls and the strategy but has never actually held a steering wheel. The VR students knew what to do and when to do it, but they were slightly less practiced at the physical act of grabbing the tools.

Knowledge vs. Skill: The Two Different Brains

The study also tested how much the students remembered about the theory behind the procedures. They took a 30-question test immediately after training and again four weeks later. The VR group did better here too, but the gap was much smaller than in the physical skills.

• Immediate Knowledge: VR students scored 18.33 vs. 13.53 for the control group.
• Four-Week Retention: VR students scored 18.63 vs. 14.60.

While the VR group kept their knowledge well, the advantage in doing the procedure (the physical skill) was much larger than the advantage in knowing the facts. The researchers found that the students who were best at the physical procedure weren't necessarily the ones who got the highest scores on the written test. This suggests that VR is incredibly good at teaching the "muscle memory" of a sequence, but it doesn't automatically make you a genius at the theory.

The Verdict: A Powerful Tool, Not a Magic Wand

So, what does this paper actually teach us? It suggests that Immersive VR is a fantastic tool, but it is not a replacement for real practice. It works because of something called "constructive alignment." Think of it like this: if you practice a dance routine in a video game that shows you every step perfectly, you will be amazing at that specific dance. But if the real dance floor has a slippery spot or a different floor texture that the game didn't show, you might stumble.

The study proves that VR creates a massive advantage in performance, but that advantage is selective. It makes you a master of the steps the simulation rehearsed, but it leaves you slightly behind on the physical handling of real equipment. The researchers conclude that VR is best used as a preparatory complement. It's the perfect way to get students ready, to teach them the sequence, the safety checks, and the confidence, before they ever touch a real patient or a real kit.

The paper explicitly rules out the idea that VR is a "magic bullet" that makes you better at everything. Instead, it shows that VR is a highly specialized training tool. If you want to learn the choreography of a complex medical procedure, VR is unbeatable. But if you want to learn how to physically handle the equipment, you still need to get your hands dirty with the real thing. The best approach, the authors suggest, is to use VR to learn the steps, and then use physical practice to master the tools, ensuring that when the student finally faces a real patient, they are ready for both the dance and the floor.