GazePrinter: Visualizing Expert Gaze to Guide Novices in a New Codebase
This paper introduces GazePrinter, a tool that visualizes expert gaze patterns to guide novices through new codebases, and demonstrates through a mixed-methods study with 40 participants that this approach helps novices follow expert-like navigation paths while potentially reducing their time and cognitive load.
Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Imagine you've just moved to a massive, sprawling city (a new codebase) and you need to find a specific building to fix a broken window. You have a map, but the city is huge, with thousands of streets, confusing alleyways, and buildings that look identical. You're a tourist (a novice), and you don't know the shortcuts.
Now, imagine you have a pair of magic glasses (the tool GazePrinter) that show you exactly where a local expert looked when they visited this city before. The glasses don't tell you what to do; they just highlight the path the expert took, glowing brighter on the streets they walked down and dimmer on the dead ends they ignored.
This paper is about testing if wearing these "magic glasses" helps tourists navigate the city faster and with less stress.
The Problem: The "Overwhelmed Tourist"
Learning to read a new computer program is like trying to read a library of books you've never seen before.
- The Challenge: Professional developers often struggle with this, but for students or new hires, it's terrifying. They don't know where to start. Do they read the front door first? The basement? The attic?
- The Current Tools: We have maps (documentation) and guides (tutorials), but they are static. They don't show you how an expert thinks or where their eyes naturally go when they are trying to understand something.
The Solution: GazePrinter (The "Ghost Guide")
The researchers built a tool called GazePrinter. Here is how it works:
- The Experts: They asked five experienced software engineers to look at a specific codebase (a Library Management System) while wearing eye-tracking glasses. The system recorded exactly where they looked, how long they stared at specific lines of code, and in what order they opened files.
- The Map: They turned this eye-tracking data into a visual "heat map."
- The Tourist: They gave this heat map to 40 students (the novices) who were trying to solve problems in the same codebase.
- The Control Group: Got a normal computer screen.
- The Experiment Group: Got the screen with the "Ghost Guide" overlay. It highlighted the top 10 files the experts looked at, and showed glowing bars next to code lines that experts stared at the most.
The Experiment: Two Cities, Two Tasks
The students had to do two tasks:
- Task 1 (The Warm-up): Fix a few bugs in the Library System. The "Experiment Group" had the magic glasses; the "Control Group" did not.
- Task 2 (The Test): Fix bugs in a different, slightly larger system (an E-commerce store). Crucially, the magic glasses were turned off for everyone.
The researchers wanted to see:
- Did the glasses help them finish faster?
- Did they make fewer mistakes?
- Did they feel less stressed (cognitive load)?
- Most importantly: Did the students who used the glasses learn how to read code better, so that even when the glasses were gone in Task 2, they still read like experts?
The Results: What Happened?
1. The "Path" Changed (The Big Win)
The most interesting finding was about where they looked.
- Without glasses: The students wandered aimlessly. They opened almost every file, like a tourist checking every single shop window in the city.
- With glasses: The students followed the "Ghost Guide." They skipped the irrelevant files and went straight to the important ones, just like the experts.
- The Transfer: Even in Task 2 (when the glasses were gone), the students who had used the glasses in Task 1 kept reading in that efficient, expert-like pattern. They had "learned the route."
2. Speed and Mistakes (The Surprise)
Surprisingly, the students with the glasses did not finish the tasks significantly faster, nor did they make significantly fewer errors than the group without glasses.
- Why? The researchers think the "magic glasses" helped them focus their attention, but they still had to do the hard mental work of understanding the code. The glasses didn't do the thinking for them; they just pointed the way.
3. The Feeling (The Hidden Benefit)
While they didn't finish faster, the students with the glasses reported feeling less stressed and more confident. They felt like they had a safety net. They didn't feel as lost in the dark.
The Takeaway: Why This Matters
Think of this like teaching someone to drive.
- Old way: You tell them, "Just drive carefully." (This is like giving them a manual).
- GazePrinter way: You sit in the passenger seat and point out, "Look at the stop sign here, look at the pedestrian crossing there."
The study shows that showing novices where experts look is a powerful way to teach them how to navigate complex code. It doesn't instantly make them geniuses, but it stops them from getting lost in the weeds. It helps them build a "mental map" of how to approach a new system.
In simple terms:
If you are a beginner trying to learn a new programming language, you might feel like you're staring at a wall of text. This research suggests that if you could see a "highlight reel" of where a pro looked first, you would stop panicking, skip the boring parts, and learn the right way to think about the code much faster. It's not about giving you the answers; it's about showing you where to look so you can find the answers yourself.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.