Secrets Everywhere: Auditing Memorization in Mobility Prediction Models
This paper presents the first systematic audit of memorization in human mobility prediction models, introducing a multi-granularity framework to quantify how these models expose sensitive user trajectories and revealing pervasive privacy risks that correlate with user regularity.
Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Imagine your daily life as a giant, invisible storybook. Every time you walk to school, grab coffee, or head home, you're writing a new chapter in a book that only you have read. For a long time, scientists have been trying to build "super-readers"—computer programs that can guess what you'll do next based on your past chapters. These programs are called mobility prediction models. They are the brains behind your GPS suggesting the fastest route or apps recommending a restaurant near your office. But here's the twist: just like a student who memorizes a textbook word-for-word instead of understanding the story, these computer programs sometimes get too good at remembering. They don't just learn the general rules of how people move; they accidentally memorize your exact path, your secret hangouts, and your daily routine. This is called memorization. It's a big deal because if a computer remembers your specific story too well, a sneaky hacker could ask the computer, "What happens after you leave work?" and the computer might spit out your exact home address, thinking it's just being helpful.
This paper, titled "Secrets Everywhere," is like a detective story where the authors go undercover to audit these super-readers. They wanted to find out: Do these models really memorize our secrets, and if so, whose secrets are they keeping? The researchers discovered that these models are indeed hoarding our private movements, but not in the way we thought. It turns out that the more boring and routine your day is, the more likely the computer is to memorize it. If you are a "scouter" who wanders all over the city, the computer forgets you. But if you are a "routiner" who goes to the same gym at the same time every day, the computer remembers your every step with frightening precision. The authors also found that the old way of checking for these secrets didn't work for location data, so they invented a new set of tools to measure exactly how much of your life the computer is stealing.
The Detective's Toolkit: Why Old Rules Didn't Work
To understand the paper's big discovery, we first need to look at how scientists usually check for memorization. In the world of language models (like the ones that write essays or chat with you), researchers use a trick called "exposure." They sneak a fake, random sentence—like a made-up phone number—into the training data. If the computer later spits out that exact fake number when asked, it's a sign the computer memorized it. This works because a fake phone number is nonsense; the computer shouldn't know it unless it memorized it.
But the authors realized this trick fails miserably for human movement. Why? Because in the real world, there are no "fake" movements. Every path a person takes is real, and every path is sensitive. You can't just invent a random "secret" path to test a model because a random path might look like nonsense to the computer, making it easy to tell the difference. The real danger is that the computer memorizes real paths that look perfectly normal. The authors argue that for mobility models, the "secrets" are the very things the model is supposed to learn to be good at predicting. It's like a teacher who is supposed to learn the rules of grammar but accidentally memorizes your specific diary entry instead.
The New Framework: Measuring the "Memory Leak"
To solve this, the authors built a new framework to audit these models. Instead of looking for fake secrets, they created a system to see if the model prefers your specific path over other paths that look similar. They broke this down into three levels of "leakage":
- Location Memorization: Does the model remember the exact coordinates of your house?
- Anchor-Pair Memorization: Does it remember the specific link between your home and your workplace?
- Segment Memorization: Does it remember the tiny, specific route you take to get from the bus stop to the coffee shop?
To test this, they didn't just guess. They built "reference sets." Imagine you are the model, and you are shown a picture of your daily route. Then, you are shown 100 other pictures of routes that look almost the same (same distance, same time of day) but belong to different people. If you, the model, say, "Oh, I know this one perfectly!" and give it a much higher confidence score than the other 99, you have memorized it.
The Findings: The Boring Are the Most Vulnerable
The researchers tested their new tools on three massive datasets containing millions of movement records from people in Shanghai, Shenzhen, and Japan. They trained several different types of models, from simple ones to complex deep-learning systems. Here is what they found:
1. Memorization is Everywhere:
The models were definitely memorizing. In some cases, up to 85% of the training paths showed strong signs of memorization. This wasn't just a few outliers; it was a widespread problem. Even models that were very good at predicting the next location (with accuracy sometimes over 90%) were still secretly storing the exact details of the paths they learned.
2. The "Routiner" Paradox:
The most surprising finding was who got memorized. The authors grouped users into three types:
- Routiners: People with very predictable, repetitive lives (high stationarity, low diversity).
- Regulars: People with some routine but some variety.
- Scouters: People who wander a lot and have unpredictable paths.
The models loved the Routiners. In fact, 99.4% of the trajectories in one dataset showed positive memorization signals, and these were mostly the predictable users. The models found it easy to learn the pattern of a person who goes to the same place every day, so they stored the exact details. Conversely, the Scouters were much harder to memorize. Their paths were too chaotic, so the models had to generalize (learn the general idea) rather than memorize the specific details.
3. The "Anchor" Effect:
The models were particularly good at remembering "anchor pairs"—the connection between two key places, like home and work. If you know where someone lives, the model could often predict exactly where they work, and vice versa, because it had memorized that specific pair.
4. Small Changes, Big Differences:
The authors also found that the design of the model mattered. For example, they tested a model called Graph-Flashback, which had very small "memory" (only 10 units of hidden state). You might think a small model would forget things, but it actually showed a massive "tail" of memorization, with some exposure scores reaching 469.15. This suggests that even simple models can be dangerous if they aren't designed carefully.
The Real Danger: It's Easy to Steal the Secrets
Finally, the paper asked the scary question: "If the model memorized it, can a hacker actually steal it?" They simulated an attacker who knew a little bit about a person's day (like their morning routine) and tried to guess the rest. They found a clear link: the more the model had memorized a path (measured by their "magnitude" score), the easier it was for the attacker to reconstruct the whole journey.
In one experiment, they found that for users with high memorization scores, the attacker needed far fewer guesses to figure out the rest of the day. It's like if a thief knows you always leave your house at 8:00 AM and walk to the same bakery; they don't need to guess where you are going next. The model's "memory" gave the thief the answer.
The Bottom Line
This paper doesn't just say "privacy is important." It provides the first systematic way to measure how much privacy is being lost in mobility apps. The authors conclude that memorization is not a bug; it's a feature of how these models learn, and it happens most to the people with the most predictable lives. They suggest that before we deploy these models in the real world, we need to run these new "privacy audits" to see which users are at risk. If we don't, we might be handing our daily secrets to computers that are too eager to remember them.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.