HERMES: Heterogeneous Edge-Relational Multi-Head Embedded SSM Attention for Traffic Conflict Prediction at Signalized Intersections
This paper proposes HERMES, a heterogeneous edge-relational graph neural network with SSM-informed multi-head attention that models vehicles and pedestrians as nodes and their interactions as relation-specific edges to achieve state-of-the-art, transferable traffic conflict prediction at signalized intersections by effectively capturing heterogeneous interaction topologies and safety-aware temporal dynamics.
Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Imagine you are watching a busy city intersection from a high-up window. Cars are zooming, turning, and stopping, while pedestrians weave through the crosswalks. To a computer, this isn't just a chaotic mess; it's a giant, moving puzzle where every piece (a car or a person) is constantly changing its mind and reacting to its neighbors. For decades, traffic safety experts have tried to predict when these pieces might crash into each other. They used to wait for the actual crash to happen and then study the wreckage, but that's like waiting for a house to burn down to learn about fire safety. Instead, they started looking for "near-misses"—those heart-pounding moments when a car slams on its brakes just inches from a pedestrian. These are called "surrogate safety measures." Think of them as the traffic world's version of a "close call" detector.
However, most old-school computer programs looked at these near-misses one pair at a time, like checking if Car A is too close to Car B, and then checking if Car C is too close to Pedestrian D, ignoring the fact that Car A's sudden stop might make Car B swerve, which then scares Pedestrian D. It was like trying to understand a complex dance by only watching two dancers at a time. This paper introduces a new, smarter way to watch the whole dance floor at once. It treats the intersection not as a list of separate pairs, but as a living, breathing web of connections where every move ripples through the crowd. The goal is simple but vital: to build a system that can spot a dangerous situation before it turns into a tragedy, without screaming "false alarm" every time someone just slows down for a red light.
The New "Traffic Detective": HERMES
Enter HERMES, a fancy name for a new kind of computer brain designed to predict traffic conflicts at signalized intersections. The researchers, Md Monzurul Islam and Subasish Das from Texas State University, built this system to solve the "flat" problem of older models. Imagine trying to describe a symphony by listing the volume of each instrument separately; you'd miss the harmony and the chaos. Old models did exactly that with traffic, flattening the scene into a boring list of numbers. HERMES, on the other hand, sees the intersection as a heterogeneous graph.
In plain English, a "graph" here is just a map of connections. HERMES draws a map where cars and pedestrians are the dots (nodes) and their interactions are the lines (edges) connecting them. But it's not just any map; it's a heterogeneous one, meaning it knows the difference between a car talking to another car, a car talking to a person, and a person talking to another person. It treats these relationships differently, just like you'd treat a conversation with your best friend differently than a chat with a stranger.
What makes HERMES truly special is how it uses "surrogate safety measures" (SSMs). These are physics-based clues like Time-to-Collision (how many seconds until a crash if no one moves) and DRAC (how hard someone has to brake to avoid a crash). Instead of just tacking these numbers onto the end of a list, HERMES bakes them right into the connections between the dots. It's like giving the computer a superpower: it doesn't just see that two cars are close; it sees that they are close and moving fast toward each other, and it knows that this specific combination is dangerous.
How It Works: The Magic of the Web
HERMES works in layers, like peeling an onion or stacking building blocks.
- The Graph Layer: It looks at a snapshot of the intersection and builds a web of connections. It pays extra attention to the "edges" (the lines between dots) that have high braking demands (high DRAC). If a car has to slam on its brakes, HERMES highlights that connection immediately.
- The Attention Layer: This is the "multi-head" part. Imagine HERMES has several pairs of glasses, each looking at the scene through a different lens. One pair might focus on speed, another on direction, and another on how close everyone is. It combines all these views to decide which interactions are the most critical.
- The Time Layer: Traffic doesn't happen in a single frozen photo; it's a movie. HERMES watches a sequence of these graphs over time (specifically, 8 frames in a row). It uses a memory system (called an LSTM) to remember how the situation evolved. Did the cars get closer? Did the pedestrian step out? By watching the story unfold, it can predict the ending before it happens.
The Results: A Near-Perfect Score
The researchers tested HERMES using over 109,000 sequences of traffic data from a busy intersection in San Marcos, Texas. They compared it against a whole team of other "detectives," including old-school statistical models (like XGBoost) and modern deep-learning models (like Transformers).
The results were impressive. HERMES didn't just win; it dominated.
- Accuracy: It achieved a score called AUC-ROC of 0.9898. In the world of prediction models, a score of 1.0 is perfect, and 0.5 is like guessing with a coin flip. HERMES was incredibly close to perfect.
- The "False Alarm" Test: This is the most important part for real-world use. If a safety system screams "CRASH!" every time a car slows down, nobody will listen to it. The researchers tested how well the models could find real dangers while keeping false alarms very low (specifically, only 5% of safe situations were wrongly flagged).
- The best previous model (a Transformer) caught about 81% of the real conflicts at this low false-alarm rate.
- HERMES caught 95.7% of the conflicts.
- That means HERMES found almost every dangerous situation while barely raising a false alarm.
They also tested if HERMES could work in a different city. They took the model trained in Texas and dropped it into an intersection in Coldwater, Michigan, without retraining it on the new data. This is called "zero-shot transfer." Even without seeing the new city, HERMES still performed remarkably well, catching 91.45% of conflicts with a 5% false-alarm rate. When they gave it just a tiny bit of data from the new city (only 20% of the training segments), its performance jumped even higher, catching nearly 98.7% of conflicts.
What It's Not (and What It Rules Out)
It's important to know what HERMES doesn't do. The paper explicitly argues against the idea that you can just look at one pair of road users (like a car and a pedestrian) in isolation to understand the risk. The study shows that looking at interactions individually or flattening the scene into a simple list of numbers misses the complex web of cause-and-effect that leads to accidents.
The paper also rules out the idea that you need a massive amount of new data from every single new location to make the system work. While adding a little bit of local data helps, the system is robust enough to work well on a new site just by learning from a different, similar site.
The Bottom Line
This paper suggests that the future of traffic safety isn't just about better cameras or faster computers; it's about better understanding. By treating traffic as a connected web of relationships rather than a list of isolated events, HERMES can see the danger coming much earlier and more accurately than ever before. It's a powerful step toward a world where intersections are safer, not because we wait for crashes to happen, but because we can spot the near-misses and fix the problem before anyone gets hurt. The authors conclude that this approach provides a solid foundation for building roadside safety monitors that are smart enough to know the difference between a scary moment and a real crash.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.