🤖 machine learning

Predicting Post Virality with Temporal Cross-Attention over Trend Signals

This paper introduces ViralityNet, a novel architecture that enhances the prediction of Reddit post virality by fusing internal post features with exogenous temporal signals from Wikipedia pageview spikes via a temporal cross-attention mechanism, demonstrating that incorporating real-world attention dynamics significantly outperforms text-only baselines.

Original authors: Sarvagya Somvanshi, Mohan Xu, Rakhi Chadalavada, Nathan Canera

Published 2026-05-06

📖 5 min read🧠 Deep dive

CC BY 4.0

Original authors: Sarvagya Somvanshi, Mohan Xu, Rakhi Chadalavada, Nathan Canera

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). ✨ This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

Imagine you are trying to guess which of your friends' social media posts will go "viral"—getting thousands of likes and comments—versus which ones will get ignored.

Most computer programs try to solve this by looking only at the post itself. They read the title, count the words, check if it was posted on a Friday, and see how many followers the user has. It's like trying to predict if a song will be a hit just by reading the lyrics, without ever hearing the radio or knowing what people are currently singing about.

This paper argues that this approach misses a huge piece of the puzzle: timing and context. A post about a specific topic might be boring on a random Tuesday, but if that same topic is suddenly the biggest news story in the world, that post could explode in popularity.

Here is how the authors, Sarvagya Somvanshi and Mohan Xu, built a new system called ViralityNet to fix this, explained simply:

1. The "Weather Report" of the Internet

The authors realized that to predict virality, you need to know what the "public mood" is at that exact moment. To do this, they used Wikipedia page views as a "weather report" for internet attention.

The Analogy: Imagine you are a fisherman. You can look at your boat (the post) and your fishing gear (the text), but to catch a big fish, you need to know where the fish are right now.
The Method: They tracked which Wikipedia articles were getting a sudden, massive spike in views every day. If "Artificial Intelligence" suddenly had 100,000 more views than usual, it meant the whole world was suddenly obsessed with AI. ViralityNet uses this data to see if a Reddit post is "surfing the wave" of current public interest.

2. The "Super-Reader" (The Architecture)

They built a neural network (a type of AI) named ViralityNet. Think of it as a super-reader that looks at a Reddit post through four different lenses at the same time:

The Title: What does the headline say?
The Body: What is the actual story?
The Structure: When was it posted? How long is it?
The Community: Which "club" (subreddit) is it in? (e.g., a post in a finance club is judged differently than one in a gaming club).

The Secret Sauce:
Usually, these four lenses just get mixed together. But ViralityNet has a special "Cross-Attention" feature.

The Analogy: Imagine you are reading a news article. As you read, you constantly glance out the window to see what's happening in the street. If you see a parade, you pay extra attention to the part of the article about the parade.
How it works: ViralityNet reads the Reddit post, then immediately glances at a "sliding window" of the top 512 trending Wikipedia topics from the last week. It asks: "Does this post match what the world is currently talking about?" If the answer is yes, it boosts the prediction that the post will go viral.

3. How They Measured Success

They tested this on nearly 800,000 Reddit posts from 10 different communities (like r/technology, r/politics, and r/gaming) over three years.

The Goal: Predict if a post would be in the top 10% of engagement for its specific community.
The Result:
- The old way (looking only at the text) was okay, but not great.
- The new way (ViralityNet), which included the "Wikipedia weather report," was consistently better.
- It improved the accuracy by a small but meaningful margin. The system learned that a post about a stock market crash is much more likely to go viral if people are currently searching for that stock on Wikipedia.

4. Important Nuances

The paper highlights a few interesting details:

Context Matters: The system worked best in communities where the outside world matters (like r/technology or r/stocks). It struggled a bit more in communities driven by inside jokes or specific culture (like r/gaming), where the "global weather" matters less than the "local vibe."
Time is Key: The system learned that engagement norms change from year to year. A post that gets 1,000 upvotes in 2021 might be considered "viral," while in 2023, you might need 5,000. The model learned to adjust for this.
It's Not Magic: The system isn't perfect. It sometimes gets fooled. For example, if a post has a title that sounds like a trending topic but is actually a joke or low-quality content, the system might over-predict its success. Conversely, it sometimes misses posts that go viral because of pure humor or anger, which has nothing to do with current news trends.

The Bottom Line

The main takeaway is simple: Content doesn't go viral in a vacuum.

To predict what will catch fire, you can't just look at the wood (the post); you have to look at the wind (the current public attention). By combining the text of a post with real-time data on what the world is actually reading and thinking about, the authors showed that we can make significantly better predictions about what will become popular online.

Technical Summary: Predicting Post Virality with Temporal Cross-Attention over Trend Signals

Problem Statement

Current models for predicting social media virality predominantly rely on static textual and structural features (e.g., follower counts, posting time, network centrality, and text semantics). A critical limitation of these approaches is their "temporal blindness": they fail to account for the dynamic nature of public attention. A post about a specific topic may have vastly different viral potential depending on whether that topic is currently spiking in public interest or has been dormant. The authors hypothesize that ignoring these temporal dynamics leads to mischaracterized engagement drivers and reduced predictive accuracy. The core problem addressed is whether real-world, exogenous attention signals can improve virality prediction beyond what post text alone reveals.

Methodology

Data and Labeling

The study utilizes a dataset of 788,873 Reddit posts from 10 diverse subreddits (spanning news, technology, finance, science, and entertainment) collected between January 2021 and December 2023.

Virality Definition: Virality is defined via a subreddit-stratified binary labeling strategy to account for scale differences across communities. A post is labeled viral ( $y=1$ ) if its engagement score $v$ exceeds the 90th percentile of its subreddit's distribution AND its raw score $s$ meets a minimum threshold of 100.
Engagement Score: $v = s + 0.3 \cdot c$ , where $s$ is the post score (upvotes minus downvotes) and $c$ is the comment count. The weight $\beta=0.3$ reflects the higher effort of commenting compared to voting.
Exogenous Signals: The model incorporates Wikipedia pageview data as a proxy for collective public interest. "Spike" terms are identified daily based on a ratio of current views to previous day views ( $\rho \ge 2.0$ ) and absolute view increases. The top 512 trending terms per day are retained, filtered for noise (e.g., evergreen pages), and encoded.

Architecture: ViralityNet

ViralityNet is a cross-attention architecture designed to fuse internal post representations with external temporal trend signals.

Post Encoder: Generates a 256-dimensional post representation ( $p$ ) by fusing four parallel streams:
- Title & Body: Encoded using all-mpnet-base-v2 (768-dimensional). Body text is chunked (400 chars), mean-pooled, and renormalized. A learned padding embedding handles posts without body text.
- Structural Features: 9 features (posting hour, day of week, log-normalized age/lengths, subreddit size, etc.) projected to 64 dimensions.
- Subreddit Embedding: A learned 32-dimensional embedding for the specific subreddit.
- Fusion: These streams are concatenated (1632 dimensions), projected to 256 dimensions, and fused with a learned year embedding ( $e_y$ ) via a residual connection to account for year-on-year shifts in engagement norms.
Cross-Attention Block:
- Trends Matrix ( $T_d$ ): A sliding 7-day window of the top 512 Wikipedia spike terms is constructed for each day $d$ . These terms are encoded into a $512 \times 768$ matrix.
- Mechanism: The post encoding $p$ acts as a single-token query ( $Q$ ) against the trends matrix keys and values ( $K, V$ ). A 4-head multi-head attention mechanism (MHA) allows the model to selectively attend to the subset of recent public-interest topics most semantically aligned with the post content.
- Output: The resulting context vector $c$ (256 dimensions) captures the alignment between the post and current trends.
Classifier: The concatenation of the post encoding and context vector ( $[p; c]$ ) is passed through a Multi-Layer Perceptron (MLP) with two hidden layers to produce a viral logit. The model is trained using Focal Loss ( $\alpha=0.25, \gamma=2.0$ ) to address the severe class imbalance (9.7% positive rate).

Key Contributions

Trend Alignment Signal: Introduction of a post-level trend alignment signal derived from Wikipedia pageview spikes, demonstrated to be statistically significant at the individual post level.
ViralityNet Architecture: A novel cross-attention architecture that conditions post representations on daily sliding-window trend matrices, augmented with learned year and subreddit embeddings.
Systematic Ablation: A study disentangling the contributions of temporal context (year embeddings), exogenous trends (cross-attention), and their combination.

Results

The model was evaluated on a held-out test set of 118,331 posts (11,459 viral). The primary metric is AUC-PR, with AUC-ROC and F1 reported at a fixed threshold of 0.31 (optimized for F1).

Performance Gains: The full ViralityNet model achieved an AUC-PR of 0.3584 and an AUC-ROC of 0.8355.
Comparison to Baselines:
- Text Only: AUC-PR 0.3431.
- Text + Year: AUC-PR 0.3554 (+0.012 improvement).
- Text + Trends: AUC-PR 0.3476 (+0.005 improvement).
- Full Model: AUC-PR 0.3584 (+0.015 improvement over Text Only).
Component Analysis: The year embedding contributed the most significant gain (+0.012), attributed to shifting engagement norms across 2021–2023. The trend cross-attention provided a smaller but consistent complementary gain (+0.003 over the Text+Year baseline).
Subreddit Variance: Performance varied by community. Subreddits with strong topical overlap with Wikipedia trends (e.g., r/technology, r/stocks) saw the highest AUC-PR (>0.39). Communities driven by internal culture (e.g., r/gaming, r/wallstreetbets) were more challenging to predict using external signals.
Threshold Sensitivity: Due to class imbalance, the default 0.5 threshold yielded low recall (2.7%). Lowering the threshold to 0.31 improved recall to 53.0% with a precision of 31.9%, suitable for surfacing candidate viral posts for review.

Significance and Claims

The paper claims that incorporating external attention signals yields measurable improvements over text-only baselines, validating the hypothesis that virality is not determined by content alone but by its alignment with real-world dynamics.

Evidence of Alignment: The results suggest that posts semantically aligned with contemporaneous spikes in public attention are measurably more likely to go viral.
Complementarity: Exogenous signals (Wikipedia trends) act as a useful complement to in-platform features, particularly in communities where virality is driven by external events rather than internal culture.
Modest but Consistent: The authors characterize the gains as "modest but consistent," noting that while the trend signal alone is not a dominant factor compared to temporal context (year), it drives the full model to its highest performance.
Limitations: The authors explicitly note that the model measures contemporaneous alignment, not forward forecasting. They acknowledge limitations regarding the static nature of the engagement data (lack of early velocity), the heuristic design of the pipeline, and the potential generalizability issues due to the specific subreddit selection. They also highlight the broader impact concern that such predictive capabilities could theoretically be misused for optimizing the spread of polarized content or spam.