📈 economics

Bitcoin Price Direction Prediction via Regime-Aware Multi-Modal Fusion of Social Sentiment and Technical Features

This paper introduces Regime-Aware Multi-Modal Learning (RAML), a novel framework that dynamically adjusts the fusion weight of social sentiment and technical features based on detected market volatility regimes, demonstrating superior predictive performance for sub-daily Bitcoin price direction compared to static fusion methods.

Original authors: Muhammad Abdullah Haroon

Published 2026-07-28

📖 7 min read🧠 Deep dive

CC BY 4.0

Original authors: Muhammad Abdullah Haroon

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). ✨ This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

Imagine trying to predict the weather in a city where the sky changes its mind every hour, and the forecast depends on two very different things: the actual movement of clouds and the mood of the crowd shouting from the streets. This is the chaotic world of cryptocurrency, specifically Bitcoin. Unlike a steady river, Bitcoin's price is a wild, churning ocean that never sleeps, jumping up and down in ways that don't always make sense. For a long time, scientists and traders have tried to build "weather stations" for this market using two main tools. The first is technical analysis, which looks at the price history itself—like checking the water's speed and direction to guess where it's going next. The second is sentiment analysis, which listens to what people are saying on social media, assuming that if everyone is excited, the price might go up, or if they are scared, it might crash.

The big question has always been: how do you mix these two tools? Should you listen to the price charts and the crowd equally all the time? Or does the importance of the crowd's voice change depending on how stormy the market is? This is exactly what the paper "Bitcoin Price Direction Prediction via Regime-Aware Multi-Modal Fusion of Social Sentiment and Technical Features" tries to solve. The authors, led by Muhammad Abdullah Haroon, argue that treating the market like a calm lake and a raging hurricane with the same set of rules is a mistake. They propose a new, smarter way to combine these signals that adapts to the current "mood" of the market, showing that sometimes you should trust the charts, and other times, you should trust the crowd.

The Problem: One Size Does Not Fit All

Imagine you are driving a car. On a sunny, calm day, you rely mostly on the road ahead and your speedometer (the technical data). But if a sudden storm hits, with lightning and heavy rain, you might start listening more intently to the radio for traffic reports or the warnings of other drivers (the social sentiment) because the road itself is too chaotic to read clearly.

For years, computer models trying to predict Bitcoin prices have done the opposite. They take the price data and the social media feelings and just mash them together into one big pile, giving them equal weight no matter what is happening. The paper argues this is like trying to drive through a hurricane using only your speedometer. The authors suggest that in calm markets, the crowd's chatter is often just noise, but during crazy, volatile times, that same chatter becomes a powerful signal of what's about to happen next.

The Solution: The "Smart Switch" (RAML)

To fix this, the researchers built a new system called RAML (Regime-Aware Multi-Modal Learning). Think of RAML as a super-smart co-pilot for your trading car. This co-pilot has a special "switch" that constantly checks how bumpy the ride is.

The "Bumpiness" Detector: The system first looks at how much the price is jiggling over the last 24 hours. If the price is moving smoothly, it calls this a "stable regime." If the price is jumping wildly, it calls this a "volatile regime."
The Smart Switch: Once the system knows the regime, it flips a switch to decide how much to trust the social media feelings versus the price charts.
- In a Stable Regime: The switch turns down the volume on social media. The system decides, "The market is calm; the price charts are the best guide right now."
- In a Volatile Regime: The switch turns up the volume on social media. The system thinks, "Chaos is everywhere! The crowd is reacting fast, so let's listen to what they are saying on Reddit."

This isn't a manual switch the researchers flip; the computer learns how to flip it automatically by looking at millions of examples of how the market behaves.

What They Found: Smarter, Not Just Faster

The team tested their new RAML system against older, "dumb" systems that just mixed everything together. They used a massive amount of data: over 3,400 hours of Bitcoin price data from July 2024 to September 2025, paired with millions of posts from the Reddit community r/Bitcoin. They asked the models to predict if the price would go up or down in 3 hours and again in 6 hours.

Here is what they discovered:

The "Dumb" Mix Failed: The old systems that just mashed price and sentiment together performed poorly. In fact, when they tried to predict the 6-hour future, one of the old models completely gave up, predicting "down" almost all the time and failing to catch any upward moves.
The "Crowd-Only" Trap: A model that only listened to Reddit was surprisingly good at guessing "up," but it was a trick. It guessed "up" so often that it looked smart, but it was actually just guessing the most common outcome. It couldn't tell the difference between a real trend and a fake one. In fact, its "raw" score for guessing "up" was higher than RAML's, but its ability to distinguish real trends from noise was actually worse than random chance.
RAML Won the Race: The new RAML system was the only one that got it right in the most important way. It didn't just guess "up" or "down"; it balanced its predictions. It achieved the best overall score (called an F1 score of 0.5474 for the 3-hour prediction and 0.5513 for the 6-hour prediction). More importantly, it was the only model that managed to be better than a random guess on both its overall accuracy (F1) and its ability to rank probabilities correctly (AUC) at the same time. This balance is crucial for making real-world decisions.

The "Aha!" Moment: Why the Switch Matters

The researchers didn't just say "RAML works"; they proved why it works by taking the system apart, piece by piece, in a process called an "ablation study."

No Switch? When they removed the "smart switch" and forced the system to treat calm and crazy markets the same, the system's performance crashed. It became confused and started making terrible predictions, especially for the 6-hour outlook.
No Social Media? When they removed the social media part entirely, the system got worse, proving that listening to the crowd does help, but only when used correctly.
No Price Charts? When they removed the price data, the system also struggled, showing that you can't rely on social media alone.

The big takeaway is that the "switch" is the secret sauce. Without it, the two sources of information fight each other. With it, they work together like a well-coordinated team.

The Bottom Line

This paper doesn't claim to have found a magic crystal ball that predicts Bitcoin prices with 100% accuracy. In fact, the authors are very honest: predicting Bitcoin is incredibly hard, and even their best model is only slightly better than a random guess. However, they have shown that the way we build these prediction machines matters.

By realizing that the market has different "personalities" (calm vs. chaotic) and building a system that adapts to them, they created a more reliable tool. It's a reminder that in the noisy, fast-moving world of crypto, sometimes you need to listen to the charts, and sometimes you need to listen to the crowd—but the smartest move is knowing exactly when to do which.

Technical Summary: Regime-Aware Multi-Modal Fusion for Bitcoin Price Prediction

Problem Statement
Predicting Bitcoin price direction on sub-daily timescales (specifically hourly) remains a formidable challenge in computational finance due to the asset's fat-tailed return distributions, non-stationary dynamics, and susceptibility to structural breaks. A critical limitation in existing literature is the treatment of all market conditions as equivalent. Conventional multi-modal approaches statically concatenate technical features (OHLCV) and social sentiment scores, applying identical fusion weights regardless of the market state. This design contradicts behavioral finance literature, which posits that retail crowd sentiment is highly predictive during high-volatility and crisis phases but largely noisy during stable, trending periods. The paper argues that failing to modulate the reliance on sentiment based on market regime degrades both calibration and directional accuracy.

Methodology: The RAML Framework
The authors propose the Regime-Aware Multi-Modal Learning (RAML) framework, an architecture that dynamically conditions the fusion of social sentiment and technical features on a detected binary market state.

Data Construction:
- Sources: The dataset aligns hourly Bitcoin OHLCV data (via yfinance) with Reddit /r/Bitcoin sentiment scores derived from the ProsusAI/FinBERT model.
- Features:
  - Technical: 10 features including raw OHLCV, log-returns, 24-hour rolling volatility, RSI, and moving averages (7 and 30 periods).
  - Sentiment: 5 features comprising mean FinBERT composite score, bullish/bearish probabilities, sentiment strength, and post count.
- Regime Labeling: A binary regime label ( $r_t \in \{0, 1\}$ ) is assigned based on whether the 24-hour rolling volatility exceeds the global median. This partitions the data into "stable" and "volatile" regimes.
- Target: Binary classification for price direction at 3-hour and 6-hour horizons.
Architecture:
- Dual Branches: The model employs two parallel, symmetric branches.
  - Price Branch: A two-layer Bidirectional LSTM (BiLSTM) processes the 24-hour technical sequence, outputting a 32-dimensional embedding.
  - Sentiment Branch: An identical BiLSTM processes the 24-hour sentiment sequence, outputting a 32-dimensional embedding.
- Adaptive Fusion Gate: The core innovation is a learnable sigmoid gate that dynamically adjusts the weight of the sentiment embedding relative to the price embedding based on the regime label.
  - Formula: $w_t = \sigma(\theta_r \cdot r_t)$ , where $\theta_r$ is a single learnable scalar and $r_t$ is the binary regime.
  - Fused Embedding: $e^{(fused)}_t = w_t \cdot e^{(s)}_t + (1 - w_t) \cdot e^{(p)}_t$ .
  - Mechanism: During volatile regimes ( $r_t=1$ ), the gate upweights the sentiment branch; during stable regimes ( $r_t=0$ ), it defaults to equal weighting (where the stronger price signal naturally dominates).
- Classification: The fused embedding passes through a feedforward network to predict the probability of an upward price move.

Key Contributions

Regime-Aware Fusion Architecture: A principled, interpretable adaptive gate that conditions multi-modal weighting on a volatility-derived signal without requiring additional labeled data.
Reproducible Hourly Pipeline: A complete data pipeline aligning 14 months of hourly OHLCV data with FinBERT sentiment scores, covering diverse market phases (bull, bear, consolidation).
Systematic Ablation Study: A rigorous evaluation isolating the contributions of the sentiment branch, the regime gate, and the adaptive weighting mechanism.
Honest Calibration Benchmark: An empirical characterization of performance limits on hourly Bitcoin data, acknowledging the near-efficient nature of the market at this timescale.

Experimental Results
The model was evaluated on 1,345 held-out hourly observations (July–September 2025), a period of elevated volatility distinct from the training distribution.

Performance: RAML achieved the highest Macro-F1 scores on both horizons (0.5474 at 3h; 0.5513 at 6h) and the highest AUC on the 3-hour task (0.5084).
Baseline Comparisons:
- Price-only (B1): Performed near random, suffering from recall collapse on the 6-hour horizon.
- Sentiment-only (B2): Achieved high F1 via a degenerate strategy of predicting "up" almost universally, resulting in poor AUC (below 0.5).
- Static Concatenation (B3): Failed to improve upon sentiment-only on the 3-hour task and exhibited severe recall collapse on the 6-hour task when compared to RAML.
Ablation Insights:
- Removing the sentiment branch caused significant performance drops, particularly on the 6-hour horizon.
- Removing the regime gate (replacing with fixed weights) led to a return to majority-class bias, inflating recall but destroying AUC.
- Replacing adaptive weighting with static concatenation caused catastrophic failure (F1 dropped to 0.14 on the 6-hour task), proving that the fusion mechanism itself is critical.

Significance and Claims
The paper claims that RAML establishes regime-conditioned adaptive fusion as a necessary design principle for multi-modal financial forecasting. The results demonstrate that:

Context Matters: The predictive value of social sentiment is not static; it is regime-dependent. Trusting sentiment during volatility and technicals during stability yields superior calibration.
Efficiency: The adaptive gate adds only one learnable parameter and zero inference latency compared to static baselines, yet prevents the "catastrophic recall collapse" observed in naive fusion methods.
Realistic Expectations: The authors emphasize that the modest absolute performance values (e.g., AUC ~0.51) reflect the genuine difficulty of predicting hourly Bitcoin prices in a near-efficient market. The value lies in the statistically non-trivial departure from a random walk and the robustness of the calibration, rather than inflated accuracy metrics often found in prior literature with data leakage or daily horizons.

The work concludes that future multi-modal financial models should condition on interpretable market state signals rather than applying fixed fusion weights across heterogeneous conditions.