← Latest papers
🤖 machine learning

Forecasting Multiple Observables with SCROLL: Score-Trained Uncertainty for Stochastic Dynamics

The paper introduces SCROLL, a score-trained uncertainty framework that composes per-task likelihoods via free-routed last-layer beliefs on a shared backbone to efficiently forecast multiple observables in stochastic dynamical systems, achieving state-of-the-art calibration and accuracy on both synthetic and real-world data without the computational cost of extensive hyperparameter tuning.

Original authors: Pavel Prochazka

Published 2026-08-27
📖 7 min read🧠 Deep dive

Original authors: Pavel Prochazka

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

Predicting the future of a chaotic system, like the swirling path of a storm or the fluctuating level of air pollution, rarely yields a single number. A forecaster is usually asked for a whole set of possibilities: where the system will be in an hour, whether it will cross a dangerous threshold, or what broad category of weather it has entered. Each of these questions carries its own uncertainty, and answering them together is a classic challenge in machine learning. Traditionally, researchers have treated these questions as separate tasks that must be balanced against one another, often by manually adjusting the importance of each question until the computer produces a satisfactory result. This balancing act is difficult because the questions are measured in different units; a small error in a temperature reading is not the same as a small error in a probability. If the weights are not set perfectly, the system might ignore a critical warning to focus on a trivial detail, or it might waste effort trying to be precise about something that is inherently unpredictable.

A researcher has proposed a new way to handle this problem, one that removes the need for manual balancing entirely. Instead of forcing the computer to choose between competing goals, they designed a system where each question keeps its own natural scale and its own way of measuring uncertainty. The method, which they call SCROLL, allows the computer to learn the importance of each task automatically while it learns the patterns in the data. They tested this approach on mathematical models of chaotic systems and on real-world air quality data. They found that the new method could predict not just the future state of the system, but also how uncertain that prediction was, with a level of accuracy that matched the theoretical best possible outcome. Crucially, it did this without the expensive trial-and-error tuning that usually plagues such systems, and it remained reliable even when the data changed drastically in scale.

The core of the problem lies in how machines learn to predict. When a computer tries to forecast a stochastic, or randomly fluctuating, system, it builds a shared understanding of the data—a common backbone—that it then uses to answer specific questions. In the old way of doing things, the computer would try to minimize the errors for every question at once by adding them up into a single score. To make this work, researchers had to decide how much weight to give to each question. Should the error in predicting a temperature count for more than the error in predicting a storm warning? They usually found the answer by running the computer thousands of times with different settings, a process that is slow and expensive. Furthermore, this method had a hidden flaw: if the questions were measured in different units, the computer could not easily adjust for that difference without constant human intervention.

The new approach changes the rules of the game. Instead of adding the errors together, the researcher let each question speak in its own language. They gave every task its own specific model for how it observes the world and its own internal measure of confidence. These individual models are then connected to the shared backbone, but they are not forced to compromise. The system learns to route the information freely, allowing the uncertainty of each task to adjust itself based on the specific conditions of the data. This means the computer can learn that a certain type of weather is inherently more unpredictable than another, and it will widen its confidence interval accordingly, without being told to do so. The method effectively absorbs the differences in scale into the learning process itself, turning a complex balancing act into a single, smooth calculation.

To see if this idea worked in practice, the researcher tested it on three different scenarios. The first was a well-understood mathematical system called the Ornstein-Uhlenbeck process. In this case, the true behavior of the system was known exactly, allowing the researcher to check their results against a perfect answer. They found that the new method recovered the exact mathematical pattern of uncertainty, proving that it could learn the correct behavior when the answer was known. The second test was a more chaotic system, a variation of the famous Lorenz equations, where the uncertainty changes depending on the current state of the system. Here, the new method successfully tracked how the unpredictability of the system grew and shrank, whereas older methods that did not use this flexible routing failed to capture these changes. The third test involved real-world data: hourly measurements of fine particulate matter in Beijing. On this real data, the new method produced the most accurate forecasts for both the pollution levels and the likelihood of dangerous thresholds being crossed, outperforming other methods that required extensive manual tuning.

One of the most striking findings was how the method handled the scale of the data. In many forecasting problems, if you change the units of measurement—for example, measuring temperature in Fahrenheit instead of Celsius, or pollution in different units—the old methods would break down or require the weights to be re-tuned from scratch. The new method, however, remained stable. It adjusted its internal parameters to match the new scale automatically, maintaining the same level of accuracy without any human intervention. This property, known as scale equivariance, means the system is robust to the arbitrary choices of how data is presented. The researcher also showed that the method could learn the correct level of uncertainty even when the data was noisy, and that it did not invent false patterns of uncertainty where none existed.

The study also explored what happens when the different tasks compete for the computer's attention. In some cases, the tasks were so closely related that helping one automatically helped the others. In other cases, the tasks were in conflict, and the system had to find a compromise. The researcher found that the new method handled these conflicts gracefully, often finding a solution that was as good as the best possible compromise found by the old, heavily tuned methods, but in a fraction of the time. They also tested whether the system could learn different levels of confidence for different tasks, and found that it could do so automatically, without needing a separate tuning process for each one.

The results suggest that the key to better forecasting is not just having more data or more powerful computers, but having a better way to combine different types of questions. By letting each question keep its own natural scale and its own measure of uncertainty, the system can learn a more complete picture of the future. The researcher demonstrated that this approach works not only on simple mathematical models where the answer is known, but also on complex, real-world data where the answer is uncertain. They showed that the method is faster, more accurate, and more reliable than the traditional ways of balancing multiple tasks. While the study was limited to a small number of tasks and specific types of data, the principles it uncovered offer a promising path forward for building forecasting systems that are both precise and honest about their own uncertainty. The work proves that it is possible to teach a machine to weigh its own doubts correctly, without needing a human to hold the scale.

Drowning in papers in your field?

Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.

Try Digest →