A Theory of Partial Truth for Scientific Statements
This paper proposes a restricted formal framework for quantifying the partial factual truth of scientific statements by evaluating the normalized discrepancies of their components against empirical evidence, thereby allowing for the assessment of models that contain both accurate and inaccurate elements without conflating factual adequacy with confidence or convergence to complete truth.
Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written by the author. For technical accuracy, refer to the original paper. Read full disclaimer
Science often relies on descriptions that are not perfectly true, yet they work remarkably well. Think of a map that leaves out small side streets to show the main highways clearly; it is technically inaccurate because it omits details, but it is incredibly useful for navigation. In physics and astronomy, scientists use similar "maps" of reality. They describe stars as points, surfaces as perfectly smooth, or populations as infinite numbers. These descriptions are strictly speaking false because the real world is messier, but they capture the essential behavior of systems with enough accuracy to make predictions and drive progress. For a long time, the standard way to judge these scientific statements has been a simple "yes or no" question: is the statement true or is it false? This binary approach, however, hides the nuance of how science actually works. It treats a model that is 90% accurate the same as one that is 10% accurate, simply because neither is perfect. It fails to explain how a theory can be false yet still lead to genuine discovery.
A new paper by Gustavo E. Romero, a researcher at the Argentine Institute of Radio Astronomy, proposes a way to measure the "partial truth" of scientific statements. Instead of asking if a claim is simply right or wrong, the paper offers a method to estimate how well a claim fits the facts, even when it contains errors. The core idea is that scientific progress is not about finding a single, perfect description of the universe, but about building representations that become increasingly adequate for the specific problems we are trying to solve. This approach allows scientists to say that a statement is "mostly right" in a precise, numerical way, distinguishing between a small, harmless error and a major flaw, without confusing this measurement with the probability that the statement is true.
The paper begins by clarifying what exactly is being measured. It distinguishes between the physical statement itself—the words written on a page or spoken aloud—and the proposition, which is the actual meaning or claim being made. The goal is to evaluate the factual adequacy of that meaning against a body of evidence. This evidence consists of controlled observations and experiments, such as measurements of a star's brightness or the resistance of an electrical wire. The author argues that we must separate the question of "how confident are we in this data?" from "how well does this claim match the data?" A claim can be very close to the measured facts even if the measurement itself has some uncertainty, and the new framework is designed to capture that closeness.
To do this, the paper introduces a system for assigning a score between zero and one to any scientific claim. A score of one represents the maximum possible adequacy given the current evidence, while zero represents a complete mismatch. For claims involving numbers, such as "the mass of this star is 100 times the mass of the sun," the score is calculated by looking at the difference between the claimed number and the number supported by observation. If the claimed number is very close to the observed number, the score is high. If it is far away, the score drops. The paper specifies that this difference is measured relative to a scale appropriate for the problem, ensuring that a small error in a large number is treated fairly compared to a small error in a tiny number.
A crucial part of the new method is how it handles complex statements that are made up of several smaller claims. Imagine a scientific model that makes three predictions: one about temperature, one about pressure, and one about the shape of a container. If the model gets the temperature and pressure right but gets the shape wrong, a simple "true or false" system would label the entire model as false. The new framework, however, allows the model to retain a high score because the accurate parts still contribute value. The paper shows that by averaging the scores of the individual parts, weighted by how important each part is to the specific question being asked, we can get a fair assessment of the whole. For instance, if a model is being tested for its ability to predict electrical resistance, claims about the color of the wire or the temperature of the lab are irrelevant. The new system ignores these irrelevant details, ensuring that a model isn't unfairly penalized for getting unimportant things right or wrong.
The author demonstrates this method with concrete examples, including a hypothetical assessment of electrical resistance and a real-world application involving a massive star called Zeta Puppis. In the star example, researchers had previously estimated the rate at which the star loses mass based on X-ray observations. The paper takes a specific claim about this rate and compares it to the observed data. Even though the claimed rate was slightly different from the observed rate, the new method assigns it a high score of about 0.86, indicating that it is a very good approximation of reality. This score is not a guess about the likelihood of the claim being true; it is a direct measure of how well the claim aligns with the evidence, taking into account the known limitations of the measurements.
The paper also addresses potential pitfalls in this kind of measurement. It warns that the score depends heavily on how the problem is defined and which parts of a model are considered important. If a scientist changes the scale of measurement or decides that a different part of the model is more critical, the score can change. The author is careful to state that this does not mean the facts have changed, but rather that the assessment criteria have shifted. The method is designed to be transparent about these choices, requiring scientists to explicitly state what they are measuring and how they are weighing the different pieces of evidence. This prevents the scores from being misleading or arbitrary.
Ultimately, the paper offers a tool for a more honest and nuanced view of scientific progress. It suggests that we should stop thinking of science as a journey toward a single, perfect truth that we will eventually reach. Instead, science is a process of refining our descriptions, making them more adequate for the specific questions we need to answer. A theory can be "partially true" in a way that is mathematically precise, allowing us to see exactly where it succeeds and where it fails. This approach respects the fact that scientific models are always approximations, but it also gives us a way to measure how good those approximations are. By distinguishing between the accuracy of a claim and the confidence we have in it, and by weighing the importance of different parts of a theory, the new framework helps us understand how science moves forward, even when it is not yet perfect.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.