Bridging evidence and practice through evaluative judgement
This paper argues that evaluative judgement serves as the critical bridge between evidence and practice, identifying four key explicative practices—illumination, introspection, intermediation, and interrogation—that enable individuals to form wise, defensible decisions across diverse domains.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
We live in an age where facts are more accessible than ever before. Scientists can sequence genomes, economists can model global markets, and engineers can simulate the climate of a thousand years from now. Yet, having the facts does not automatically tell us what to do with them. A doctor may have the latest data on a virus, but deciding which hospital beds to prioritize requires a choice about what matters most. A policy-maker may have a perfect forecast of a flood, but deciding whether to evacuate a town involves weighing safety against economic disruption. This gap between knowing what is true and deciding what ought to be done has long troubled philosophers. It is the difference between describing a situation and prescribing a solution. While evidence tells us the state of the world, it does not, on its own, tell us how to navigate it. Bridging this gap requires a human skill that is often overlooked: the ability to make a judgment about what is valuable, important, or right in a specific situation.
Researchers Venessa Lee Wells and Simon Burgess from the University of New England set out to understand how people actually perform this difficult task. They were interested in the moment when raw information is transformed into a decision. To do this, they did not look at computer algorithms or statistical models. Instead, they looked at people. They conducted a small study involving fifteen leaders, information providers, and experts from various fields in Australia, including health, the arts, and community safety. These participants were asked to talk through their thought processes as they considered real-world scenarios, such as deciding which information was "good" or "important" for a strategic decision. The researchers recorded these conversations and analyzed them to find patterns in how these professionals moved from data to action.
The study revealed that these professionals do not simply follow a checklist. Instead, they engage in a set of four distinct activities that the researchers call "explicative practices." These are not rigid steps but rather fluid ways of thinking and interacting that help people clarify what matters. The first activity is illumination. This is the act of noticing that a word or a piece of data might mean different things to different people. For example, if a report says a result is "significant," a scientist might mean it is statistically rare, while a manager might mean it is financially important. Illumination is the practice of stepping back to see the context in which these words are used, realizing that the same piece of evidence can hold different values depending on the situation. It is about shining a light on the hidden assumptions that shape how we see the world.
Once the context is clear, the second activity, introspection, begins. This is the practice of turning inward to examine one's own thoughts and biases. The participants in the study described this as a process of "marinating" in an idea or "sifting through" options. They asked themselves questions like, "Am I biased here?" or "Is this too risky?" But introspection also involves looking outward to understand others. It is the act of trying to see the world through someone else's eyes, asking what would matter to a community leader versus a technical expert. By holding multiple perspectives at once, decision-makers can test their own judgments against the views of others, ensuring that their choices are not just personal preferences but reasoned evaluations.
The third activity is intermediation, which acts as a bridge between different groups of people. In complex situations, different stakeholders often speak different languages or prioritize different values. One person might focus on safety, while another focuses on speed. Intermediation is the practice of filtering information to make it relevant for a specific audience and brokering a conversation between conflicting viewpoints. It is the work of a translator who takes a complex technical report and explains why it matters to a community group, or who helps two opposing sides find a common ground. This process turns static data into dynamic information that can actually be used to make a decision.
Finally, there is interrogation. This is the practice of asking hard questions to unpack vague concepts. When someone says a project was "successful," an interrogative thinker does not just accept that label. They ask, "Successful for whom?" or "What does success actually look like in this case?" They dig into the definitions of words like "essential" or "safe" to reveal the criteria being used. This practice forces people to be specific about their values and the reasons behind their choices. It prevents decisions from being made on fuzzy ideas and ensures that the reasons for a judgment are clear and defensible.
The researchers suggest that these four practices—illumination, introspection, intermediation, and interrogation—are the invisible machinery that allows us to translate evidence into practice. They are not rare talents reserved for geniuses; rather, they are sophisticated skills that ordinary professionals use routinely, often without realizing they are doing it. The study indicates that when people engage in these practices, they are better able to form judgments that are wise and grounded in evidence. These practices help build a bridge between the cold facts of what is happening and the human choices of what ought to be done. In a world where information is abundant but agreement is scarce, understanding these mental habits offers a way to navigate the gap between knowing and doing, ensuring that our decisions are not just based on data, but on a clear understanding of what truly matters.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.