← Latest papers
💻 computer science

Workflow Cards: Structured Summaries of Workflow Executions Using Provenance Data

This paper introduces "Workflow Cards," a structured documentation format that condenses machine-readable provenance data into human- and LLM-readable summaries, effectively filling a gap in existing artifact documentation and significantly improving the quality of workflow execution analysis compared to traditional schema-based querying.

Original authors: Nicola Giuseppe Marchioro, Gabriele Padovani, Amal Gueroudji, Rafael Ferreira da Silva, Wesley Brewer, Valentine Anantharaj, Sandro Fiore, Renan Souza

Published 2026-08-12
📖 7 min read🧠 Deep dive

Original authors: Nicola Giuseppe Marchioro, Gabriele Padovani, Amal Gueroudji, Rafael Ferreira da Silva, Wesley Brewer, Valentine Anantharaj, Sandro Fiore, Renan Souza

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

Imagine you are watching a magician perform a trick. You see the final result: a rabbit appears from a hat. But if you only look at the rabbit (the "Model") or the hat (the "Data"), you miss the most important part: the secret hand movements, the specific timing, and the exact moment the rabbit was pulled out. In the world of computer science, specifically in how we build and run complex computer programs called "workflows," we have been great at documenting the ingredients and the final dish, but terrible at recording the actual cooking process. We have "Model Cards" (like a recipe card for the final dish) and "Data Cards" (like a label on the ingredients), but we lack a clear, easy-to-read summary of the execution—the step-by-step story of how the computer actually did the work. This matters because if we don't know exactly how a result was made, we can't trust it, we can't fix it if it's wrong, and we can't repeat it later.

This paper introduces a new tool called "Workflow Cards" to solve this missing link. Think of a Workflow Card as a "highlight reel" or a "digest" of a computer's entire cooking session. Instead of forcing a human or a smart computer program (called a Large Language Model, or LLM) to dig through thousands of messy, technical logs to find out what happened, the Workflow Card condenses all that data into a neat, readable story. The researchers tested this idea in two ways. First, they checked if these cards actually contain new information that the old "Model" and "Data" cards were missing. They found that yes, the Workflow Cards hold unique details about the execution process that the other cards simply don't have. Second, they tested how well a smart computer program could answer questions about the workflow using these cards versus trying to query a raw database. The results were clear: when the computer used the Workflow Card, it nearly doubled its ability to give correct answers compared to when it had to dig through the raw database structure. The paper suggests that by giving both humans and AI a clear, pre-summarized story of the work, we can make scientific computing much more transparent and easier to understand.

The Missing Chapter in the Story of Science

To understand why this paper is exciting, we first need to look at the "ingredients" and the "final dish" of modern computing. In the field of Artificial Intelligence and data science, researchers often create complex programs called workflows. These are like assembly lines where raw data goes in, gets processed through many steps, and comes out as a result, such as a trained AI model or a weather forecast.

For a long time, scientists have used Model Cards and Data Cards to document their work. Imagine a Data Card as a nutrition label on a bag of flour; it tells you where the flour came from, how it was grown, and what's in it. A Model Card is like the menu description of a cake; it tells you what the cake tastes like, who made it, and what it's best used for. These are great for static snapshots. However, they don't tell you how the baker actually mixed the batter, how long they baked it, or if the oven temperature fluctuated during the process.

This is where Provenance comes in. Provenance is the technical term for the "history of the object." It's the digital trail of every single step a computer took: which files it touched, how long it waited, what hardware it used, and what decisions it made. While computers are very good at recording this trail in massive, complex databases, it's often like trying to read a novel written in a secret code. To find a specific detail, you need to be a detective with a special map. This makes it hard for regular people (and even smart AI programs) to quickly understand what really happened.

The question this paper tackles is simple but crucial: Can we turn that messy, secret-code trail into a clear, readable story that helps us trust and understand our computer experiments?

The Solution: The "Highlight Reel" for Computers

The authors propose a new solution called Workflow Cards. If Model Cards are the menu and Data Cards are the ingredient labels, a Workflow Card is the behind-the-scenes documentary of the cooking show.

The researchers designed a specific template for these cards. Instead of dumping every single piece of data, the card organizes the information into a story that answers the questions humans and AI actually care about. It includes:

  • The Setup: What computer was used? What software was running?
  • The Timeline: When did it start? How long did it take?
  • The Action: What were the main steps? Did anything go wrong?
  • The Result: What was the final output?

The goal was to create a document that is small enough to read quickly but rich enough to answer complex questions without needing to dig through the raw database.

What They Found: The Magic of Summaries

The team put their new Workflow Cards to the test in two different scenarios to see if they actually worked.

Test 1: Do these cards tell us something new?
First, they compared the Workflow Cards against the existing Model and Data Cards. They asked a smart AI (an LLM) to answer questions about a computer workflow using only one type of card at a time.

  • When the AI only had the Model Card or the Data Card, it often missed the mark. It didn't know the details of the process.
  • However, when the AI had the Workflow Card, it performed just as well as if it had all the cards combined.
  • The most surprising finding came when they removed the Workflow Card from the mix. Without it, the AI's ability to answer questions dropped by more than half (a score of 0.611 dropped to 0.265). This proved that the Workflow Card contains unique, critical information that the other cards simply do not have. It's like trying to guess the plot of a movie by only looking at the poster and the cast list, but missing the actual scenes.

Test 2: Is it easier to read a story than to query a database?
Next, they tested how well an AI could answer questions when given two different types of information:

  1. Schema-based Querying: The AI was given the "map" of the database (the structure) and had to figure out how to ask the right questions to find the answers. This is like being given a library's catalog system and having to find the books yourself.
  2. Workflow Cards: The AI was given the pre-written summary card. This is like being handed a book report.

The results were dramatic. When the AI used the Workflow Card, its answer quality nearly doubled compared to when it had to query the database structure. The average score jumped from about 0.45 to 0.87. Even human experts agreed with this trend, confirming that the cards made the information much more accessible. The researchers noted that this improvement happened across different sizes of AI models, suggesting that the "summary" approach is a powerful tool for anyone trying to understand complex computer processes.

Why This Matters

The paper concludes that Workflow Cards are a vital missing piece in the puzzle of scientific transparency. They don't replace the detailed logs or the databases; instead, they sit on top of them, acting as a friendly interface. By turning complex, machine-readable data into a human-readable story, these cards help us:

  • Spot Bias: See if the process was fair.
  • Fix Errors: Understand exactly where things went wrong.
  • Repeat Success: Know exactly how to get the same result again.

The authors suggest that in the future, these cards could be generated automatically for any computer workflow, making the "behind-the-scenes" of science as easy to read as the final report. While the current tests focused on machine learning and climate forecasting, the idea is that this "highlight reel" approach could work for any complex scientific experiment, turning the mystery of the black box into a clear, open story.

Drowning in papers in your field?

Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.

Try Digest →