← Latest papers
🤖 AI

Generative Ontology Induction: Domain-Agnostic Schema Discovery from Document Corpora Using Large Language Models

This paper introduces Generative Ontology Induction (GOI), a domain-agnostic framework that leverages Large Language Models to automatically induce structured, typed graph ontologies from document corpora, demonstrating superior structural coverage compared to generic templates across diverse and unfamiliar domains.

Original authors: Sergei Sergienko

Published 2026-07-21
📖 7 min read🧠 Deep dive

Original authors: Sergei Sergienko

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

Imagine you are trying to teach a super-smart robot how to write a story. You could just say, "Write a story," and it might give you something fun, but it could also forget the plot, mix up the characters, or invent a world that doesn't make sense. To get the robot to write a perfect story every time, you need to give it a blueprint. In the world of Artificial Intelligence, this blueprint is called an ontology. Think of an ontology as a master map or a Lego instruction manual for a specific type of document. It tells the AI exactly what pieces (like "characters," "settings," or "conflicts") must exist, how they connect, and what rules they must follow.

For a long time, making these blueprints has been a slow, boring, and expensive job. It usually requires a team of experts to sit down and manually design the rules for every new type of document, whether it's a medical report, a legal contract, or a job posting. If a company wants to switch from writing invoices to writing medical records, they have to hire experts to build a brand new map from scratch. This is a huge bottleneck because the AI is ready to go, but the map isn't finished yet.

This is where a new idea called Generative Ontology Induction (GOI) comes in. Instead of hiring a team of architects to draw the map, this paper suggests we can ask the AI to look at a pile of finished documents and figure out the map itself. It's like showing a robot a hundred different houses and asking it to reverse-engineer the architectural plans that made them all possible. The researchers wanted to see if an AI could look at a bunch of examples, learn the hidden structure, and then use that structure to build new, perfect documents on its own. They tested this on four very different types of documents to see if the AI could handle everything from simple bills to complex medical records.


The Paper's Big Idea: Teaching the AI to Draw Its Own Map

The paper introduces a framework called Generative Ontology Induction (GOI). The main goal is to stop humans from manually designing the "instruction manuals" (ontologies) for AI. Instead, GOI takes a collection of documents—like a folder full of job postings or a stack of medical visit records—and asks a Large Language Model (LLM) to study them. The AI's job isn't just to read them; it's to figure out the invisible skeleton that holds them together.

Think of it like this: If you show a child a hundred different pictures of dogs, they eventually learn what a "dog" looks like, even if they've never seen a specific breed before. GOI does the same thing but for documents. It looks at a pile of examples and asks, "What are the essential parts that must be here? What are the rules that connect them?"

The paper finds that the AI can successfully "reverse-engineer" these blueprints. It doesn't just list the words it sees; it builds a structured graph with six types of nodes (like "Class," "Property," and "Dimension") and seven types of connections. This graph acts as a strict set of rules. Once the AI has built this map, it can use it to generate brand new documents that follow the exact same structure, without needing a human to tell it what to do next.

The "Familiarity" Trap: Why Old Tricks Fail

One of the most interesting things the paper discovered is that AI is a bit of a "cheater" when it comes to things it knows well. The researchers tested their new GOI system against a very simple, generic method: just giving the AI a basic template with three fields (Title, Content, and Metadata).

When the document type was something the AI had seen a million times before—like a Software Services Invoice—the generic template worked surprisingly well. The AI knew enough from its training data to fill in the blanks, covering about 97.8% of the necessary structural parts. It was like asking a chef to make a burger when you only gave them a napkin; they knew exactly what a burger looked like, so they filled in the missing details from memory.

However, the moment the researchers switched to documents the AI didn't know as well, the generic template fell apart.

  • Job Descriptions: When the AI tried to use the generic template to create a custom job posting with specific, unusual sections (like "Employer Brand Voice" or "Career Trajectory"), it only covered 52.2% of the required parts. It missed the unique, custom sections entirely because it didn't have a "memory" of them.
  • Medical Records: For a specialized pain-management clinical record, the generic template only covered 62.2%. It missed the entire section on workers' compensation and specific physical exam modules, reverting to a generic "doctor's note" instead.
  • Legal Contracts: For a professional services contract, the generic template managed 78.3%, but it still missed critical, specific clauses like "Non-Solicitation" or "Weekly Hours Caps."

The paper shows that while the AI can guess the structure of familiar things, it fails completely when the document has a unique, custom structure. The generic template relies on the AI's "prior knowledge" (what it saw during training), and when that knowledge isn't there, the structure collapses.

The Solution: A "Structural Contract"

This is where GOI shines. In every single test case, when the AI was given the GOI-generated blueprint (the "structural contract"), it covered 95% to 100% of the required parts.

  • For the Job Description, it hit 100%.
  • For the Medical Record, it hit 95.6%.
  • For the Legal Contract, it hit 100%.

The paper argues that GOI provides a "structural guarantee." It doesn't matter if the AI has seen the document type before or not. If you give it the blueprint it built itself from the examples, it will follow the rules. It's like giving the chef a detailed recipe card instead of just a napkin. Even if the chef has never made that specific dish, the recipe ensures they don't forget the secret ingredients.

How They Measured Success: The "Node Coverage Score"

The researchers knew that just saying "it worked" wasn't enough. They needed a way to measure how well it worked. They invented a new metric called the Node Coverage Score.

Imagine the blueprint is a checklist of 45 items (like "Seller Name," "Total Cost," "Service Type"). The "Node Coverage Score" simply asks: "How many of these 45 items actually appeared in the final document?"

  • If the AI wrote a document that included 44 out of 45 items, the score is 97.8%.
  • If it missed the "Seller Name" and "Total Cost," the score drops.

This is different from older ways of measuring AI, which often just check if the words are spelled correctly. The Node Coverage Score checks if the structure is there. The paper shows that while generic prompts might get the words right, they often miss the structure entirely when the document is complex. GOI, however, consistently hits the high scores, proving it captures the "bones" of the document, not just the skin.

What This Means for the Future

The paper concludes that for industries that deal with complex, custom documents (like healthcare, law, or specialized engineering), relying on the AI's general memory is risky. The AI might fill in the gaps with the wrong information or miss critical sections.

GOI offers a way to fix this. By letting the AI study a set of examples and build its own strict blueprint, teams can ensure that every new document generated is structurally perfect. The paper suggests that this method works regardless of how familiar the document type is to the AI. It turns the AI from a "guessing machine" into a "rule-following architect."

The authors are careful to note that this isn't a magic wand that solves everything. The AI can still make mistakes, and the system needs to be checked by humans, especially for high-stakes documents. But the results show that when you give the AI a clear, self-discovered map, it can build complex structures with a reliability that generic prompts simply cannot match. It's a step toward making AI a true partner in building knowledge, rather than just a tool that guesses what you want.

Drowning in papers in your field?

Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.

Try Digest →