Lightweight Semantic Embeddings Enable Redundancy-Sensitive Knowledge Graph Construction for LLM-Based Document Processing
This paper introduces AMODD, an ML-augmented pipeline that leverages lightweight semantic embeddings to deduplicate redundant document sections and cluster graph entities, significantly reducing LLM token consumption and latency for knowledge graph construction while maintaining high retrieval quality.