Sub-Billion, Super-Frontier: Small Language Models Rival Zero-Shot Frontier LLMs on General and Literary Relation Extraction
This paper demonstrates that compact, task-adapted small language models (under 3B parameters) can significantly outperform zero-shot frontier LLMs in both general and literary relation extraction when trained on specific domain data, offering a hardware-efficient and private alternative without requiring generative scaling.