Pre-registered tests of solid-state-physics-inspired LLM compression: a cluster-level negative result at small-language-model scale
This pre-registered study employing autonomous research agents and a strict 3-sigma decision gate found that solid-state-physics-inspired compression mappings, including those based on Kohn-nearsightedness and tensor-train embeddings, failed to compress small-scale language models, instead revealing that their attention mechanisms exhibit critical or glassy behaviors rather than the predicted insulator-like properties.