Bielik-Q2-Sharp: A Comparative Study of Extreme 2-bit Quantization Methods for a Polish 11B Language Model
This paper presents Bielik-Q2-Sharp, a systematic evaluation of six 2-bit quantization methods on a Polish 11B language model that identifies QuIP# as a high-performing variant comparable to the IQ2_XXS baseline while revealing a critical dissociation between log-likelihood preservation and autoregressive generation in rotation-based methods.